Category Archives: Big Data

Data Science – Who could become a Data Scientist?

This article represents information related different classes of IT & Non-IT professionals who could take on different data science free courses (as mentioned) and get on to the path of becoming a data scientist. Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos. Following are the different classifications of IT/Non-IT professional which has been addressed later in this article: Software Development Stakeholders working on Non-analytics projects Datawarehouse/BI Developers Big Data Developers Statisticians Senior Management Executive Non-Software Professionals Could I become a Data Scientist? Anyone matching following criteria could become a data scientist. One is decent with Mathematics & Statistics …

Continue reading

Posted in Big Data. Tagged with , .

Top 10 Solution Approaches for Supervised Learning Problems

This article represents top 10 solutions approaches that could be used to solve supervised learning problems. For those unaware of what is supervised learning problem, here is the supervised learning definition from Wikipedia: Supervised learning is the machine learning task of inferring a function from labeled training data.[1] The training data consist of a set of training examples. In supervised learning, each example is a pair consisting of an input object (typically a vector) and a desired output value (also called the supervisory signal). A supervised learning algorithm analyzes the training data and produces an inferred function, which can be used for mapping new examples. Following are two different kind of supervised …

Continue reading

Posted in Big Data. Tagged with , .

Document Search Architecture to Search Millions of Documents

This article represents different document search architectural models using which one could create a search architecture that could search through 100s of millions of documents in faster time (milliseconds) with most up-to-date and fresh results. If you are planning to create a document search infrastructure which could search millions of documents, and shows up results in less than a second time, go ahead and explore different models and adopt the one that suits your needs at this stage. Note that the models given below could scale to multiple data centers. In this blog, we shall try and examine different architecture models that could achieve the search timing of less than a …

Continue reading

Posted in Big Data. Tagged with , .

Learn R or Python for Becoming Data Scientist?

This article presents analysis on whether one should go for learning R or Python programming language to create one or more predictive models using different machine learning algorithms. It could be noted that both languages, R and Python, is equally doing good and sought after by developers and the companies hiring such developers. So, you could choose either one of these languages. However, majority has been found to be voted in favour of Python for ease of learning and greater community support.   Data Scientist with expertise in R Following indeed.com plot represents the job trends for the search term, “Data Scientist R”. It clearly indicates the trend such as …

Continue reading

Posted in Big Data. Tagged with , .

Machine Learning – Top 16 Learning Resources on Statistics

This article represents some of the top learning resources (webpages, videos etc) on my frequent visit list. Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos. Following are the key categories of webpages/videos that are expanded later in this article: Websites Quora Youtube Videos Coursera courses Khan Academy Top 16 Learning Resources on Statistics Folllowing is the list of URLs for these learning resources: Websites on Statistics Stattrek.com Elementary Statistics with R StatsDirect.com Usable Stats Quora.com Statistics Channel Probability & Statistics Statistics (Acacedmic Discipline) Bayesian Inference Youtube Videos Playlists on Statistics Brandon Foltz StatisticsFun JBStatistics Quantitative Specialists Coursera Courses …

Continue reading

Posted in Big Data. Tagged with , .

Machine Learning Research in Top 10 US Universities

This article represents information related with machine learning departments & related research projects in top 10 US universities (as per USNews Ranking). I have put it together for my quick reference and thought to share with you for the same purpose. Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos. Following are top 10 universities covered later in this article: Princeton University Harvard University Yale University Columbia University Stanford University University of Chicago MIT Duke University University of Pennsylvania California Institue of Technology   Machine Learning @ Top 10 US Universities Princeton University: Machine Learning Department at Princeton University …

Continue reading

Posted in Big Data. Tagged with .

List of 35 Free Online Books on Machine Learning

Machine Learning Books

This article represents a comprehensive list of 35 free books on machine learning (& related fields) which are freely available online (in pdf format) for self-paced learning. Please feel free to comment/suggest if I missed to mention one or more important books that you like and would like to share. Also, sorry for the typos. Following are the key areas under which books are categorized: Pattern Recognition & Machine Learning Probability & Statistics Neural Networks & Deep Learning List of 35 Free eBooks on Machine Learning & Related Fields Following is a list of 35 FREE online ebooks (pdf format) which could be used for learning ML at your own …

Continue reading

Posted in Big Data. Tagged with , , .

Data Science – 175 Probability & Statistics Interview Questions

data science interviews

This article presents URL and short description of around 175 probability & statistics objective questions which could prove very useful and helpful for those who are planning to attend one or more data scientist interviews in time to come. These tests/quizzes were created when I was learning probability and statistics some time back and, found various concepts interesting enough to be converted into quizzes for my future references. As probability & statistics form key to data science, it may be worth spending some time on these tests and check your understanding. You may also use this for your future reference. These questions could also be used for checking your concepts …

Continue reading

Posted in Big Data, Career Planning, Interview questions. Tagged with , , , .

Quick Cheat Sheet for Big Data Technologies

This article represents quick details on some of the key open-source technologies (tools & frameworks) associated with Big Data. The objective of this article is to present quick details on open-source tools & frameworks in a well-categorized manner using top-down approach where data engineering and data science aspects of Big Data is associated with relevant tools & framework. Most of these tools and frameworks could be found with commercial Hadoop distributions such as Cloudera, Hortonworks, MapR etc. Please feel free to comment/suggest if I missed to mention one or more important frameworks. Also, sorry for the typos. Following is the key classication of tools/frameworks that have been briefed later in …

Continue reading

Posted in Big Data. Tagged with .

Machine Learning – Top 5 Video Channels for Regression Models

This article represents top 5 video channels that one could use to learn and become expert at regression models.  I make visits to watch these videos, once in a while, to clarify my doubts in relation with regression models. As I find these pages very useful, I thought it to share with you all. These are some real good videos from learning perspective that could help you get started with regression models and get a good hang of it within no time. Please feel free to share it with your community. Please feel free to comment/suggest if I missed to mention any other great video channels. Also, sorry for the …

Continue reading

Posted in Big Data. Tagged with , , .

Data Science – Top 10 Websites to Bookmark for Daily News

top 10 data science websites

This article represents links and information in relation with top 10 websites that publishes data science related news and article on daily/regular basis. These links are my favorites and help me remain up-to-date with latest and greatest happening in the field of data science. Please feel free to comment/suggest if I missed to mention/include one or more important and interesting websites in the list given below. Also, sorry for the typos. Following are the key points described later in this article: Top 5 Data Science News Websites – Recommended Daily Visit Top 5 Data Science News Websites – Recommended Regular Visit   Top 5 Data Science News Websites – Recommended …

Continue reading

Posted in Big Data. Tagged with , , .

Data Science – Hypothesis Testing & Type I and Type II Errors

This article describes Type I and Type II errors made during hypothesis testing, based on a couple of examples such as House on Fire, Swine Flu. You may want to note that it is key to understand type I and type II errors as these concepts will show up when we are evaluating a hypothesis function such as that related with machine learning algorithms such as linear regression, logistic regression etc. For example, in case of linear regression models, the significance value (often set as 0.05 and represent probability of making Type I error) is compared with p-value and, the null hypothesis that the parameter/coefficient is equal to zero is …

Continue reading

Posted in Big Data. Tagged with , .

Machine Learning – Mathematical Concepts for Linear Regression Models

linear regression model

This article represents some of the key mathematics & statistics concepts that one may need to learn in order to work with linear regression models. Understanding following concepts would help in some of the following manners in relation with evaluating linear regression models: Interpreting coefficients Evaluating the regression model Comparing multiple regression models and choosing the best out of them Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos. Following are the key mathematical concepts/topics described later in this article: Statistical hypothesis testing Probability distributions Quantitative data analysis Plots   Key Mathematics & Statistics Topics for Linear Regression Models …

Continue reading

Posted in Big Data. Tagged with , , .

Data Science – Descriptive Vs Predictive Vs Prescriptive Analytics

Descriptive vs Predictive vs Prescriptive

This article represents key classification or types of analytics that business stakeholders, in this Big Data age, would want to adopt in order to take the most informed and smarter decisions for better business outcomes. Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos. Following are the key categories of analytics which are described later in this article: Descriptive Analytics Predictive Analytics Prescriptive Analytics What is Descriptive Analytics? Descriptive analytics answers the question or gains insights into or summarize, “What has happened?”. This could be seen as first stage of business analytics and still accounts for the majority of …

Continue reading

Posted in Big Data. Tagged with , , .

Data Science – Key Algebra Topics to Master

algebra topics for data science

This article represents some of the key topics in Algebra that one may need to brush up or master in order to get good at understanding different aspects of machine learning algorithms. If you are gearing up to become the data scientist, the topics below may be worth your attention as I had to brush them up eventually when I was learning different machine learning algorithms. The concepts listed below, especially related with linear algebra, touches almost all machine learning algorithms. Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos. Following are the key high level topics which are …

Continue reading

Posted in Big Data. Tagged with , .

Data Science – Key Probability & Statistics Topics to Master

Table of content for probability & statistics

This article represents a list of key probability & statistics topics that one may need to master if he is aiming to become a data scientist. This article lists topics that has worked for me so far in relation with working on a data science problem. One could also see the below list as table of content for key probability and statistics topics for data science. However, I do believe that there are some topics that I might not have mentioned. Please feel free to comment/suggest if I missed to mention one or more important points. Also, sorry for the typos. Probability & Statistics Topics Following are some of the …

Continue reading

Posted in Big Data. Tagged with , .