Data Science Book Review: The Master Algorithm

February 6, 2016 by
Filed under: Uncategorized 

MasterAlgoI recently received a copy of The Master Algorithm, written by Pedro Domingos, to review. While I was reading the back cover, my first impression was skepticism. Indeed, Domingos main idea in this book, is the (future) existence of a so called “Master Algorithm” which will outperform any other algorithms for any kind of tasks.

I can see you smiling and so did I when I started reading the book. Reaching the end, I have a different, let’s say more enlightened, view of the concept of Master Algorithm. Although Domingos has several arguments on why such an algorithm should exist, I’m still not convinced, and I will tell you why at the end of this post.

Nevertheless, The Master Algorithm is a must read for several reasons. First, the book is a journey in the field of data science algorithms, grouping data scientists into “tribes”:

  • Symbolists (e.g. decision tree)
  • Connectionists (e.g. neural networks)
  • Evolutionaries (e.g. genetic algorithm)
  • Bayesians (e.g. naive Bayes)
  • Analogizers (e.g. SVM)

Each chapter describes the principles and history behind these tribes. This gives the reader a broad and comprehensive view of data mining approaches and differences between them. The chapter about combining all methods is full of metaphors and very well written. A vision of the future is provided in the last chapter.

Second reason why Domingos book is a must read: its idea of a unique algorithm to tune (beating all others) is interesting and well described. For Domingos, we will need to combine different learning paradigms to reach the Master Algorithm. According to Domingos, it is the role of the reader to discover it, the book being only a starting point. This is a very nice way of motivating non-experts to read the book. Finally, the book is provocative (at least if you don’t believe in a unique algorithm to solve all problems).

Let me now explain why I don’t believe that a Master Algorithm will soon replace the variety of existing ones. First, the very existence of a variety of algorithms is due to the various ways we can solve a given problem. As long as there is more than one person using Predictive Analytics, there will be more than one algorithm used. People use different algorithms because they think differently and are better at solving a problem with a specific algorithm they know better.

Second, the many different applications of Predictive Analytics are way too heterogeneous to be solved by a unique algorithm. Want to understand your model? Use linear regression. Need stability? Just try SVM. Limited by an low memory device implementation? Rules obtained using decision trees may do the trick. In conclusion, the variety of algorithms used are needed due to the different skills of people using them, the various applications to solve as well as deployment particularities, for example.

Whether you agree with Domingos or not, this book is a must have to learn machine learning without equation. It will help you get the big picture of the several learning paradigms. Finally, the provocative idea is not only intriguing, but also very well argued.



6 Comments on Data Science Book Review: The Master Algorithm

  1. Victoria Lawson on Thu, 17th Mar 2016 3:01 pm

    Do you need a loan? if yes,
    are Granting you personal loan, Business loan, mortgage loan, Construction loan, Debt loan, Student loan, Auto loan, e.t.c. loan at any currency are range
    from $10,000 ”min” to $100,000.000 ”max” @ 2% interest rate.
    If you are interested kindly send
    response to: { }

    *Full Name/Company Name:_________



    *loan amount:_________

    *Loan duration:_________


    *Purpose of loan:_________

    *Monthly Income:__________


    *Next of kin:_________

    *Email :_________

    *Awaiting your Response:—-
    Best Regard

  3. cheat coc gems on Wed, 6th Apr 2016 1:02 am
  4. Great article. I’m going through many of these issues as well..

  5. keerthi on Wed, 4th May 2016 6:57 am
  6. We should implement that in practically then only we can understand that exact thing clearly, but it’s no need to do it, because you have explained the concepts very well.

  7. on Tue, 4th Oct 2016 9:45 am
  8. happy

  9. roblox on Mon, 31st Oct 2016 9:59 am
  10. I really like the dear information you offer in your articles. I’m able to bookmark your site and show the kids check out up here generally. Im fairly positive theyre likely to be informed a great deal of new stuff here than anyone

  11. FreeInstaFollowers on Tue, 24th Jan 2017 9:42 pm
  12. What do you use to blog your site? I love the layout!

Tell me what you're thinking...

  • Swiss Association for Analytics

  • Most Popular Posts

  • T-shirts, Mugs & Mousepads

    All benefits given to a charity association
  • Data Mining Search Engine

    Supported by AnalyticBridge

  • Archives

  • Reading Recommandations