Think you need Hadoop? Think again

January 25, 2014 by
Filed under: Uncategorized 

Today’s post is written by Rick DelGado. His guest post is about the need of Hadoop. Thanks Rick for your input.

In the big data buzz, Hadoop has been the big data solution of choice leaving many feeling like Hadoop is their only option for harnessing big data. However, there are many other big data options out there that offer different features than Hadoop, and may actually fit your business needs better. Flash array storage, in particular, has made it easier to create fast, affordable storage options, so check out these other big data solutions before settling on Hadoop.

HPCC Systems

This system developed by LexisNexis is similar to Hadoop in that it is used to build clusters of servers for the purpose of analysing large data sets. HPCC uses Enterprise Control Language to make the process of writing parallel-processing workflows easier, and, also like Hadoop, has an ecosystem of tools built around it including the Roxy Rapid Data Delivery Cluster, a data warehouse similar to HBase, and the Thor Data Refinery Cluster, a data processor.

While still in its preliminary stages, HPCC’s similarities to Hadoop make it a running alternative as a big data solution.


Storm, first developed by Backtype before being purchased by Twitter, was dubbed the “Hadoop of real time processing” in a blog post by Nathan Marz. This distinction was made because Hadoop is a batch processor that works with fixed data. Storm, on the other hand, can process data as it streams. Of course, the real-time issue is being addressed in Hadoop providing some competition for Storm.

Disco Project

Developed by Nokia Research, Disco Project has been around for a while without a lot of attention. With Disco Project, data is distributed and replicated in a similar manner to Hadoop, and Disco has job scheduling features. However Disco Project doesn’t use its own file system. The advantage of Disco is that it’s backend is written in Erlang, a language with support for fault tolerance, distribution and concurrency.


Spark was specifically created by UC Berkeley to make it faster to write and run data analytics and is one of the newest options on the market. A key difference from other MapReduce systems is that Spark permits in-memory querying of data instead of disk I/O. Spark also performs better than Hadoop on several iterative algorithms and is written in Scala—an object-oriented language that permits users to make queries directly from the Scala interpreter.


GraphLab was created to make designing and implementing parallel machine learning algorithms easier. It varies from MapReduce in that it has an update phase that can read and modify data sets that overlap while MapReduce requires that all data sets be separated. GraphLab also offers its own version of the reduce stage called sync operation in which the output is global rather than local.

Microsoft Alternatives

Microsoft offers three Hadoop Alternatives.

Azure Table Storage is offered in Microsoft’s cloud and is meant to serve as an alternative data store to the one provided by Hadoop. It is not an analytics system.

LINQ to HPC allows you to build clusters of servers in Microsoft’s programming language and complete data analytics with unstructured data just like Hadoop does.

Azure Project Daytona is a research project that is based on MapReduce. It runs as a service that provides ready-to-use algorithms and can be delivered through Excel.

As you can see, there is actually plenty to choose from when looking for a big data solution, and an added benefit is that many of these tools can work together, including with Hadoop, to create a customized solution for your individual needs.

Short bio

I’ve been blessed to have a successful career and have recently taken a step back to pursue my passion of writing. I’ve started doing freelance writing and I love to write about new technologies and how it can help us and our planet.” – Rick DelGado



140 Comments on Think you need Hadoop? Think again

  1. Lucy on Tue, 25th Aug 2015 2:00 pm
  2. lucyhrivera on Mon, 31st Aug 2015 5:29 am
  3. looking for a big data solution and added benefit is that many of these tools can work together, including with Hadoop to create a customized solution for your carrer to visit our page to develop knowledge in hadoop
    learn hadoop in chennai

  4. lucyhrivera on Wed, 2nd Sep 2015 5:18 am
  5. Hadoop Training in Chennai with real-time corporate professionals. We are providing practical oriented best Hadoop training institute in Chennai

    learn more Hadoop

  6. Lucy on Mon, 7th Sep 2015 2:20 pm
  7. very nice !!! i have to learning a lot of information for this sites…Sharing for wonderful information.if you want get certification with job in Microsoft bi. please let us know by click the following link
    Linux Training in Chennai

  8. Ashik on Tue, 8th Sep 2015 11:14 am
  9. Thanks for sharing your useful article with us to gain our knowledge in a better way.

  10. Jones on Tue, 8th Sep 2015 12:36 pm
  11. I have read your blog and I got very useful and knowledgeable information from your blog. It’s really a very nice article. You have done a great job

  12. naveen on Wed, 9th Sep 2015 11:12 am
  13. Thanks good information.keep blogging.Hybris Training

  14. sumanth on Sun, 13th Sep 2015 11:26 am
  15. Thanks Its very useful for my site.For Linux Professionals Free DevOps Training

  16. akshit on Wed, 23rd Sep 2015 8:43 am
  17. Thanks The information which you provided is very much useful for Websphere Commerce Server Training vm

  18. pega training on Sat, 10th Oct 2015 10:23 am
  19. Thanks for your Blogging.your blog commenting is very useful to my website:Pega Training

  20. geometry dash on Fri, 13th Nov 2015 10:04 am
  21. Thanks for the best blog. it was very useful for me.keep sharing such ideas in the future as well. Thanks for giving me the useful information. I think I need it!

  22. hulk on Fri, 13th Nov 2015 10:04 am
  23. In your blog I was happy to see your article, better than last time, and have made great progress, I am very pleased. I am looking forward to your article will become better and better.

  24. agario on Fri, 13th Nov 2015 10:05 am
  25. Really impressive post. I read it whole and going to share it with my social circules. I enjoyed your article and planning to rewrite it on my own blog.

  26. mahjong on Fri, 13th Nov 2015 10:06 am
  27. This was among the best posts and episode from your team it let me learn many new things.

  28. sniper games on Fri, 13th Nov 2015 10:06 am
  29. Wonderful blog! This is very informative site. I am totally pleased by your excellent work. Many thanks for sharing.

    This is really informative post. very unique and informative thanks for update……………….

  30. UP Urdu Teacher Recruitment 2016 on Mon, 21st Dec 2015 5:59 am
  31. Thanks for the information. By visiting to your website it helps me a lot………

  32. agario on Sat, 2nd Jan 2016 5:12 pm
  33. I think it will look a lot more nice. I think school will have all most everything in it use technology. I think that schools will look a lot different.

  34. Nithiyaravi on Mon, 8th Feb 2016 7:46 am
  35. “We … are very happy with your editing. Your rewriting reduced the length and
    also improved clarity of the sentences. Most importantly, you kept the major…

  36. Ravi on Mon, 8th Feb 2016 8:01 am
  37. Dear Rick DelGado, Thank you for having taken your time to provide us with your valuable information relating to your stay with us.we are sincerely concerned.., Most importantly, you Keepit the major

  38. merlinmaarit on Thu, 11th Feb 2016 1:49 pm
  39. The hadoop was very useful for me best training in the hadoop sides,so i read your all article was excellent points included in this sites and then the more information to available in this page.

    android training in chennai


  40. rennijen on Mon, 15th Feb 2016 6:51 am
  41. Thank you for the informative articles on Hadoop. And please keep posting like this article.
    java training in chennai

  42. nithiya on Mon, 15th Feb 2016 10:04 am
  43. This is one of the best blog that i have comes across till now. hadoop is considered as the best technology that is emerging nowadays and the prerequisite for learning hadoop is java. As a fresher level candidates you should have a through knowledge with JAVA. So join our best Java Training in Chennai to get more technical knowledge

  44. maheswariswa on Thu, 18th Feb 2016 11:46 am
  45. Great blog was very useful to me. keep updating.we provides sap training for students.if you want to join here visit this site.

  46. maheshwarithangaraj on Thu, 18th Feb 2016 11:49 am
  47. Great blog was very useful to me. keep updating.we provides sap training for students.if you want to join here visit this site.

  48. maheshwarithangaraj on Thu, 18th Feb 2016 11:53 am
  49. Thank you for your posting.

  50. aanadhi123 on Mon, 22nd Feb 2016 6:25 am
  51. I read your articles very excellent and the i agree our all points because all is very good information provided this through in the post.
    It is very helpful for me.

  52. aanadhi123 on Mon, 22nd Feb 2016 6:55 am
  53. In the site was very excellent,i think this is very best one compare others and then the more information to get after read this post.

  54. aanadhi123 on Mon, 22nd Feb 2016 7:07 am
  55. That the information was very helpful in my carrier because of all articles very good,thanks for sharing in this post.

  56. Buzz Applications on Mon, 22nd Feb 2016 12:18 pm
  57. Great blog… Your article is Awesome…..

  58. keerthi on Wed, 4th May 2016 6:38 am
  59. Great explanation to given on this post and i read our full content was really amazing, then the more important in my part of life.

  60. keerthi on Wed, 4th May 2016 6:38 am
  61. Great tips, and awesome way to get exert tips from everyone – you are the master of content.Keep update more information..

  62. Nidhi on Thu, 5th May 2016 4:03 pm
  63. Awesome.Yes hadoop isrequired ..Keep updating such info

  64. Malli on Thu, 5th May 2016 4:07 pm
  65. Good Info

  66. Best SEO training in hyderabad on Thu, 19th May 2016 1:49 pm
  67. Best SEO training in hyderabad all modules are clearly solved and practice with guide.seo training in hyderabadAnd clearly getting knowledge of seo.

  68. Cisco Training in Chennai on Fri, 17th Jun 2016 9:31 am
  69. Nice and Excellent Info

  70. Yashikar on Mon, 27th Jun 2016 9:52 am
  71. Pretty article! I found some useful information in your blog, it was awesome to read, thanks for sharing this great content to my vision, keep sharing.

  72. Preethi on Sat, 20th Aug 2016 10:42 am
  73. he Executive Committee votes to approve all proposed changes to a specification to be carried out immediately or reject the changes and thus either require the Maintenance Lead to submit a revised list of changes, or defer the changes until the specification can be revised by an expert group in a new JSR. Challenges to one or more tests in a specification’s Technology Compatibility Kit are ultimately decided by the Executive Committee if they cannot be otherwise resolved.

    Java Training Institutes

  74. Nura on Wed, 7th Sep 2016 11:10 am
  75. Thanks for sharing this valuable content digital marketing course in chennai

  76. akshay kumar on Thu, 24th Nov 2016 11:28 am
  77. Nice article
    Thanks for sharing the informative blog.

Tell me what you're thinking...

  • Swiss Association for Analytics

  • Most Popular Posts

  • T-shirts, Mugs & Mousepads

    All benefits given to a charity association
  • Archives

  • Visitors