Worst Practices in Data Mining

July 27, 2010 by Sandro Saitta
Filed under: Uncategorized 

If you're new here, you may want to subscribe to my RSS feed. Thanks for visiting!

dangerI recently read the article Worst practices in business forecasting written by Michael Gilliland and Udo Sglavo. It is published in the July/August issue of AnalyticsMagazine, which is by the way an excellent journal about analytics. In their article, the authors are looking for the reasons why forecasts are sometimes completely wrong. According to them, there are four main reasons:

  • Unsound software
  • Untrained, unskilled, inexperienced or unmotivated forecasters
  • Political contamination
  • Unforecastable behavior

I particularly like a few sentences from the article, which really point out important issues in data mining:

No software, no matter how powerful, and no analyst, no matter how talented, can guarantee perfect (or even highly accurate) forecasts.

Forecast accuracy is ultimately limited by the nature of the behavior being forecast.

Another interesting point is the inappropriate performance objectives mentioned by the authors. It is inappropriate to set an overall objective (in classification accuracy), that would fit any data mining problem. This is strongly related to the post What is a good classification accuracy in data mining?, published a few weeks ago on Data Mining Research.

To read the full article: Worst practices in business forecasting (it may take some time to load the page, be patient)

No TweetBacks yet. (Be the first to Tweet this post)
  • Share/Bookmark

Comments

One Comment on Worst Practices in Data Mining

  1. Data Extraction on Mon, 9th Aug 2010 11:22 am
  2. I am doing this for quiet sometime now and i am searching for this kind of article to improve my data mining performances. Thanks for your posts.

Tell me what you're thinking...





  • Swiss Association for Analytics

  • T-shirts, Mugs & Mousepads


    All benefits given to a charity association
  • Data Mining Search Engine

    Supported by AnalyticBridge

  • Archives

  • Reading Recommandations