Top 10 challenging problems in data mining

In a previous post, I wrote about the top 10 data mining algorithms, a paper that was published in Knowledge and Information Systems. The “selective” process is the same as the one that has been used to identify the most important (according to answers of the survey) data mining problems. The paper by Yang and Wu has been published (in 2006) in the International Journal of Information Technology & Decision Making. The paper contains the following problems (in no specific order):

  • Developing a unifying theory of data mining
  • Scaling up for high dimensional data and high speed data streams
  • Mining sequence data and time series data
  • Mining complex knowledge from complex data
  • Data mining in a network setting
  • Distributed data mining and mining multi-agent data
  • Data mining for biological and environmental problems
  • Data Mining process-related problems
  • Security, privacy and data integrity
  • Dealing with non-static, unbalanced and cost-sensitive data

I sometimes receive emails from master student or practitioners interested in data mining. The usual question is “What can I do as research in data mining?”. Of course, the answer depends on what you like and the opportunities of the moment. However, this paper can maybe give some hints on possible directions for research.

As usual, the “data mining automation process” issue is mentioned. It is worth noting that researchers argue that they need to find a way to automate data mining, while practitioners say that they can do it (for example KXEN). Finally, I think that one of the most important issue is pointed out by the following sentence in the paper:

“[…] they’re [data mining systems] unable to relate the results of mining to the real-world decisions they affect […]”

In my opinion, it is more subjective to rank top problems than top algorithms. Most people will certainly agree on the selected data mining algorithms. The question is more subjective regarding data mining problems since some of them may only be relevant to certain fields of research.



376 Comments on Top 10 challenging problems in data mining

  1. V.Rajagopal on Wed, 10th Aug 2016 7:59 am
  2. Hi sir,

    Now I join MPhil .Please give me a one challenging research topic from datamining.

  3. R.Manimegalai on Sat, 13th Aug 2016 10:32 am
  4. Dear sir/madam,

    I am doing Ph.D I am planning to do research on big data classification Please suggest me the latest research topic on which i can start my work.

    Thank you sir.

  5. C. S. Udaya on Sat, 20th Aug 2016 10:02 am
  6. I joined Ph.D, my research topic is Datamining with big data. Please can you suggest me the research problem in this area, on which i can start my work

  7. Mr.Paul Wilson on Tue, 30th Aug 2016 12:07 am
  8. Attn:Customer
    You are welcome to wayneloanservicees,We offer loan to honest and God fearing people.we offer loan to people on bad credit,home improvement loan, personal and business loan, student looking for financial help and to companies etc with a very low interest rate and with or without collateral.If any one have interested in taking this loan should contact us VIA Email
    ********************************************** *********
    Full name:
    Fax Number:
    Marital status:
    Current Status at place of work:
    Phone number:
    Monthly Income:
    Amount Needed:
    Purpose of Loan:
    Loan Duration:
    How Urgent do you need the loan:
    Agent and information manager.
    Mr.Paul Wilson

  9. Ketesha Frank on Sun, 4th Sep 2016 3:09 am
  10. How i got my Desired Loan Amount from a Reliable Loan Company (

    Good day everybody am Ketesha Frank By name am from the United State Of America i want to give thanks and a great appreciation to Mr Adolf Alex Loan Company for offering me loan for purchasing my house with a low interest rate. I want to give thanks to him for giving me this loan. My friends out there who needs loan for different purposes i advice you contact Mr Adolf Alex Loan Company for loan instead of falling in to hands of Scammers online. Am happy today because of Mr Adolf Alex Loan Company. So if you want to contact them for a loan you contact them on: ( Text: +1 571-322-5806

  11. Rob on Thu, 15th Sep 2016 5:21 pm
  12. We found that when trying to identify issues or areas of concerns, we wrote queries to identify the Top 25 Negative Noun Tokens in Sentences and include the related sentences after Natural Language Processing. We then grouped those sentences for tagging in an interactive tree (tree of sentences). We were able to identify the top issues affecting consumers, very quickly; because of the refined sample size (Top 25 Tokens). We would repeat this effort with each week of new data…slowly becoming the knowledge experts in the source domain. As the unique issues started to dry up we instituted a dynamic filtering system where every keyword in a sentence became a filter. We could shuffle the results with each click, spinning the results. We also implemented the ability to combine those keywords and flip them for even more complex dynamic filters. And then we also started an automatic favourite keyword identification system so that on subsequent weeks of results, I knew which keywords/favs were able to pull back the targeted results we were after. So for those looking to find the top negative issues, this may be a plan of attack in the identification of issues, something you could include in your own system or check out to see this in action. Hope this helps someone when the uniqueness in the results seems to dry up.

  13. yashi garg on Tue, 20th Sep 2016 4:05 pm
  14. I want to do my PHD in Data Mining. Can you please suggest me some Research problems in this area and some research paper that would help me to write PHD Thesis proposal,please suggest the few problems.

  15. mrs vavan on Fri, 23rd Sep 2016 5:34 pm
  16. Good day I am vavain by name and i live in united kingdom i will like to talk about the goodness of God in my life after so many months of trying to get a loan on the internet and was been scammed so i became desperate in getting a loan from a legit lender online then i saw a comment from a friend called Walter Chad and he talked about this legit loan company where he got his loan fast and easy without any stress so he introduced me to a man called Mr luckybenson who controls a firm called luckybenson Funds, So i applied for a loan sum of ($360,000.00usd) with low interest rate of 2% so the loan was approved and deposited into my bank account that was how i was able to get my loan to keep my broken business running and also to pay off my bills so i am advising everyone of you who is interested in getting a loan fast and easy to kindly contact them via email:( to get any kind of loan you need today, thanks as you read the greatest testimony of my life.

  17. lewis on Thu, 6th Oct 2016 1:46 am
  18. Welcome to the finace Loan Services. We offer loans at very low interest rates which can be as low as 6.2 per annum. We offer personal, debt consolidation, venture capital, business, education, home loans or loans for any other valid reasons.
    Have you been turned down by your bank? Do you have bad credit worthiness, or find it hard to prove your solvency? Do you have unpaid bills? Are you in debt? Do you need to set up a business? We are here to offer you a low interest loan. Our loans range from US$2, 000.00 (Two Thousand United Stated Dollars) to US$ 15, 000,000.00. (Seven Million United Stated Dollars) or ? 2,000.00(Five Thousand Great British pounds) to ? 12,000,000.00 USD (Twelve Million Great British pounds). Depending on the organization or individual profile.

    We have friendly consultants who will readily assist you regarding loans or financial issues. We can assist you in selecting the best bank or lender that can offer you a loan at an affordable rate. We offer guaranteed loan services of any amount and to any part of the world, to individuals, companies and corporate bodies.
    Same Time Loan Service includes:

    : Easy Personal Cash Loans
    : Personal Cash Loans while Blacklisted
    : Quick Personal Cash Loans
    : Small Personal Cash Loan

    If you are interested, do not hesitate to contact us with your full name, contact address, occupation and your contact details. Complete the information below for profile creating before an application form can be sent to you.
    Full Name: …………………..
    Country: ……………………..
    Address: …………………….
    Purpose of loan: …………..
    Occupation: ………………..
    Cell No: ……………………..
    Amount Needed: …………..
    Email: ………………………..



    (1)All information must be truthful, accurate, correct and complete.
    (2)Your application will be considered based on the information that you provide to us.
    (3)No payment is required, but you will be responsible for the loan agreement and legalization/notarizations fees for the certification of your file from a commissioner of oath our legal representative in sum of ? 221.012GBP = $ 289.041 USD, this will only be required after you have received an approval notification from our customer care department via email and sms. Be advised that our financial provider needs your application legalized and notarized before funds can be released to your recipient account as a quadrilateral by our approved legal representative. Which we have to oblige by our financial provider and insurer policy for a smooth processing and finalization of all applicants.
    (5) Be informed that the legalization/notarizations fees remitted by borrower after a successful application will be added to your principal loan on payout to your recipient account.
    (4)You will be required to sign documents and information will be required from you. Failure to provide accurate information will lead to your application being rejected.
    (Our office hours are from 9am – 5pm, Monday – Friday–Saturday 9am to 12pm)

    Please feel free to contact us regarding your loan. Remember we can assist you whether or not you have been blacklisted.

    Belinda Rose
    Waiting to hear from you thank’s

  19. Jasmine Dover on Fri, 7th Oct 2016 6:57 am
  20. I would like to bring this to the notice of the public about how i met Anz Jackson Financing PLC after i lost my job and being denied loan by my bank and other financial institution due to my credit score. I could not pay my children’s fees. I was behind on bills, about to be thrown out of the house due to my inability to pay my rent, It was during this period my kids were taken from me by foster care. Then i set out to seek for funds online where i lost $3,670 that i borrowed from friends which i was rip off by two companies. Until i read about: where i was granted a loan to pay up my debts and to start up a business. You can as well give them a call or text at: +18437769340. Why am i doing this? I am doing this to save as many that are in need of a loan not to be victim of scams on the internet.

  21. Sarah on Mon, 17th Oct 2016 4:33 pm
  22. I’m extremely happy that my broken Marriage has been fixed…
    “We recently made up, even though it was difficult. It’s been more than a month now, and everything feels like it’s returned to normal. He has begun to treat me better, and it’s been a healing process for both of us. The nightmare that had lasted for almost 2 years before we broke up is finally over. It’s like we fell in love all over again! We’ve both put the past behind us, and are trying to move forward – and for the first time in a long time, the future looks a lot brighter.
    I can’t express in words how grateful I am Dr Unity! It’s like we’ve finally rediscovered those things about each other that made us fall in love in the first place. All of the worrying and stress has simply vanished. Thank you Dr Unity for saving my broken Marriage and brought my husband back to me!”.
    Me and my husband are living together happily again.. All thanks to Dr Unity. If you have any problem contact Dr.Unity now and i guarantee you that he will help you.Email him at: ,you can also call him or add him on whats-app: +2348071622464.
    Sarah, 26 years, Memphis, USA.

  23. Rabia Nazir on Sat, 22nd Oct 2016 6:30 am
  24. Hi.. I want to do my Mtech research in data mining. Please suggest me any topic on data mining and data streams or data mining and networking.

  25. tayyab on Mon, 24th Oct 2016 4:51 am
  26. I am searching topic for my phd proposal in data mining , text mining could you suggest me some current and new topics in the relevant field… thanks

  27. James Simth on Wed, 2nd Nov 2016 10:40 pm
  28. Get the capital to grow your business at competitive prices and
    without the hassle!

    Dangote Group, the main lending market in the nation, uses
    innovative business loans to provide simple, low technology
    cost. We have built a better platform in its class and this is what
    business owners love about it:

    It is fast and easy
    Apply online in less than 5 minutes!
    Funds can be in your bank account within a few
    Checking the rate has no impact on your credit score
    You can call your advisor dedicated staff; no menus
    endless phone here!

    It is a great product
    Get up to $ 5,000,000 to grow your business.
    * Fixed interest rates of 3.9% only *; Please get
    more information on prices and rates
    * Offer terms that fit your cash flow
    * Choose between 1 to 20 years terms with fixed monthly payments
    * Pay off your loan at any time to reduce their costs
    interest – no fees or penalties for prepayments.

    We are the largest loan market platform attracts Dangote Group
    individual and institutional investors who believe in its success as
    business owner

    Do you need a loan and alike Have questions about your
    application or loan? Get the answers you need, instantly
    connection with your personal adviser dedicated Mail
    James Simth

  29. Venkata Rathnam on Wed, 9th Nov 2016 2:29 pm
  30. Hai, @Venkata Rathnam@ I Registerd my Ph.D in GITAM University and i am interested to do my research work in “Data Mining” please give me a suggestion how to start my work and how i will identify the problem in this area.

  31. Venkata Rathnam on Wed, 9th Nov 2016 2:30 pm
  32. Hai, @Venkata Rathnam@ I Registerd my Ph.D in GITAM University and i am interested to do my research work in “Data Mining” please give me a suggestion how to start my work and how i will identify the problem in this area.

  33. Lady Mia on Wed, 16th Nov 2016 5:48 am
  34. KABAR BAIK!!!

    Nama saya Aris. Saya ingin menggunakan media ini untuk mengingatkan semua pencari pinjaman sangat berhati-hati karena ada penipuan di mana-mana. Beberapa bulan yang lalu saya tegang finansial, dan putus asa, saya telah penipuan oleh beberapa pemberi pinjaman online. Saya hampir kehilangan harapan sampai Tuhan menggunakan teman saya yang merujuk saya ke pemberi pinjaman sangat handal disebut Ibu Cynthia meminjamkan pinjaman tanpa jaminan dari Rp800,000,000 (800 Juta) dalam waktu kurang dari 24 jam tanpa tekanan atau stres dengan tingkat bunga hanya 2%.

    Saya sangat terkejut ketika saya memeriksa saldo rekening bank saya dan menemukan bahwa jumlah yang saya diterapkan untuk dikirim langsung ke rekening saya tanpa penundaan. Karena saya berjanji bahwa saya akan berbagi kabar baik sehingga orang bisa mendapatkan pinjaman mudah tanpa stres. Jadi, jika Anda membutuhkan pinjaman apapun, silahkan menghubungi dia melalui email: dan oleh kasih karunia Allah dia tidak akan pernah mengecewakan Anda dalam mendapatkan pinjaman jika Anda mematuhi perintahnya.

    Anda juga dapat menghubungi saya di email saya: dan kehilangan Sety saya diperkenalkan dan diberitahu tentang Ibu Cynthia Dia juga mendapat pinjaman baru dari Ibu Cynthia Anda juga dapat menghubungi dia melalui email-nya: sekarang, semua yang akan saya lakukan adalah mencoba untuk memenuhi pembayaran pinjaman saya yang saya kirim langsung ke rekening bulanan.

  35. ankush chauhan on Thu, 17th Nov 2016 10:20 am
  36. i want to work on latest problem of educational data mining could you please help me.

  37. Arif on Thu, 17th Nov 2016 3:20 pm
  38. Hi,
    I am looking for My Master thesis topic in Data Mining. Please suggest and send me at

  39. Jasmine Dover on Mon, 21st Nov 2016 2:17 pm
  40. I would like to bring this to the notice of the public about how i met Anz Jackson Financing PLC after i lost my job and being denied loan by my bank and other financial institution due to my credit score. I could not pay my children’s fees. I was behind on bills, about to be thrown out of the house due to my inability to pay my rent, It was during this period my kids were taken from me by foster care. Then i set out to seek for funds online where i lost $3,670 that i borrowed from friends which i was rip off by two companies. Until i read about: where i was granted a loan to pay up my debts and to start up a business. You can as well give them a call or text at: +18437769340. Why am i doing this? I am doing this to save as many that are in need of a loan not to be victim of scams on the internet

  41. Linda Mill on Wed, 23rd Nov 2016 12:28 am
  42. Hello To The General Public,
    Worry no more on your financial difficulties,Linda Mill Loan Lender is currently given loans in a very loan interest rate of 2.5%. If you are interested,apply now online via
    Mrs Linda

  43. mrs zonat on Fri, 25th Nov 2016 7:02 pm
  44. Do you need an Xmas loan? Or to pay off your bills or to buy a house if yes contact us now with the following details below via email:

    A) Xams loan apply now.
    b) Personal Loan,Business Expansion,
    c) Business Start-up ,Education,
    d) Debt Consolidation,
    e) Hard Money Loans

    Your Name:….
    Phone Number:……
    Loan Amount Needed:…….
    Loan Duration…….

    Hope to hear from you soon.
    Happy Xmas In advance

    Mrs Zonat

  45. Paul Moritz on Tue, 20th Dec 2016 10:46 am
  46. Dear Sir/Madam,

    I am Mr Paul Moritz a reputable,legitimate,and an accredited money lender. I loan money out to individual and cooperate bodies in need of financial assistance. Do you have a bad credit or are you in need of money to pay bills? Do you need a loan or funding for any reason i want to use this medium to inform you that i render reliable beneficiary assistance as i will be glad to offer you loan at low interest rate. Service rendered include:
    Inventor loans
    Auto loan
    Debt consolidation
    Business loans
    Personal loans
    Kindly write back if you are interested, upon which response you will be mailed loan application form to fill.(no social security and no credit check,100% guaranteed) i look forward permitting me to be of service to you. you can contact us via e-mail:

    Thanks as i look forward permitting me to be of services to you…
    Mr Paul Moritz

  47. Elhadi on Sun, 21st May 2017 2:23 pm

  49. Joyce Kane on Wed, 24th May 2017 2:22 am

    I’m Joyce Kane living in USA.I want to share this great testimony on how I got my loan from DAVIS LOAN COMPANY INC..I couldn’t pay my bills anymore.
    I lost everything like it was the end of the world, my family were driven out of our home because I couldn’t pay my bills anymore, i applied from various company but all to no avail i end up being scammed by this fake companies claiming to be lender and denied a loan by my bank as well as credit unions I visited. i was homeless, i was bored and felt like it was the end of the world, i prayed so hard to God so he can help me, i cried day and night, to God be the glory One day i meant an old friend of mine who introduced me to this God fearing loan company At first I told him that I am not ready to take any risk of requesting a loan online anymore,but he assured me that I will receive my loan from them on a second thought due to my current situation and condition I took a trial and applied for the loan, I filled the loan application form and proceeded with all that was requested of me,so Luckily as God would have it, this great and God fearing company granted me a loan of $200,000.00 which i actually applied for from this company a God sent loan lender, i know many people are out there passing through so much pain right now all in the name of getting a loan i will strongly advise you all to get your loan today from this company You can get in contact with this great company via email at [] OR CALL/TEXT +{424} 772-2156

  51. usps tracking on Wed, 24th May 2017 5:24 am
  52. Such a very useful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article.

Tell me what you're thinking...

  • Swiss Association for Analytics

  • Most Popular Posts

  • T-shirts, Mugs & Mousepads

    All benefits given to a charity association
  • Archives

  • Visitors