Skip to main content

DM vs RDBMS SQL; project failure

Short answer

RDBMS SQL is verification-driven, retrieving known facts; data mining is discovery-driven, finding hidden patterns. Project failures stem from unclear goals, poor data quality, underestimating ETL, lack of support, unrealistic expectations, wrong tools, and not acting on results.

Compare Data Mining with RDBMS SQL in Knowledge Extraction. Explain the cause of DM & DW Project Failure.

Data mining vs RDBMS SQL in knowledge extraction

PointRDBMS / SQLData mining
ApproachVerification-driven: user states exactly what to retrieveDiscovery-driven: finds unknown patterns
Question type"What was the total sales of Pokhara in 2025?""Which customers are likely to churn?"
ResultStored facts (data)Patterns, rules, models (knowledge)
TechniquesSelection, join, aggregationClassification, clustering, association, prediction
DataCurrent, operationalLarge historical, preprocessed
PredictionNot possiblePossible
User neededMust know the data and the queryNeeds less prior hypothesis

Causes of data mining and data warehouse project failure

  1. Unclear goals: no business objective or poor requirement analysis.
  2. Poor data quality: dirty, incomplete or inconsistent source data.
  3. Underestimating ETL effort (it takes most of the time and cost).
  4. Lack of management support or user involvement; users resist change.
  5. Unrealistic expectations: expecting instant magic results; over-ambitious scope (big-bang approach).
  6. Wrong tools or architecture; poor performance and scalability.
  7. Lack of skilled staff and domain experts; poor project management and budget overrun.
  8. Ignoring metadata, security and privacy.
  9. Not acting on results or poor interpretation and presentation.

✓ Answer checked by Claude Opus 5.5 (high effort)

All Data Mining chapter 1 questions →