Skip to main content

Major clustering approaches

Short answer

Major approaches: partitioning (e.g., k-means), hierarchical (aglomerative/divisive), density-based (DBSCAN), grid-based (STING), model-based (EM). Hierarchical builds a dendrogram without prespecifying k; partitioning divides data into k clusters iteratively, requires k, is faster, and typically finds spherical clusters.

Describe major clustering approaches. Differentiate between hierarchical and partitioning clustering technique.

Major clustering approaches are:

  1. Partitioning methods: divide n objects into k clusters, then improve the partition by moving objects between clusters. Distance-based, find spherical clusters, need k. Examples: k-means, k-medoids (PAM), CLARA.
  2. Hierarchical methods: create a tree (dendrogram) of clusters.
    • Agglomerative (bottom-up, AGNES) merges the closest clusters.
    • Divisive (top-down, DIANA) splits clusters.
    • Examples: BIRCH, CURE, Chameleon.
  3. Density-based methods: a cluster is a dense region of objects separated by sparse regions; can find arbitrary shapes and handle noise. Examples: DBSCAN, OPTICS, DENCLUE.
  4. Grid-based methods: quantise the space into a finite grid of cells and cluster the cells; speed independent of the number of objects. Examples: STING, CLIQUE.
  5. Model-based methods: assume a model (e.g. Gaussian mixture) for each cluster and fit the data to it. Examples: EM, COBWEB, SOM.

Hierarchical vs partitioning

BasisHierarchicalPartitioning
OutputNested clusters, dendrogramSingle flat partition
Number of clustersNot required in advancek must be given
MethodMerge (agglomerative) or split (divisive)Iterative relocation
ReversibilityA merge/split cannot be undoneObjects can change clusters
Complexity≥ O(n²), slowO(nkt), faster
Cluster shapeCan be arbitrary (single link)Mostly spherical
ExamplesAGNES, DIANA, BIRCHk-means, PAM

✓ Answer checked by Claude Opus 5.5 (high effort)

All Data Mining chapter 5 questions →