Skip to main content

Short note: Partitioning and hierarchical clustering

Short answer

Partitioning methods like k-means divide data into k clusters via iterative relocation; hierarchical builds a dendrogram by agglomeration or division. Partitioning needs k, is faster but may be a local optimum; hierarchical requires no k, O(n²), merges irreversible.

Write a short note on Partitioning and Hierarchical Clustering.

Partitioning clustering

It divides n objects into k non-overlapping groups (k ≤ n), each with at least one object. An initial partition is created, then objects are moved between clusters again and again (iterative relocation) to improve an objective, such as minimum sum of squared distances to the cluster centres.

  • k-means: the cluster centre is the mean.
  • k-medoids (PAM): the centre is an actual object (medoid), more robust to outliers.
  • Needs k in advance; suits spherical clusters; efficient for large data (O(nkt)); may reach a local optimum.

Hierarchical clustering

It builds a hierarchy of clusters, drawn as a dendrogram, with no need to give k in advance (cut the dendrogram at the desired level).

  • Agglomerative (AGNES): bottom-up; start with each object as a cluster and repeatedly merge the two closest clusters.
  • Divisive (DIANA): top-down; start with one cluster and repeatedly split.
  • Cluster distance: single link (minimum), complete link (maximum), average link, centroid.
  • A merge or split cannot be undone; cost at least O(n²).
 a b c d e          Agglomerative ->
 (a)(b)(c)(d)(e)  -> (ab)(c)(de) -> (abc)(de) -> (abcde)
                          <- Divisive
BasisPartitioningHierarchical
ResultFlat k clustersTree of clusters
kNeededNot needed
SpeedFasterSlower
UndoPossibleNot possible

✓ Answer checked by Claude Opus 5.5 (high effort)

All Data Mining chapter 5 questions →