- 2065 Baisakh
Short note: Partitioning and hierarchical clustering
Short answer
Partitioning methods like k-means divide data into k clusters via iterative relocation; hierarchical builds a dendrogram by agglomeration or division. Partitioning needs k, is faster but may be a local optimum; hierarchical requires no k, O(n²), merges irreversible.
Write a short note on Partitioning and Hierarchical Clustering.
Partitioning clustering
It divides n objects into k non-overlapping groups (k ≤ n), each with at least one object. An initial partition is created, then objects are moved between clusters again and again (iterative relocation) to improve an objective, such as minimum sum of squared distances to the cluster centres.
- k-means: the cluster centre is the mean.
- k-medoids (PAM): the centre is an actual object (medoid), more robust to outliers.
- Needs k in advance; suits spherical clusters; efficient for large data (O(nkt)); may reach a local optimum.
Hierarchical clustering
It builds a hierarchy of clusters, drawn as a dendrogram, with no need to give k in advance (cut the dendrogram at the desired level).
- Agglomerative (AGNES): bottom-up; start with each object as a cluster and repeatedly merge the two closest clusters.
- Divisive (DIANA): top-down; start with one cluster and repeatedly split.
- Cluster distance: single link (minimum), complete link (maximum), average link, centroid.
- A merge or split cannot be undone; cost at least O(n²).
a b c d e Agglomerative ->
(a)(b)(c)(d)(e) -> (ab)(c)(de) -> (abc)(de) -> (abcde)
<- Divisive
| Basis | Partitioning | Hierarchical |
|---|---|---|
| Result | Flat k clusters | Tree of clusters |
| k | Needed | Not needed |
| Speed | Faster | Slower |
| Undo | Possible | Not possible |
✓ Answer checked by Claude Opus 5.5 (high effort)
Related questions
- Need of clustering; hierarchical vs partitioning; K-means · Data Mining, chapter 5
- Hierarchical clustering: AGNES and DIANA · Data Mining, chapter 5
- Short note: Hierarchical clustering · Data Mining, chapter 5
- Short note: Partitioning clustering · Data Mining, chapter 5
- Major clustering approaches · Data Mining, chapter 5