- 2066 Bhadra · 4+2 marks
"Do as your Neighbor Do" principle
Short answer
"Do as your neighbour does" means nearest-neighbor classification: assign class by majority of closest objects, using distance to measure similarity and likelihood to choose class. Hierarchical clustering creates a tree of nested clusters without presetting k, O(n²); partitioning (k-means) splits into k groups iteratively, faster but requires spherical clusters.
"Do as your Neighbor Do". Explain this concept on behalf of Likelihood and Distance principle. Differentiate between hierarchical clustering and partitioning clustering technique.
"Do as your neighbour does" and the likelihood-and-distance principle
This phrase means that an object behaves like the objects nearest to it. Under the distance principle, objects close to each other in attribute space are similar and likely to share the same class or cluster; under the likelihood principle, the class most probable among its neighbours is assigned to the object.
This is the idea of K-nearest neighbour (KNN):
- Compute the distance (e.g. Euclidean) from the new object to every stored object.
- Choose the K nearest ones (its "neighbours").
- Assign the majority class of these neighbours (or their average, for prediction).
Example: a customer whose 3 nearest customers (by age and income) all bought a laptop is predicted to buy a laptop too. The same idea clusters data: an object joins the cluster of the centre it is nearest to.
Hierarchical vs partitioning clustering
| Basis | Hierarchical | Partitioning |
|---|---|---|
| Result | Nested clusters shown as a tree (dendrogram) | One flat set of k non-overlapping clusters |
| Number of clusters k | Not needed in advance; choose by cutting the dendrogram | Must be given in advance |
| Method | Agglomerative (bottom-up) or divisive (top-down) | Iterative relocation (k-means, k-medoids) |
| Merge/split | Once done, cannot be undone | Objects can move between clusters in later iterations |
| Complexity | At least O(n²), poor for big data | About O(nkt), good for big data |
| Cluster shape | Can find arbitrary shapes (with single link) | Tends to find spherical clusters |
| Examples | AGNES, DIANA, BIRCH | k-means, k-medoids (PAM) |
✓ Answer checked by Claude Opus 5.5 (high effort)
Related questions
- Need of clustering; hierarchical vs partitioning; K-means · Data Mining, chapter 5
- Short note: Partitioning and hierarchical clustering · Data Mining, chapter 5
- DM techniques; likelihood and distance principle · Data Mining, chapter 3
- Short note: Likelihood and distance · Data Mining, chapter 3
- Hierarchical clustering: AGNES and DIANA · Data Mining, chapter 5
- Short note: Hierarchical clustering · Data Mining, chapter 5