---
title: "Web mining structure and challenges"
subject: "Data Mining"
chapter: 7
key: "semester_7/data_mining:web-mining-structure-challenges"
source: https://www.bctengineer.com/q/semester_7/data_mining/web-mining-structure-challenges
site: BCT Engineering
---

# Web mining structure and challenges

Data Mining · Chapter 7: Advanced Applications

- Asked in: year not given
- Video: [web mining](https://www.youtube.com/watch?v=sLyHs-Hf00o) — Reva Bankar
- Answer checked by Claude Opus 5.5 (high effort) on 2026-10-14
- Page: https://www.bctengineer.com/q/semester_7/data_mining/web-mining-structure-challenges
- Whole chapter: https://www.bctengineer.com/md/semester_7/data_mining/chapter-7

## Question

Describe web mining along with its structure. What are the challenges in web mining?

## Short answer

Web mining applies data mining to discover patterns from web content, structure, and usage. Content mining extracts knowledge from page text and media, structure mining analyzes hyperlinks, and usage mining analyzes logs and clickstreams. Challenges include scale, dynamism, heterogeneity, noise, link farms, user identification, privacy, multilingual data, and evaluation.

## Answer

**Web mining** is the use of data mining techniques to automatically discover and extract useful information and patterns from web documents, hyperlinks and usage data of the World Wide Web.

#### Structure (taxonomy) of web mining
```text
               Web mining
     ____________|______________
    |            |              |
 Content      Structure       Usage
 mining        mining         mining
 (page text,  (hyperlink     (server logs,
 images,       graph:         clickstream,
 video)        PageRank,      sessions)
               HITS)
```
- **Content mining**: knowledge from the content of pages (classification, clustering, extraction, summarisation).
- **Structure mining**: analysis of the link graph to rank pages and find communities.
- **Usage mining**: discovery of user navigation patterns (association rules, sequence patterns, clustering).

#### Challenges in web mining
1. **Huge size and rapid growth** of the web: scalability of algorithms.
2. **Dynamic nature**: pages change constantly or disappear; new pages appear.
3. **Heterogeneous and unstructured data**: HTML, text, images, video; no uniform schema.
4. **Noise and poor quality**: spam, duplicate, advertising and misleading pages; irrelevant data.
5. **Link and anchor-text issues**: spam links, link farms.
6. **Usage data issues**: identification of users and sessions (proxies, caches, dynamic IPs), incomplete logs.
7. **Privacy and security** concerns of tracking users.
8. **Multilingual** content and semantic understanding.
9. **Evaluation difficulties**: lack of ground truth.

## Check yourself

The answer's key points as multiple-choice questions, with the correct option and why.

1. Structure mining in the web mining taxonomy analyses what?
   A. Page text
   B. Server logs
   C. The link graph
   D. Image colours
   Answer: C. Structure mining uses the hyperlink graph (PageRank, HITS). (Key point: Structure)

2. Why is the dynamic nature of the web a challenge?
   A. Pages change constantly or disappear, and new ones appear
   B. Pages never change
   C. All pages have the same schema
   D. Links are always valid
   Answer: A. Constant change makes mined results outdated. (Key point: Dynamic)

3. Why is user identification hard in usage mining?
   A. Proxies, caches and dynamic IPs hide real users
   B. Logs record everything perfectly
   C. Users never revisit
   D. Logs contain no IPs
   Answer: A. Proxies, caches and dynamic IPs make users and sessions hard to identify. (Key point: Usage data issues)

4. What are link farms an example of?
   A. Link and anchor-text spam issues
   B. Multilingual issues
   C. Scalability
   D. Evaluation methods
   Answer: A. Link farms are spam links that distort link analysis. (Key point: Link issues)

## Related in Data Mining

- [Web structure/content/usage mining; privacy](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Aweb-structure-content-usage-privacy) — Data Mining, chapter 7
- [Web mining, importance and techniques](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Aweb-mining-importance-techniques) — Data Mining, chapter 7
- [Web log mining and WWW mining architecture](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Aweb-log-mining-architecture) — Data Mining, chapter 7
- [Data integration and its challenges](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Adata-integration) — Data Mining, chapter 2
- [Anomaly detection challenges and schemes](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Aanomaly-challenges-schemes) — Data Mining, chapter 6
- [KDD applied to WWW mining](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Akdd-in-www-mining) — Data Mining, chapter 7

## Related in other subjects

- [Web mining with structure mining](https://www.bctengineer.com/question.md?key=semester_8%2Finformation_system%3Aweb-mining-structure-mining) — Information System, chapter 7
- [Web mining importance and types](https://www.bctengineer.com/question.md?key=semester_8%2Finformation_system%3Aweb-mining-importance-types) — Information System, chapter 7, asked 3×
- [Text mining vs web usage mining](https://www.bctengineer.com/question.md?key=semester_8%2Finformation_system%3Atext-mining-vs-web-usage-mining) — Information System, chapter 7
- [Web structure and search engine](https://www.bctengineer.com/question.md?key=semester_8%2Finformation_system%3Aweb-organization-search-engine-working) — Information System, chapter 7