---
title: "Hybrid data in big data warehouse"
subject: "Big Data Technologies"
chapter: 1
key: "semester_8/big_data_technologies:hybrid-data-warehouse"
source: https://www.bctengineer.com/q/semester_8/big_data_technologies/hybrid-data-warehouse
site: BCT Engineering
---

# Hybrid data in big data warehouse

Big Data Technologies · Chapter 1: Introduction to Big Data

- Asked in: 2075 Bhadra, 10 marks
- Answer checked by Claude Opus 5.5 (high effort) on 2026-10-14
- Page: https://www.bctengineer.com/q/semester_8/big_data_technologies/hybrid-data-warehouse
- Whole chapter: https://www.bctengineer.com/md/semester_8/big_data_technologies/chapter-1

## Question

The data in big data warehouse is called hybrid data. Explain with suitable examples.

## Short answer

Hybrid data mixes structured, semi-structured and unstructured data (e.g., sales tables, JSON logs, images) stored and analysed together. For instance, a retailer combines transaction tables (structured) with click logs (semi-structured) and customer photos (unstructured) to gain insights.

## Answer

**Hybrid data** is the mixture of structured, semi-structured and unstructured data (from internal and external, batch and streaming sources) that is stored and analysed together in a big data warehouse. A traditional data warehouse holds only structured, cleaned, schema-defined data. A big data warehouse also keeps data in its raw or varied form, so its data is hybrid.

#### Types of data found in a big data warehouse
| Type | Description | Examples |
|---|---|---|
| Structured | Fixed schema, rows and columns | Sales tables, customer records, bank transactions |
| Semi-structured | Tags/keys, flexible schema | JSON, XML, CSV, web logs, e-mail headers |
| Unstructured | No predefined model | Text, images, audio, video, social media posts, documents |

Hybrid also refers to mixed origin and mode: data from enterprise systems (ERP, CRM), external sources (social media, sensors, web) and both historical (batch) and real-time (stream) data.

#### Why it is called hybrid
- The warehouse combines relational tables with files in HDFS/NoSQL stores.
- It uses both schema-on-write (cleaned structured data) and schema-on-read (raw data interpreted when queried).
- It integrates batch (Hadoop) with real-time (Storm/Spark Streaming) processing.

```text
 ERP/CRM (structured) --\
 Logs, JSON (semi) -------> Big data warehouse --> Reports,
 Tweets, images (unstr.) -/  (HDFS + NoSQL + DW)    analytics
```

#### Examples
1. **Retail company:** sales transactions (structured) joined with website click logs (semi-structured) and customer reviews and photos (unstructured) to understand buying behaviour.
2. **Telecom:** call detail records (structured), network logs (semi-structured) and customer-care call recordings (unstructured) for churn analysis.
3. **Hospital:** patient records (structured), doctor notes and X-ray images (unstructured), and sensor readings (semi-structured) for diagnosis support.
4. **Bank:** transactions (structured), e-mail and chat transcripts (unstructured) for fraud detection.

#### Benefits
A complete 360-degree view of the customer, richer analytics than structured data alone, and flexibility in adding new data types.

#### Challenges
Integration of formats, data quality, metadata management and security.

#### Traditional versus big data (hybrid) warehouse
| Point | Traditional data warehouse | Big data (hybrid) warehouse |
|---|---|---|
| Data types | Structured only | Structured, semi-structured, unstructured |
| Schema | Schema-on-write (ETL first) | Schema-on-read as well as on-write |
| Storage | Relational DBMS on costly servers | HDFS/NoSQL on commodity clusters plus RDBMS |
| Size | GB to TB | TB to PB |
| Processing | Batch SQL | Batch (MapReduce), interactive (Hive), real-time (Spark, Storm) |

#### How hybrid data is handled
1. **Ingestion:** Sqoop moves relational data into HDFS, Flume or Kafka collect logs and streams.
2. **Storage:** raw files stay in HDFS (data lake), refined structured data goes to Hive tables or the existing DW.
3. **Processing:** MapReduce or Spark transform and join the different forms; unstructured text is parsed into features.
4. **Access:** analysts query through Hive or SQL-on-Hadoop and visual tools, so that structured and unstructured results are viewed together.
5. **Governance:** metadata catalogue, data lineage and access control span all data types.

## Check yourself

The answer's key points as multiple-choice questions, with the correct option and why.

1. What is hybrid data in a big data warehouse?
   A. Only structured data from one source
   B. Only encrypted data
   C. A mixture of structured, semi-structured and unstructured data stored and analysed together
   D. Data stored only in the cloud
   Answer: C. Hybrid data combines structured, semi-structured and unstructured data from varied sources and modes. (Key point: Meaning of hybrid data)

2. Which is the correct classification?
   A. JSON/XML is unstructured; images are structured
   B. Sales tables are semi-structured
   C. Web logs are unstructured; video is structured
   D. Sales tables are structured; JSON/XML and web logs are semi-structured; images and video are unstructured
   Answer: D. Fixed-schema tables are structured, tagged flexible formats such as JSON/XML/logs are semi-structured, and images/audio/video are unstructured. (Key point: Classifying data types)

3. How does a big data (hybrid) warehouse differ from a traditional warehouse in schema handling?
   A. It uses schema-on-read as well as schema-on-write
   B. It uses no schema ever
   C. It uses only schema-on-write with ETL first
   D. It cannot store raw data
   Answer: A. Traditional warehouses are schema-on-write only; hybrid ones also keep raw data and interpret it when queried (schema-on-read). (Key point: Schema-on-write vs schema-on-read)

4. In the retail example, which combination gives a view of buying behaviour?
   A. Only sales transactions
   B. Sales transactions, website click logs, and customer reviews/photos together
   C. Only customer photos
   D. Only click logs
   Answer: B. Structured sales, semi-structured click logs and unstructured reviews/photos are joined for richer analysis. (Key point: Hybrid data example)

## Related in Big Data Technologies

- [Role of data scientist in big data](https://www.bctengineer.com/question.md?key=semester_8%2Fbig_data_technologies%3Arole-of-data-scientist) — Big Data Technologies, chapter 1, asked 2×
- [Why distributed computing for big data](https://www.bctengineer.com/question.md?key=semester_8%2Fbig_data_technologies%3Adistributed-computing-necessary) — Big Data Technologies, chapter 1
- [Distributed system in big data example](https://www.bctengineer.com/question.md?key=semester_8%2Fbig_data_technologies%3Adistributed-system-example) — Big Data Technologies, chapter 1
- [Big data trends, challenges, characteristics](https://www.bctengineer.com/question.md?key=semester_8%2Fbig_data_technologies%3Abig-data-trends-challenges) — Big Data Technologies, chapter 1
- [Attributes of Big Data](https://www.bctengineer.com/question.md?key=semester_8%2Fbig_data_technologies%3Abig-data-attributes) — Big Data Technologies, chapter 1
- [Data analytics process and distributed computing](https://www.bctengineer.com/question.md?key=semester_8%2Fbig_data_technologies%3Adata-analytics-distributed-role) — Big Data Technologies, chapter 1

## Related in other subjects

- [Data warehouse and data mining](https://www.bctengineer.com/question.md?key=semester_8%2Finformation_system%3Adata-warehouse-data-mining) — Information System, chapter 4, asked 2×
- [Data warehouse, data mart and need](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Awarehouse-datamart-need) — Data Mining, chapter 1
- [Data warehouse architecture and components](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Adw-architecture-components) — Data Mining, chapter 1
- [Data warehouse schemas](https://www.bctengineer.com/question.md?key=semester_7%2Fdata_mining%3Adw-schema-types) — Data Mining, chapter 1