---
title: "Calibration and validation of models"
subject: "Simulation and Modeling"
chapter: 7
key: "semester_8/simulation_and_modeling:calibration-validation-models"
source: https://www.bctengineer.com/q/semester_8/simulation_and_modeling/calibration-validation-models
site: BCT Engineering
---

# Calibration and validation of models

Simulation and Modeling · Chapter 7: Verification and validation of simulation models

- Asked in: 2074 Bhadra, 5 marks; 2072 Ashwin, 5 marks (asked 2 times)
- Video: [Model Calibration and Model Validation  - What's the Difference?](https://www.youtube.com/watch?v=eg5xOer9Hu0) — NAFEMS
- Answer checked by Claude Opus 5.5 (high effort) on 2026-10-14
- Page: https://www.bctengineer.com/q/semester_8/simulation_and_modeling/calibration-validation-models
- Whole chapter: https://www.bctengineer.com/md/semester_8/simulation_and_modeling/chapter-7

## Question

What is calibration and validation of models? Explain with practical example.

## Short answer

Calibration tunes a model by comparing output with reality and adjusting until it matches. Validation ensures the model accurately represents the real system. For a petrol station, calibration changed service time to normal and adjusted arrival rate until average wait matched observed 4.6 min; validation on separate data confirmed accuracy.

## Answer

#### Calibration
Calibration is the iterative process of comparing the simulation model with the real system and adjusting the model (parameters, distributions, logic) until the differences are acceptably small. Each cycle is: compare, find the discrepancy, revise, compare again.

#### Validation
Validation is the process of determining whether the model is an accurate representation of the real system for the intended purpose. Its question is "Are we building the right model?" (verification, in contrast, asks "Are we building the model right?", i.e. is the program free of coding errors). Validation is done by:
1. Face validity: experts in the system review the model and its output for reasonableness.
2. Validating model assumptions: structural assumptions (how the system works) and data assumptions (input distributions are fitted and tested, e.g. by the chi-square or K-S test).
3. Validating input-output transformations: the model output is compared statistically with the real output under the same input conditions (e.g. a t-test on the mean, or confidence intervals).

#### Practical example: single-pump petrol station
A model is built with Poisson arrivals (mean 10 vehicles per hour) and exponential service time (mean 4 min). The data collected from the real station show an average waiting time of 4.6 minutes.

- **Calibration:** the model gives about 8 minutes (as M/M/1 theory also predicts for ρ = 10 × 4/60 = 0.67). Checking the data shows that service time is not exponential; it is better fitted by a normal distribution with mean 4 min and standard deviation 1 min. Less variable service shortens the queue, and after the change the model gives about 4.3 minutes. Adjusting the arrival rate for peak hours brings it to 4.5 minutes.
- **Validation:** the calibrated model is run with a new set of observations (another week's data) that was not used for calibration. The simulated mean waiting time of 4.5 min, with a 95% confidence interval of 4.0–5.0 min, contains the real value of 4.6 minutes. The two agree statistically, and the managers confirm that the queue lengths look realistic (face validity). So the model is considered valid for studying whether a second pump is needed.

Both steps together increase the credibility of the model, so that decision makers will use its results.

## Check yourself

The answer's key points as multiple-choice questions, with the correct option and why.

1. Which question does validation answer?
   A. Is the program free of coding errors?
   B. Are we building the model right?
   C. Are we building the right model?
   D. Is the run long enough?
   Answer: C. Validation asks whether the model accurately represents the real system; verification asks whether it is built right. (Key point: Validation vs verification)

2. Which list gives the validation approaches in the answer?
   A. Tracing, debugging, walk-throughs
   B. Face validity, validating assumptions, validating input-output transformations
   C. Warm-up deletion, batch means, replications
   D. Seizing, releasing, terminating
   Answer: B. Validation uses face validity, assumption checks (structural and data) and input-output comparison. (Key point: Validation techniques)

3. In the petrol station example, what calibration changes brought the model from 12 min toward the real 8.5 min?
   A. Changing service time to normal(4,1) and adjusting arrival rate for peak hours
   B. Adding a second pump
   C. Reducing the confidence level
   D. Running the model for a shorter time
   Answer: A. The service-time distribution was refitted and the arrival rate adjusted, giving 9 then 8.7 min. (Key point: Calibration in example)

4. Why was the calibrated model validated with another week's data?
   A. To increase the number of pumps
   B. Validation needs data not used in calibration, so agreement is not just tuned fit
   C. Because the first week's data was lost
   D. To avoid using confidence intervals
   Answer: B. Testing on separate data checks that the model truly represents the system, not just the calibration data. (Key point: Validation data)

## Related in Simulation and Modeling

- [Compare verification, validation, calibration](https://www.bctengineer.com/question.md?key=semester_8%2Fsimulation_and_modeling%3Averification-validation-calibration-compare) — Simulation and Modeling, chapter 7