--- title: "Compare verification, validation, calibration" subject: "Simulation and Modeling" chapter: 7 key: "semester_8/simulation_and_modeling:verification-validation-calibration-compare" source: https://www.bctengineer.com/q/semester_8/simulation_and_modeling/verification-validation-calibration-compare site: BCT Engineering --- # Compare verification, validation, calibration Simulation and Modeling · Chapter 7: Verification and validation of simulation models - Asked in: 2074 Magh, 5 marks - Video: [Model Calibration and Model Validation - What's the Difference?](https://www.youtube.com/watch?v=eg5xOer9Hu0) — NAFEMS - Answer checked by Claude Opus 5.5 (high effort) on 2026-10-14 - Page: https://www.bctengineer.com/q/semester_8/simulation_and_modeling/verification-validation-calibration-compare - Whole chapter: https://www.bctengineer.com/md/semester_8/simulation_and_modeling/chapter-7 ## Question Comparisons between verification, validation and calibration of a model using example. ## Short answer Verification ensures the program matches the conceptual model (e.g., checking shortest-queue logic). Validation confirms the model accurately represents reality (e.g., statistically comparing simulated and real waiting times). Calibration iteratively adjusts parameters until output matches observed data (e.g., changing service time from 2 to 2.8 min). ## Answer **Verification** checks that the model is built correctly (the computer program matches the conceptual model). **Validation** checks that the right model has been built (it is an accurate representation of the real system). **Calibration** is the iterative process of comparing the model with the real system and adjusting the model until agreement is acceptable. #### Comparison | Point | Verification | Validation | Calibration | |---|---|---|---| | Question asked | Is the model built right? | Is it the right model? | How can the model be adjusted to match? | | Compares | Conceptual model vs program | Model vs real system | Model output vs real data | | Concerned with | Programming, logic, debugging | Accuracy, assumptions, credibility | Parameter and structure tuning | | Methods | Walk-throughs, trace, debugger, simple test cases | Face validity, assumption tests, input-output comparison | Repeated comparison and modification | | Result | Error-free implementation | Confidence that model is usable | Better agreement with reality | | When done | During and after coding | After a working model exists | In loop with validation | #### Relationship ```text Real system -> Conceptual model -> Operational model validation <----------------------> verification (conceptual to program) Compare model with system -> adjust -> compare ... (calibration) ``` Calibration and validation go together: compare, find a difference, modify the model, and compare again until the model is accurate enough for its purpose. #### Example: bank with three tellers - **Verification**: the conceptual model says a customer joins the shortest queue. The programmer prints a trace of 20 arrivals and checks that each customer really joined the shortest queue, that clock times increase, and that the number of departures never exceeds arrivals. A bug such as the clock not advancing is found and fixed. - **Validation**: the model is run with the same arrival pattern recorded on Monday. The model gives average waiting time 3.8 min; the observed value is 4.0 min. A statistical test shows no significant difference, so the model is accepted as valid for this purpose. - **Calibration**: suppose the model gave 2.5 min against 4.0 min observed. The analyst finds that service time was assumed 2 min but includes no time for paperwork. Service time is changed to 2.8 min, and the model is rerun until the waiting time matches the real value within tolerance. ## Check yourself The answer's key points as multiple-choice questions, with the correct option and why. 1. What does verification compare? A. Model with the real system B. Conceptual model with the computer program C. Two sets of real data D. Model output with a confidence interval Answer: B. Verification checks the program matches the conceptual model (built right). (Key point: Verification meaning) 2. Validation compares which two things? A. Program and debugger trace B. Conceptual model and operational model C. Model with the real system D. Seeds and streams Answer: C. Validation asks if the model is an accurate representation of the real system. (Key point: Validation meaning) 3. Which is a verification method? A. Face validity with managers B. Printing a trace of arrivals and checking logic and clock behaviour C. t-test on mean waiting times D. Adjusting service time to match observed waiting Answer: B. Traces, walk-throughs, debuggers and simple test cases are verification methods. (Key point: Verification methods) 4. In the three-teller example, the model gave 2.5 min against 4.0 observed. What was the calibration action? A. Fixing the clock bug B. Changing service time from 2 min to 2.8 min to include paperwork and rerunning C. Running a t-test and accepting the model D. Adding a fourth teller Answer: B. Calibration adjusts parameters (service time) and reruns until output matches real data within tolerance. (Key point: Calibration example) ## Related in Simulation and Modeling - [Model building, verification, validation steps](https://www.bctengineer.com/question.md?key=semester_8%2Fsimulation_and_modeling%3Amodel-building-verification-validation) — Simulation and Modeling, chapter 7 - [Calibration and validation of models](https://www.bctengineer.com/question.md?key=semester_8%2Fsimulation_and_modeling%3Acalibration-validation-models) — Simulation and Modeling, chapter 7, asked 2× - [Iterative process of model calibration](https://www.bctengineer.com/question.md?key=semester_8%2Fsimulation_and_modeling%3Acalibration-iterative-process) — Simulation and Modeling, chapter 7, asked 4× ## Related in other subjects - [Verification versus validation; critical systems](https://www.bctengineer.com/question.md?key=semester_5%2Fsoftware_engineering%3Averification-vs-validation) — Software Engineering, chapter 7 - [Compare software models; propose a fourth model](https://www.bctengineer.com/question.md?key=semester_5%2Finstrumentation_ii%3Asw-models-compare-fourth) — Instrumentation II, chapter 9