What is the basic cycle of calibrating a model?

Compare with the real system, find discrepancies, revise, compare again

Build once, then validate on the same data

Debug the code, then run more replications

Collect more data, then discard the model

When does the calibration iteration stop?

When the discrepancy is within the accepted limit, or further revision costs more than it gains

When the program has no coding errors

When the model output equals the real value exactly

Which pair describes the tests used to compare the model with the real system?

Subjective review by system experts and objective statistical comparison (t-test, confidence intervals)

Only subjective review by the programmer

Only chi-square tests on the code

Compiler checks and trace output

In the bank example the model gave 3.5 min against a real 6 min. What was done in the second version?

Service time was changed to normal (mean 4, SD 1) and a loan desk was added

Asked 4/10
2073 Magh · 5 marks
2071 Bhadra · 5 marks
2070 Magh · 5 marks
2070 Bhadra · 3 marks

Iterative process of model calibration

Short answer

Calibration iteratively compares model output with real system, identifies discrepancies, and adjusts parameters or distributions until the difference is acceptable. For example, a bank model initially underestimated wait; changing the service time distribution and adding a loan desk brought wait within tolerance.

Explain the iterative process of calibrating a model with example.

Calibration is the process of comparing the model with the real system, then adjusting the model to remove the differences, and repeating until the model is accepted as accurate enough. It is an iterative "compare, revise, compare again" cycle (Banks, Carson, Nelson & Nicol).

 Real system          Initial model
      |                    |
      +----> compare <-----+
              |
      discrepancies found?
        |yes            |no
   revise the model     accept model
        |
   (first revision) -> compare again
        |
   (second revision) -> compare again ...

Steps

Build the first version of the model from observations and assumptions.
Compare the model's behaviour with the real system, using subjective tests (people who know the system review the output) and objective tests (statistical comparison of outputs, e.g. t-test or confidence intervals on means).
Find the discrepancies and their causes (wrong distribution, missing detail, wrong parameter).
Revise the model: change the input distributions, parameters, or logic.
Compare the revised model with the real system again.
Repeat until the discrepancy is within the accepted limit. Stop when the cost of further revision is greater than the benefit.

Example: bank with two tellers. The first model assumes exponential service time with mean 4 minutes. The real bank shows an average customer wait of 6 minutes, but the model gives 3.5 minutes. On inspection, real service times vary less than exponential, and some customers use a special loan desk. In the second version, service time is changed to a normal distribution (mean 4, standard deviation 1), and the loan desk is added. The model now gives a wait of 5.4 minutes. After the arrival rate during lunch hour is corrected in the third version, the model output is 5.9 minutes, which is within the 10% tolerance of the real value. Calibration stops here.

Calibration should be followed by validation on a separate data set that was not used in calibration.

✓ Answer checked by Claude Opus 5.5 (high effort)

Compare verification, validation, calibration · Simulation and Modeling, chapter 7
Iterative and incremental model · ICT Project Management, chapter 4
Book store process model · Software Engineering, chapter 2
Steady 2D model: seepage under a dam · Computational Techniques in Civil Engineering, chapter 7 · asked 3×
Steps in the design and synthesis process · Machine Design I, chapter 1

All Simulation and Modeling chapter 7 questions →

Iterative process of model calibration

Related questions