Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

1

scrollbar

_Toc172823893
Anchortoc
_Toc172823893

 

Note: the content of this page is outdated. There is new functionality available within the Modifier Display and IFD to perform manual calibration in standalone Delft-FEWS applications, when parameters are available in pi-xml format.

Calibration Display

The calibration display forms a special part of the forecasting systems that allow automatic calibration of any model connected to FEWS through the General Adapter. The model to calibrate must have a correctly configured General Adapter module Instance and included in a workflow. The calibration display (or utility) will be available only in the stand alone system, as it is not considered a functional part of an on-line system.

...

  • Model to Calibrate
  • Model Parameters
  • Run Options
  • Results 1.1 Anchor_Toc172823894_Toc172823894 Anchor_Toc140564201_Toc140564201

Model to Calibrate

In the first tab the user must enter all information concerning the model to calibrate. Not all models can be selected, the requirements for a calibration model run are:

  • The model must allow module parameters to be exchanged through the Published Interface Exchange XML format.
  • For each model the Parameter Files must be added to the ModuleParFiles configuration directory.

...

1. Select the workflow that includes the model to calibrate from the list of available workflows.
2. When the workflow is selected the General Adapter Module Instance of the external module should be selected from the list. This General Adapter Module Instance must include configured elements that export model parameter files, adapted by the Calibration utility.
3. Select the time period to calibrate for by entering a start date and an end date
4. Select the observed time series; this is the time series that will be used to compare the model results with. It is important to select the correct module instance id that generated the observed time series (most often an import module instance) and the correct location id and parameter id.
5. Select the simulated time series that should be compared with the observed time series. The module instance id of this time series will be the module instance of the module to calibrate.
6. Enter a period for the Grace period. The model results produced in the grace period will not be included in the calibration optimisation.
7. Select the cold state group that will be used in the workflow.

Wiki MarkupOnce the selection has been entered in the Model Calibration tab it can be stored to a file by pressing the \ [Save\] button. Next time the calibration utility is used the \ [Load\] button can be used to load the selection. 1.2 <ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="df8d2093-4734-47b8-9122-2e8ac87a17a8"><ac:parameter ac:name="">_Toc172823895</ac:parameter></ac:structured-macro><ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="5e643a13-81c4-44c0-b905-a496f7934e54"><ac:parameter ac:name="">_Toc140564202</ac:parameter></ac:structured-macro>Model Parameters The Model Parameters tab includes a spreadsheet with all model parameters that can be adjusted by the calibration selection.

Model Parameters

The Model Parameters tab includes a spreadsheet with all model parameters that can be adjusted by the calibration utility.

The parameters shown in the spreadsheet are the model parameters of the parameter file that is selected in the upper drop down list. Once the spreadsheet has been filled with parameter values the model parameters can be selected that need to be optimised through the calibration utility. A model parameter can be selected by checking the "Adjust" column in the spreadsheet. Make sure that the original, minimum and maximum values for the selected parameter have realistic values.
1.3 Anchor_Toc172823896_Toc172823896 Anchor_Toc140564203_Toc140564203

Run Options tab

In the Run Options tab the final set of definitions must be set that allows the method and constraints of calibration to be defined. These include:

1. The calibration method to be used- thus may either be the Local gradient method "SuperDUD" or the global "SCE-UA" method. At the moment only the SuperDUD method is implemented.
2. The performance indicator to be used in calibration. The enumeration of this is "BIAS", "MAE", "MSE", "NS", "PEAK_MSE" and "PERCENT_VOLUME".
3. A number of termination criteria. All are available and may be selected for application or not considered:
a) Maximum number of runs.
b) Threshold change in performance
c) Threshold change in parameter vector

Wiki Markup
!image006.png! 
1.4 <ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="82c325c7-fd98-4d56-a25f-8e97fe413d4c"><ac:parameter ac:name="">_Toc172823897</ac:parameter></ac:structured-macro><ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="9abdad62-a996-4d14-a579-10c375a20e4b"><ac:parameter ac:name="">_Toc140564204</ac:parameter></ac:structured-macro>Results 
The results tab shows the calibration results in a graph. To start the calibration utility the \[Run\] button must be pressed. The workflow will be started and the model parameters adjusted by the calibration utility. The user can follow the calibration progress by analysing the graph and the current iteration and current performance values located in the progress info frame.

Image Removed

Wiki Markup
After the calibration run is completed you can select to see a report by pressing the \[Report\] button. The report of the calibration run contains information on the model parameters that have been optimised in each iteration step.

Wiki Markup
By pressing \[Close\] the Calibration display can be closed.
1.5 <ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="f1ecef0e-7c69-4aef-be32-ec03bbd01a59"><ac:parameter ac:name="">_Toc172823898</ac:parameter></ac:structured-macro><ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="750c1353-7496-452b-a598-74f1eedb5433"><ac:parameter ac:name="">_Toc140564205</ac:parameter></ac:structured-macro>Working efficiently with calibration 
When working with the calibration utility a complete workflow must be run in order to optimise one of the modules in that workflow. In the calibration process this workflow will be run for multiple iterations. When the module is included in a fluvial workflow for the complete region each iteration will require a long time to complete. It is therefore recommended to create specific "calibration" workflows that only include one or several modules; the number of modules not contributing to the calibration module must be minimised. This will bring down the calculation time considerably. Especially for rainfall-runoff modules it will not take much time to create such calibration workflows.

Image Added

Results

The results tab shows the calibration results in a graph. To start the calibration utility the [Run] button must be pressed. The workflow will be started and the model parameters adjusted by the calibration utility. The user can follow the calibration progress by analysing the graph and the current iteration and current performance values located in the progress info frame.

Image Added

After the calibration run is completed you can select to see a report by pressing the [Report] button. The report of the calibration run contains information on the model parameters that have been optimised in each iteration step.

By pressing [Close] the Calibration display can be closed.

Working efficiently with calibration

When working with the calibration utility a complete workflow must be run in order to optimise one of the modules in that workflow. In the calibration process this workflow will be run for multiple iterations. When the module is included in a fluvial workflow for the complete region each iteration will require a long time to complete. It is therefore recommended to create specific "calibration" workflows that only include one or several modules; the number of modules not contributing to the calibration module must be minimised. This will bring down the calculation time considerably. Especially for rainfall-runoff modules it will not take much time to create such calibration workflows.

1.6 When running the calibration utility a database must be used with a complete set of historical data. Such a database can be created using the on-line or off-line systems or by importing data from HARP.