...
| Table of Contents |
|---|
Schema location: httphttps://fewsfewsdocs.wldelftdeltares.nl/schemas/version1.0/performanceIndicatorSets.xsd
Performance Indicator module
...
The second type of measure can be assessed once observed data for which forecasts were made becomes available.
Assessing performance of modules
...
Lead time accuracy is evaluated using again the BIAS, MSE, or MAE or BIAS:
Lead time accuracy in Mean Square Error bias (mean error) LEAD_MSEBIAS
Lead time accuracy in bias Mean Square Error LEAD_BIASMSE
Lead time accuracy in Mean absolute error LEAD_MAE
where 
is the lead time accuracy at time 
, J is the number of forecasts considered, 
is the reference value at time and 
is the estimated value at time .
...
- indicatorType : selection of performance indicator. Enumeration of options includes:
- bias
- meanabsoluteerror
- meansquareerror
- nashsutcliffeefficiency
- peakmeansquareerror
- volumeerror
- calculatedVariableId : VariableId to identify calculated time series
- observedVariableId : VariableId to identify observed (reference) time series
- outputVariableId : VariableId to write resulting Performance index time series to.
- sampleOutputVariableId : VariableId to write total number of values (samples) used for the analysis to the output time series. Optional.
- analysedCalculatedVariableId : VariableId to write exactly that part of the calculated series, which was used for the analysis, to the output series. Optional .
- analysedObservedVariableId : VariableId to write exactly that part of the observed series, which was used for the analysis, to the output series. Optional .
leadTimeAccuracyIndicator
...
- indicatorType : selection of performance indicator. Enumeration of options includes;
- bias
- meanabsoluteerror
- meansquareerror
- calculatedVariableId : VariableId to identify calculated time series
- observedVariableId : VariableId to identify observed (reference) time series
- outputVariableId : VariableId to write resulting Performance index time series to
- sampleOutputVariableId : VariableId to write total number of values (samples) used for the analysis to the output time series. Optional. NOTE: this option is not supported by all assessment types. In that case, there will be a nullpointer error.
- intermediateValuesVariableId : VariableId to write intermediate values (as visible in log file if debug is on) to the output series. Optional and only applicable if leadTimePeriods are configured.
- analysedCalculatedVariableId : VariableId to write exactly that part of the calculated series, which was used for the analysis, to the output series. Optional and only applicable if leadTimePeriods are configured.
- analysedObservedVariableId : VariableId to write exactly that part of the observed series, which was used for the analysis, to the output series. Optional and only applicable if leadTimePeriods are configured.
thresholdTimingIndicator
Root element for configuration of performance indicator assessing accuracy of threshold Timing
...
Description of criteria defined. For reference purposes only.
Figure 136 Elements of the leadTimeAccuracy configuration.
...
Lead time for which to assess lead time performance.
Attributes;
- time : lead time in number
...
- of time units from the forecast time of the calculated time series. The time units are configured with the attribute 'unit'
- outputVariableId: variableId to output lead time accuracy to. This is defined when a separate time series is defined to keep track of performance at different lead times. It is not required when keeping track of performance in a single time series (Note that in the former a simulated historical time series can be used. In the latter this must be a simulated forecasting time series).
leadTimePeriods
Root element for defining lead time periods
leadTimePeriod
Lead time period for which to assess lead time performance.
Attributes;
- start : start of the period in number of time units from the forecast time of the calculated time series. The time units are configured with the attribute 'unit'
- end : end of the period in number of time units from the forecast time of the calculated time series. The time units are configured with the attribute 'unit'
- outputVariableId: variableId to output lead time accuracy to. This is defined when a separate time series is defined to keep track of performance at different lead time periods. It is not required when keeping track of performance in a single time series
- sampleOutputVariableId : variableId to output number of samples used in this lead time period. This is defined when a separate time series is defined to keep track of performance at different lead time periods. It is not required when keeping track of performance in a single time series
Figure 137 Elements of the thresholdTimingAccuracy configuration.
...