Skill Scores Display
This display provides an overview of all threshold crossings in the observed and forecast time series. By matching observed and forecast thresholds, various skill scores can be computed.
Background
1.1 The number The first step is to set up a contingency table. Given criteria on time intervals to consider when matching thresholds, the values of a , b , c and d in the table below can be filled in (where e.g. a is the number of matched observed and forecast thresholds).
1.2
1.3 
1.4
1.5 Once the contingency table has been filled, different skill scores can be established:
1.6
1.7 
False Alarm Rate
Probability of Detection
Critical Success Index
Critical Reliability (checks if a forecast is available at least some time (but not too late) before the observed threshold)
1.8 The First Forecast of Threshold (FFOT) is determined as the average time between the T~0~ of the forecast run in which a threshold was detected and the time of the threshold (i.e. the average lead time of the category a thresholds in the contingency table).
1.9
1.10 The Bias of paired thresholds is the average time between paired observed and forecast events.
1.11
<ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="dc0e83ea-15b3-438c-8cd4-e240f068fbbe"><ac:parameter ac:name="">_Toc172823867</ac:parameter></ac:structured-macro>Setting Criteria for Analyses
1.12 To specific what matching threshold crossings mean, a number of criteria can be used. When clicking the [Change Criteria] button the following display appears...
1.13
1.14 
1.15
1.16 The criteria in the display have the following meaning...
1.17
- Min/Max T~0~ difference . These criteria define in what time interval the T0 of a forecast should fall that has predicted a threshold crossing in order for this threshold crossing event to be included in the analysis.
1.18 - Max dispatch time difference . This criterion is used to compute the Critical Reliability (CR) which determines whether a forecast was available at the time of an observed crossing irrespective of its quality. By setting this criterion the maximum time difference can be defined between the dispatch time of a forecast and the time of an observed crossing.
1.19 - Max time threshold being too early/late . These criteria define what the maximum difference between a forecasted threshold crossing and an observed threshold crossing are allowed to be in order to consider them as matching.
Matching Events
1.20 In the Matching Events tab different background colours are used to indicate in which sector of the Contingency Table events fall...
1.21 - green: observed and forecast threshold crossing event match (sector a of contingency table)
- yellow a threshold crossing has been observed but not forecasted (sector c)
- orange: a threshold crossing has been forecasted but not observed (sector b)
1.22
1.23
1.24
1.25 In general, skill scores are determined for all forecast locations being at a gauging station and having level thresholds. Typically these are determined separately, but the structure of the display allows skill scores to be established for several models.
1.26
1.27 The performance indicators that are computed on the basis of the selection in this tab are... - probability of detection
- false alarm rate
- critical success factor
- first forecast of threshold
- bias of paired thresholds
1.28
1.29 The filter boxes at the left hand side of the skill scores display enable the selection of certain locations or certain thresholds levels to be shown alone. By activating the check box below the criteria, it's possible to display Up crossings of thresholds only.
Forecast Available for Events
1.30 In the Forecast Available for Events tab different background colours are used to indicate in which sector of the Contingency Table events fall...
1.31 - green: a forecast is available for an observed threshold crossing event (sector e of contingency table)
- yellow no forecast available for an observed threshold crossing event (sector f)
1.32 
1.33
1.34 The performance indicator that is computed on the basis of the selection in this tab is critical reliability .
<ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="f19a056c-647d-4103-9f81-35e88e7822f4"><ac:parameter ac:name="">_Toc172823870</ac:parameter></ac:structured-macro>Thresholds List
1.35 The Threshold List provides an overview of all threshold crossing events available for the selected locations. In the analyses subsets can be made by setting the criteria discussed in the earlier part of this section.
1.36 
<ac:structured-macro ac:name="anchor" ac:schema-version="1" ac:macro-id="aa4861a7-cf24-407b-9398-89dbc41f6da2"><ac:parameter ac:name="">_Toc172823871</ac:parameter></ac:structured-macro>Archiving Events
1.37 As the thresholds are stored in the operational database for only some days (according to the length of the Rolling Barrel), it's possible to manually export the list of thresholds by pressing the [Export ] button in the skill scores display. This list can later be imported in a Stand Alone system by pressing the [Import ] button. In this way, longer records can be established for analysis in an off-line modus.
1.38
1.39 Instead of exporting the whole list of thresholds, as described above, it's also possible to select some of them and export only this ones by using the [Save ] button.
1.40
1.41 All threshold crossing events can also be archived automatically by the system. See also Archive Display.
1.42
