Time series flags describe the origin and the quality of the data.
Possible origins of data are:
- Original: This entails the data value is the original value. It has not been amended by Delft-FEWS
- Completed: This entails the original value was missing and was replaced by a non-missing value.
- Corrected: This entails the original value was replaced with another non-missing value.
Possible Qualities are:
- Reliable: Data is reliable and valid
- Doubtful: The validity of the data value is uncertain
- Unreliable: The data value is unreliable and cannot be used for calculations like transformations or external models. It can still be viewed and exported with a regular exportModule as long as the unreliable flag is shown with it.
Following this specification, the table below gives an overview of quality flag enumerations
Table D.1 Enumeration of quality flags
Enumeration | Description |
0 | Original/Reliable |
1 | Corrected/Reliable |
2 | Completed/Reliable |
3 | Original/Doubtful |
4 | Corrected/Doubtful |
5 | Completed/Doubtful |
6 | Missing/Unreliable |
7 | Corrected/Unreliable |
8 | Completed/Unreliable |
9 | Missing value in originally observed series. Note this is a special form of Original/Unreliable. Missing values are automatically unreliable |
10 | Deleted Only used for non-equidistant series when timestep is deleted |
11, 12, 13 | Not used |
14 | Reset Used for rainfall data processing when the storage is reset (canister reset) |
| Anchor | ||||
|---|---|---|---|---|
|
The list of flagSources is:
- IMP: flag is imported
- SN: soft min.
- HN: hard min.
- SX: soft max.
- HX: hard max.
- ROR: rate of rise
- ROF: rate of fall
- SR: same reading
- TS: temporary shift
- OSC: oscillation
- SC: secondary validation, series comparison
- FC: secondary validation, flag comparison
- MK: secondary validation, Mann-Kendall test
- SVP: secondary valdidation, Flag persistency (FlagPersistencyCheck)
- SFP: start flag persistency
- MAN: manual edit
- MK: mann kendall
- CA: Conditional aggregation
| Note |
|---|
|
| Wiki Markup |
| <!-- /* Font Definitions */ @font-face {font-family:Wingdings; panose-1:5 0 0 0 0 0 0 0 0 0; mso-font-charset:2; mso-generic-font-family:auto; mso-font-pitch:variable; mso-font-signature:0 268435456 0 0 -2147483648 0;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {mso-style-parent:""; margin:0cm; margin-bottom:.0001pt; mso-pagination:widow-orphan; font-size:12.0pt; font-family:"Times New Roman"; mso-fareast-font-family:"Times New Roman";} p.MsoBodyText, li.MsoBodyText, div.MsoBodyText {margin:0cm; margin-bottom:.0001pt; text-align:justify; line-height:110%; mso-pagination:widow-orphan; tab-stops:18.0pt 36.0pt 54.0pt; font-size:11.0pt; mso-bidi-font-size:10.0pt; font-family:"Times New Roman"; mso-fareast-font-family:"Times New Roman"; mso-font-kerning:11.0pt; mso-ansi-language:EN-GB;} @page Section1 {size:612.0pt 792.0pt; margin:72.0pt 90.0pt 72.0pt 90.0pt; mso-header-margin:36.0pt; mso-footer-margin:36.0pt; mso-paper-source:0;} div.Section1 {page:Section1;} /* List Definitions */ @list l0 {mso-list-id:718284006; mso-list-type:hybrid; mso-list-template-ids:-1594691806 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;} @list l0:level1 {mso-level-number-format:bullet; mso-level-text:; mso-level-tab-stop:36.0pt; mso-level-number-position:left; text-indent:-18.0pt; font-family:Symbol;} @list l1 {mso-list-id:1359425300; mso-list-template-ids:-715719340;} @list l1:level1 {mso-level-reset-level:level1; mso-level-tab-stop:35.7pt; mso-level-number-position:left; margin-left:35.7pt; text-indent:-17.85pt; mso-ansi-font-size:11.0pt; mso-bidi-font-size:16.0pt; font-family:"Times New Roman"; font-variant:normal !important; mso-hide:none; text-transform:none; position:relative; top:0pt; mso-text-raise:0pt; letter-spacing:0pt; mso-font-kerning:0pt; text-effect:none; text-shadow:none; text-effect:none; text-effect:none; font-emphasize:none; mso-ansi-font-weight:normal; mso-bidi-font-weight:normal; mso-ansi-font-style:normal; mso-bidi-font-style:normal; text-decoration:none; text-underline:none; text-decoration:none; text-line-through:none; vertical-align:baseline;} @list l1:level2 {mso-level-number-format:alpha-lower; mso-level-text:"%2\)"; mso-level-tab-stop:17.85pt; mso-level-number-position:left; margin-left:53.85pt; text-indent:-18.15pt; mso-ansi-font-size:11.0pt; font-family:"Times New Roman"; mso-hide:none; text-transform:none; text-effect:none; text-shadow:none; text-effect:none; text-effect:none; text-decoration:none; text-line-through:none; vertical-align:baseline;} @list l1:level3 {mso-level-number-format:roman-lower; mso-level-text:"%3\)"; mso-level-tab-stop:35.7pt; mso-level-number-position:left; margin-left:71.7pt; text-indent:-17.85pt; mso-hide:none; text-transform:none; text-effect:none; text-shadow:none; text-effect:none; text-effect:none; text-decoration:none; text-line-through:none; vertical-align:baseline;} @list l1:level4 {mso-level-text:"%1\.%2\.%3\.%4"; mso-level-tab-stop:17.85pt; mso-level-number-position:left; margin-left:17.85pt; text-indent:0cm;} @list l1:level5 {mso-level-number-format:none; mso-level-reset-level:level1; mso-level-suffix:none; mso-level-text:""; mso-level-tab-stop:none; mso-level-number-position:left; margin-left:17.85pt; text-indent:0cm;} @list l1:level6 {mso-level-number-format:alpha-upper; mso-level-reset-level:level1; mso-level-text:%6; mso-level-tab-stop:53.85pt; mso-level-number-position:left; margin-left:17.85pt; text-indent:0cm;} @list l1:level7 {mso-level-text:"%6\.%7"; mso-level-tab-stop:89.85pt; mso-level-number-position:left; margin-left:17.85pt; text-indent:0cm;} @list l1:level8 {mso-level-text:"%6\.%7\.%8"; mso-level-tab-stop:125.85pt; mso-level-number-position:left; margin-left:17.85pt; text-indent:0cm;} @list l1:level9 {mso-level-text:"%6\.%7\.%8\.%9"; mso-level-tab-stop:35.7pt; mso-level-number-position:left; margin-left:17.85pt; text-indent:0cm;} ol {margin-bottom:0cm;} ul {margin-bottom:0cm;} -->Following the discussion between Delft Hydraulics and CEH & Wallingford Software on Friday 2 May 2003 in Wallingford on providing an enumeration of quality flags as a part of the SIS, a proposed quality flag enumeration is given in the table below. As described in the timeseries XML schemas provided we have made allowance for a single quality flag. This is contrary to the EA XML interchange formats which provide for three separate quality flags. A single flag seems more appropriate to the level of communication we are dealing with and should avoid ambiguity. The flags are single byte values and are incorporated in the XML Schema for time series. Quality flags are provided for each data point.
Quality flags are constructed on a philosophy of two qualifiers. The first described the origin of the data and the second the quality.
Possible origins of data are:
1. Original: This entails the data value is the original value. It has not been amended by NFFS
2. Completed: This entails the original value was missing and was replaced by a non-missing value.
3. Corrected: This entails the original value was replaced with another non-missing value.
Possible qualifiers are:
4. Reliable: Data is reliable and valid
5. Doubtful: The validity of the data value is uncertain
6. Unreliable: The data value is unreliable and cannot be used.
Following this specification, the table below gives an overview of quality flag enumerations
Table D.1 Enumeration of quality flags
| *Enumeration*\\ | *Description* |
| 0 | Original/Reliable\\
The data value is the original value retrieved from an external source and it successfully passes all validation criteria set. |
| 1 | Corrected/Reliable\\
The original value was removed and corrected. Correction may be through interpolation or manual editing. |
| 2 | Completed/Reliable\\
Original value was missing. Value has been filled in through interpolation, transformation (e.g. stage discharge) or a model. |
| 3 | Original/Doubtful\\
Observed value retrieved from external data source. Value is valid, but marked as suspect due to soft validation limits being exceeded. |
| 4 | Corrected/Doubtful\\
The original value was removed and corrected. However, the corrected value is doubtful due to validation limits. |
| 5 | Completed/Doubtful\\
Original value was missing. Value has been filled in as above, but resulting value is doubtful due to limits in transformation/interpolation or input value used for transformation being doubtful. |
| 6 | Missing/Unreliable\\
Observed value retrieved from external data source. Value is invalid due to validation limits set. Value is removed |
| 7 | Corrected/Unreliable\\
The original value was removed and corrected. However, corrected value is unreliable and is removed. |
| 8 | Completed/Unreliable\\
Original value was missing. Value has been filled in as above, but resulting value is unreliable and is removed. |
| 9 | Missing value in originally observed series. Note this is a special form of both Original/Unreliable and Original/Reliable. | Notes:
* No difference is made between historic and forecast data. This is not considered a quality flag. The data model of NFFS is constructed such that this difference is inherent to the data type definition.
* External sources may either be an actual external source, a forecasting module or a transformation. The convention in NFFS the definition of data series parameter types identifies the data source. |