- Editing Data
- Changing display properties
- Interactively modifying display colours
- The F12 debug menu (Timeseries Display)
- Statistical functions
- Filtering data
Data Display and Data Editor
The Data Display and Data Editor offer graphical displays for presenting and editing of data. Both have nearly the same functionality but only the Data Editor allows you to edit data. In addition, the data editor can only be opened once while multiple instances of the data display can be opened.
This display offers the following features:
- Display of time series in:
- graphs (scalar/longitudinal profiles)
- tables (scalar/longitudinal profiles)
- Tabular data editor
- Display of actual data with:
- Historical events
- Threshold levels
Data is displayed in a table and a graph simultaneously. The splitter between the table and the graph can be moved to modify the display. Select the data series, that should be displayed with help of the List Boxes and/or the Map Display (see also Filters ).
Decimals for the reference values (ticks) in the chart autorange between 0 and 6, always using the lowest amount necessary to differentiate between ticks.
When the display is started through the FEWS Tools menu item Data Editor , data can be edited and the edited data can be stored in the FEWS data base. When the display is started through the FEWS Tools menu item Data Display or through the FEWS toolbar, the data can only be viewed.
1.1 Data Display
Press the [Data Display ] button on the toolbar to present graphs displaying the data. The splitter is normally positioned on the left of the display.
When data series of different data types have been selected, the data will be presented in different subplots with the data series of a single data type merged into one subplot.
The data in the graph is updated automatically in case new data becomes available. Below the graph the workflows are listed that generated the forecast time series in the graph. Their numbers are used in the graph legend and table headers too.
The following buttons are used in the Time Series Display:
By clicking this button the time series in the graph is also displayed in tabular format. Please note that in case you like to edit data, you have to select the Data Editor from the Tools menu (see section 4.3).
Selecting the small arrow at the right of the icon shows the next menu:
|Validation||shows a separate column with the validation flags|
|Users||shows a separate column with the user names of editted values|
|Comments||shows a separate column with the comments|
|Units||shows in the header the unit of the parameter|
|Location Names||shows in the header the location name|
|Location Ids||shows in the header the location ID|
|Module||shows in the header the moduleInstanceId|
|Column statistics||shows between the header and the table statistics of the values in the current relativeViewPeriod, like mean, sum, min, max|
|Threshold crossing||shows in the cells (on the left side) a small bar with a color according to the threshold definition, that indicates a threshold crossing|
|Normal||shows the values in a normal table, so all times have a row|
|Days||shows the values in an aggregated way, so that each day gets its own column. Usefull to series with for example an hourly time step.|
|Weeks||shows the values in an aggregated way, so that each week gets its own column. Usefull to series with for example a daily time step.|
|Months||shows the values in an aggregated way, so that each month gets its own column. Usefull to series with for example daily time step.|
|Years||shows the values in an aggregated way, so that each year gets its own column. Usefull to series with for example monthly time step.|
|Removed times||Show the deleted time steps from non-equidistant time steps.|
|Time order reversed||Shows the times in reversed order, so from new to old|
Display templates are available for rapid assessment of data. The templates can be activated by clicking the above mentioned button. The left side of the display shows the available shortcuts in a pre-configured grouping.
The data shown via the Shortcuts belong to the forecasts selected in the Forecasts panel of the FEWS Explorer. Please note that the current forecast is always displayed in the graphs.
This button can be used to hide or show the graph. If the table was not yet selected, it will show up.
Selecting the small arrow at the right of the icon shows the next menu:
This button will add below the display a database viewer of the timeseries that are displayed. The database records are visualised as individual rows, which can be selected. When selected it can be browsed through (all columns). All meta information and statistics are calculated on-the-fly and are not stored. Within selections or filters (e.g. on start/end time) the content of the (visible) columns are updated immediately. There are many columns which can be viewed: general columns about module instance, location, parameter, disk space and all kind of relevant meta information about the selected record(s).
Besides the 'general' metadata, the basic statistics of that row can be inspected. These basic statistics are sum, average, maximum, minimum, etc. The remaining columns describe the quality of the data. If the user e.g. wants to know how many values are 'unreliable' and how many 'periods' of unreliable data are available, this information can be retrieved. The same is true for all kinds of combinations of doubtful, completed and corrected data. This same functionality (number of records, periods) is available for primary and secondary validation results. This means that the user can inspect number of records and periods of e.g. hard maximums and flag comparison or series comparison.
The Timeseries Lister has similar functionality as the Database Viewer, like filtering, ordering and righmouse context menu options. These are described in detail in: Database Viewer
This button will add a table to the display with descriptive statistical information. The statistics only appear if a column in the table is selected. Use the right mouse button to copy this table to the clipboard for pasting in Excel.
Statistical Functionality available (if configured):
- Min (with date)
- Max (with date)
- Standard deviation
- Percentiles (exceedance and non-exceedance)
Time series information:
- Location id
- Location name
- Parameter id
- Parameter name
- Module instance
- Start time
- End time
Data quality information:
- Number of values
- Number of completed values
- Number of corrected values
- Number of doubtful values
- Number of missing values
- Number of reliable values
- Number of unreliable values
Timeseries Information (hidable panel)
Since 2016.02 button is added to show (or hide) a panel that shows a panel with four subpanels (toggleable) with the Timeseries Information, Attributes, Validation criteria and availabel Thresholds for the selected time series on the selected time step
Opening this panel will automatically hide descriptive statistics panel when open
Changing the view period
Since 2020.01 it is possible to move the view period to the first or to the last data point available. This will not change the zoom in the display. The buttons are in the following order:
- move to first datapoint available
- move one full viewperiod back
- move a half viewperiod back
- move a half viewperiod forward
- move a whole viewperiod forward
- move to the last datapoint available
With this button the splitter between table and graph can be placed in a horizontal position. Clicking the same button again returns the splitter to its default vertical position.
This button can be used to place the graph legend underneath the graph. Clicking the same button again returns the legend to its default position at the right hand side of the graph.
When multiple data series are selected for a single data type (parameter), the graphs will be placed in one subplot of the graph. This sometimes complicates the analysis of time series with different data ranges. By clicking the above mentioned button you can change the layout of the chart:
- Merged into a single graph
- Stacked in different subplots
Scale to show unreliable Data
This button can be used to focus on time intervals with unreliable data within the selected time series. Data is marked as unreliable, if values exceed hard limits.
No Thresholds Scaling
By clicking this button there will be no scaling in order to show thresholds out of data range.
Scale to show relevant Thresholds
With this option the graph is scaled in such a way, that relevant thresholds (the closest threshold values) are displayed together with the selected time series in the graph.
Scale to show all Thresholds
This button can be used to show all pre-configured thresholds of a certain parameter at the selected location(s). This means that all thresholds levels (e.g. Standby, Flood Watch, Flood Warning and Severe Flood Warning) are displayed in the graph.
Show data labels
Clicking the 'Show data labels' will you to display quality flags for the data you are presenting. The information is shown at the bottom of the screen.
The following colour codes have been used:
- the upper line indicates the origin of the data
- original data: no line is displayed
- automatically corrected data (original data flagged as unreliable and automatically interpolated): blue line
- automatically completed data (original data is missing and interpolated by system): magenta line
- manual corrected data (original data edited by a user): dark blue line
- manual completed data (filled up by a user): dark magenta line
- the middle line indicates the quality of the data
- reliable data: no line is displayed
- doubtful data: orange
- unreliable data: yellow
- the lower line indicates where comments have been added to the data
- no comment: no line is displayed
- comment available: dark red
The lines are displayed under the data points. The colours correspond with the colouring used in the tables.
Show on/off checkboxes in legend (since 2020.02)
It is possible to show checkboxes in the legend to quickly hide/unhide time series in the time series dialog. You can find the option to show legend checkboxes in the chart dropdown button in the toolbar.
If switched on in the configuration. This functionality works independently from the descriptive statistics table.
The available statistical functions can be selected from the drop-down box in the button bar. The selected function will act on the timeseries that are currently selected by in the timeseries dialogue. The result of the statistical analysis will be shown in the timeseries dialogue window. Follow this link for a description of all available statistical functions.
Search and Select Forecast
Displays in FEWS by default only show current approved forecasts. Previous forecasts can be shown if you approve them in the Forecast Management Display, or by using this “search and select forecasts” option.
There are two ways to use this button. The little arrow on the right opens up a drop-down menu, where you can quickly select the number of recent forecast you want to view.
When you click on the button itself, it opens a separate display, with some additional options and information about the available timeseries.
Hide whole forecasts (since 2020.02)
Since 2020.02 it is possible to hide all time series belonging to the same forecast.
When time series are selected, with the dropdown button or ctrl+alt+shift+X all time series sharing a forecast with one of the selected forecasts will be hidden.
In the image belong forecast  has been made hidden.
In the search and select forecasts there will be a postfix stating (hidden) behind their forecast time.
In the image below forecast 1 and 8 have been hidden.
All hidden forecasts can be made visible again by the "Show all hidden forecasts" dropdown menu item or with ctrl+alt+shift+Z.
With this button historical events can be activated (provided that they are pre-configured). They will be displayed in the same graph to enable a comparison with the actual timeseries. Further explanation is given below.
To change the view period in the graph, the field Display time in the Status Bar below the graph should be double clicked. The display time can now be changed with help of the menu. Press [OK ] to accept the changed view period. The next time the chart is opened the original configured display time will be used again.
The Datum Toggle at the lower right hand corner of the display allows levels to be displayed with reference to Local Datum or mAOD .
Navigating in Graphs
Zooming in and out can be done with help of the scroll wheel of the mouse. Scrolling away from the user results in zooming in while scrolling towards the user results in zooming out.
Zooming is also possible by selecting a zoom range. Drag the mouse holding down the right button to form a rectangular area to zoom in to.
When clicking the right mouse button, the dropdown menu presented below appears. The menu gives you some additional options.
You can save the graph to file with this option.
This option allows you to print the graph.
Zoom in / out
You can select to zoom in and out along one or both axis with this option.
Allow Vertical / Horizontal Axis Zoom
You can select to allow for zooming in and out along one of the axis with this option.
This feature allows you the set automatic scaling along one or both axis.
The Graph and Editor display has a table and an edit mode.
The most left column shows the date and time of the data. The period displayed spans the overall period defined in the filters for all time series.
The colours in the headings of the columns correspond with the line colour in the graph.
In the date/time column different colours are used to provide a logical meaning to certain important moments:
- Light blue: historical data, either observed or hindcast (data before T~0~ )
- Dark blue: forecast data (data after T~0~ )
For the data columns the background colour is used to indicate the quality of the data, identified by the data flags set of the Validation utility. Further, an indication of the editability of the data is given by the the background colour. The meaning of the background colours in the data fields is:
- White: reliable, editable
- Light yellow: doubtful
- Bright yellow: unreliable
- Gray: not editable
The font colour in the data fields indicates the data origin. Following colours are used:
- Black: original data
- Blue: corrected (original data flagged "Unreliable" and interpolated)
- Magenta: completed (original data missing and interpolated)
The edit mode can be enabled from the toolbar with theEnable Edit mode button. Data (only those with a white background) can be edited by double clicking a field in the column. Editing may be done in the table directly. The result of an edit action is directly displayed in the corresponding graph. Manually corrected data will be saved to the database by disabling the Edit mode again from the toolbar. A pop-up will ask to save the edited data to the database. With [OK ] the data is saved, [NO ] the data is not saved and with [Cancel ] changes will be undone.
Through manual editing of data, the source of the data changes from original to corrected. The font colour used for edited data is blue to indicate that it is completed data. The background colour remains white, as the data has not yet been validated. If however, after pressing [Apply ] validation indicates that the value exceeds certain validation limits, the background colour will be set accordingly.
Since 2020.01 it is possible to "freeze" part of a time series and make that part uneditable. This can be useful if the values need to be evaluated and verified, than used in different systems. This ensures that they all contain the same data, and that cannot change. This can be done by configuring a ReadOnlyPeriod. This contains a relative time, and a time series filter. All time series that match the filter become uneditable before the given relative time. Exempel configuration:
In this case, data older than 2 days before the system time, in a time series where the location ID is LocA, becomes uneditable.
You can configure as many readOnlyPeriods as you wish. They should be configured in the TimeSeriesDisplayConfig, following scrollerDefaultViewPeriod. The image bellow shows the time from when the time series becomes uneditable. "Frozen" time series can be edited, if "enable editing read only period" option is selected. Time series that are entirely uneditable remain so.
Editing data labels
Data labels can also be edited from the Table when theEnable Edit mode is active. Press the right mouse button when selecting one or multiple cells in the table and select the Mark option. It is now possible to change the data label of a value to reliable, doubtful, etc.. or remove the Manual Data Label Marks. A special data label is the Persistent Void or Persistent Unreliable data label, this label is used by the secondary validation module.
Note: It is not possible to change the data label of a missing value.
A special option in the Data Display is the option to add historic events to the chart window.
To show historic events for a specific location take following steps:
- Select the location from the location list box in the FEWS explorer
- Select the parameter from the parameter list box
- Open the chart display by pressing the chart button
- Press the button in the Chart Display and select one of the historical events from the list
A new (red) line will be added to the chart. This event line can now be shifted forwards and backwards in time using the "+" and "-" keys on your keyboard. To activate this shift procedure press the [Historic Events ] button in the Chart Display and select Shift Time.
A small pop-up window shows that you can now shift the historic event forwards and backwards by pressing the "+" or "-" keys on your keyboard. When the shift procedure is completed press [Done ].
Since release 2007.02, the display offers also the opportunity to show longitudinal profiles. In such graph, the parameter values (Y-axis) are plotted against the river chainage (X-axis). The graph can progress over time, eitehr step by step or animated, via the time control toolbar, described in the Spatial display. both the graph and table will change over time as they shown data along the profile.
Longitudinal profiles can be simply added to the display by configuration of timeSeriesSet’s with value type longitudinalprofile in the config file DisplayGroups.xml
The display offers also the opportunity to show rating curves. In such graph, the rating curve stage values are plotted against discharge values. By default stage is shown on the Y-axis and discharge on the X-axis. Configure stageAxisOrientation ‘horizontal’ in TimeSeriesDisplay config if the axes should be switched. Rating curve display shows the rating curve that belongs to the location selected in the table or in the chart legend. If this location has multiple rating curves with different qualifiers, rating display shows a list where the specific rating curve can be selected
Displaying gaugings along with the rating curves
Since release 2019.02 it is possible to display gaugings (observations of level and discharge (velocity) combinations) along with the rating curve. To show the observations in rating curve display, follow these steps:
- open TimeSeriesDialog with the time series you want to see along with the rating curve,
- open rating curve display for required location,
- select option “Show selected stage and discharge as scatter plot” from the drop down menu of the button “ Rating Curves” (on the TSD toolbar),
- select one stage series and one discharge series from the time series table or from the chart legend. The selected series will be shown as scatter plot along the rating curve. All values in the chart zoom period will be displayed. The number of values shown can be changed by changing of the zoom period.
Note that the selected series must be stage and discharge, it means the series parameter must be from the same parameter group as the rating curve parameters configured in Parameters.xml. Other series selection will be ignored.
This graph type is available in DELFT-FEWS versions 2011.01 and higher.
In Category plot the parameter values (X-axis) are plotted against the locations (Y-axis).
The graph can progress over time, either step by step or animated, via the time control toolbar. Both the graph and table will change over time
The detail description of the time toolbar can be found in the paragraph Spatial display.
If there are more subplots in a plot, a separate table wil be created for each subplot.
To show the data in the category plot, the 'category' plot viewer type should be specified in DisplayGroups.xml with element <plotViewerId> :
The category plot can be customized in TimeSeriesDisplay.xml and in DisplayGroups.xml, similar to the other plot types. However not all configuration elements are applicable to the category plot. If these elements are still configured, they wil be ignored.
The category plot is only applicable to scalar timeseries.
The data selection made in the Data Viewer can be stored through its toolbar. This allows for storing favorite data selections / graphs in the user settings. More information on this functionality can be found in the location parameter selection section of the FEWS Explorer page.
Long Term Scroller
For viewing a longer period than is shown in specific graphs, the long term scoller can be openen via the button highlighted in red below.
It will open a zoomed out graph were a smaller period can be selected via the black vertical lines. The red vertical line shows the display time and the green vertical line the system time.