Overview
The WIWB Import connects to the Hydronet WIWB API and has support for downloading observations and forecasts for both scalar and grid data. WIWB has a concept of DataSources which have to be configured as a property of the import. Using the meta data api of the WIWB API the type of data is determined and processed accordingly.
More about WIWB
WIWB is the Dutch national database for storage and dissemination of weather related data, specifically for the Dutch water sector. It has been developed in 2017 by HydroLogic, HKV and HydroConsult for Het Waterschapshuis, a national body that represents all Dutch water boards. The WIWB database is based on the HydroNET platform (www.hydronet.com) and offers a REST API for retrieving data and metadata. WIWB contains weather observations and forecasts, based on weather stations, meteorological radar data and numerical weather models.
WIWB is intended for professional use only by Dutch water boards. It is not intended for public or commercial use. Only officials from Dutch water boards can request access to the WIWB API. More information on specifications and use of the WIWB API can be requested from the WWIB helpdesk (helpdesk@hydrologic.com).
Access to WIWB API
Access to the WIWIB API can be requested from the Waterschapshuis Water (HWH) by sending an e-mail to mr. Jack Bosman. Please list the following items in your e-mail
- Organisation name
- Contact person and contact details (e-mail and telephone number).
- List with IP addresses that require access to the API.
- Short explanation of intended use:
- Systems to be connected to the API
- Required data sources
- Expected data request per time interval.
HWH will forward the required information to the WIWB back-office operated by HydroLogic. Your account will be configured within 5 days after the request was received by the WIWB back office.
More info about WIWB at HWH can be found here.
Import Configuration
To configure the WIWB import the dataSource property has to be specified. Se the list of supported dataSource values in the next section.
For ensembles the ensemble id can be configured using the ensembleId property. In case no property is configured, the default value "EPS" will be used.
DataSource values
The following data sources are currently provided through WIWB. New data sources might become available in future.
More information on the data sources can be obtained form the links provided in the table. All times are in UTC.
Datasource & Code | Type | Interval | Available Parameter(s) | Remark |
---|---|---|---|---|
Uncorrected Radar (Real time) | Grid | 5 minutes | Precipitation [ ] | Grid definition required in grids.xml. See below for the configuration example. |
Radar Corrected B (Near-real time) Knmi.Radar.CorrectedB | Grid | 5 minutes | Precipitation | Grid definition required in grids.xml. See below for the configuration example. |
Radar Corrected C2 (After) Knmi.Radar.CorrectedC2 | Grid | 5 minutes | Precipitation | Grid definition required in grids.xml. See below for the configuration example. |
Radar Corrected D2 (Re-analysis) Knmi.Radar.CorrectedD2 | Grid | 5 minutes | Precipitation | Grid definition required in grids.xml. See below for the configuration example. |
Eps meteo parameters | Ensemble | 6 hours | Dew Point Temperature, Neerslag, Snow Depth, Total Cloud Cover, Maximum Temperature 2m above ground, Minimum temperature 2 m above ground, Temperature 2m above ground, U-Component of Wind 10m above ground, V-Component of Wind 10m above ground, Wind Direction, Wind Speed | Note that the ensemble members 1-50 are the real ensemble, while member 51 and 52 are the control and deterministic runs. So it is advised to store the ensemble in a temporary ensembleId and to postprocess the members 1-50 to the real ensemble. |
Hirlam | Model Grid | 1 hour | Air Pressure, Total Precipitation, | Tested. |
Harmonie | Model Grid | 1 hour | Air Pressure, Total Precipitation, Global Radiation Flux, High Cloud Cover, Large Scale Precipitation, Latent Heat Flux, Low Cloud Cover, Medium Cloud Cover, Net Longwave Radiation Flux, Net Shortwave Radiation Flux, Relative Humidity 2m above ground, Sensible Heat Flux, Snow Depth, Total Cloud Cover, Soil temperature Level 2, Temperature 2m above ground, U-Component of Wind 10 m above ground, V-Component of Wind 10 m above ground | Tested Grids details are recognized from the HARMONIE files (WGS84) and are imported automatically |
Iris stations | TimeSeries | 1 day | Precipitation, Snow Depth | |
Reference Evaporation | TimeSeries | 1 day | Evaporation | |
Eps waterlevels coast | Ensemble TimeSeries | 6 hours | Water Surge | |
Naval Warnings | Event | n.a. | Naval report for warnings and forecasts | |
Naval Forcecast | Event | n.a. | Naval report for warnings and forecasts | |
Weather warnings | TimeSeries | 1 hour | Heat warning, Rain warning, | |
Waqua | Model TimeSeries | 10 minutes | Astronomical Tide, Total Water Level, Observations from WAQC_ODC, Water Surge | |
KNMI AWS Stations | TimeSeries | 10 minutes | Air Pressure, Dewpoint Temperature, Horizontal Visibility, | Tested |
Meteobase Makkink Evaporation Meteobase.Evaporation.Makkink | Grid | 1 day | Evaporation | |
Meteobase Makkink Evaporation Meteobase.Evaporation.PennmanMonteith | Grid | 1 day | Evaporation | |
Meteobase Precipitation Meteobase.Precipitation | Grid | 1 day | Evaporation |
Missing values.
If the WIWB specifies the missing value for a datasource, this will be used by FEWS. The missing value can also be specified in the import configuration as well. The default value for missing value is -9999 for the WIWB API.
Grid definitions
The WIWB API can provide the grid definitions of the models. The WIWB Import will log the Grid Definition if debug is enabled during the import.
View period
Where appropriate a viewPeriod can be configured. The view period can be no longer than one year, since the WIWP api doesn't support periods longer than that.
For model forecasts only the latest forecast will be downloaded.
Examples
This example is configured to import scalar observations from the Knmi.AwsTenMinutes dataSource:
<import> <general> <importType>WIWB</importType> <serverUrl>https://wiwb.hydronet.com/api</serverUrl> <user>$WIWB_USER$</user> <password>$WIWB_PW$</password> <relativeViewPeriod unit="hour" start="-120" end="0" startOverrulable="true"/> <idMapId>IdImportWIWB_obs</idMapId> <dataFeedId>WIWB (Knmi.AwsTenMinutes)</dataFeedId> </general> <properties> <string key="dataSource" value="Knmi.AwsTenMinutes"/> </properties> <timeSeriesSet> <moduleInstanceId>ImportKNMI</moduleInstanceId> <valueType>scalar</valueType> <parameterId>P.meting</parameterId> <locationSetId>KNMI-EVP</locationSetId> <timeSeriesType>external historical</timeSeriesType> <timeStep unit="minute" multiplier="10"/> <readWriteMode>add originals</readWriteMode> </timeSeriesSet> </import>
The following example is configured for importing grids from the Knmi.Radar.Uncorrected dataSource:
<import> <general> <importType>WIWB</importType> <serverUrl>https://wiwb.hydronet.com/api</serverUrl> <user>$WIWB_USER$</user> <password>$WIWB_PW$</password> <relativeViewPeriod unit="hour" start="-12" end="-10" startOverrulable="false"/> <idMapId>IdImportWIWB_obs</idMapId> <dataFeedId>WIWB (Knmi.Radar.Uncorrected)</dataFeedId> </general> <properties> <string key="dataSource" value="Knmi.Radar.Uncorrected"/> <string value="true" key="keepDownloadDataInTempFolder" /> </properties> <timeSeriesSet> <moduleInstanceId>ImportKNMI</moduleInstanceId> <valueType>grid</valueType> <parameterId>P.radar</parameterId> <qualifierId>realtime</qualifierId> <locationId>Hydronet_radar</locationId> <timeSeriesType>external historical</timeSeriesType> <timeStep unit="nonequidistant"/> <readWriteMode>add originals</readWriteMode> <synchLevel>6</synchLevel> </timeSeriesSet> </import>
Example of idMapping to some of the WIWB parameters in the IdImportWIWB_obs.xml file:
<idMap version="1.1" xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/idMap.xsd"> <parameter external="Evaporation" internal="E.meting"/> <parameter external="P" internal="P.meting"/> <parameter external="P" internal="P.radar" internalQualifier="realtime"/> <parameter external="WindDirection" internal="Wind.meting.richting"/> <parameter external="WindSpeed" internal="Wind.meting.snelheid"/> <parameter external="TMP" internal="T.meting"/> <location external="Hydronet_radar" internal="Hydronet_radar"/> <locationIdPattern internalLocationSet="KNMI-EVP" internalLocationPattern="KNMI_*" externalLocationPattern="06*"/> <enableOneToOneMapping/> </idMap>
Example of the grids.xml file for the KNMI Radar grid products
<?xml version="1.0" encoding="UTF-8"?> <grids xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/grids.xsd"> <regular locationId="knmi_radar_1km"> <rows>765</rows> <columns>700</columns> <polarStereographic> <originLatitude>90</originLatitude> <originLongitude>0</originLongitude> <trueScalingLatitude>60</trueScalingLatitude> <equatorRadius>6378137</equatorRadius> <poleRadius>6356752</poleRadius> </polarStereographic> <firstCellCenter> <x>500</x> <y>-3650500</y> <z>0</z> </firstCellCenter> <xCellSize>1000</xCellSize> <yCellSize>1000</yCellSize> </regular> </grids>