Overview
Imports time series data with forecasts from the KNMI that are delivered to the Dutch waterboards. The files contain the next 52 forecasts:
- deterministic forecast
- control run
- ensemble forecast of 50 members.
See KNMI site for information on all possible parameters and locations EPS. Two forecasts are supported: a forecast of 10 days and the forecast of 15 days. Notice that the forecast of 15 days still contains a 10 day deterministic forecast only.
Notice that the rainfall forecast is supplied as an accumulative time series in 0.1 mm. All time series have a 6 hourly time step in GMT.
A complete forecast is supplied as a zipfile that contains individual files for each location. In each file the forecast timeseries for a list of parameters are suppplied.
Example: the file "ECME_VEN_2007102912.zip" contains the next list of files:
- ECME_VEN_200710291200_NL001_LC
- ECME_VEN_200710291200_NL002_LC
- ECME_VEN_200710291200_NL004_LC
- ECME_VEN_200710291200_NL009_LC
- ECME_VEN_200710291200_NL011_LC
- ECME_VEN_200710291200_NL012_LC
- ECME_VEN_200710291200_NL015_LC
- ECME_VEN_200710291200_NL018_LC
- ECME_VEN_200710291200_NL020_LC
for the stations NL001, NL002 etc. at forecast time 2007-10-29 12:00.
Configuration (Example)
A complete import module configuration consists of an ID Mapping file and a Import Module Instance file. To convert the rainfall in a proper unit (from 0.1 mm per 6 hour to mm/hr for example) it is also required to configure a Unit Conversion file.
ModuleConfigFiles
The following example of an Import Module Instance will import the time series as equidistant series for timezone GMT with a time step of 6 hours.
<?xml version="1.0" encoding="UTF-8"?>
<timeSeriesImportRun ......">
<import>
<general>
<importType>KNMIEPS</importType>
<folder>$IMPORT_FOLDER_KNMI_EPS$</folder>
<failedFolder>$IMPORT_FAILED_FOLDER_KNMI_EPS$</failedFolder>
<backupFolder>$IMPORT_BACKUP_FOLDER_KNMI_EPS$</backupFolder>
<idMapId>IdImportEPS</idMapId>
<unitConversionsId>ImportKNMIUnits</unitConversionsId>
<importTimeZone>
<!--EPS is in GMT-->
<timeZoneOffset>+00:00</timeZoneOffset>
</importTimeZone>
<dataFeedId>KNMI-EPS</dataFeedId>
</general>
<timeSeriesSet>
<moduleInstanceId>ImportKNMI</moduleInstanceId>
<valueType>scalar</valueType>
<parameterId>P.voorsp.ens</parameterId>
<locationSetId>KNMI-EPS</locationSetId>
<timeSeriesType>external forecasting</timeSeriesType>
<timeStep unit="hour" multiplier="6"/>
<readWriteMode>add originals</readWriteMode>
<synchLevel>1</synchLevel>
<ensembleId>EPS</ensembleId>
</timeSeriesSet>
<timeSeriesSet>
<moduleInstanceId>ImportKNMI</moduleInstanceId>
<valueType>scalar</valueType>
<parameterId>P.voorsp.ctr</parameterId>
<locationSetId>KNMI-EPS</locationSetId>
<timeSeriesType>external forecasting</timeSeriesType>
<timeStep unit="hour" multiplier="6"/>
<readWriteMode>add originals</readWriteMode>
<synchLevel>1</synchLevel>
</timeSeriesSet>
<timeSeriesSet>
<moduleInstanceId>ImportKNMI</moduleInstanceId>
<valueType>scalar</valueType>
<parameterId>P.voorsp.det</parameterId>
<locationSetId>KNMI-EPS</locationSetId>
<timeSeriesType>external forecasting</timeSeriesType>
<timeStep unit="hour" multiplier="6"/>
<readWriteMode>add originals</readWriteMode>
<synchLevel>1</synchLevel>
</timeSeriesSet>
<!--to let the import module know that the KNMI rainfall is an accumulative timeseries
in 0.1 mm/hr that should be disaggrated and converted to for example mm/hr-->
<externUnit parameterId="P.voorsp.ens" unit="0.1 mm/6hr" cumulativeSum="true"/>
<externUnit parameterId="P.voorsp.ctr" unit="0.1 mm/6hr" cumulativeSum="true"/>
<externUnit parameterId="P.voorsp.det" unit="0.1 mm/6hr" cumulativeSum="true"/>
</import>
</timeSeriesImportRun>
IdMapFiles
Defines mappings between KNMI and FEWS parameters and locations.
<idMap version="1.1" ..............> <parameter external="13011_deterministic" internal="P.voorsp.det"/> <parameter external="13011_control" internal="P.voorsp.ctr"/> <parameter external="13011_ensemble" internal="P.voorsp.ens"/> <location external="NL001" internal="KNMI_NL001"/> <location external="NL002" internal="KNMI_NL002"/> <location external="NL004" internal="KNMI_NL004"/> <location external="NL009" internal="KNMI_NL009"/> <location external="NL011" internal="KNMI_NL011"/> <location external="NL012" internal="KNMI_NL012"/> <location external="NL015" internal="KNMI_NL015"/> <location external="NL018" internal="KNMI_NL018"/> <location external="NL020" internal="KNMI_NL020"/> </idMap>
Important in this configuration is the externalParameter is manipulated to identify the deterministic, control and ensemble forecasts. Therefore the import module generates automatically a suffix to the parameter ID in the import files. If the import file contains a parameter "13011" for rainfall, the import generates the next externalParameters: "13011_deterministic", "13011_control" and "13011_ensemble".
UnitConversionFile
Defines the conversion of the units that should be applied.
<?xml version="1.0" encoding="UTF-8"?>
<unitConversions ...................>
<unitConversion>
<inputUnitType>0.1 mm/6hr</inputUnitType>
<outputUnitType>mm/hr</outputUnitType>
<multiplier>0.01666667</multiplier>
<incrementer>0</incrementer>
</unitConversion>
........
........
</unitConversions>
