Overview
This import is available in DELFT-FEWS versions after 28-10-2008
Imports time series data in ASCII format from MATROOS Forecast databases. The import reader creaters PhP URL's for direct data retrieving from Matroos. There are three types of NOOS URL's supported by the NOOS import function:
- get_series.php for direct retrieval of scalar time series.
- get_maps1d_series.php for retrieval of scalar time series from the Matroos maps1d database.
- get_map2series.php for retrieval of scalar time series from the Matroos map data, interpolated in space
More information on the retrieval of time series from Matroos can be found on: http://matroos.deltares.nl/direct/index.html
For the three types of series retrieval URL's three import readers have been made in FEWS:
- noos_timeseries
- noos_1dmapseries
- noos_mapseries
Configuring the Import
An example of the noos_timeseries configuration will be given here. The reader is named noos_timeseries which should be configured in the general section of the import. The general section must also contain the server URL and a correct username and password if you need to log-in. The relativeViewPeriod in the general section is used to select the period to retrieve data for.
Special attention should be given to the timezone; FEWS restrieves all Noos data from hte Matroos database in GMT.
An example import configuration is shown below:
<?xml version="1.0" encoding="UTF-8"?> <timeSeriesImportRun xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/timeSeriesImportRun.xsd"> <import> <general> <importType>noos_timeseries</importType> <serverUrl>http://matroos.deltares.nl/direct</serverUrl> <user>XXX</user> <password>YYYY</password> <relativeViewPeriod unit="hour" start="-12" end="36" startOverrulable="true" endOverrulable="true"/> <idMapId>IdImportMatroos</idMapId> <unitConversionsId>ImportUnitConversions</unitConversionsId> <importTimeZone> <timeZoneOffset>+00:00</timeZoneOffset> </importTimeZone> <dataFeedId>Matroos</dataFeedId> </general> <timeSeriesSet> <moduleInstanceId>ImportMatroos</moduleInstanceId> <valueType>scalar</valueType> <parameterId>H.astronomisch</parameterId> <locationId>hoekvanholland</locationId> <timeSeriesType>external historical</timeSeriesType> <timeStep unit="minute" multiplier="10"/> <readWriteMode>add originals</readWriteMode> <synchLevel>1</synchLevel> </timeSeriesSet> </import> </timeSeriesImportRun>
When a locationSet or multiple time series sets are configured in the import module instance, the Noos readers will construct URL's for each time series and retreive the data from the Matroos database sequentially. An improvement of the import readers could be to construct a more complex URL and retreive the data for multiple time series in one URL query.
The IdMapping configuration is very important because this maps the internal FEWS Id's to the Matroos Id's. In the IdMapping the following FEWS and Matroos elements are mapped:
- the FEWS externalLocation is used to map the Matroos loc or node element
- the FEWS externalParameter is used to map the Matroos unit element
- the FEWS externalParameterQualifier is used to map the Matroos source element
In case the noos_mapseries reader is used, the FEWS externalLocation is used to map a fews Matroos loc elements, namely coordsys, x and y.
An example IdMapping file for the noos_timeseries and noos_1dmapseries readers is shown below:
<?xml version="1.0" encoding="UTF-8"?> <idMap version="1.1" xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/idMap.xsd"> <map internalParameter="H.astronomisch" internalLocation="hoekvanholland" externalLocation="hoekvanholland" externalParameter="waterlevel_astro" externalParameterQualifier="observed"/> </idMap>
An example IdMapping file for the noos_mapseries reader is shown below:
<?xml version="1.0" encoding="UTF-8"?> <idMap version="1.1" xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/idMap.xsd"> <map internalParameter="H.astronomisch" internalLocation="hoekvanholland" externalLocation="coordsys=RD&x=52670&y=449847" externalParameter="waterlevel_astro" externalParameterQualifier="observed"/> </idMap>
The NOOS file format
#------------------------------------------------------ # Timeseries retrieved from the MATROOS maps1d database # Created at Tue Oct 28 20:33:51 CET 2008 #------------------------------------------------------ # Location : MAMO001_0 # Position : (64040,444970) # Source : sobek_hmr # Unit : waterlevel # Analyse time: 200709020100 # Timezone : MET #------------------------------------------------------ 200709010000 -0.387653201818466 200709010010 -0.395031750202179 200709010020 -0.407451331615448 200709010030 -0.414252400398254 200709010040 -0.425763547420502 200709010050 -0.43956795334816 200709010100 -0.309808939695358 200709010110 -0.297703713178635 200709010120 -0.289261430501938 200709010130 -0.256232291460037