MSW import (MFPS)

Overview

Imports time series data from MSW CSV files that are delivered from MFPS. The files contain both observed levels and flows in the main Dutch rivers. The files have an extension of "*.csv".

Configuration (Example)

A complete import module configuration consists of an ID Mapping file and a Import Module Instance file. See the attached example configuration files.

ModuleConfigFiles/

The following example of an Import Module Instance will import the time series as equidistant daily series for timezone GMT+1 hour. Notice that FEWS should store the time at the end of the day. Therefore the import timezone should be -23:00 instead of +01:00.

ImportMSW.xml
  <import>
    <general>
      <importType>MSW</importType>
      <folder>$IMPORT_FOLDER_MSW$</folder>
      <failedFolder>$IMPORT_FAILED_FOLDER_MSW$</failedFolder>
      <backupFolder>$IMPORT_BACKUP_FOLDER_MSW$</backupFolder>
      <idMapId>IdImportMSW</idMapId>
      <unitConversionsId>ImportMSWUnits</unitConversionsId>
      <flagConversionsId>ImportMSWFlagConversions</flagConversionsId>
      <importTimeZone>
        <timeZoneOffset>+01:00</timeZoneOffset>
      </importTimeZone>
      <dataFeedId>MSW</dataFeedId>
      <reportChangedValues>true</reportChangedValues>
    </general>
    <timeSeriesSet>
      <moduleInstanceId>ImportMSW</moduleInstanceId>
      <valueType>scalar</valueType>
      <parameterId>H.meting</parameterId>
      <locationSetId>MSW_H</locationSetId>
      <timeSeriesType>external historical</timeSeriesType>
      <timeStep unit="hour"/>
      <readWriteMode>add originals</readWriteMode>
      <synchLevel>1</synchLevel>
    </timeSeriesSet>
    ....
    <externUnit parameterId="H.meting" unit="cm"/>
  </import>

UnitConversion

Important in this configuration is that a unitconversion should be forced to convert the waterlevels from cm to m NAP.

Example File/

BorghWaterhoogte.CSV
Databank=MSW
Locatie=BORD
Parameter=H10
Waarnemingsgroepcode=-
X_coordinaat=17638000
Y_coordinaat=32040000
2007/12/12;03:00;MET;cm NAP;30;4323
2007/12/12;03:10;MET;cm NAP;30;4324
2007/12/12;03:20;MET;cm NAP;30;4325
2007/12/12;03:30;MET;cm NAP;30;4326
2007/12/12;03:40;MET;cm NAP;30;4326
2007/12/12;03:50;MET;cm NAP;30;4327
2007/12/12;04:00;MET;cm NAP;30;4326
2007/12/12;04:10;MET;cm NAP;30;4326
2007/12/12;04:20;MET;cm NAP;30;4326
2007/12/12;04:30;MET;cm NAP;30;4327
2007/12/12;04:40;MET;cm NAP;30;4327
2007/12/12;04:50;MET;cm NAP;30;4327
2007/12/12;05:00;MET;cm NAP;30;4326
2007/12/12;05:10;MET;cm NAP;30;4326
2007/12/12;05:20;MET;cm NAP;30;4325
........

Java source code

MswTimeSeriesParser.java

  • No labels