Versions Compared

Old Version 42

changes.mady.by.user Onno van den Akker

Saved on

compared with

New Version 43

changes.mady.by.user Rudie Ekkelenkamp

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

scrollbar
What
nameofinstance.xml
Description
Configuration for import module
schema location
http://fews.wldelft.nl/schemas/version1.0/timeSeriesImportRun.xsd
Entry in ModuleDescriptors
<moduleDescriptor id="TimeSeriesImportRun"> 
 <description>Import module to import timeseries from the various grid-formats ie GRIB format</description> 
 <className>nl.wldelft.fews.system.plugin.dataImport.TimeSeriesImport</className> 
 </moduleDescriptor>
 Table of Contents
Time Series Import Module
...
JDBC example:
 Code Block
xml
xml

<general>
      <importTypeStandard>database</importTypeStandard>
      <jdbcDriverClass>com.mysql.jdbc.Driver</jdbcDriverClass>
      <jdbcConnectionString>jdbc:mysql://192.168.101.215/cwb_ac</jdbcConnectionString>
      <user>sobek</user>
      <password>Tohek>cwa</password>
      <relativeViewPeriod startOverrulable="true" endOverrulable="true" start="-1" end="1" unit="day"/>
      <table name="qpe_sums_obs">
        <dateTimeColumn name="rehdate"/>
        <valueColumn name="rad_gz" unit="mm/hr" locationId="Qesums" parameterId="P.radar.actual" parser="Mosaic"/>
      </table>
      <table name="qpe_sums_fo">
        <forecastDateTimeColumn name="createdate"/>
        <dateTimeColumn name="raddate"/>
        <valueColumn name="rad_gz" unit="mm/hr" locationId="Qpesums" parameterId="P.radar.forecast" parser="Mosaic"/>
      </table>
      <unitConversionsId>ImportUnitConversions</unitConversionsId>
      <importTimeZone>
        <timeZoneOffset>+00:00</timeZoneOffset>
      </importTimeZone>
      <dataFeedId>QPE_Sum</dataFeedId>
    </general>

sftp example:
 Code Block
xml
xml

<general>
      <importType>TypicalAsciiForecast</importType>
      <folder>sftp://wf:2004wrf@130.167.66.114:22/home/WRF</folder>
      <relativeViewPeriod startOverrulable="true" endOverrulable="true" start="-1" end="3" unit="day"/>
      <unitConversionsId>ImportUnitConversions</unitConversionsId>
      <importTimeZone>
        <timeZoneOffset>+00:00</timeZoneOffset>
      </importTimeZone>
      <dataFeedId>Forecast</dataFeedId>
    </general>

http example:
 Code Block
xml
xml

<general>
      <importType>RemoteServer</importType>
      <serverUrl>http://192.168.65.12:8002</serverUrl>
      <relativeViewPeriod startOverrulable="true" endOverrulable="true" start="-1" end="0" unit="day"/>
      <idMapId>IdImportRO</idMapId>
      <importTimeZone>
        <timeZoneOffset>+10:00</timeZoneOffset>
      </importTimeZone>
      <dataFeedId>RO</dataFeedId>
    </general>

When using the serverUrl (http), then it is also possible to use tags in the serverUrl. Tags should be separated by "%" signs. The following tags can be used in this URL. %TIME_ZERO(dateFormat)% is replaced with the time zero of the import run. The time zero is formatted using the dateFormat that is specified between the brackets. For example %TIME_ZERO(yyyyMMdd)% would be replaced with the year, month and day of the time zero. %RELATIVE_TIME_IN_SECONDS(dateFormat,relativeTime)% is replaced with time = (time0 + relativeTime), where time0 is the time zero of the import run and relativeTime is a time relative to time0 in seconds (can be negative). The time is formatted using the dateFormat that is specified as the first argument between the brackets. For example %RELATIVE_TIME_IN_SECONDS(yyyyMMdd,-18000)% would be replaced with the year, month and day of time = time0 - 18000 seconds. Examples of serverUrls with tags in it:
 No Format

<serverUrl>http://nomads.ncep.noaa.gov:9090/dods/gfs/gfs%TIME_ZERO(yyyyMMdd)%/gfs_%TIME_ZERO(HH)%z</serverUrl>

 No Format

<serverUrl>http://nomads.ncep.noaa.gov:9090/dods/gfs/gfs%RELATIVE_TIME_IN_SECONDS(yyyyMMdd, -18000 )%/gfs_%RELATIVE_TIME_IN_SECONDS(HH,-18000)%z</serverUrl>

...
fileNameObservationDateTimePattern
'IMAGE_'yyyyMMdd_HHmmss'.jpg' This will overrule the observation time stored in the file, some grid formats don't contain the time at all, so for these files the pattern is required. Put the literal parts of the pattern between single quotes.
...
Meteosat Images are generally imported as images in [filename].png format. The Meteosat images constitute a time series of png images, that are geo-referenced by means of a specific world file. Each image needs its own world file, which in case of PNG carries the extension [filename].pgw .
 Import of images in another format, such as JPEG is also possible. The corresponding world file for a JPEG file has the extension [filename].jpg .
 The images are imported via a common time series import, for which a specific image parameter needs to be specified in a parameterGroup via the parameter id image .
 Code Block
xml
xml

<parameterGroup id="image">
       <parameterType>instantaneous</parameterType>
       <unit>-</unit>
       <valueResolution>8</valueResolution>
       <parameter id="image">
       <shortName>image</shortName>
       </parameter>
</parameterGroup>

The value resolution indicates the resolution of the values of the pixels (grey tones) in the Meteosat images. In this case 8 grey tones are resampled into a single grey tone for storage space reductions. In the module for the timemeseries import run for a Meteosat image the import is then configured as follows:
 Code Block
xml
xml

<import>
    <general>
        <importType>GrayScaleImage</importType>
        <folder>$REGIONHOME$/Import/MeteoSat</folder>
             <idMapId>IdImportMeteosat</idMapId>
    </general>

    <timeSeriesSet>
        <moduleInstanceId>ImportMeteosat</moduleInstanceId>
        <valueType>grid</valueType>
        <parameterId>image</parameterId>
        <locationId>meteosat</locationId>
        <timeSeriesType>external historical</timeSeriesType>
        <timeStep unit="minute" multiplier="15"/>
        <readWriteMode>add originals</readWriteMode>
        <synchLevel>4</synchLevel>
        <expiryTime unit="day" multiplier="750"/>
   </timeSeriesSet>
</import>

...