Contents
Table of Contents |
---|
Overview
Imports time series data from the Microsoft Access database file.
...
Info | ||
---|---|---|
| ||
Tmx database (mdb) may contain data for both digital and analog types of data. |
ModuleConfigFiles/
Time series which are listed in this file can be imported into fews.
...
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
<idMap xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.wldelft.nl/fews ..\..\..\..\..\..\..\..\..\..\..\xml-schemas\idMap.xsd" version="1.1"> <!-- analog --> <map internalParameter="P1.m" internalLocation="tmx_location1" externalParameter="Ai1" externalLocation="Loc063" /> <map internalParameter="P2.m" internalLocation="tmx_location1" externalParameter="Ao1" externalLocation="Loc063" /> <!-- digital --> <map internalParameter="P3.m" internalLocation="tmx_location2" externalParameter="1" externalLocation="46" externalParameterQualifier="ReportAo" /> <map internalParameter="P3.m" internalLocation="tmx_location3" externalParameter="1" externalLocation="51" externalParameterQualifier="ReportAo" /> </idMap> |
Import of TMX in CSV file format
The importtype is called TmxCsv
1. Missing values
If string can not be parsed as a number it is assumed as a missing value,
e.g.: "---", "???", ">>>", "<<<"
Example:
Datum;Tijd;Ai8;Ai1;Ai3;Ai2;Ai7;Ai9
;;Gem;Gem;Gem;Gem;Gem;Gem
25-05-2005;12:00;16.257;15.958;16.135;15.026;15.513
25-05-2005;13:00;16.257;15.958;16.135;15.026;15.507
25-05-2005;14:00;--;-;-;-;--
25-05-2005;15:00;16.257;15.958;16.135;15.026;15.494
...
09-01-2006;01:00;1.648;?;?;?;?;???
09-01-2006;02:00;0.399;12.743;12.606;12.333;?;?
...
27-08-2007;01:00;>>>;>>>;>>>;>>>;>>>;>>>
27-08-2007;02:00;<<<;<<<;<<<;<<<;<<<;<<<
...
2. Date and time format
It is assumed that date and time comes always in the "DD-MM-YYYY hh:mm" format. Since december 2008 also the time format of "DD-MM-YYYY hh:mm:ss" (with seconds) supported.
TimeZone can be used in the configuration file to set an offset.
3. 2nd line
2nd line containing ";;Gem;Gem;Gem;Gem;Gem;Gem" is always skipped.
4. Reader also assumes Date and Time always come as a 1st and 2nd columns.
5. File naming convention
TMX CSV files to be imported by FEWS should be in the following format:
No Format |
---|
<location> anything else.csv |
- Location should be at the first position and should be the same as location defined in the idMap.xml
- Location must be separated by " " - space from the rest of file or ".csv", for example:
File Name | Valid |
---|---|
location1 01-01-2007.csv |
|
location1.csv |
|
location1 .csv |
|
location1_01012007.csv |
|
location101012007.csv |
|
6. Two new warnings have been added to this import:
The systems gives a warning when data in the database is overwritten by new data:
- 29.02.2008 08:52:04 WARN - Timeseries.Changed: ModuleInstance=ImportTMX, locationId=0002_boven, parameterId=H.meting, timestep=10minutes, period=2006-01-01 00:40:00 - 2006-01-31 23:10:00, number of timesteps changed 744
The system gives a warning when multiple series are imported for one location-parameter combination:
- 29.02.2008 09:07:45 WARN - Multiple time series sets found for parameter-internal/external=H.meting/Ai2 location-internal/external=WAM0400_afwat_kan/WAM0400 ensemble member main$0