Overview

This import is available in DELFT-FEWS versions after 2008.03

There is also an UMAQUO version of this import: link

Imports time series data in csv format, specially added for some of the Dutch Waterboards. This import format has some special features compared to other time series import formats. Water quality is mostly analysed from a sample, there fore the sample id is a required field in this file. The data is seperated by a ";" and contains 15 columns with data. Because the data files do not contain any information on the content of the different columns, the layout and number of columns is fixed.

Column

Content

1

Sample ID

2

Location ID

3

Location name (not used on importing)

4

X-coordinate (not used on importing)

5

Y-coordinate (not used on importing)

6

Date (format "dd-mm-yyyy")

7

Time (format "hh-mm-ss")

8

Parameter name (not used on importing)

9

Extra Parameter Info (not used on importing)

10

Label / Detection Flag (can be < or > )

11

Value

12

Extra Parameter Info (not used on importing)

13

Unit

14

Hoedanigheid (not used on importing)

15

Parameter ID

The Location ID's, Parameter ID's and Units can be converted to DELFT-FEWS ID's and units using the different mapping tables.

Configuring the Import

The reader is named WQCSV which should be configured in the general section of the import. An example import configuration is shown below:

<?xml version="1.0" encoding="UTF-8"?>
<timeSeriesImportRun xmlns="http://www.wldelft.nl/fews"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.wldelft.nl/fews
http://fews.wldelft.nl/schemas/version1.0/timeSeriesImportRun.xsd">
	<import>
		<general>
			<importType>WQCSV</importType>
			<folder>$IMPORT_FOLDER_WQCSV$</folder>
			<failedFolder>$IMPORT_FAILED_FOLDER_WQCSV$</failedFolder>
			<backupFolder>$IMPORT_BACKUP_FOLDER_WQCSV$</backupFolder>
			<idMapId>IdImportWQCSV</idMapId>
			<unitConversionsId>ImportUnitConversions</unitConversionsId>
			<importTimeZone>
				<timeZoneOffset>+01:00</timeZoneOffset>
			</importTimeZone>
			<dataFeedId>WQCSV</dataFeedId>
		</general>
		<timeSeriesSet>
			<moduleInstanceId>ImportWQCSV</moduleInstanceId>
			<valueType>sample</valueType>
			<parameterId>ZS</parameterId>
			<locationSetId>WQLocaties</locationSetId>
			<timeSeriesType>external historical</timeSeriesType>
			<timeStep unit="nonequidistant"/>
			<readWriteMode>add originals</readWriteMode>
			<synchLevel>1</synchLevel>
		</timeSeriesSet>
		<timeSeriesSet>
			<moduleInstanceId>ImportWQCSV</moduleInstanceId>
			<valueType>sample</valueType>
			<parameterId>BZV4</parameterId>
			<locationSetId>WQLocaties</locationSetId>
			<timeSeriesType>external historical</timeSeriesType>
			<timeStep unit="nonequidistant"/>
			<readWriteMode>add originals</readWriteMode>
			<synchLevel>1</synchLevel>
		</timeSeriesSet>
		<timeSeriesSet>
			<moduleInstanceId>ImportWQCSV</moduleInstanceId>
			<valueType>sample</valueType>
			<parameterId>BZV1</parameterId>
			<locationSetId>WQLocaties</locationSetId>
			<timeSeriesType>external historical</timeSeriesType>
			<timeStep unit="nonequidistant"/>
			<readWriteMode>add originals</readWriteMode>
			<synchLevel>1</synchLevel>
		</timeSeriesSet>
	</import>
</timeSeriesImportRun>

The file format

The file format is just plain ASCII with the columns seperated by a semicolon ";"

Example:

2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;Afvoer geschat l/s;;;15;NVT;l/s;OW;afGeschat
2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;Afvoer l/s;;;n.b.;NVT;l/s;OW;afL/s
2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;Ammonium-N;NH4;;0,2;N;mg/l;OW;NH4
2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;BZV met Atu/5 dagen;BZV5;<;1;O2;mg/l;OW;BZV1
2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;Cadmium (Cd);Cd;;0,088;NVT;ug/l;OW;Cd2W
2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;Calcium (Ca);Ca;;36;NVT;mg/l;OW;Ca2W
2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;Chloride;Cl;;14;NVT;mg/l;OW;Cl
2006010177;OGANS900;Gansbeek Schelkenspoort;204.22;367.63;09-01-2006;10:30:00;Chroom (Cr);Cr;;1,2;NVT;ug/l;OW;Cr2W

Note:

  • Make sure the date and time formats are correct (dd-mm-yyyy and hh-mm-ss).
  • Make sure each line has only 15 columns with 14 ";" characters separating the columns.
  • Only columns 1, 2, 6, 7, 10, 11, 13 and 15 are required, all other columns can be left empty.

java source code

WQCSVTimeSeriesParser.java

  • No labels

Disclaimer