View Source

Overview

The DHI_PRESA import function (<importType>DHI_PRESA</importType>) imports external historical time series from a specific CSV files for FEWS Basque. Since the csv data is specified in local time format, a timezone has to be configured in the importer:

<importTimeZone>
<timeZoneName>CET</timeZoneName>
</importTimeZone>

These files are received each 3-5 minutes. During one day they comprise all the intervals of the day, which means that each 3-5 minutes they are overwritten including all the intervals of the day till the time of sending.
Their name gives the date.
Time is local (i.e. +2 hr GMT in summer and +1hr GMT in winter)
Each line of the file represents one interval with several signals
There are 27 fields per line separated by “,” Values are given with decimal point.
The first field contains the date and time. The following 26 fields contain the signal values.
The first row contains the names of the signals. Each signal name contains a combination of parameters and locations. The following table shows the mapping of signal name to parameter id and location id. Signals where no parameter and location are specified, should be ignored.

Signal name	parameter id	location id
CONDU_E01A10C197QAL37	QAL37	E01A10
CONDU_E01A10C189QAL34	QAL34	E01A10
CONDU_E01A10C183QAL32	QAL32	E01A10
CONDU_E01A09D166NEMBA2	NEMBA2	E01A09
CONDU_E01A09C167PORCE
CONDU_E01A09C166VEMBA	VEMBA	E01A09
CONDU_E01A09C162QAL24	QAL24	E01A09
CONDU_E01A09C156QAL22	QAL22	E01A09
CONDU_E01A05C68QALI3	QALI3	E01A05
CONDU_E01A05C64QAL12	QAL12	E01A05
CONDU_E01A05C60QALI1	QALI1	E01A05
CONDU_E01A01D7PLU	PLU	E01A01
CONDU_CAI_MB_QENT	QENT	CAI_MB
CONDU_CAI_MB_QCAN	QCAN	CAI_MB
CONDU_CAI_MB_PACT
CONDU_APIL_AE_NIV	NIV	APIL_AE
CONDU_AFOR_AI_QAFO	QAFO	AFOR_AI
CONDU_AFOR_AE_QCAN	QCAN	AFOR_AE
CONDU_AFOR_AE_NIVRR	NIVRR	AFOR_AE
CONDU_AFOR_AE_NIVR	NIVR	AFOR_AE
CONDU_AFOR_AE_NIVC	NIVC	AFOR_AE
CONDU_AERE_AI_QA	QA	AERE_AI
CONDU_AERE_AE_QC	QC	AERE_AE
CONDU_AERE_AE_NIVC	NIVC	AERE_AE
CONDU_AERE_AE_NAF2	NAF2	AERE_AE
CONDU_AERE_AE_NAF1	NAF1	AERE_AE

Configuring the Import

To make the importer known to FEWS, the import module has to be declared in the moduleInstanceDescriptors.xml in the RegionConfigFiles directory of the FEWS configuration:

<?xml version="1.0" encoding="UTF-8"?>
<moduleInstanceDescriptors xmlns="http://www.wldelft.nl/fews"
		xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
		xsi:schemaLocation="http://www.wldelft.nl/fews
		http://fews.wldelft.nl/schemas/version1.0/moduleInstanceDescriptors.xsd" version="1.0">
...
	<moduleInstanceDescriptor id="ImportDhiPresa">
		<moduleId>TimeSeriesImportRun</moduleId>
	</moduleInstanceDescriptor>
...
</moduleInstanceDescriptors>

An example of the DHI_PRESA import configuration will be given here. The importType is named DHI_PRESA which should be configured in the general section of the import.
Special attention should be given to the timezone since DHI_PRESA data is stored in local time;

<?xml version="1.0" encoding="UTF-8"?>
<timeSeriesImportRun xmlns="http://www.wldelft.nl/fews" 
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" 
	xsi:schemaLocation="http://www.wldelft.nl/fews 
	http://fews.wldelft.nl/schemas/version1.0/timeSeriesImportRun.xsd">
	<import>
		<general>
			<importType>DHI_PRESA</importType>
			<folder>$IMPORT_FOLDER$/import/dhi_presa</folder>
			<idMapId>dhiPresaMapId</idMapId>
			<importTimeZone>
				<timeZoneName>CET</timeZoneName>
			</importTimeZone>
		</general>
		<timeSeriesSet>
			<moduleInstanceId>ImportDhiPresa</moduleInstanceId>
			<valueType>scalar</valueType>
			<parameterId>Q.m</parameterId>
			<locationId>FewsLocation</locationId>
			<timeSeriesType>external historical</timeSeriesType>
			<timeStep unit="second" multiplier="1"/>
			<relativeViewPeriod unit="minute" start="0" end="10"/>
			<readWriteMode>add originals</readWriteMode>
		</timeSeriesSet>
	</import>
</timeSeriesImportRun>

The IdMapping configuration dhiPresMapId.xml is very important because this maps the internal FEWS Id's to the DHI_PRESA Id's. An example IdMapping file for the DHI_PRESA importer is shown below.:

<?xml version="1.0" encoding="UTF-8"?>
<idMap version="1.1" xmlns="http://www.wldelft.nl/fews"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.wldelft.nl/fews
http://fews.wldelft.nl/schemas/version1.0/idMap.xsd">
	....
	<parameter internal="Q.m" external="NEMBA2"/>

	<location internal="FewsLocation" external="E01A09"/>
	....
</idMap>

Example DHI_PRESA file

Date_and_Time,CONDU_E01A10C197QAL37,CONDU_E01A10C189QAL34,CONDU_E01A10C183QAL32,CONDU_E01A09D166NEMBA2,CONDU_E01A09C167PORCE,CONDU_E01A09C166VEMBA,CONDU_E01A09C162QAL24,CONDU_E01A09C156QAL22,CONDU_E01A05C68QALI3,CONDU_E01A05C64QAL12,CONDU_E01A05C60QALI1,CONDU_E01A01D7PLU,CONDU_CAI_MB_QENT,CONDU_CAI_MB_QCAN,CONDU_CAI_MB_PACT,CONDU_APIL_AE_NIV,CONDU_AFOR_AI_QAFO,CONDU_AFOR_AE_QCAN,CONDU_AFOR_AE_NIVRR,CONDU_AFOR_AE_NIVR,CONDU_AFOR_AE_NIVC,CONDU_AERE_AI_QA,CONDU_AERE_AE_QC,CONDU_AERE_AE_NIVC,CONDU_AERE_AE_NAF2,CONDU_AERE_AE_NAF1
2014-05-05 00:00:48,0.000000,0.000000,0.000000,153.480000,89.978073,33.543484,0.000000,0.000000,0.000000,0.000000,0.000000,0.000000,1796.000000,845.000000,821.000000,0.000000,0.000000,1422.000000,0.434000,0.449000,0.966000,6.711419,6.119000,1.530000,0.542000,0.510000
2014-05-05 00:04:19,0.000000,0.000000,0.000000,153.480000,89.978073,33.543484,0.000000,0.000000,0.000000,0.000000,0.000000,0.000000,1789.000000,849.000000,831.000000,0.000000,1.770736,1431.000000,0.440000,0.453000,0.964000,6.448431,5.892000,1.530000,0.542000,0.500000