Page History

...

Imports grid time series data from CMEMS NetCDF files. Data is imported per z-layer, cut into smaller time steps to avoid getting "data file too big" error.

Import Configuration

An example of the CMEMS import will be given here.

...

DATA_TYPE should be set to "HOURLY" for hourly data.
DATA_TYPE should be set to "DAILY" for daily data.
DATA_TYPE should be set to "MONTHLY" for monthly data.

Properties "product" and "service" are compulsory fields. Please fill them in exactly the same as it should b in the request url. (See the examples bellow.)

FEWS will automatically add x_lo, x_hi, y_lo, y_hi, z_lo, z_hi values to the url. The data will be extracted from the grid configuration. Please make sure that the configured grid layer depth (z-layer) matches exactly the z_lo layer values the library provides. If it is not an exact match the data request will be refuesd. The z_hi values will be calculated by fews (z_lo+0.01). Do not use more than two decimals to configure the layers.

Code Block

title	Z-layer configuration example
linenumbers	true

LAYER,Z
1,-0.49
8,-9.57
18,-47.37
23,-109.72
32,-541.08
36,-1062.43
46,-3992.48

The parameters needed will be added to the request url by FEWS. It uses the external paramter ID for this, so please make sure it matches the parameter that should be in the url exactly.

This example is configured to import 2D Hourly grids for the last 24 hours:

Code Block

borderStyle	solid
title	ImportNetcdf_Grid 1.00 default.xml

<?xml version="1.0" encoding="UTF-8"?>
<timeSeriesImportRun xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/timeSeriesImportRun.xsd">

	<import>
		<general>
			<importType>Cmems</importType>
			
<!--				
Make sure the parameters that are needed are added to the URL:
The following parameters are available:
	uo
	vo
	zos
	thetao
Also set the x, y, and z values:
	x_lo, x_hi, y_lo, y_hi, z_lo, z_hi
-->			
		<serverUrl>http://nrtcmems.mercator-ocean.fr/mis-gateway-servlet/Motu?product=global-analysis-forecast-phy-001-024-hourly-t-u-v-ssh&amp;service=http://purl.org/myocean/ontology/service/database%23GLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS&amp;variable=uo&amp;variable=vo&amp;variable=zos&amp;variable=thetao&amp;x_lo=43.0&amp;x_hi=65.0&amp;y_lo=8.0&amp;y_hi=28.0&amp;z_lo=0.494&amp;z_hi=5727.9171</action=productdownload</serverUrl>
			<user>USERNAME</user>
			<password>PASSWORD</password>
			<relativeViewPeriod unit="hour" start="-24" end="0" startOverrulable="true"/>
			<idMapId>IdImportCmems</idMapId>
			<unitConversionsId>ImportUnitConversions</unitConversionsId>
			<expiryTime unit="week" multiplier="500"/>
		</general>
		<properties>
			<string key="DATA_TYPE" value="HOURLY"></string>
			<string key="TICKET_URL" value="https://cmems-cas.cls.fr/cas/v1/tickets"></string>
		</properties>	<string key="product" value="global-analysis-forecast-phy-001-024-hourly-t-u-v-ssh"/>
		<timeSeriesSet>
			<moduleInstanceId>Import_E2O_Server</moduleInstanceId>
			<valueType>grid</valueType>
			<parameterId>Wind.u</parameterId>
			<locationId>CMEMS_2D</locationId>
			<timeSeriesType>external historical</timeSeriesType>
		    <timeStep unit="nonequidistant"/>
			<readWriteMode>add originals</readWriteMode>	<string key="service" value="http://purl.org/myocean/ontology/service/database%23GLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS"/>
		</timeSeriesSet>properties>
		<timeSeriesSet>
			<moduleInstanceId>Import_E2O_Server</moduleInstanceId>
			<valueType>grid</valueType>
			<parameterId>Wind.v<u</parameterId>
			<locationId>CMEMS<locationId>$LOOP_LOCATION_2D<ID$</locationId>
			<timeSeriesType>external historical</timeSeriesType>
			    <timeStep unit="nonequidistant"/>
			<readWriteMode>add originals</readWriteMode>
		</timeSeriesSet>		
	</import>
</timeSeriesImportRun></timeSer

...

The following example is configured for importing daily 3D grids:

Code Block

language	xml
linenumbers	true

	<import>
		<general>
			<importType>Cmems<<importType>CMEMS</importType>
			<serverUrl>http://nrtcmemsnrt.mercatorcmems-oceandu.freu/mismotu-gateway-servletweb/Motu?product=global-analysis-forecast-phy-001-024&amp;service=http://purl.org/myocean/ontology/service/database%23GLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS&amp;variable=thetao&amp;x_lo=30.0&amp;x_hi=79.0&amp;y_lo=7.0&amp;y_hi=31.0&amp;z_lo=0.494&amp;z_hi=5727.9171</serverUrl>
            action=productdownload</serverUrl>
			<connectionTimeOutMillis>300000</connectionTimeOutMillis>
			<user><<user>$CMEMS_USER$</user>
			<password><<password>$CMEMS_PASSWORD$</password>
			<relativeViewPeriod unit="day" start="-12" end="110" startOverrulable="true"/>
			<idMapId>IdImport_CMEMS</idMapId>
			<maximumVerticalSnapDistance>0.1</maximumVerticalSnapDistance>
			<unitConversionsId>ImportUnitConversions</unitConversionsId>
			<expiryTime unit="day" multiplier="356"/><dataFeedId>CMEMS_3D</dataFeedId>
		</general>
		<properties>
			<string key="DATA_TYPE" value="DAILY"/>
			<string key="TICKET_URL" value="https://cmems-cas.cls.fr/cas/v1/tickets"/>
			<string key="DATA_TYPE"product" value="global-analysis-forecast-phy-001-024"/>
			<string key="service" value="DAILYGLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS"/>
		</properties>
		<timeSeriesSet>
			<moduleInstanceId>Import_CMEMS<CMEMS_3D</moduleInstanceId>
			<valueType>grid</valueType>
			<parameterId>T.simulated.CMEMS<simulated</parameterId>
			<locationId>CMEMS<locationId>$LOOP_LOCATION_3D<ID$</locationId>
			<timeSeriesType>external forecasting<historical</timeSeriesType>
			<timeStep unit="nonequidistant"/>
			<readWriteMode>add originals</readWriteMode>
			<expiryTime unit="day" multiplier="$EXPIRY_DAYS_EXTERNAL_FORECAST_GRID$"/>
		</timeSeriesSet>
	</import>

...

The following example is configured for importing monthly 3D grids:

Code Block

language	xml
linenumbers	true

	<import>
		<general>
			<importType>Cmems</importType>
			<serverUrl>http://nrtcmems.mercator-ocean.fr/mis-gateway-servlet/Motu?product=global-analysis-forecast-phy-001-024-monthly&amp;service=http://purl.org/myocean/ontology/service/database%23GLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS&amp;variable=thetao&amp;x_lo=30.0&amp;x_hi=79.0&amp;y_lo=7.0&amp;y_hi=31.0&amp;z_lo=0.494&amp;z_hi=5727.9171</action=productdownload</serverUrl>
            <connectionTimeOutMillis>300000</connectionTimeOutMillis>
			<user><<user>$CMEMS_USER$</user>
			<password><<password>$CMEMS_PASSWORD$</password>
			<relativeViewPeriod unit="day" start="-1" end="1" startOverrulable="true"/>
			<idMapId>IdImport_CMEMS</idMapId>
			<unitConversionsId>ImportUnitConversions</unitConversionsId>
			<expiryTime unit="day" multiplier="356"/>
		</general>
		<properties>
			<string key="TICKET_URL" value="https://cmems-cas.cls.fr/cas/v1/tickets"/>
			<string key="DATA_TYPE" value="MONTHLY"/>
			<string key="product" value="global-analysis-forecast-phy-001-024-monthly"/>
			<string key="service" value="http://purl.org/myocean/ontology/service/database%23GLOBAL_ANALYSIS_FORECAST_PHY_001_024-TDS"/>
		</properties>
		<timeSeriesSet>
			<moduleInstanceId>Import_CMEMS</moduleInstanceId>
			<valueType>grid</valueType>
			<parameterId>T.simulated.CMEMS</parameterId>
			<locationId>CMEMS<locationId>$LOOP_LOCATION_3D<ID$</locationId>
			<timeSeriesType>external forecasting</timeSeriesType>
			<timeStep unit="nonequidistant"/>
			<readWriteMode>add originals</readWriteMode>
		</timeSeriesSet>
	</import>

...

Page tree

Versions Compared

Old Version 6

New Version 7

Key

Import Configuration