...
| Property name | Type | Purpose | Note |
|---|---|---|---|
| s3Region | String | Specify the AWS import region if required, if not specified the region AWS_GLOBAL is used. | |
anonymousS3Credentials | Boolean | To make unauthenticated, anonymous requests to Amazon S3 using the AWS SDK, you must configure the client to bypass credential resolution. This is only supported for S3 buckets and objects that have been explicitly configured with public-read or anonymous access policies. | |
| s3forcePathStyle | Boolean | When true, force a path-style endpoint interpretation by the AWS SDK. To be used where the bucket name is part of the path. | |
variable_identification_method | string | For ECMWF import see This How-to page | For ECMWF import |
| s3endpointOverrideUrl | String | To be used when:
| https://docs.aws.amazon.com/sdk-for-java/latest/developer-guide/endpoint-config.html |
s3MaxForecastHours | int | To specify relative end time. When used the Import Routine will skip files outside the RVP endtime. see This How-to page |
| Code Block | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
<general>
<importType>NETCDF-CF_GRID_S3</importType>
<serverUrl>$EcmwfApiUrl$/ecmwf-forecasts/%TIME_ZERO(yyyyMMdd)%/%TIME_ZERO(HH)%z/ifs/0p25/$EcmwfDataSet$/</serverUrl>
<connectionTimeOutMillis>1200000</connectionTimeOutMillis>
<relativeViewPeriod unit="hour" start="$StartInHours$" end="$EndInHours$" startOverrulable="$StartOverrulable$" endOverrulable="$EndOverrulable$"/>
<idMapId>IdMapFromEcmwf</idMapId>
<unitConversionsId>ImportUnitConversions</unitConversionsId>
<importTimeZone>
<timeZoneName>GMT</timeZoneName>
</importTimeZone>
<dataFeedId>Ecmwf.$AnalysisTimeIdentifier$</dataFeedId>
<actionLogEventTypeId>New.Forecast.Ecmwf.$AnalysisTimeIdentifier$</actionLogEventTypeId>
<expiryTime unit="day" multiplier="$ExpiryTimeExternalForecastingGridInDays$"/>
</general>
<properties>
<int key="s3MaxForecastHours" value="$EndInHours$"/>
<bool key="anonymousS3Credentials" value="true"/>
<bool key="s3forcePathStyle" value="true"/>
<string key="variable_identification_method" value="grib2_parameter_code"/>
<string key="s3endpointOverrideUrl" value="$EcmwfApiUrl$"/>
</properties> |
Example for CMEMS data
| Code Block |
|---|
<serverUrl>https://s3.waw3-1.cloudferro.com/mdl-native-14/native/GLOBAL_ANALYSISFORECAST_PHY_001_024/cmems_mod_glo_phy_anfc_0.083deg_PT1H-m_202211/%DATE_TIME(yyyy)%/%DATE_TIME(MM)%</serverUrl> <fileNameObservationDateTimePattern>'glo12_rg_1h-m_'yyyyMMdd'?'</fileNameObservationDateTimePattern> <relativeViewPeriod unit="day" start="-10" end="0"/> |
...