...
Directory to export module datasets from Delft-FEWS to the external module. A module dataset is a ZIP file, which will be unzipped using this directory as the root directory. If the zip file contains full path information, this will be included as a tree of subdirectories under this directory.
updateExportDataSetDirOnlyOnChange
If set to 'true' datasets are only updated when they have changed. Change is detected by comparing the timestamp in the dataset info file with the modification time of the dataset configuration file. By default this value is 'false' and datasets are always updated. Since the 2018.02 the dataset info file is written to $REGION_HOME$/temp/moduleDataSetsCheckSums when the export dir is sub dir (any level) of the region home.
purgeExportDataSetDirOnUpdate
If a dataset has been detected as updated then this option allows user to purge content of existing moduledataset directory before new moduledataset is exported. By default the value is 'false' and all existing dataset content is overwritten.
exportIdMap
ID of the IdMap used to convert internal parameterId's and locationId's to external parameter and location Id's. See section on configuration for Mapping Id's units and flags.
...
Includes missing values in the export file or leave them out. In addition, unreliable data will be exported as missing values because unreliable data cannot be used in calculations.
Note: this means that the original values that have been set as unrealiable will be converted to missing upon export. If the original values are needed (in for example a model that does the data validation instead of the FEWS ValidationRuleSets), use the regular exportModule.
checkMissingValues
Option to check the timeseries for missing values. This option works in combination with the Parameter element 'allowMissing'. If that allowMissing is set to false, you can check for missing values. So if checkMissingValues = true and allowMissing=false, an error will occur in case there are missing values to be exported. As such, you can prevent to run a model with missing values and let the General Adapter stop with an error.
...
It is possible to have the parameterfile filled with location attributes. When exporting the parameter file, FEWS will loop over all the locations in the given locationSet, or through the given locationIds, and add the configured attributes to the parameterfile. For an example of a template parameterfile, see 02 Module Parameters. Notice that the element "model" references to the model in the template parameter file.
exportLocationAttributesCsvActivity (since 2020.01)
Exports attributes of a location set or a single location to csv format, including multi-value attributes. Skips by default when encountering empty or non-existing location sets.
...
File name of the file to be exported. Always placed into the export dir.
onlyLatestAvailable
If 'onlyLatestAvailable' is used, then only the latest available rating curve in the run period will be exported. By default all rating curves within the run period are exported
linearTableStageResolution
...
Code Block | ||||
---|---|---|---|---|
| ||||
<importNetcdfActivity> <folder>%ROOT_DIR%/importDir</folder> <fileNamePatternFilter>*.nc</fileNamePatternFilter> <fileNameLocationIdPattern>(.*)\.nc</fileNameLocationIdPattern> <timeSeriesSets> <timeSeriesSet> <moduleInstanceId>GeneralAdapterRun</moduleInstanceId> <valueType>scalar</valueType> <parameterId>WaterLevel</parameterId> <locationId>H-2001</locationId> <timeSeriesType>external historical</timeSeriesType> <timeStep unit="minute" divider="1" multiplier="15"/> <readWriteMode>add originals</readWriteMode> <ensembleId>prognose</ensembleId> </timeSeriesSet> </timeSeriesSets> <ignoreNonExistingLocationSets>true</ignoreNonExistingLocationSets> </importNetcdfActivity> |
Combined with workflow ensemble loop
When an importNetcdfActivity is run within an ensemble loop defined in the workflow configuration and the %ENSEMBLE_MEMBER_ID% tag is used in the <importDir> or the <importFile> it will loop over the ensemble members and use the ensemble member index for the imported scalar time series (since 2017.02).
Code Block | ||||
---|---|---|---|---|
| ||||
<activity> <moduleInstanceId>ImportNetcdfScalarEnsembles</moduleInstanceId> <ensemble> <ensembleId>Ens</ensembleId> <ensembleMemberIndexRange start="0" end="4"/> <runInLoop>false</runInLoop> </ensemble> </activity> |
When it is not desired that all other activities are also run for each ensemble member, make sure <runInLoop> is set to false.
This is useful when 1 general adapter run generates many similar ensemble files that do not contain data from which their ensemble id can be determined besides their file name or their parent directories. Like a run from OpenDA.
importPiNetcdfActivity
Deprecated, do not use. Please use importNetcdfActivity instead. Imports scalar, grid or 1d/2d spectra time series from a NetCDF file resulting from the run of the external modules. All time series specified inside one importPiNetcdfActivity must have the same value type (grid, scalar, 1d spectra or 2d spectra). For this activity the exportPlaceholderFile option only works for scalar and grid data, not for spectra data. For more documentation see importNetcdfActivity.
...
The (placeholder) location used for this polygon is defined in Locations.xls in xml in the same way you define a placeholder location for a grid.
Code Block | ||
---|---|---|
| ||
<location id="RASMapper_Nickajack"> <description>Location to hold Nickajack polygon and raster results</description> <shortName>RiverSystem</shortName> <x>0</x> <y>0</y> <z>0</z> </location> |
...
Elements of the Shutdown Activities configuration
This activity is the identical to the startUpActivities. The only difference is that these are carried out after the module run and import of data. See definition of StartUp activities for configuration.
ignoreNonExistingLocationSets
<command> <className>nl.wldelft.fews.adapter.urbsiniadapter.UrbsIniAdapter</className> <customJreDir>%ROOT_DIR%/jre</customJreDir> <jvmArg>-Xmx512m</jvmArg> </command>
...