The import module allows data from external source to be imported into DELFT-FEWS. Data may be provided to FEWS in a variety of formats. The approach taken in the import module is that a class is defined for each of the file formats that can be imported.
Data is imported from specified directories. An attempt is made to import all files in the directories and subdirectories configured. If a file conforms to the expected format then the data will be imported. If the file does not conform to the expected format, it will not be imported, but will be moved to a configurable directory with failed import files.
Note that Delft-FEWS can only import the specific data formats that are listed here. Delft-FEWS assumes data types for a configured import to remain the same over time as Delft-FEWS is usually part of an operational system. This means that it will not have the flexibility in importing data that for example programs like Matlab and Excel have. Instead, for each new filetype a dedicated import must be written. However, the list of supported filetypes is ever increasing and adding new imports is fairly simple.
You can select the files to be imported via the directory and its subdirectories where the files live and by means of a file mask, which is then used to match the file names against.
Two main groups of import can be defined;
- Importing data in the XML format defined by the Environment Agency, UK.
- Importing of various data formats (including ASCII formats, png files- e.g. meteosat images- grids and GRIB files).
On importing data, the approach to be used for converting flags, units, locations and parameters can be defined. These conversions are identified by referring to the appropriate configuration files (see Regional Configuration). When data is imported to an equidistant time series, a time tolerance may also be defined. If the time recorded is within this tolerance it will be snapped to the cardinal time step in the imported series.
When available as configuration on the file system, the name of the XML file for configuring an instance of the import module called for example ImportRTS may be:
ImportRTS 1.00 default.xml
File name for the ImportRTS configuration.
Flag to indicate the version is the default configuration (otherwise omitted).