What is the archive database?
It is possible to store scalar data in a database instead of netcdf-files on disk. At the moment the only supported database type is MongoDB. It is however possible to add support for other database types as well by implementing a set of java interfaces.
The archive database should be considered as an optional extension to the Deltares Open Archive to store scalar data in a way which is more convenient to your organization.
Storing data in MongoDB instead of Netcdf-files has the following advantages:
- Data is directly available. It is not necessary to run the harvester.
- Reading data from MongoDB by using seamless integration is more performant in comparison to reading from Netcdf-files,
- MongoDB prevents that data is stored multiple times in the archive.
The MongoDB implementation was developed in close cooperation with TVA and Infisys.
How should I configure the archive database?
The archive database should be configured in the Archives.xml. In this file should be configured how to connect to the archive database and how to load the database plugin.
More information about the configuration of the Archives.xml can be found here 10 Archives - DELFT-FEWS Documentation - Deltares Public Wiki
How can I import data to the archive database?
How can I import data from the archive database? Data can be imported by using the archive display. More information about this topic can be found here: 21 Archive display - DELFT-FEWS Documentation - Deltares Public Wiki
Data can also be retrieved by using the seamless integration. The Time Series Dialog the seamless integration is only available for external historical data. In the pi-webservice the seamless integration is also available for simulated data and external forecast data.
How can I export data to the archive database?
The data export to the archive database can be configured in a way which is similar to the regular data export to the open archive. The archive export module has three different tags (exportExternalHistoricalTimeSeriesToArchiveDatabase, exportSimulatedTimeSeriesToArchiveDatabase and exportExternalForecastingTimeSeriesToArchiveDatabase) which can be used to configure data exports to the archive database. More details can be found here
