Storage of data is a basic task in any Water Resources Management activity. This data often includes observations/measurements, meteorological forecasts, historical model simulations and model forecasts. Often, this data is stored using commercially available databases including WISKI, Aquarius and CUAHSI HIS. These databases allow for storage of both timeseries data and rating curves. However, it may not be possible to store forecast data (which is characterised by multiple time vectors) or 'messy' data such as text reports, communications logs, model states, database snaps, et cetera. For that purpose, Deltares developed the Open Archive.

The Deltares OpenArchive

The OpenArchive is a file based storage solution where data can be accessed through a catalogue. The OpenArchive intimately integrates with Delft-FEWS applications but can be used independently from it. The data can be easily accessed by third party applications using web protocols.

Delft-FEWS and the OpenArchive: seamless integration

The OpenArchive intimately integrates with Delft-FEWS in a number of ways:

Delft-FEWS can export data to an archive.
Archived data can be visualized within Delft-FEWS.
Archived data can be used in workflows in a Delft-FEWS application (for example in a hindcast run).

Sample applications

The archive can contribute to a number of tasks often encountered in water resources management. These include hindcasting (re-forecasting), forecast verification and (web) dissemination.

Hindcasting, sometimes referred to as re-forecasting, is the process of producing forecasts for times in the past, using only data that was available at the time. Reasons for hindcasting include testing of new models or other forecasting routine such as data assimilation or statistical post-processing. Hindcasting requires the availability of forcing data. In the case of hydrological forecasts, this includes weather forecasts that were available at the time. Every hindcast should then be forced by another weather forecast. Delft-FEWS is eminently suited to carry out these hindcast exercises, especially if connected to an OpenArchive. Within a hindcasting workflow, past weather forecasts are retrieved from the archive and used to force hydrological and/or hydrodynamic models.

Forecast verification is the process of establishing the quality of a set of forecasts. Often, these are compared to the 'verifying' observations. The record of forecasts needs to be available to the verification tools and one way of achieving this is through an OpenArchive. Indeed, one of the most often used forecast verification packages, the EVS, can source its data from an instance of the OpenArchive.

In realtime hydrological forecasting systems as well as in 'water information systems', forecasts are often disseminated to stakeholders via the web. One way to do this is by actively pushing data from a forecast production system to HTML pages or to locations from where the data is ingested by a web viewer. The OpenArchive, however, allows for web viewers to directly access the archive and visualize its data in a browser environment.

Available documentation

Links and references

OpenArchive brochure

TBA

Conference papers

Gijsbers, P., Grijze, A., Dijk, M. van and Akker, O. van den: Usage of the Deltares Open Archive, in Proceedings of the 7th International Congress on Environmental Modelling and Software, edited by D. P. Ames, N. W. T. Quinn, and A. E. Rizzoli, International Environmental Modelling and Software Society (iEMSs), San Diego, CA, United States., 2014. PDF can be downloaded from here.

Grijze, A., Gijsbers, P., Rooij, E. de, Pelgrim, E. and Akker, O. van den: Technology behind the Deltares Open Archive, in Proceedings of the 7th International Congress on Environmental Modelling and Software, edited by D. P. Ames, N. W. T. Quinn, and A. E. Rizzoli, International Environmental Modelling and Software Society (iEMSs), San Diego, CA, United States., 2014. PDF can be downloaded from here.

Page tree

The Deltares Open Archive