Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Introduction

Currently, the only graphical user interface to access the Deltares Open Archive is via the Delft-FEWS GUI. In addition, data can be approached via the Geonetwork web client of via THREDDS web server.

...

This user guide is derived from the HyFS application as used at the Bureau of Meteorology.

Archived data

In the Delft-FEWS application, scheduled and manual archive workflows can take care of archiving the data (sets) from the database. The scheduled archive workflow is generally run once a day and will generally archive the following type of data:

...

Note: External data which is archived elsewhere should in general not be archived within the context of the Delft-FEWS application.

Events

Within Forecasting organisations, events are situations that can be distinguished from business as ususal as something special or interesting is happening, e.g. a flood, drought or calamity. Generally the operations during an event is hectic and no one wants to spent time on data archiving. however, after the event the archived data may be crucial for legal inquiries, performance assessment, or model calibration or to use as input for training. Therefore, the concept of Event has been introduced to label a period of interest for a certain area, such that one easily can find this data back.

...

Finally, events can play a crucial role in the data management of the archive. Data labelled for a specific type of event may be help longer in the archive compared to data not labelled for an event. E.g. Numerical Weather Predictions may be removed quickly, except for those external forecast that are part of a Flood Watch or training event.

Archive display

All data that is archived can be accessed and downloaded through the Delft-FEWS archive display. The archive display can be started from the Delft-FEWS Explorer from the Tools menu.

...

In the following paragraphs the functionality of the different tabs is explained.

Create an archive event

Events are created for Areas and are valid for a period; specified by the start and end time.

...

3         Press the upload event button to upload the event file from the local computer to the archive server.

Search and Download archive events

The Deltares archive will contain many events for all catchments. The events can be searched and downloaded in the Search for Events tab.

...

Figure Delft-FEWS Archive display; search for events (filtered by flood event using double click)


Search and Download archive data

The Deltares archive will contain data that is not always included in an archive event file. If the data is not included in an event file it can be downloaded in the Search in archive tab.

...

Note: After selecting an area and period make sure to press the search in archive data before downloading the files from the archive server. Especially the National area can contain many external forecast data files and the size of the files can be considerable.

Importing archived data into Delft-FEWS stand alone application

If you did not import the data directly as part of the download, you can import the data in the Delft-FEWS Stand Alone system with use of the Manual Forecast display. To import downloaded data; take the following steps:

...

If you want to use the data within a different context, you may also copy the data to the normal Import folders, and setup a normal timeSeriesImport run module with idmapping to bring the data into the Delft-FEWS stand alone application registered under your timeSeriesImport run module.

Using archived configurations

These are the 3 ways you can make use of an archived configuration:

...

Code Block
languagexml
linenumberstrue
<?xml version="1.0" encoding="UTF-8"?>
<archiveModuleDisplay xmlns="http://www.wldelft.nl/fews" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
					  xsi:schemaLocation="http://www.wldelft.nl/fews http://fews.wldelft.nl/schemas/version1.0/archiveModuleDisplay.xsd">
	<levelThresholds>
		<levelThresholdId>MIN</levelThresholdId>
	</levelThresholds>
	<workFolder>$ARCHIVE_DOWNLOAD_FOLDER$/work</workFolder>
	<createEventPermission>Admin</createEventPermission>
	<deleteEventPermission>Admin</deleteEventPermission>
	<disableDataDownloadAtOperatorClient>true</disableDataDownloadAtOperatorClient>
	<downloadFolders>
		<downloadFolderObserved>$ARCHIVE_DOWNLOAD_FOLDER$/Observed</downloadFolderObserved>
		<downloadFolderSimulated>$ARCHIVE_DOWNLOAD_FOLDER$/Simulated</downloadFolderSimulated>
		<downloadFolderExternalForecasts>$ARCHIVE_DOWNLOAD_FOLDER$/ExternalForecasts</downloadFolderExternalForecasts>
		<downloadFolderRatingCurves>$ARCHIVE_DOWNLOAD_FOLDER$/RatingCurves</downloadFolderRatingCurves>
		<downloadFolderHistoricalEvents>$ARCHIVE_DOWNLOAD_FOLDER$/HistoricalEvents</downloadFolderHistoricalEvents>
		<downloadFolderForecasterNotes>$ARCHIVE_DOWNLOAD_FOLDER$/ForecasterNotes</downloadFolderForecasterNotes>
		<downloadFolderConfiguration>$ARCHIVE_DOWNLOAD_FOLDER$/Configuration</downloadFolderConfiguration>
		<downloadFolderEventAttachments>$ARCHIVE_DOWNLOAD_FOLDER$/Attachments</downloadFolderEventAttachments>
		<downloadFolderSnapShots>$ARCHIVE_DOWNLOAD_FOLDER$/SnapShots</downloadFolderSnapShots>
		<downloadFolderProducts>$ARCHIVE_DOWNLOAD_FOLDER$/Products</downloadFolderProducts>
	</downloadFolders>
	<archiveImportWorkflowId>Archive_Import</archiveImportWorkflowId>
	<hideDownloadDataSetsTab>true</hideDownloadDataSetsTab>
	<hideCreateEventTab>true</hideCreateEventTab>
	<hideSearchEventTab>true</hideSearchEventTab>
	<hideArchiveDatabaseTab>true</hideArchiveDatabaseTab>
	<hideArchiveUploadTab>true</hideArchiveUploadTab>
	<archiveUploadIdMapId>id</archiveUploadIdMapId>
	<initialSearchTimePeriod start="-1000" end="1" unit="day"></initialSearchTimePeriod>
	<dataSearchProperty>
		<propertyId>aVeryLongPropertyId</propertyId>
		<displayName>propertyA</displayName>
	</dataSearchProperty>
	<dataSearchProperty>
		<propertyId>propertyB</propertyId>
	</dataSearchProperty>
</archiveModuleDisplay>


Archive Database

A mongo database plugin can be added to the archives to store scalar data. This tab is only available if you added a <archiveDatabase> to your config. To search for or download data from the database, different filters can (or must be used). The list of areas available is loaded from the configuration.

...