...
When an invalid file is uploaded to the archive server this will be detected by the system and the file will not be used.
Data management
The archive admin console provides tools to manage the data in the archive. To prevent that the amount of the data in the archive keeps growing several tools are available which can be used to remove expired data sets from the archive. This section will explain how to confgure and use these tools.
First step is to define the rules for expiring data sets. The file DataManagementTool.xml can be used to define the rules for expiring data sets.
Below is an example given this file.
| Code Block |
|---|
<arc:dataManagementTool xmlns:arc="http://www.wldelft.nl/fews/archive" xsi:schemaLocation="http://www.wldelft.nl/fews/archive http://fews.wldelft.nl/schemas//version1.0/archive-schemas/dataManagementTool.xsd" xmlns="http://www.wldelft.nl/fews/archive" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<outputFile>d:\fews\output\managementreport.csv</outputFile>
<lifeTimeRules>
<defaultLifeTime unit="year" multiplier="10"/>
<defaultAction>default</defaultAction>
<lifeTimeSimulatedDataSets>
<lifeTime unit="year" multiplier="15"/>
<action>remove</action>
</lifeTimeSimulatedDataSets>
<lifeTimeObservedDataSets>
<lifeTime unit="year" multiplier="15"/>
<action>remove</action>
</lifeTimeObservedDataSets>
</lifeTimeRules>
</arc:dataManagementTool> |
This example contains all the mandatory elements of this file. The output file defines were the data management tool should write its output. The output will be the list of data sets which are expired according the defined rules.
The default life time defines the life time of a data set in the archive when there is not a more specific rule defined. In the example above there is no rule defined for external data sets. This means that the defaul life time will used for external data sets. For simulated data sets there is a specific rule defined in the tag lifeTimeSimulatedDataSets. This means that for simulated data sets the default life time will not be used but the more specific rule in the lifeTimeSimulatedDataSets tag will be used. If needed it is possible to define specific rules for the other types of data sets in the archive like external forecasts, rating curves, configuration etc. An example is given below.
| Code Block |
|---|
<arc:dataManagementTool xmlns:arc="http://www.wldelft.nl/fews/archive" xsi:schemaLocation="http://www.wldelft.nl/fews/archive http://fews.wldelft.nl/schemas//version1.0/archive-schemas/dataManagementTool.xsd" xmlns="http://www.wldelft.nl/fews/archive" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<outputFile>d:\fews\output\managementreport.csv</outputFile>
<lifeTimeRules>
<defaultLifeTime unit="year" multiplier="10"/>
<defaultAction>default</defaultAction>
<lifeTimeSimulatedDataSets>
<lifeTime unit="year" multiplier="15"/>
<action>remove</action>
</lifeTimeSimulatedDataSets>
<lifeTimeObservedDataSets>
<lifeTime unit="year" multiplier="15"/>
<action>remove</action>
</lifeTimeObservedDataSets>
<lifeTimeExternalForecastDataSets>
<lifeTime unit="year" multiplier="10"/>
<action>remove</action>
</lifeTimeExternalForecastDataSets>
<lifeTimeMessagesDataSets>
<lifeTime unit="year" multiplier="10"/>
<action>remove</action>
</lifeTimeMessagesDataSets>
<lifeTimeConfigurationDataSets>
<lifeTime unit="year" multiplier="10"/>
<action>remove</action>
</lifeTimeConfigurationDataSets>
<lifeTimeRatingCurveDataSets>
<lifeTime unit="year" multiplier="10"/>
<action>remove</action>
</lifeTimeRatingCurveDataSets>
</lifeTimeRules>
</arc:dataManagementTool>
|