Versions Compared

Old Version 2

changes.mady.by.user Andre Grijze

Saved on

compared with

New Version 3

changes.mady.by.user Andre Grijze

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The data directory contains of two sub directories warm en and cold. Both directories are symbolic links to the actual storages.

...

To configure a dedicated harvester for each storage the following configuration can be used.

Code Block
languagexml
	<scheduledArchiveTask><manualArchiveTask>
		<internalHarvesterTask id="harvester warm storage">
			<storage>warm</storage>
		</internalHarvesterTask>
		<description/>
	</manualArchiveTask>
		<description>harvester warm storage<<manualArchiveTask>
		<internalHarvesterTask id="harvester cold storage">
			<storage>cold</storage>
		</internalHarvesterTask>
		<description/>
	</manualArchiveTask>


The configuration above is quite similar to the configuration of a regular harvester. The main difference is that a storage is configured. This storage is the sub directory of data directory which contains the actual storage.

In our case we have two sub directories, warm and cold. For each directory we configured a dedicated harvester.


In addition it is useful that the incremental harvester, the harvester which harvests only the most recent days quickly, knows which storages contains the most recent data.

A configuration example is given below.

Code Block
    <scheduledArchiveTask>
		<incrementalHarvesterTask id="incremental harvester">
			<harvesterTimeSpan unit="day" multiplier="10"/>
			<storage>warm</storage>
		</incrementalHarvesterTask>
		<description>incremental harvester</description>
		<startTime>03<startTime>00:00:00</startTime>
		<endTime>20<endTime>23:3059:00</endTime>
		<runInterval>2<<runIntervalInSeconds>300</runInterval>runIntervalInSeconds>
		<active>false</active>
	</scheduledArchiveTask>
	<scheduledArchiveTask>


In addition to clearing the entire catalogue it is useful if only the data for a certain can be removed from the catalogue.

An configuration example is given below.

Code Block
	<manualArchiveTask>
		<internalHarvesterTask<removeObsoleteDataFromCatalogue id="harvesterremove data from cold storage">
			<storage>cold</storage>
		</internalHarvesterTask>removeObsoleteDataFromCatalogue>
		<description>harvester<description>remove data from cold storage</description>
		<startTime>03:00:00</startTime>
		<endTime>20:30:00</endTime>
		<runInterval>2</runInterval>
		<active>false</active>
	</scheduledArchiveTask></manualArchiveTask>
		<manualArchiveTask>
		<removeObsoleteDataFromCatalogue id="remove data from warm storage">
			<storage>warm</storage>
		</removeObsoleteDataFromCatalogue>
		<description>remove data from warm storage</description>
	</manualArchiveTask>