...
The main downside of this approach was that this task would take a long time to complete.
From the release FEWS 202401 the harvest process is improved in the following way;
1) All the data exports from FEWS to the archive also now inform the archive now about which data sets were newly added to the archive. The archive will immediately harvest these newly added data sets so that they become directly available in the catalogue.
...
It therefore no longer necessary to run a full harvest task at a daily basis. You only need to run the harvest task after you have upgraded to a new FEWS version . (run clear catalogue first!)
Also when you have deleted data from the archive manually or by using your own scripts it is recommended to run thefull the full harvest task.
For the harvest tasks the following tasks are recommended for your configuration:
...
2) Incremental harvest task. This harvest task should be scheduled every 10 minutes. This task harvest harvests the last 7 days in the archive. Normally new data should be harvested automatically by the Immediate harvester. However when the immediate harvest was not available
for any reason then the Incremental harvester will make sure that the data sets which not harvested immediately after the export are still will be harvested.