In releases prior to Delft-FEWS 202401 2024.01 it was recommended to have a full harvest task scheduled to run at least once a day. This task scanned the entire content of the archive data folder and added data sets to the catalogue which were not harvested yet.
...
The main downside of this approach was that this task would take a long time to complete.
From the release Delft-FEWS 202401 2024.01 the harvest process is improved in the following way;
...
It therefore no longer necessary to run a full harvest task at a daily basis. You only need to run the harvest task after you have upgraded to a new Delft-FEWS version (run clear catalogue first!)
...