Function: |
|
---|
Module Name: |
runInLoopParallelProcessorCount |
---|---|
Where to Use? |
global properties file |
Why to Use? |
to speed-up ensemble runs on multi core machines |
Description: |
The runInLoopParallelProcessorCount en try in the global properties files indicated the number of cores Delft-FEWS may use when running ensemble members in a loop |
Preconditions: |
2009-02 release, multi core cpu or multi cpu computer |
Outcome(s): |
speed-up of the computations |
Scheendump(s): |
link to attached screendump(s) for displays only |
Remark(s): |
The speedup that may be obtained is highly dependent on the type of module you are running |
Available since: |
DelftFEWS200902 |
Contents
Overview
Delft-FEWS can split ensemble workflows (that have the runInLoop element set to true) over multiple cores. Based on the available amount of cores a number of queues is made, one for each core. When running the activity the different ensemble members are added to the different queues. An example of a workflow that can use this feature is shown below:
<activity> <runIndependent>true</runIndependent> <moduleInstanceId>MOGREPS_Spatial_Interpolation</moduleInstanceId> <ensemble> <ensembleId>MOGREPS</ensembleId> <runInLoop>true</runInLoop> </ensemble> </activity>
Configuration
By default Delft-FEWS will only use one core and all tasks are run one after another. To enable the parallel running of ensemble members the runInLoopParallelProcessorCount entry must be set in the global properties file. Here you either specify the number of cores to use or specify 100 to use all available cores.
In the global properties
Config Example |
# to use all available cores/cpu's: runInLoopParallelProcessorCount=100 |
---|
description of the config example.
Sample input and output
Sample input and output
Error and warning messages
Description of errors and warnings that may be generated
Error: |
Error message |
---|---|
Action: |
Action to fix |
Known issues
Describe all known issues and unexpected behaviour
Related modules and documentation
Links to related parts of the system
Technical reference
Entry in moduleDescriptors: |
none |
---|---|
Link to schema: |
none |