You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, it seems like WK only gives a limited number of parallel running jobs to the worker at a time. Any other started jobs are set to "pending" until some of the currently running jobs are completed. Now that we use slurm to run some of the jobs we could remove or at least increase this limit because slurm takes care of the scheduling and it does so on the finer and more efficient task level.
Depending on how much effort this is to have different settings for the parallelism for different jobs we could also wait with implementing this until all jobs are running on slurm.
Context
Specific to long-running jobs (set jobsEnabled=true in application.conf)
The text was updated successfully, but these errors were encountered:
Detailed Description
Currently, it seems like WK only gives a limited number of parallel running jobs to the worker at a time. Any other started jobs are set to "pending" until some of the currently running jobs are completed. Now that we use slurm to run some of the jobs we could remove or at least increase this limit because slurm takes care of the scheduling and it does so on the finer and more efficient task level.
Depending on how much effort this is to have different settings for the parallelism for different jobs we could also wait with implementing this until all jobs are running on slurm.
Context
jobsEnabled=true
inapplication.conf
)The text was updated successfully, but these errors were encountered: