Skip to content

[Documentation] Explain calling of external executables in more detail #733

@jan-janssen

Description

@jan-janssen

It is important to use srun or flux run when calling external executables from Python functions submitted to executorlib. Still unless nested executors are used, these jobs appear as additional tasks in the list of tasks from the queuing system. This should be explained in more detail, for example by extending the following sections:

This becomes even more important when calling GPU applications like nvidia-smi, without flux run or srun these applications have access to all GPUs of a given compute node. This can result in unintended resource sharing and slower performance. In the same way the relation to block_allocation=True should be explained in more detail.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions