Skip to content

Commit

Permalink
[Docs] Add Slurm agent setup (#6231)
Browse files Browse the repository at this point in the history
* docs: Spin up a Slurm cluster

Signed-off-by: JiangJiaWei1103 <[email protected]>

* Fix typos

Signed-off-by: JiangJiaWei1103 <[email protected]>

* docs: Test your Slurm agent locally

Signed-off-by: JiangJiaWei1103 <[email protected]>

* docs: Update docs to ensure reproducibility

Signed-off-by: JiangJiaWei1103 <[email protected]>

* docs: Add command for restarting slurmd daemon

Signed-off-by: JiangJiaWei1103 <[email protected]>

* docs: Ensure a Slurm job can be submitted

Signed-off-by: JiangJiaWei1103 <[email protected]>

* update

Signed-off-by: Future-Outlier <[email protected]>

* update

Signed-off-by: Future-Outlier <[email protected]>

* add emphasized line 13

Signed-off-by: Future-Outlier <[email protected]>

---------

Signed-off-by: JiangJiaWei1103 <[email protected]>
Signed-off-by: Future-Outlier <[email protected]>
Co-authored-by: Future-Outlier <[email protected]>
  • Loading branch information
JiangJiaWei1103 and Future-Outlier authored Feb 22, 2025
1 parent 6c2624b commit 8fc3b5b
Show file tree
Hide file tree
Showing 3 changed files with 530 additions and 1 deletion.
2 changes: 1 addition & 1 deletion docs/deployment/agents/databricks.rst
Original file line number Diff line number Diff line change
Expand Up @@ -178,7 +178,7 @@ Specify agent configuration
Create a file named ``values-override.yaml`` and add the following config to it:

.. code-block:: yaml
:emphasize-lines: 9
:emphasize-lines: 8,13
enabled_plugins:
tasks:
Expand Down
3 changes: 3 additions & 0 deletions docs/deployment/agents/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,8 @@ If you are using a managed deployment of Flyte, you will need to contact your de
- Submit requests to OpenAI GPT models for asynchronous batch processing.
* - {ref}`LinkedIn K8s Service Batch <deployment-agent-setup-k8sservice>`
- Configuring your Flyte deployment for the K8s service agent.
* - {ref}`Slurm Agent <deployment-agent-setup-slurm>`
- Configuring your Flyte deployment for the Slurm agent.
```

```{toctree}
Expand All @@ -52,4 +54,5 @@ sensor
snowflake
openai_batch
k8sservice
slurm
```
Loading

0 comments on commit 8fc3b5b

Please sign in to comment.