[Docs] Add Slurm agent setup

[JiangJiaWei1103]

Tracking issue

Issue: #3936

Related to flyteorg/flytekit#3005

Why are the changes needed?

Provide users with a step-by-step guide to setting up the Slurm agent from scratch.

What changes were proposed in this pull request?

Add documentation on setting up the Slurm agent for both local testing and deployment. The documentation includes following sections:

1. Spin up a Slurm cluster
2. Test your Slurm agent locally

How was this patch tested?

Labels

• added: For new features.

Setup process

Screenshots

Check all the applicable boxes

• I updated the documentation accordingly.
• All new and existing tests passed.
• All commits are signed-off.

Related PRs

flyteorg/flytekit#3005

Docs link

https://flyte--6231.org.readthedocs.build/en/6231/deployment/agents/slurm.html

Summary by Bito

Documentation enhancement PR focused on Slurm agent setup and configuration in Flyte. Provides detailed instructions for cluster setup, SSH configuration, AWS S3 integration, and deployment scenarios. Includes both local testing and production deployment guidelines. Minor updates to Databricks agent documentation included.

Unit tests added: False

Estimated effort to review (1-5, lower is better): 2

[flyte-bot]

Code Review Agent Run Status

• Limitations and other issues: ❌ Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 36.88%. Comparing base (34205dd) to head (8ebc3b8).
Report is 18 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #6231      +/-   ##
==========================================
+ Coverage   36.87%   36.88%   +0.01%     
==========================================
  Files        1318     1318              
  Lines      134647   134829     +182     
==========================================
+ Hits        49647    49728      +81     
- Misses      80679    80767      +88     
- Partials     4321     4334      +13     

Flag	Coverage Δ
unittests-datacatalog	51.58% <ø> (ø)
unittests-flyteadmin	51.87% <ø> (-0.09%)	⬇️
unittests-flytecopilot	30.99% <ø> (ø)
unittests-flytectl	62.29% <ø> (ø)
unittests-flyteidl	7.22% <ø> (-0.01%)	⬇️
unittests-flyteplugins	53.98% <ø> (-0.04%)	⬇️
unittests-flytepropeller	42.86% <ø> (+0.07%)	⬆️
unittests-flytestdlib	55.33% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[flyte-bot]

Code Review Agent Run Status

• Limitations and other issues: ❌ Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

[flyte-bot]

Code Review Agent Run Status

• Limitations and other issues: ❌ Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

[flyte-bot]

Code Review Agent Run Status

• Limitations and other issues: ❌ Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

[flyte-bot]

Code Review Agent Run Status

• Limitations and other issues: ❌ Failure - The AI Code Review Agent skipped reviewing this change because it is configured to exclude certain pull requests based on the source/target branch or the pull request status. You can change the settings here, or contact the agent instance creator at [email protected].

[flyte-bot]

Code Review Agent Run #9a6330

Actionable Suggestions - 0

Review Details

• Files reviewed - 2 · Commit Range: 7c35da6..8ebc3b8

  • docs/deployment/agents/databricks.rst
  • docs/deployment/agents/slurm.rst
• Files skipped - 1

  • docs/deployment/agents/index.md - Reason: Filter setting
• Tools

  • Golangci-lint (Linter) - ✖︎ Failed
  • Whispers (Secret Scanner) - ✔︎ Successful
  • Detect-secrets (Secret Scanner) - ✔︎ Successful

---

AI Code Review powered by

[flyte-bot]

Changelist by Bito

This pull request implements the following key changes.

Key Change	Files Impacted
Documentation - Add Slurm Agent Setup Documentation	- databricks.rst - Update emphasis line numbers in documentation - slurm.rst - Add comprehensive guide for setting up and configuring Slurm agent