Documentation specifies Kubeflow jobs, but not SparkApplication

[danc]

Could doc clarify if Kubeflow SparkApplications are supported by kueue ?

I'm currently able to submit Jobs to kueue, but SparkApplications appear not to be passing via the LocalQueue (maybe some info missing)
Example failing yaml. (SparkApplication succeeds, but is not managed by Queue) :

apiVersion: "sparkoperator.k8s.io/v1beta2"
kind: SparkApplication
metadata:
  generateName: spark-pi-ingestion-
  namespace: mining
  labels:
    app: spark
    kueue.x-k8s.io/queue-name: lq-spark
spec:
  timeToLiveSeconds: 60
  type: Scala
  mode: cluster
  image: "apache/spark:3.4.1"
  imagePullPolicy: IfNotPresent
  mainClass: org.apache.spark.examples.SparkPi
  mainApplicationFile: "local:///opt/spark/examples/jars/spark-examples_2.12-3.4.1.jar"
  arguments:
    - "10"
  sparkVersion: "3.4.1"
  restartPolicy:
    type: Never
  driver:
    cores: 1
    coreLimit: "1200m"
    memory: "512m"
    labels:
      version: 3.4.1
      app: spark
    serviceAccount: logpickr-api
  executor:
    cores: 1
    instances: 1
    memory: "512m"
    labels:
      version: 3.4.1
      app: spark

[everpeace]

Could doc clarify if Kubeflow SparkApplications are supported by kueue ?

I think Tasks / Run Workloads / Kubeflow Jobs page clearly states so (the list does not contain Kubeflow Spark Operator(SparkApplication)).

And, Tasks / Developer Tools / Integrate a custom Job with Kueue also clearly instructs how to support custom jobs in Kueue.

By the way, Kueue community already aware the spark issue and already have grand design how to support spark workloards in Kueue: #1656

[danc]

Thanks for the confirmation, shared links, and grand design perspective.

[kannon92]

It seems clear to me but you could add that the list of kubeflow jobs in that list are the ones that we support in-tree for Kueue.

Maybe adding something like:
The following list are the supported frameworks for Kueue and Kubeflow.

You could add it here.

[danc]

I see some other works in progress : #4032