workload.codeflare.dev/appwrapper unsupported value

[gbenhaim]

What happened:

I failed to install kueue using helm.
I followed the instructions on the readme and the controller didn't start with the following error:

{"level":"error","ts":"2025-02-10T20:20:50.432349454Z","logger":"setup","caller":"kueue/main.go:120","msg":"Unable to load the configuration","error":"integrations.frameworks[9]: Unsupported value: \"workload.codeflare.dev/appwrapper\": supported values: \"batch/job\", \"deployment\", \"jobset.x-k8s.io/jobset\", \"kubeflow.org/mpijob\", \"kubeflow.org/mxjob\", \"kubeflow.org/paddlejob\", \"kubeflow.org/pytorchjob\", \"kubeflow.org/tfjob\", \"kubeflow.org/xgboostjob\", \"pod\", \"ray.io/raycluster\", \"ray.io/rayjob\", \"statefulset\"","errorCauses":[{"error":"integrations.frameworks[9]: Unsupported value: \"workload.codeflare.dev/appwrapper\": supported values: \"batch/job\", \"deployment\", \"jobset.x-k8s.io/jobset\", \"kubeflow.org/mpijob\", \"kubeflow.org/mxjob\", \"kubeflow.org/paddlejob\", \"kubeflow.org/pytorchjob\", \"kubeflow.org/tfjob\", \"kubeflow.org/xgboostjob\", \"pod\", \"ray.io/raycluster\", \"ray.io/rayjob\", \"statefulset\""}],"stacktrace":"main.main\n\t/workspace/cmd/kueue/main.go:120\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:272"}

What you expected to happen:

Installation to complete successfully.

How to reproduce it (as minimally and precisely as possible):

Install using helm by following the kueue readme.

Anything else we need to know?:

After commenting out the "workload.codeflare.dev/appwrapper" line from the values file the installation completed successfully.

Environment:

• Kubernetes version (use kubectl version):

Server Version: version.Info{Major:"1", Minor:"31", GitVersion:"v1.31.2", GitCommit:"5864a4677267e6adeae276ad85882a8714d69d9d", GitTreeState:"clean", BuildDate:"2024-11-08T19:38:46Z", GoVersion:"go1.22.8", Compiler:"gc", Platform:"linux/amd64"}

• Kueue version (use git describe --tags --dirty --always):
  v0.11.0-devel-148-g3755065c-dirty

• Cloud provider or hardware configuration:
  kind cluster

[mimowo]

I followed the instructions on the readme ...

Do you mean the installation instructions?

Note that appwrapper is not released yet, so 0.10.1 version of Kueue does not have it. It will be released in 0.11.0 for the first time. If you want to test it you need to install a staging version (either by manifest or helm).

[gbenhaim]

| Do you mean the installation instructions?

yes - https://github.com/kubernetes-sigs/kueue/blob/main/charts/kueue/README.md

[mimowo]

I see, try something like
helm install kueue oci://us-central1-docker.pkg.dev/k8s-staging-images/charts/kueue --version="v20250211-v0.11.0-devel-156-g21af73b2" --create-namespace --namespace=kueue-system (latest main build).