Kueue helm charts 0.8.X (0.8.3 0.8.2 0.8.1 0.8.0) have been deleted from registry

[mtparet]

What happened:

v0.8.x images disappeared from container registry.

$ docker pull us-central1-docker.pkg.dev/k8s-staging-images/kueue/kueue:v0.8.3
Error response from daemon: manifest for us-central1-docker.pkg.dev/k8s-staging-images/kueue/kueue:v0.8.3 not found: manifest unknown: Failed to fetch "v0.8.3"

$ docker pull us-central1-docker.pkg.dev/k8s-staging-images/kueue/kueue:v0.10.1
v0.10.1: Pulling from k8s-staging-images/kueue/kueue
688513194d7a: Pull complete
bfb59b82a9b6: Pull complete
efa9d1d5d3a2: Pull complete
a62778643d56: Pull complete
7c12895b777b: Pull complete
3214acf345c0: Pull complete
5664b15f108b: Pull complete
0bab15eea81d: Pull complete
4aa0ea1413d3: Pull complete
da7816fa955e: Pull complete
9aee425378d2: Pull complete
905a5f508b4e: Pull complete
Digest: sha256:60f813c1ba2fd1b94d2345957e7690b61bc716f5725d20bb08ac4239cd9433a8
Status: Downloaded newer image for us-central1-docker.pkg.dev/k8s-staging-images/kueue/kueue:v0.10.1
us-central1-docker.pkg.dev/k8s-staging-images/kueue/kueue:v0.10.1

[tenzen-y]

The released image is published to registry.k8s.io/kueue/kueue. So, could you try registry.k8s.io/kueue/kueue:v0.8.3?

[tenzen-y]

/remove-kind bug
/kind support

[mtparet]

Good know because the helm chart is pointing to it https://github.com/kubernetes-sigs/kueue/blob/main/charts/kueue/values.yaml#L19

[tenzen-y]

Good know because the helm chart is pointing to it https://github.com/kubernetes-sigs/kueue/blob/main/charts/kueue/values.yaml#L19

Here, we have released Chart, and then it uses the released image registry:

• https://github.com/kubernetes-sigs/kueue/releases/tag/v0.8.3
• https://github.com/kubernetes-sigs/kueue/releases/download/v0.8.3/kueue-chart-v0.8.3.tgz

[mtparet]

Thank you !

[mtparet]

There is the same issue at the helm chart layer https://github.com/kubernetes-sigs/kueue/tree/main/charts/kueue#install-chart-using-helm-v30

It indicates helm install kueue oci://us-central1-docker.pkg.dev/k8s-staging-images/charts/kueue --version="v0.10.1"

but for 0.8.3 it does not exist anymore, do you have any published version to registry.k8s.io too ?

[mimowo]

Good point, we don't publish charts into registry.k8s.io which makes them disappear after 90 days. I guess we could extend the docs to show how to use the tgz helm charts for that.

Also, in a longer run we could consider "promoting" the charts to registry.k8s.io as we do it for images, but it requires a but of research. Here is an example how we promote an image: kubernetes/k8s.io#7696. Not sure the same method would work for charts, probably not

[tenzen-y]

Good point, we don't publish charts into registry.k8s.io which makes them disappear after 90 days. I guess we could extend the docs to show how to use the tgz helm charts for that.

Also, in a longer run we could consider "promoting" the charts to registry.k8s.io as we do it for images, but it requires a but of research. Here is an example how we promote an image: kubernetes/k8s.io#7696. Not sure the same method would work for charts, probably not

That sounds reasonable. I'm wondering if we can install chart with helm install kueue https://github.com/kubernetes-sigs/kueue/releases/download/v0.8.3/kueue-chart-v0.8.3.tgz.

@mtparet Could you check it? If this works fine, we can mention it in our documentations.

[mtparet]

We are using fluxcd and it does not seems supporting referencing directly a version .tgz https://fluxcd.io/flux/components/source/helmrepositories/

[mimowo]

/retitle Kueue helm charts 0.8.X (0.8.3 0.8.2 0.8.1 0.8.0) have been deleted from registry

Proposal, to scope the remaining issue clearly by title, WDYT @mtparet ?

[mtparet]

Thanks, that's the real issue at the end (images are ok when properly registry is used)

[tenzen-y]

/remove-kind support
/kind feature

We need to investigate how we can register the Helm Chart OCI image as a persistent one.