chore(kafka): Update container image to 3.9.0 ahead of Stackable Release 25.3.0

[sbernauer]

Part of #964

• Add: 3.9.0 and 3.7.2
• Bump: 3.8.0 to 3.8.1

Tip

Please add the scheduled-for/2025-03 label, and add to the Stackable Engineering project.

Update tasks (kafka)

Preview Give feedback

1. Update versions.py to reflect the agreed upon versions in the spreadsheet (including the removal of old versions).
2. Upload new version (see kafka/upload_new_kafka_version.sh).
3. Add/Remove patches
4. Update versions.py to the latest supported version of JVM (base and devel). Keeping 21, same as used upstream.
5. Update other dependencies if applicable (eg: jmx_exporter, kcat, scala, etc).
6. Check other operators (getting_started / kuttl) for usage of the versions. Add the PR(s) to the list below.
7. Update the version in demos. Add the PR(s) to the list below.

Update tasks (kcat and kafka-testing-tools)

Preview Give feedback

1. Update kcat/versions.py. No new version
2. Update kafka-testing-tools/versions.py.
3. Upload new version (see .scripts/upload_new_kcat_version.sh).
4. Update versions.py to the latest supported version of JVM (base and devel).
5. Check other operators (getting_started / kuttl) for usage of the versions. Add the PR(s) to the list below.
6. Update the version in demos. Add the PR(s) to the list below.

Related Pull Requests

Preview Give feedback

1. feat(kafka): Add 3.9.0, Bump 3.7.1 to 3.7.2 #988
   6 of 6
   release/25.3.0 +1
   
2. fix(kafka): Restore version 3.7.1, bump 3.8.0 to 3.8.1 #995
   release/25.3.0 +1
   
3. test: Bump Kafka to 3.7.2, Add 3.9.0 kafka-operator#822
   3 of 12
   release/25.3.0 +1
   
4. test: Correct the versions to test against kafka-operator#825
   release/25.3.0 +1
   
5. chore: Update supported-versions kafka-operator#824
   release/25.3.0 +1
   
6. Link to any other operator PRs (getting_started / kuttl)
7. chore(kafka): Bump to 3.9.0 demos#148
   release/25.3.0 +1
   
8. Link to the Release Notes PR in the documentation repo (if not a comment below)
9. chore(kafka): Set productVersion to 3.9.0 in getting_started documentation#706
   release/25.3.0 +1
   

Tip

Delete any items that do not apply so that all applicable items can be checked.
For example, if you add release notes to the documentation repository, you do not need the latter two criteria.

This list should be completed by the assignee(s), once respective PRs have been merged. Once all items have been checked, the issue can be moved into Development: Done.

Acceptance

Preview Give feedback

1. Can build image (either locally, or in CI)
2. Kuttl smoke tests passes (either locally, or in CI)
3. Release notes written in a comment below
4. Applicable release-note label added to this issue None needed

Testing instructions

# See the latest version at https://pypi.org/project/image-tools-stackabletech/
pip install image-tools-stackabletech==0.0.13

bake --product kafka=x.y.z # where x.y.z is the new version added in this PR
bake --product kafka-testing-tools=1.0.0 # This version doesn't change

kind load docker-image docker.stackable.tech/stackable/kafka:x.y.z-stackable0.0.0-dev
kind load docker-image docker.stackable.tech/stackable/kafka-testing-tools:1.0.0-stackable0.0.0-dev

# Change directory into the kafka-operator repository and update the
# product version in tests/test-definition.yaml
./scripts/run-tests --test-suite smoke-latest # or similar

Please consider updating this template if these instructions are wrong, or
could be made clearer.