Using Keras/Tensorflow seems to be outdated because most people use PyTorch instead of Tensorflow.
We can keep using Keras, which can use Tensorflow and Pytorch (and Jax) as backends.
Also, Keras 3 should be used (and will be used by default with pip install keras), but the lesson should be updated accordingly.

To check:

• Update setup instructions to refer to Keras version 3
• Update setup instructions to use PyTorch instead of Tensorflow
• Investigate which parts of the code need to be adapted (Keras 3 is highly backwards compatible with Keras 2)
• Update outputs, and potentially explanations, where necessary

As a starting point, I recommend running a few commands and compare the outputs to estimate which episodes need to be updated and how much effort that will be.
As a result of the investigation, splitting this task up into multiple might be reasonable.