Ubuntu 20.04

• Choose this Linux version when creating your EC2 instance.

CUDA 11.8

• This is the latest CUDA version that Pytorch support.

See the Pytorch Install Guide

• Follow this to add nvidia apt repository.
• apt install cuda=11.8.0-1

cuDNN

• Download a *.deb file from here.
• You need to sign up Nvidia Developer account and choose the correct version, for CUDA 11.8 and Ubuntu 20.04.
• Use scp to upload the deb file on EC2. And run deb -i cudnn-local-repo-ubuntu2004-8.9.2.26_1.0-1_amd64.deb to install it.

Pytorch

• Install Mamba and create a Conda virtual environment.
• Install Pytorch with this instructions, choosing correct options then it gives you this command to run conda install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia

Verify Installation

• Run minimum_cnn_inference.py and it should output the following if eveything is good:

TODO