GPUs-Specs

Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM

NVIDIA GPUs

• NVIDIA GB200/B200 ： GB200/B200 Datasheet

• GeForce RTX 5090 ： Blackwell GPU Arch whitepaper

• NVIDIA H100：H100 GPU Arch & H100 DataSheet

• NVIDIA H200：H200 DataSheet

• NVIDIA H800：H800 DataSheet

• NVIDIA H20：H20 DataSheet

• GeForce RTX 4090 ： Ada GPU Arch whitepaper

• NVIDIA L40：L40 DataSheet

• NVIDIA L40s：L40s DataSheet

• NVIDIA L20：L20 Dataheet

• NVIDIA A100：A100 DataSheet 、Ampere-arch-whitepaper

• NVIDIA A800：A800 80G DataSheet、A800 40G DataSheet

• NVIDIA A16 ：A16 DataSheet、A16 Product Brief

• NVIDIA A2 ：A2 DataSheet、A2 Product Brief

• NVIDIA A10 ：A10 DataSheet、A10 Product Brief

• NVIDIA A40 ：A40 DataSheet、A40 Product Brief

• NVIDIA A30 ：A30 DataSheet、A30 Product Brief

• NVIDIA T4 ：T4 Tensor Core Datasheet、T4 Product Brief、NVIDIA TURING GPU Arch

• NVIDIA V100: V100 DataSheet、Volta-arch-whitepaper

• …

AMD GPUs

• AMD Instinct MI325X : MI325X DataSheet
• AMD Instinct MI300X：MI300X DataSheet
• AMD Instinct MI300A：MI300A DataSheet
• …

国产 GPUs

• 摩尔线程 MTT S4000 : MTT S4000 DataSheet 页面底部
• 华为、昆仑芯、天数智芯、燧原等国产AI加速卡参考知乎@黄世青提供: 国产AI加速卡性能数据