NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
-
Updated
Sep 10, 2025 - C++
#
tensorrt
Here are 598 public repositories matching this topic...
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
machine-learning embedded caffe computer-vision deep-learning robotics inference nvidia digits image-recognition segmentation object-detection jetson-tx1 jetson tensorrt jetson-tx2 video-analytics jetson-xavier jetson-nano jetson-xavier-nx
-
Updated
Oct 16, 2024 - C++
BoxMOT: Pluggable SOTA multi-object tracking modules modules for segmentation, object detection and pose estimation models
machine-learning deep-learning yolo segmentation clip multi-object-tracking mot tensorrt tracking-by-detection mots osnet multi-object-tracking-segmentation bytetrack strongsort ocsort botsort deepocsort improvedassociation boosttrack oriented-bounding-box-tracking
-
Updated
Sep 3, 2025 - Python
Implementation of popular deep learning networks with TensorRT network definition API
resnet squeezenet tensorrt crnn arcface mobilenetv2 yolov3 mnasnet retinaface mobilenetv3 yolov3-spp yolov4 yolov5 detr swin-transformer yolov7 yolov8 yolov9 yolo11
-
Updated
Sep 11, 2025 - C++
An easy to use PyTorch to TensorRT converter
-
Updated
Aug 17, 2024 - Python
PyTorch ,ONNX and TensorRT implementation of YOLOv4
-
Updated
Jun 19, 2024 - Python
Tengine is a lite, high performance, modular inference engine for embedded device
machine-learning arm mips tensorflow x86-64 container cuda acl cnn pytorch artificial-intelligence riscv tensorrt onnx nvdla npu supperedge
-
Updated
Mar 6, 2025 - C++
🛠A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉
tensorrt mnn ncnn onnx onnxruntime yolov5 tnn mnn-model yolox robustvideomatting yolov6 stable-diffusion yolov8 facefusion
-
Updated
Aug 19, 2025 - C++
《Pytorch实用教程》（第二版）无论是零基础入门，还是CV、NLP、LLM项目应用，或是进阶工程化部署落地，在这里都有。相信在本书的帮助下，读者将能够轻松掌握 PyTorch 的使用，成为一名优秀的深度学习工程师。
-
Updated
Jan 27, 2025 - Jupyter Notebook
Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
microservice gpu-acceleration nemo tensorrt rag triton-inference-server large-language-models llm llm-inference retrieval-augmented-generation
-
Updated
Sep 10, 2025 - Jupyter Notebook
A nearly-live implementation of OpenAI's Whisper.
text-to-speech translation voice-recognition openai obs dictation whisper tensorrt openvino openvino-intel tensorrt-llm whisper-tensorrt
-
Updated
Jul 24, 2025 - Python
🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥
detection transformers face yolo object-detection tensorrt instance-segmentation onnx detr yolox yolov6 detextron2 yolov7
-
Updated
Nov 18, 2023 - Python
DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.
-
Updated
May 25, 2024 - Python
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
-
Updated
Sep 12, 2025 - Python
Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
machine-learning caffe deep-learning time-series gpu rest-api pytorch xgboost image-classification image-search object-detection image-segmentation tsne neural-nets tensorrt ncnn tensorrt-conversion tensorrt-inference
-
Updated
Sep 7, 2025 - C++
YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)
-
Updated
Jul 22, 2024 - Python
YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite
-
Updated
May 12, 2024 - Python
micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、reg…
pytorch pruning convolutional-networks quantization xnor-net tensorrt model-compression bnn neuromorphic-computing group-convolution onnx network-in-network tensorrt-int8-python dorefa twn network-slimming integer-arithmetic-only quantization-aware-training post-training-quantization batch-normalization-fuse
-
Updated
May 6, 2025 - Python
Turn any computer or edge device into a command center for your computer vision projects.
python docker machine-learning computer-vision deployment inference classification object-detection vit agents inference-server jetson tensorrt instance-segmentation onnx inference-api yolov5 yolov8 yolo11 yolov12
-
Updated
Sep 13, 2025 - Python
NVIDIA DeepStream SDK 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
cuda pytorch nvidia yolo object-detection deepstream darknet paddle tensorrt ultralytics nvidia-deepstream-sdk ppyoloe mmyolo rtmdet rtdetr
-
Updated
Jul 24, 2025 - C++
Improve this page
Add a description, image, and links to the tensorrt topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tensorrt topic, visit your repo's landing page and select "manage topics."