Skip to content

@ModelTC ModelTC

Change the repository type filter

All

    Repositories list

    59 repositories

    • LightLLM

      Public
      LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
      nlpdeep-learningllamagptmodel-servingllmopenai-triton
      Python
      •
      Apache License 2.0
      •282•3.7k•81•25•Updated Nov 1, 2025Nov 1, 2025

    • LightX2V

      Public
      Light Video Generation Inference Framework
      video-generationdiffusion-modelswan-videoauto-regressive-diffusion-model
      Python
      •45•730•38•1•Updated Nov 1, 2025Nov 1, 2025

    • LightKernel

      Public
      HTML
      •
      Apache License 2.0
      •0•3•0•0•Updated Oct 31, 2025Oct 31, 2025

    • LightCompress

      Public
      A powerful toolkit for compressing large models including LLM, VLM, and video generation models.
      benchmarkdeploymenttoolevaluationpruningquantizationwanawqlarge-language-modelsllm
      Python
      •
      Apache License 2.0
      •63•599•39•0•Updated Oct 30, 2025Oct 30, 2025

    • ComfyUI-LightVAE

      Public
      Python
      •
      Apache License 2.0
      •5•20•6•0•Updated Oct 30, 2025Oct 30, 2025

    • FlashVSR

      Public
      Towards Real-Time Diffusion-Based Streaming Video Super-Resolution — An efficient one-step diffusion framework for streaming VSR with locality-constrained sparse attention and a tiny conditional decoder.
      Python
      •
      Apache License 2.0
      •45•0•0•0•Updated Oct 28, 2025Oct 28, 2025

    • general-sam-py

      Public
      Python bindings for general-sam and some utilities
      Python
      •
      Apache License 2.0
      •0•5•0•4•Updated Oct 27, 2025Oct 27, 2025

    • mtc-token-healing

      Public
      Token healing implementation in Rust
      Rust
      •
      Apache License 2.0
      •0•4•0•3•Updated Oct 27, 2025Oct 27, 2025

    • ComfyUI-Lightx2vWrapper

      Public
      ComfyUI custom node for lightx2v
      comfyuicomfyui-nodes
      Python
      •
      MIT License
      •5•46•0•0•Updated Oct 26, 2025Oct 26, 2025

    • Qwen-Image-Lightning

      Public
      Qwen-Image-Lightning: Speed up Qwen-Image model with distillation
      Python
      •
      Apache License 2.0
      •36•893•17•0•Updated Oct 14, 2025Oct 14, 2025

    • HBP

      Public
      [NIPS 2025] This is the official PyTorch implementation of "Hierarchical Balance Packing: Towards Efficient Supervised Fine-tuning for Long-Context LLM".
      Python
      •
      Apache License 2.0
      •0•3•0•0•Updated Sep 30, 2025Sep 30, 2025

    • TFMQ-DM

      Public
      [CVPR 2024 Highlight & TPAMI 2025] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Models".
      highlightquantizationcvprldmdiffusion-modelstpamipost-training-quantizationddimstable-diffusioncvpr2024
      Jupyter Notebook
      •
      Apache License 2.0
      •4•106•0•0•Updated Sep 29, 2025Sep 29, 2025

    • Wan2.2-Lightning

      Public
      Wan2.2-Lightning: Speed up wan2.2 model with distillation
      Python
      •
      Apache License 2.0
      •1.2k•211•17•0•Updated Sep 28, 2025Sep 28, 2025

    • modeltc.github.io

      Public
      HTML
      •0•0•0•0•Updated Sep 15, 2025Sep 15, 2025

    • greedy-tokenizer

      Public
      Greedily tokenize strings with the longest tokens iteratively.
      Python
      •
      Apache License 2.0
      •0•0•0•3•Updated Sep 15, 2025Sep 15, 2025

    • general-sam

      Public
      A general suffix automaton implementation in Rust with Python bindings
      Rust
      •
      Apache License 2.0
      •0•8•0•0•Updated Sep 8, 2025Sep 8, 2025

    • lightllm-blog

      Public
      SCSS
      •
      MIT License
      •0•1•0•0•Updated Sep 4, 2025Sep 4, 2025

    • SageAttention

      Public
      Quantized Attention achieves speedup of 2-5x and 3-11x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.
      Cuda
      •
      Apache License 2.0
      •250•2•0•0•Updated Aug 16, 2025Aug 16, 2025

    • fa3

      Public
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •1•0•0•0•Updated Aug 7, 2025Aug 7, 2025

    • flash-attn-3-build

      Public
      Dockerfile
      •2•0•0•0•Updated Jul 24, 2025Jul 24, 2025

    • HarmoniCa

      Public
      [ICML 2025] This is the official PyTorch implementation of "🎵 HarmoniCa: Harmonizing Training and Inference for Better Feature Caching in Diffusion Transformer Acceleration".
      accelerationicmlditpixartdiffusion-modelsdiffusion-transformerpixart-sigmafeature-cachingicml-2025
      Python
      •
      Apache License 2.0
      •1•43•2•0•Updated Jul 10, 2025Jul 10, 2025

    • LightTTS

      Public
      Light-tts is a lightweight TTS inference framework optimized for CosyVoice2, enabling fast and scalable speech synthesis in Python.
      Python
      •
      Apache License 2.0
      •0•11•0•0•Updated Jun 24, 2025Jun 24, 2025

    • OmniBal

      Public
      [ICML 2025] This is the official PyTorch implementation of "OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance".
      vlmicml-2025
      Python
      •
      Apache License 2.0
      •3•25•3•0•Updated Jun 16, 2025Jun 16, 2025

    • lightx2v_comfyui_node

      Public
      0•0•0•0•Updated Apr 28, 2025Apr 28, 2025

    • MQBench

      Public
      Model Quantization Benchmark
      Python
      •
      Apache License 2.0
      •142•847•11•6•Updated Apr 20, 2025Apr 20, 2025

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •2.1k•0•0•0•Updated Apr 17, 2025Apr 17, 2025

    • verl

      Public
      verl: Volcano Engine Reinforcement Learning for LLMs
      Python
      •
      Apache License 2.0
      •2.4k•1•0•0•Updated Mar 17, 2025Mar 17, 2025

    • LLM_QAT

      Public
      Python
      •0•0•0•0•Updated Feb 19, 2025Feb 19, 2025

    • quant_horizon

      Public
      Cuda
      •
      Apache License 2.0
      •1•11•0•0•Updated Jan 10, 2025Jan 10, 2025

    • EasyLLM

      Public
      Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing usability, it also ensures training efficiency.
      Python
      •
      Apache License 2.0
      •8•48•0•0•Updated Sep 18, 2024Sep 18, 2024