Skip to content
@LlamaEdge

LlamaEdge

The easiest, smallest and fastest local LLM runtime and API server. Creating cross-platform LLM agents and web services in Rust.

Pinned Loading

  1. LlamaEdge LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 1.3k 107

  2. rag-api-server rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    Rust 41 10

  3. sd-api-server sd-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 20 2

  4. whisper-api-server whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 13 3

  5. tts-api-server tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    Rust 7 2

  6. llama-proxy-server llama-proxy-server Public

    Rust 2

Repositories

Showing 10 of 25 repositories
  • LlamaEdge Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/LlamaEdge’s past year of commit activity
    Rust 1,250 Apache-2.0 107 6 2 Updated Feb 20, 2025
  • rag-api-server Public

    A RAG API server written in Rust following OpenAI specs

    LlamaEdge/rag-api-server’s past year of commit activity
    Rust 41 Apache-2.0 10 12 2 Updated Feb 17, 2025
  • whisper-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/whisper-api-server’s past year of commit activity
    Rust 13 3 0 0 Updated Feb 11, 2025
  • chatbot-ui Public
    LlamaEdge/chatbot-ui’s past year of commit activity
    TypeScript 18 MIT 17 0 0 Updated Feb 7, 2025
  • tts-api-server Public

    The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

    LlamaEdge/tts-api-server’s past year of commit activity
    Rust 7 2 1 0 Updated Feb 6, 2025
  • www Public

    Public website

    LlamaEdge/www’s past year of commit activity
    HTML 0 3 0 0 Updated Feb 4, 2025
  • docs Public
    LlamaEdge/docs’s past year of commit activity
    JavaScript 4 Apache-2.0 6 0 2 Updated Feb 4, 2025
  • kw-search-server Public
    LlamaEdge/kw-search-server’s past year of commit activity
    Rust 0 0 0 0 Updated Jan 22, 2025
  • llama-proxy-server Public
    LlamaEdge/llama-proxy-server’s past year of commit activity
    Rust 2 0 0 0 Updated Jan 16, 2025
  • llamaedge-rust Public

    Rust API for LlamaEdge

    LlamaEdge/llamaedge-rust’s past year of commit activity
    Rust 0 0 0 0 Updated Jan 13, 2025
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…