Become a sponsor to Xunzhuo
Xunzhuo
Bit is exploring the frontier technologies in combination of networking and LLM at Tencent. He is currently working on AI Infrastructure. Previously, he has been involved in research at UESTC NLP Lab.
Bit is leading the development of vLLM Semantic Router, an intelligent auto reasoning router for Efficient LLM Inference on Mixture-of-Models, saving tons of cost by advanced routing algorithm.
As a CNCF Ambassador and Linux Foundation LFAPAC, Bit serves on the Envoy Gateway Steering Committee. He also maintains multiple projects including Envoy AI Gateway, vLLM AIBrix, Istio, Kiali, Aeraki-Mesh, and Merbridge, as well as the approver of Higress and MOSN. Additionally, Bit contributes as a Kubernetes Gateway API and Kubernetes Ingress2Gateway reviewer and member of Kubernetes.
Featured work
-
vllm-project/aibrix
Cost-efficient and pluggable Infrastructure components for GenAI inference
Go 4,331 -
envoyproxy/gateway
Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway
Go 2,190 -
vllm-project/semantic-router
Intelligent Router for Mixture-of-Models
Rust 2,127 -
envoyproxy/ai-gateway
Manages Unified Access to Generative AI Services built on Envoy Gateway
Go 1,168