High-performance discrete-event simulator (C++20/Python) for modeling agentic LLM traffic, KV cache dynamics, Prefill-Decode Disaggregation (PDD), and scheduling policies. Features roofline model analysis, K-Means request clustering, and a real-time web dashboard.
machine-learning data-visualization pybind11 scheduling-algorithms queuing-theory discrete-event-simulation cpp20 performance-modeling roofline-model kv-cache llm-inference ai-infrastructure continuous-batching datacenter-traffic
-
Updated
Jun 29, 2026 - C++