feat(metrics): enhance cache efficiency metrics - #720

feat(metrics): enhance cache efficiency metrics#720

JaredTan95 wants to merge 1 commit into

llm-d:mainllm-d/llm-d-kv-cache:mainfrom

JaredTan95:cache-efficiency-metricsJaredTan95/llm-d-kv-cache:cache-efficiency-metricsCopy head branch name to clipboard