Skip to content

Commit 77a2a20

Browse files
shaneuttkfswain
andauthored
Update README.md
Co-authored-by: Kellen Swain <[email protected]>
1 parent 5fbb16d commit 77a2a20

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ This project offers tools for [AI Inference], enabling developers to build [Infe
77

88
## Concepts and Definitions
99

10-
AI/ML is changing rapidly, and [Inference] goes beyond basic networking to include complex traffic routing and optimizations. Below are key terms for developers:
10+
AI/ML is changing rapidly, and [Inference] goes beyond basic networking to include complex traffic routing and optimizations. Below are key terms used within this project:
1111

1212
- **Scheduler**: Makes decisions about which endpoint is optimal (best cost / best performance) for an inference request based on `Metrics and Capabilities` from [Model Serving Platforms].
1313
- **Metrics and Capabilities**: Data provided by model serving platforms about performance, availability and capabilities to optimize routing. Includes things like [Prefix Cache] status or [LoRA Adapters] availability.

0 commit comments

Comments
 (0)