Commit b93d4ab
Add unit tests for pod APIs under pkg/datastore (kubernetes-sigs#712)
* Add unit test coverage for pod APIs under datastore/pkg
* Add unit test coverage for pod APIs under datastore/pkg
* Add unit test coverage for pod APIs under datastore/pkg
* Add unit test coverage for pod APIs under datastore/pkg
* EPP Architecture proposal (kubernetes-sigs#683)
* initial changes
* Adding to proposal to give a quick barebones definition to refactor
* feedback changes
* more feedback addressing
* removed unused Fake struct (kubernetes-sigs#723)
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* epp: return correct response for trailers (kubernetes-sigs#726)
This looks like a copy paste error.
* Refactor scheduler to run plugins (kubernetes-sigs#677)
* Refactor scheduler to run plugins
* Add scheduler plugin latency metric
* Address comments
* Address comments
* Complete the InferencePool documentation (kubernetes-sigs#673)
* Initial guide for inference pool
* Add extensionReference to the InferencePool spec
* Fix list formatting
* Remove unused labels
* Autogenerate the spec
* Update site-src/api-types/inferencepool.md
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
* Update site-src/api-types/inferencepool.md
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
* Update site-src/api-types/inferencepool.md
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
* Update site-src/api-types/inferencepool.md
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
* Update site-src/api-types/inferencepool.md
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
* Update site-src/api-types/inferencepool.md
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
* Rename llm-pool names in rollout example
* Add use cases for replacing an inference pool
* Rewording the background section
* Create replacing-inference-pool.md
* Replace instructions with a link for how to replace an inference pool
* Update replacing-inference-pool.md
* Update mkdocs.yml
* Update replacing-inference-pool.md
* Update inferencemodel_types.go
* Update inferencepool.md
* Update site-src/guides/replacing-inference-pool.md
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
---------
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
* reduce log level in metrics logger not to trash the log (kubernetes-sigs#708)
* reduce log level in metrics logger not to trash the log
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* rename flush metrics to refresh metrics
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* revert log level
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
---------
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* few updates in datastore (kubernetes-sigs#713)
* few updates in datastore
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* PoolSet documentation
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* error phrasing
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* removed unused pool arg from PodUpdateOrAddIfNotExist
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* linter
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
---------
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* scheduler refactoring (kubernetes-sigs#730)
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* filter irrelevant pod in pod_reconciler (kubernetes-sigs#696)
* EPP: Update GetRandomPod() to return nil if no pods exist (kubernetes-sigs#731)
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
* Move filter and scorer plugins registration to a separate file (kubernetes-sigs#729)
* Move filters and scorers registration to filter/scorer specific files
* Default scheduler config contains empty list of scorers
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
* Default plugin is not a scorer any more
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
* fix scheduler test + lint comments
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
---------
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
* Update issue templates (kubernetes-sigs#738)
* Update issue templates
* Updates artifacts for v0.3.0-rc.1 release
Signed-off-by: Kellen Swain <kfswain@google.com>
* Updates bbr chart for v0.3.0-rc.1 release
Signed-off-by: Kellen Swain <kfswain@google.com>
* Updates artifacts for v0.3.0 release
Signed-off-by: Kellen Swain <kfswain@google.com>
* Adding blank issue template so that all issues start with label
---------
Signed-off-by: Kellen Swain <kfswain@google.com>
* Add unit test coverage for pod APIs under datastore/pkg
* few updates in datastore (kubernetes-sigs#713)
* few updates in datastore
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* PoolSet documentation
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* error phrasing
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* removed unused pool arg from PodUpdateOrAddIfNotExist
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* linter
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
---------
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* few updates in datastore (kubernetes-sigs#713)
* few updates in datastore
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* PoolSet documentation
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* error phrasing
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* removed unused pool arg from PodUpdateOrAddIfNotExist
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* linter
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
---------
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* Add unit test coverage for pod APIs under datastore/pkg
---------
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
Signed-off-by: Kellen Swain <kfswain@google.com>
Co-authored-by: Kellen Swain <kfswain@google.com>
Co-authored-by: Nir Rozenbaum <nirro@il.ibm.com>
Co-authored-by: John Howard <john.howard@solo.io>
Co-authored-by: Cong Liu <conliu@google.com>
Co-authored-by: Nicole Xin <nxin@google.com>
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
Co-authored-by: nayihz <smartczy@outlook.com>
Co-authored-by: Daneyon Hansen <daneyon.hansen@solo.io>
Co-authored-by: Maya Barnea <mayab@il.ibm.com>1 parent 60ed83f commit b93d4ab
1 file changed
+91
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
355 | 355 | | |
356 | 356 | | |
357 | 357 | | |
| 358 | + | |
| 359 | + | |
| 360 | + | |
| 361 | + | |
| 362 | + | |
| 363 | + | |
| 364 | + | |
| 365 | + | |
| 366 | + | |
| 367 | + | |
| 368 | + | |
| 369 | + | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
| 373 | + | |
| 374 | + | |
| 375 | + | |
| 376 | + | |
| 377 | + | |
| 378 | + | |
| 379 | + | |
| 380 | + | |
| 381 | + | |
| 382 | + | |
| 383 | + | |
| 384 | + | |
| 385 | + | |
| 386 | + | |
| 387 | + | |
| 388 | + | |
| 389 | + | |
| 390 | + | |
| 391 | + | |
| 392 | + | |
| 393 | + | |
| 394 | + | |
| 395 | + | |
| 396 | + | |
| 397 | + | |
| 398 | + | |
| 399 | + | |
| 400 | + | |
| 401 | + | |
| 402 | + | |
| 403 | + | |
| 404 | + | |
| 405 | + | |
| 406 | + | |
| 407 | + | |
| 408 | + | |
| 409 | + | |
| 410 | + | |
| 411 | + | |
| 412 | + | |
| 413 | + | |
| 414 | + | |
| 415 | + | |
| 416 | + | |
| 417 | + | |
| 418 | + | |
| 419 | + | |
| 420 | + | |
| 421 | + | |
| 422 | + | |
| 423 | + | |
| 424 | + | |
| 425 | + | |
| 426 | + | |
| 427 | + | |
| 428 | + | |
| 429 | + | |
| 430 | + | |
| 431 | + | |
| 432 | + | |
| 433 | + | |
| 434 | + | |
| 435 | + | |
| 436 | + | |
| 437 | + | |
| 438 | + | |
| 439 | + | |
| 440 | + | |
| 441 | + | |
| 442 | + | |
| 443 | + | |
| 444 | + | |
| 445 | + | |
| 446 | + | |
| 447 | + | |
| 448 | + | |
0 commit comments