Skip to content

Pull requests: vllm-project/production-stack

New pull request New
55 Open 440 Closed
55 Open 440 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Bugfix][Router] use model_type instead of model_label
#705 opened Sep 19, 2025 by max-wittig Loading…
2 of 3 tasks
1
[Feat] Add Production-ready vLLM EKS terraform stack tutorial
#704 opened Sep 19, 2025 by brokedba Loading…
22
[bugfix] Add annotation to pod after loading the lora adapter to trigger the modify event
#703 opened Sep 18, 2025 by zerofishnoodles Loading…
3 tasks done
1
5
[vllm-router] fall back to remote tokenizer as 2nd path
#702 opened Sep 18, 2025 by panpan0000 Loading…
8
[Build] Update LMCache dependency to version 0.3.6
#701 opened Sep 17, 2025 by ikaadil Loading…
3 tasks
2
[Misc] bump up otel col version and use a simplified image
#698 opened Sep 17, 2025 by JaredTan95 Loading…
3 tasks done
4
[Bugfix] kv aware routing for lmcache 0.3.5
#697 opened Sep 15, 2025 by zerofishnoodles Loading…
3 tasks done
4
Introduction of /v1/responses endpoint
#691 opened Sep 9, 2025 by sebastiaanvduijn Loading…
1
11
feat: allow for configuration of number of uvicorn workers
#689 opened Sep 9, 2025 by TheCodeWrangler Loading…
8 tasks done
9
[Docs] Correct parameter in transcription API tutorial
#685 opened Sep 7, 2025 by davidgao7 • Draft
3 tasks done
3
[Bugfix] cache server yaml err
#677 opened Sep 4, 2025 by yyzxw Loading…
3 tasks done
1
3
[Misc] Add Makefile to run full pipeline with a single command
#675 opened Sep 3, 2025 by ikaadil Loading…
12
[Router][Feat][Bugfix] Add Swagger UI (OpenAPI) support with Pydantic request models + fix rewrite Content-Length + test
#672 opened Sep 2, 2025 by JaredforReal Loading…
1
9
[Feat][Router] Add TTFT Routing
#670 opened Sep 1, 2025 by chickeyton • Draft
3 tasks
1
44
[Feat][PD] lastest PD support from LMCache with NIXL
#669 opened Aug 28, 2025 by kobe0938 Loading…
3 tasks
15
[Bug][Router] ZombieIP: router routes to model pod that doesn't exist anymore
#666 opened Aug 26, 2025 by jonoillar Loading…
3 tasks
1
25
[CI] Fix bug for PD CI when router is running before vllm instance running
#663 opened Aug 26, 2025 by zerofishnoodles Loading…
3 tasks done
1
[Build] use uv with cache mount for faster docker builds
#657 opened Aug 23, 2025 by Hexoplon Loading…
3 tasks done
3
[Feat][Router] add ability to specify params to drop
#650 opened Aug 20, 2025 by max-wittig Loading…
3 tasks done
6
[Feat][Router] Add simple request migration for vLLM failure
#643 opened Aug 12, 2025 by lucas-tucker Loading…
14
Add max_model_len field support to router
#638 opened Aug 11, 2025 by llm-net Loading…
4
[Router][Improvement] Enhanced Performance Configuration with uvicorn[standard] and uvloop Integration
#636 opened Aug 6, 2025 by ikaadil Loading…
3 tasks done
1
7
[CI/Build] Optimize Docker image size by excluding test and example files (#615)
#627 opened Aug 2, 2025 by ikaadil Loading…
3 tasks done
6
[Feat] Router-side queuing support
#626 opened Aug 2, 2025 by allytotheson Loading…
18
[Feat] Implement workflow-aware routing for multi-agent AI workflows
#625 opened Aug 2, 2025 by hongsw Loading…
6 tasks done
14
ProTip! Add no:assignee to see everything that’s not assigned.