What happened?
Not sure if this was intentional, but I was rebuilding my own image from main-stable and discovered that litellm version got reverted to v1.77, which causedd issue when deployment get rolled out due to max_requests_before_restart argument does not exist on older version.
Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.79.3
Twitter / LinkedIn details
No response