(Feat) - Allow calling Nova models on /bedrock/invoke/

[ishaan-jaff]

(Feat) - Allow calling Nova models on /bedrock/invoke/

• Uses the existing Nova transformations for the /invoke routes
• There's a minor difference between Nova on converse vs invoke - which we handle in the AmazonInvokeNovaConfig
• Minor difference in where the stream content is located from the converse vs invoke routes

response = litellm.completion(
  model="bedrock/invoke/us.amazon.nova-micro-v1:0",
  messages=[]
)

Relevant issues

Type

🆕 New Feature
✅ Test

Changes

[REQUIRED] Testing - Attach a screenshot of any new tests passing locally

If UI changes, send a screenshot/GIF of working UI fixes

e2e testing for Nova JSON mode

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Feb 8, 2025 9:02pm

[codecov]

Codecov Report

Attention: Patch coverage is 57.50000% with 17 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
...voke_transformations/amazon_nova_transformation.py	42.85%	12 Missing ⚠️
...voke_transformations/base_invoke_transformation.py	66.66%	3 Missing ⚠️
litellm/llms/bedrock/chat/invoke_handler.py	33.33%	2 Missing ⚠️

📢 Thoughts on this report? Let us know!

[ishaan-jaff]

increased test cov based on codecov report