What happened?
I was debugging a call to the method: litellm.get_model_info("together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo") when I noticed that several recursive calls were being executed unnecessarily. The problem is that this method is every time a together model would be used.
They are happening in this order:
get_model_info->get_supported_openai_params->litellm.TogetherAIConfig().get_supported_openai_params(model=model)->get_model_info
Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.60.0
Twitter / LinkedIn details
No response
What happened?
I was debugging a call to the method:
litellm.get_model_info("together_ai/meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo")when I noticed that several recursive calls were being executed unnecessarily. The problem is that this method is every time a together model would be used.They are happening in this order:
get_model_info->get_supported_openai_params->litellm.TogetherAIConfig().get_supported_openai_params(model=model)->get_model_info
Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.60.0
Twitter / LinkedIn details
No response