CodeGate doesn't include reasoning for OpenRouter thinking models

[jhrozek]

It's possible to follow the reasoning of the thinking models like DeepSeek through OpenRouter, see https://openrouter.ai/announcements/reasoning-tokens-for-thinking-models

However, that doesn't work through codegate it seems.

[jhrozek]

Looks like we need to make sure that the "include_reasoning": true flag is included in the request. Hopefully, litellm will not strip the request or reply.

[jhrozek]

so on our side, the fix is simple, but won't work until BerriAI/litellm#8193 is fixed.

[jhrozek]

parking