Description
LLM context can exceed model token limit. Extra tokens silently dropped. Important information lost.
Expected Behavior
Check context length before inference. Raise error if exceeds limit.
Actual Behavior
File: src/context/manager.py
No length validation: llm.generate(context)
GSSoC Points Estimate: Level 1 (Bug)
Suggested Labels
- gssoc:approved
- type:bug
- severity:medium
- area:context
Description
LLM context can exceed model token limit. Extra tokens silently dropped. Important information lost.
Expected Behavior
Check context length before inference. Raise error if exceeds limit.
Actual Behavior
File: src/context/manager.py
No length validation: llm.generate(context)
GSSoC Points Estimate: Level 1 (Bug)
Suggested Labels