Show context window usage at the bottom of conversations
It would be very helpful to display how much of the model's context window is currently used, at the bottom of each conversation. (in app)
Why it matters
In long conversations, answer quality tends to degrade: earlier instructions get overlooked, details from the middle of the thread are lost, and the model may start contradicting itself. Today there is no way to know whether this is happening because the conversation is getting too long, or whether older messages are being truncated or summarized in the background. A visible indicator would let users decide when to start a fresh conversation instead of guessing.
Suggested implementation
A discreet progress bar or percentage below the input field (e.g. "42k / 200k tokens, 21%")
Recalculated for the currently selected model, since context window sizes differ between models
A color change or warning above a threshold (e.g. 75%) suggesting to start a new conversation
Optionally, a clear notice when older messages have been truncated or summarized
Bonus: a "summarize and continue in a new conversation" button to carry key context over
This would improve answer reliability and give users more control over long working sessions.
Log in to comment and vote
No comments yet
Be the first to share your thoughts.