Display Context Window Status / Help User Manage Context Window

It would be helpful to know when the context window is exceeded or about to be reached. The user can then ‘refresh’ context in their next request or optimize their request down to fit in the context window — to hopefully get a better response.

For example, from LM Studio

In the ideal scenario there would be a visual indication of how much of the chat history is in the context window (for example a vertical line that is colored in the area of messages within the context window), but I propose basic feedback would be better than none.

Please authenticate to join the conversation.

Upvoters
Status

Gathering Interest

Board
💡

Feature Request

Subscribe to post

Get notified by email when there are changes.