custom maximum context window

context windows at the moment are designed for focused conversations, preserving as much context as possible at severe cost to usage limits for us. this makes it extremely costly to have a single chat window open for varied questioning where context hardly applies, at the moment you are burdened to create a ton of new windows to keep new questions cost low or suffer intense and increasing token usage. if we were able to set more aggressively small windows we could keep costs down and maintain usability for that use case.

Request area
-

Please authenticate to join the conversation.

Upvoters
Status

Gathering Interest

Board
💡

Feature Request

Subscribe to post

Get notified by email when there are changes.