context windows at the moment are designed for focused conversations, preserving as much context as possible at severe cost to usage limits for us. this makes it extremely costly to have a single chat window open for varied questioning where context hardly applies, at the moment you are burdened to create a ton of new windows to keep new questions cost low or suffer intense and increasing token usage. if we were able to set more aggressively small windows we could keep costs down and maintain usability for that use case.
Please authenticate to join the conversation.
Gathering Interest
Feature Request
Get notified by email when there are changes.
Gathering Interest
Feature Request
Get notified by email when there are changes.