The previous messages get in the context which:
is limited in size
is very important for getting good responses
counts as input tokens which add up to the total cost
So, I think it would make sense to add a feature to be able to remove messages (questions or answers) from a chat, either when the context becomes too large to continue, or the model went in a bad direction and we don’t want it to stubbornly get attached to its previous responses.
And as a bonus this would save Ping input token costs ;)
Please authenticate to join the conversation.
Gathering Interest
Feature Request
Get notified by email when there are changes.
Gathering Interest
Feature Request
Get notified by email when there are changes.