Skip to main content

Deleting messages from a chat

The previous messages get in the context which:

  • is limited in size

  • is very important for getting good responses

  • counts as input tokens which add up to the total cost

So, I think it would make sense to add a feature to be able to remove messages (questions or answers) from a chat, either when the context becomes too large to continue, or the model went in a bad direction and we don’t want it to stubbornly get attached to its previous responses.


And as a bonus this would save Ping input token costs ;)

Status: Gathering Interest3 comments

This request was merged into another request

Comments3

  • Yellow Flamingo

    I rather think the messages should be heavily summarized, like in my Collapse mod but showing tl;dr of what was answered

    • Copper Pickle

      yes that too! (why not both 😉)

  • Copper Pickle

    For more context (pun intended 🤣) :

    https://youtu.be/2q0BoioYSxQ?si=-6jOAaGD-ZT6plrq&t=345