Step-by-step pauser
When the LLM generates a step-by-step guide, sometimes I have an observation even at step 1 that make the later steps irrelevant, using up space and generation time. Why not allow users to enter a step-by-step mode where you could confirm recommendations 1 step at a time and proceed to the next one if everything is fine or generate a new set of next steps based on user feedback if a problem occurred? It would also make it easier to clarify which step am I referring to when I write a response.
Log in to comment and vote
Comments2
Apricot Mat
Just tell the LLM to do exactly that.
Aqua Chameleon
Why don’t you tell the LLM to generate one step per turn? o.oa
There’s always the button to interrupt responses. It’s handy when the bot is obviously heading in the wrong direction. (Or sometimes I just immediately use the retry button.)
I feel like I must be missing something..?