Show response statistics (tokens per second, total time elapsed)

Can we get a small subtext on the bottom of each response that gives us information on how fast 🐇⚡ the response was?

I would like the stats

  • tok/sec

  • total time

I’ve attached a screenshot of what LM Studio does for reference.

What they do is they always show the line for the last response but it is visible on hover for previous responses.

Please authenticate to join the conversation.

Upvoters
Status

Completed

Board
💡

Feature Request

Subscribe to post

Get notified by email when there are changes.