Skip to main content

Search lite

When I’m using a smaller model like Gemini 2.0 Flash lite and I have search enabled, the time to get the answer to a simple question is too long. For certain questions you have to enable search.
It feels to me that this type of model should run fewer searches, 5 or less and have a strict timeout so that they only include results that repond in time.
If all I want to know is the what is the latest version of nextjs this shouldn’t take 60 seconds to find out.
This is only a papercut, generally I do love using T3chat.

Status: Planned

Log in to comment and vote

No comments yet

Be the first to share your thoughts.