Model response breaking if models decide to do web search multiple times


Case: a model starts with a web search, gets few results, but then again starts to do a websearch and response ends, nothing further!

My guess: Seems like you have backend config where you restrict only one web search tool call

Reasoning: If just add this to the prompt: “Please avoid multiple web searches as platform does not support it” the model never does the multiple web searches and response does not break.

Solution: Either let the model do multiple web searches of add the above as a system prompt in your backend.

Details:
url: https://t3.chat/share/c1fkn82ga1
model: latest haiku

Please authenticate to join the conversation.

Upvoters
Status

Completed

Board
🐛

Bug Reports

Subscribe to post

Get notified by email when there are changes.