Web serch causes the model to fail output

When using websearch (on anything other than Gemini) I get
I'm sorry, I couldn't find the information you were looking for. Please try again with more specific details.
I thought it was an OAI models not being able to handle it, but the same happens to Claude (even Opus!). Not sure what causes it.