Skip to main content

Claude Thinking Response Limited

For some reason thinking models (outside of openai?) like to include the entire code they want to return within their reasoning. It appears that this is the cause of the actual response later not successfully being fully generated due to a token limit, probably making reasoning models far less effective than they should be (as you’re essentially only using the CoT).

Status: Completed

Log in to comment and vote

No comments yet

Be the first to share your thoughts.