Skip to main content

Is cached input tokens a usage factor?

Feature Request

More of a question than feedback.

Should I avoid switching models in long threads to save usage?

Status: Closed1 comment

Log in to comment and vote

Comments1

  • Mark Florkowski

    Team

    caching is taken into account where available.