Skip to main content

Feature to filter by context limit.

Feature Request

After the release of Llama 4 Scout with a 10M token context window, I had the following idea:

I would like the ability to filter different models based on the amount of context they can handle. For example, it would be useful to have filters for models that support:

  • More than 100k tokens

  • More than 1M tokens

  • More than 10M tokens

...and so on.

2 comments

This request was merged into another request

Comments2

  • Mark Florkowski

    Team

    Tokens are not a very “human friendly” concept, but we do have plans for how to indicate more important deciding factors to users.

    • Azure Mustard

      It might bit unintuitive at first, but it's clear that T3Chat is designed with casual and power users in mind.

      Personally, I often paste large chunks of text for LLMs to parse and summarize. A token filter would be incredibly useful for that; maybe it could be an optional toggle in settings, off by default.

      Since I'm constantly trying to balance speed, intelligence, and context limits, having a tool like this would really help me fine-tune that balance.

      Hope you'll consider adding it!