Skip to main content

Allow for local LLMs

Feature RequestModel Request

I’d love to see t3.chat being able to connect to local ollama endpoint and allow for local LLMs to run and display on the website. Why? Surely we’ve got open-webui for such efforts! No, I don’t. Somehow it’s broken on my machine with no way to install and run locally seamlessly. Also, t3.chat’s UI feels faster and superior to what I’ve seen around the web, zero complication, fast af and we get the perk of having other web LLMs integrating seamlessly with one another.

Status: Closed2 comments

Log in to comment and vote

Comments2

  • Sapphire Lynx

    This seems like it would be very valuable to enterprises that want to license this for on-prem use. I hope that the t3 team decides to do this even thought it is rejected. Personally, I just really like the idea of running things locally as much as possible.

  • Tan Tomato

    Update: I’ve managed to install open-webui, but I definitely still want this feature.