I’ve been curious. Does temperature work the same way for all models so far? Or does each have a different best default?
If so, might be more user friendly to mask as a [Deterministic mode] toggle.
Mark Florkowski
Team
Each model behaves differently to specific values, but the concept is the same.
Temperature = 0 would be “deterministic mode” probably, but also would produce pretty bad outputs in most cases. We try to tune the default to a reasonable balance for most tasks.
Emerald Alligator
agreed!
Copper Eraser
I only would like this in an “advance” view. I think this is one of those things that are nice if you understand whats happening. But is just a random extra button when you dont understand it
Pink Pulsar
100% agreed. it can be in the config page of the web app
Log in to comment and vote
Comments7
Apricot Koala
I’ve been curious. Does temperature work the same way for all models so far?
Or does each have a different best default?
If so, might be more user friendly to mask as a [Deterministic mode] toggle.
Mark Florkowski
Each model behaves differently to specific values, but the concept is the same.
Temperature = 0 would be “deterministic mode” probably, but also would produce pretty bad outputs in most cases. We try to tune the default to a reasonable balance for most tasks.
Emerald Alligator
agreed!
Copper Eraser
I only would like this in an “advance” view. I think this is one of those things that are nice if you understand whats happening. But is just a random extra button when you dont understand it
Pink Pulsar
100% agreed. it can be in the config page of the web app
Lime Sunbeam
YEEESSSSSS
Maroon Quesadilla
yesss