I have the opposite problem. I'm not well-calibrated on when I'd want lower reasoning than what's available to me (and how to compare that to lower-tier models). OpenAI now has Luna, Terra and Sol, each at Low, Medium, High and Xhigh, with Pro/Ultra depending on harness and plan. That's ~15 possible combinations of model and reasoning level, and there isn't a satisfactory explanation of which one you want for any particular task.
I feel that work is basically split into two tiers, hard (which requires a good model and lots of reasoning by definition) and relatively easy (which won't consume much of my limits despite a great model and reasoning, so I may just as well keep it on Sol High).
> (which won't consume much of my limits despite a great model and reasoning, so I may just as well keep it on Sol High)
This equation significantly changes if you're paying API prices vs on a subscription. (Such as if you're integrating it into a different product, where it becomes worth it to figure out what the cheapest you can leverage is.)
I don’t see why they just don’t allow a smaller model to answer the question while letting the bigger one vet it. The vetting can be asynchronous and can be delivered after a few seconds (if it’s an easy query). If it’s a hard query, the UI can show the answer is currently being vetted or something.
It’s very confusing to me.
I’ve occasionally used pro to do high-level research and design. Then I ask it to create a prompt for Codex ultra. Ultra can do a lot of genetic benchmarking and testing to elucidate and resolve quandaries.
Asking questions to clarify user intent is a very low bar for intelligence. A bar that all SOTA models fail consistently at though. (It's both funny and legit infuriating when Opus, after having made a dozen wild assumptions without checking with you, then comes back with a request for clarification on some mundane topic).
I don't understand this at all. Whenever I ask Gemini 3.1 Pro Extended, or Claude 5 Max something in chat, the most I ever wait is maybe 30 seconds. Is that really so bad?
Auto-effort and similarly auto model routing suffer from a halting problem sort of issue: you don’t reliably know if a request is complex unless you use a complex model to make the decision.
I think it's nice to be able to make the model reason for dozens of minutes when you want to go deep on a topic, even if the router thinks it's an easy question.
> I can't wait to never see a reasoning button ever again.
I hope to see a memory-less mode that is not incognito. Want fresh contexts sometimes, but also want to keep the chats saved in history. Memory can spoil some creative work, it dials the model in too tightly.