Source
When this applies
when deciding whether to give any intelligent system (human or AI) more time/resources before judging its capability ceiling
The takeaway
Before concluding a system lacks a capability, test what happens when you give it substantially more time or resources to work the problem.
Why it works
Allowing a system more iterations to think, try alternatives, and revise before committing to an answer increases the probability of finding a correct solution, with accuracy rising as a function of compute/time budget.
One level up
Capability ceilings are often budget ceilings in disguise — test the budget before trusting the ceiling.
Where it stops holding
This stops working when the problem requires a fundamentally new theory or framework rather than more search within an existing one — simply adding compute doesn't invent new paradigms.
Detail
rule: Give a reasoning model more inference-time compute before concluding it can't solve a hard problem.
threshold: With enough test-time compute budget, the model solved the problem around 50% of the time.
rationale: Test-time/inference compute lets models think, try different approaches, and revise before finalizing, which measurably improves outcomes on hard problems.
In their words
Well, I think the biggest proof is that if you look at the plot in the official blog, if you give model more time to think, the accuracy on its problem grows faster. Like if you give it a lot of time, it can get almost 50% correct. So more thinking, more correctness.