Source
Y Combinator Startup Podcast — The Fastest Path To Super Intelligence (February 27, 2026) ·
at 10:27 ▸
When this applies
when deciding whether a human expert should manually inspect and correct the inputs to an automated system, versus letting the system learn to interpret its own inputs
The takeaway
When an automated system's job depends on understanding the data, resist the urge to manually override its data interpretation even when outputs look surprising or imperfect, because the system may be working for different, valid reasons.
Why it works
If the optimization system can itself discover failure modes and effective strategies from the data, human intervention to 'clean up' outputs may remove signal the system is using productively, even if a human wouldn't have produced that output themselves.
One level up
Trust process-level automation over spot manual correction when the automation's outputs are measurably effective, even if their form is unintuitive.
Where it stops holding
This stops working when the system's outputs are demonstrably wrong in ways that hurt measured performance, not just ones that merely look unusual to a human reviewer.
Detail
rule: If the automated meta-system produces something unexpected or even technically 'wrong' in the output, but the overall system performance is strong, leave it as-is rather than manually editing it.
threshold: Applies when the system's measured end performance validates the approach, even amid individually odd artifacts (e.g., one wrong example left unchanged).
rationale: Historically ML required deep human understanding of the dataset; the new approach outsources dataset understanding to the AI itself, including discovering failure modes and robust reasoning strategies.
In their words
And one of the examples is actually wrong. But we didn't change it. We're like, well, this is, you know, this is the thing that it output. We'll just leave it be. You know, we don't want to go in and monkey around with things.