Source
The a16z Show — The Missing Infrastructure for AI Agents: Documents | Reducto’s Adit Abraham (October 21, 2026) ·
at 32:03 ▸
When this applies
when an automated data-extraction error propagates into a high-stakes downstream decision without a human catching it
The takeaway
In domains where humans are too overloaded to verify automation output, the automation's error rate effectively becomes the system's true error rate — there's no real fallback human check despite the appearance of 'human in the loop.'
Why it works
Overworked human reviewers (doctors) cannot realistically double-check every page of tens-of-thousands-page patient packets, so they trust the automated pipeline's output as ground truth; a single misread word (pain vs chest pain) then silently alters a real clinical/insurance decision.
One level up
Never assume a 'human in the loop' is an effective safety net without checking whether that human actually has the capacity/time to meaningfully review the volume involved.
Where it stops holding
This stops working as a universal claim when document volumes are small enough, or reviewers are not time-constrained, such that genuine human verification is feasible.
Detail
situation: A healthcare search customer processes physical patient document packets that can be inches thick, read by doctors who are already overworked.
decision: N/A — illustrative of current status quo rather than a Reducto decision; shown as motivation for needing high-accuracy, trustworthy pipelines.
outcome: An initial pipeline read 'pain' instead of 'chest pain,' leading to a rejected claim because a doctor's search for history of the symptom came back negative; current sub-pipelines for this kind of data can be sub-50% accurate, leaving best case as an approximate location flag for a human to check, who often cannot due to volume.
lesson: In consequential domains, low baseline accuracy plus the fiction of human review creates compounding real-world harm; the fix is to push accuracy, cost, and latency enough that full automation is trustworthy rather than papering over the gap with a nominal human checkpoint.
In their words
In those sorts of situations, we actually find that there are cases where it's like sub 50%. Like the best you can do is have some approximation of where information sits, and then a human has to look at it.