Source
Dwarkesh Podcast — A billion years of evolution in a single afternoon — George Church (June 26, 2025) ·
at 40:13 ▸ ·
at 44:14 ▸
When this applies
when a predictive model gets the 'shape' right but not the 'function', replace single-shot simulation with massively parallel real-world variation-and-selection cycles
The takeaway
When your model's predictions are precise but not reliably predictive of the outcome that matters, substitute real, parallelized trial libraries guided loosely by the model, rather than trusting simulation alone.
Why it works
Structural prediction tools can be precise on geometry yet blind to functional subtleties (e.g., one amino acid swap preserves fold but kills function); real experimental libraries test actual function directly without the layered assumptions of simulation (QED→QM→molecular mechanics), and biology allows these tests at massive, cheap, fast scale.
One level up
Precision in a proxy metric (shape, score, etc.) is not the same as accuracy in the metric that matters (function); always test if your evaluation metric is a true stand-in for the real objective.
Where it stops holding
This stops working when real-world trials are too slow, expensive, or risky to run at scale (unlike biology's cheap billions-of-variants libraries), or when the search space can't be meaningfully narrowed by the model first.
Detail
rule: Use AI to pre-filter out clearly neutral/lethal variants, then physically test the 'quasi-neutral but likely game-changing' middle set in real experiments at huge scale.
threshold: Can do ~10^14-10^17 in vitro tests; billions when cells are involved — vastly faster than evolution's rate of a few base-pair changes per million years.
rationale: This gives 100% precision because it's the real system, not an approximated simulation, and it's cheap/fast enough to iterate repeatedly.
In their words
If you substitute an alanine for a serine in a serine protease, it will have exactly the right fold. It will be precise to a fraction of an angstrom overall average, but it won't function. It just won't function.