Source
Y Combinator Startup Podcast — The State of Startups in 2026 (September 18, 2026) ·
at 26:17 ▸
When this applies
when adapting a general-purpose foundation model to a high-stakes, real-time, narrow-domain task
The takeaway
The more an application domain diverges from a foundation model's training distribution in dimensionality and latency requirements, the more essential custom fine-tuning becomes before deployment.
Why it works
Physical robotics tasks require real-time, low-latency responses to stimuli (unlike LLMs which can 'go and come back'), and operate in high-dimensional 3D space rather than language space, so general foundation models must be fine-tuned on custom, task-specific data to be reliable enough for deployment.
One level up
General-purpose intelligence provides a starting point, but domain-specific reliability requires domain-specific adaptation, especially where failure has real-world physical consequences.
Where it stops holding
This stops working when the task is low-stakes or tolerant of latency/errors, in which case the general foundation model may suffice out of the box.
Detail
procedure:- Start with a general robotics foundation model (e.g., Pi) as a baseline.
- Collect thousands of hours of task-specific footage/data (e.g., putting things in boxes, data center cabling).
- Fine-tune the foundation model on that custom data for the specific vertical task.
- Validate real-time responsiveness given the task's physical risk tolerance.
benchmarks: {"example":"Ultra: thousands of hours of box-packing footage fine-tuned from the Pi model"}
rationale: Out-of-the-box general models aren't reliable enough for real-time, physically consequential vertical tasks without fine-tuning.
In their words
all the YC companies that are using physical intelligence as models to deploy robotics, They're all fine-tuning the Pi models. I don't think any of them are able to use the Pi models out of the box.