Source
Y Combinator Startup Podcast — The GPT Moment for Robotics Is Here (April 16, 2026) ·
at 23:01 ▸ ·
at 26:17 ▸
When this applies
when a latency-sensitive system needs the intelligence of a large, centrally-updated model without paying the cost of deploying that model at the edge
The takeaway
Pipeline inference requests ahead of need, overlapping compute latency with ongoing execution, so a centralized/heavier resource can serve a real-time edge process.
Why it works
By predicting an 'action chunk' covering the next interval and issuing the next query for a new chunk partway through execution (ensuring consistency between successive chunks), the system hides network/inference latency inside the execution window, so the robot never has to literally wait on the cloud.
One level up
Decoupling where intelligence is computed from where action is executed lets you simplify and future-proof the execution hardware, as long as you solve the latency-hiding pipelining problem.
Where it stops holding
This stops working when network connectivity to the cloud is unreliable/high-latency beyond what pipelining can absorb, or when the task requires reaction times faster than one action-chunk window.
Detail
procedure:- Predict an action chunk (sequence of actions) covering roughly the next 100ms
- Begin executing that chunk locally
- When ~50ms of the chunk remains, query the cloud model for the next chunk
- Ensure the new chunk is consistent with the trajectory of the current one so the transition is smooth
- Switch to the new chunk once the current one completes
benchmarks: {"chunk_window":"~100ms action chunk, query triggered at ~50ms remaining"}
rationale: Because the robot always has a buffer of already-decided actions to execute, the cloud round-trip latency never has to be waited on directly.
In their words
So, you know, it's not just one action. And if I have an action chunk that I can execute for 100 millisecond and 50 milliseconds in, I want to predict another action chunk, and I'm going to transition to that new action chunk after my current 50 millisecond is over.