Podlipodcast player Webplayer

Embodied AI 101

Embodied AI 101

LaLa-World: Can Language Scale Latent World Models for Robots?

Embodied AI 101 · Oct 27, 2026 · 13:36

0:0013:36

Listen in the Podli app 🎧

Follow your favourite podcasts, listen offline and in the car with CarPlay and Android Auto, and always pick up where you left off. Free to try.


Can natural language let one robot world model learn from incompatible control logs and ordinary video? This episode explains how LaLa-World unifies transition conditioning while keeping future prediction in visual feature space. ([june-page.github.io](https://june-page.github.io/lala-world/)) We unpack three findings: joint training improves average simulated planning success over JEPA-WMs; image and video co-training improves robustness to reworded actions; and predictive pretraining transfers into an action-generating policy. ([github.com](https://github.com/junha1125/LaLa-World)) The discussion follows the data pipeline from simulation trajectories and DROID's Franka manipulation recordings to captioned video and image-edit pairs, then separates goal-image model predictive control from LaLa-Policy fine-tuning on LIBERO and RoboCasa. ([raw.githubusercontent.com](https://raw.githubusercontent.com/junha1125/LaLa-World/main/data_preparation/README.md)) We explain why representation-based generation makes RAEv2 an informative comparison, and how Cosmos Policy supplies the policy-learning precedent. ([arxiv.org](https://arxiv.org/html/2605.18324v1)) The central limitation is physical execution: the DROID evaluation is offline, while LaLa-Policy's demonstrated execution is in simulation. ([arxiv.org](https://arxiv.org/html/2610.27851v2)) For roboticists working on latent world models, language-conditioned control, and mixed-data pretraining, the episode identifies the architectural idea worth testing. Could a better interface for experience matter as much as a larger predictor?

Episodes: Embodied AI 101

PodliGet the free Podli app
↓ App