Podlipodcast player Webplayer

Embodied AI 101

Embodied AI 101

Urbex: Can Agentic VLM Search Improve City-Scale 3D Grounding?

Embodied AI 101 · Oct 14, 2026 · 28:53

0:0028:53

Listen in the Podli app 🎧

Follow your favourite podcasts, listen offline and in the car with CarPlay and Android Auto, and always pick up where you left off. Free to try.


Can an agentic vision-language model search a 3D city more effectively than a system that ranks candidate objects? This episode examines what Urbex improves, how its visual tools and reinforcement learning work, and where the evidence stops short of robotic deployment. We cover three central questions: why landmark lookup, zooming, and oblique views help; why higher Hit@1 does not necessarily mean accurate 3D boundaries; and what the released code reveals about training and evaluation reproducibility. Urbex operates on prepared urban point clouds and rendered views, including real photogrammetry scenes, rather than demonstrating closed-loop control on a physical robot. Its strongest results concern language-conditioned search within those reconstructed environments. We also place the work alongside CityAnchor, GeoProg3D, and contemporary agentic grounding approaches, then outline a practical hybrid with local geometric refinement. The key limitation is the gap between identifying a likely object and returning a precise, actionable volume. Our artifact audit additionally examines inconsistent training-schedule descriptions and the distinction between repeated greedy evaluation and stochastic decoding. Would you trust the resulting box—or use it to tell a more precise perception system where to look?

Episodes: Embodied AI 101

PodliGet the free Podli app
↓ App