From Text to Robotic Assembly: 3D Generative AI and Discrete Robotic Assembly for Making Physical Objects

CDFAM Computational Design Symposium — Washington DC 2026

Alexander Htet Kyaw · MIT

Recent advances in 3D generative AI make it possible to create object geometries directly from natural language, but turning these digital forms into functional physical objects remains a major challenge. Most generated 3D models are meshes that do not contain the component level, structural, material, and assembly information required for robotic fabrication. This presentation introduces a research pipeline that combines 3D generative AI, vision language models, and robotic assembly to transform text prompts into multicomponent physical objects. Rather than only asking what an object should look like, the system reasons about how it should be physically composed, including where stronger, lighter, stiffer, or more flexible components are needed. The work points toward a future in which AI driven design systems can generate not only visual form, but also buildable, reusable, and materially informed assemblies for real world fabrication.

Links

Talk page with full transcript

Watch the talk on YouTube

Cite this talk

Search this talk's transcript

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit www.designforam.com