This course explores the frontier of Embedded Artificial Intelligence (AI) and Spatial Computing, where the physical and digital worlds merge through real-time sensing, perception, and interaction. Spatial computing extends computing into three dimensions, combining AR/VR/MR, and AI ****technologies to help machines perceive, reason about, and interact with the environment and humans. Students will learn how to build environment and body digital twins using multimodal data from wearables and AR/VR/MR headsets, enhanced by foundation models, LLMs, and VLMs. We will learn how to build AI model to understand lights/acoustic/radio signals propagation in the environment so as to create immersive, connected experiences. The course also examines wireless-networked spatial computing systems in a system view, optimize network throughput, latency, and energy efficiency for wearable and IoT devices operating under these AI-driven workloads.
Instructor: Dr. Zhenlin An
Office: Boyd 609
Office hours: Weds 9:00-10:00am (or by appointment)
Email: [email protected]
Lecture: