This IMMERSED seminar featured a presentation by Jeremy Schwartz, senior Unity 3D engineer and project lead of ThreeDWorld in the Department of Brain and Cognitive Sciences.
ThreeDWorld (TDW) is a multimodal simulation platform for physical scene i…
This IMMERSED seminar featured a presentation by Jeremy Schwartz, senior Unity 3D engineer and project lead of ThreeDWorld in the Department of Brain and Cognitive Sciences.
ThreeDWorld (TDW) is a multimodal simulation platform for physical scene interaction that uses state-of-the-art video game technology to generate photo-realistic scenes in a virtual world. TDW’s flexible, general design allows researchers to collect next-generation experimental data and generate large-scale datasets for training AI systems with complete control over data generation and full access to all associated generative parameters. TDW was developed at MIT’s Department of Brain and Cognitive Sciences, in conjunction with the MIT-IBM Watson AI Lab.
Schwartz presented an overview of the platform, with particular focus on recent and in-progress work around the development of realistic humanoid agents for embodied AI simulations. These virtual characters can serve as either full-body “avatars” for human users in VR, or as AI agents capable of performing typical day-to-day human activities and behaviors, their actions derived from motion-capture data.
---------------------------------------
IMMERSED is a monthly seminar in which we explore the possibilities enabled by immersive technology and interactive experiences. Technologies such as motion capture, virtual and augmented reality, photogrammetry, and related computational advances bestow the power to gather, process, and interact with data from multiple modalities, providing unique insights and fostering interdisciplinary collaborations.
IMMERSED examines how immersive technology is shaping innovations across the sciences and the arts through a mix of lectures, demonstrations, and tutorials. IMMERSED is sponsored by the MIT.nano Immersion Lab, which provides space, tools, and a platform to connect scientists, engineers, artists, performers, and others through creative projects that bridge multiple disciplines.
Learn more at mitnano.mit.edu/immersed-seminar-series
