IndoorWorld: Integrating Physical Task Solving and Social Simulation in A Heterogeneous Multi-Agent Environment
A new environment that merges both physical and social dynamics, forcing AI agents to use social skills to affect their physical world.
Principal Research Scientist at Autodesk Research, Toronto. Exploring novel interaction techniques for generative AI, creativity, and XR systems.
A new environment that merges both physical and social dynamics, forcing AI agents to use social skills to affect their physical world.
A system that augments VR speech transcripts with textual descriptions of ambiguous references to objects (such as "it" or "there").
The paper proposes a computational method to score how tranquil, social, or explorative spaces feel by combining daylight, pathways, and visibility data. …
Branched Narrative Fiction (BNF) are non-linear games where players shape the story. WhatIF is a tool that helps developers design, analyze, and refine …
In 2023, at Autodesk Research we partnered with The Bentway in Toronto to use wearable sensors and cameras to capture how people experienced the public space …
Creators can use WorldSmith, a multi-modal generative AI tool, to quickly design and refine fictional worlds via text, sketches, and region-based edits.
VR users can be watched without knowing, and they can also record bystanders. Vice VRsa alerts VR users when people are nearby and alerts bystanders if the VR …
Switching between solo and group work in remote settings is tricky. Peek-at-You combines collaboration and communication tools with features like position …