PlayWrite: A Multimodal System for AI Supported Narrative Co-Authoring Through Play in XR
PlayWrite is a mixed-reality AI writing system where users create stories by moving virtual characters and props instead of typing prompts.
Read More
Frederik Brudy
Principal Research Scientist at Autodesk Research, Toronto. Exploring novel interaction techniques for generative AI, creativity, and XR systems.
GroundLink
GroundLink is a 3D editor add-on that brings meeting notes, decisions, comments, and constraints directly into the editor. It helps artists and technical staff …
Read More
PrevizWhiz
A system that combines rough 3D scene blocking with generative AI and 2D video references to enable filmmakers to rapidly create expressive, high-fidelity …
Read More
IndoorWorld: Integrating Physical Task Solving and Social Simulation in A Heterogeneous Multi-Agent Environment
A new environment that merges both physical and social dynamics, forcing AI agents to use social skills to affect their physical world.
Read More
Augmenting speech transcripts of VR recordings with gaze, pointing, and visual context for multimodal coreference resolution
A system that augments VR speech transcripts with textual descriptions of ambiguous references to objects (such as "it" or "there").
Read More
Experiential space analysis: scoring tranquil, social, and explorative places in habitable buildings
The paper proposes a computational method to score how tranquil, social, or explorative spaces feel by combining daylight, pathways, and visibility data. …
Read More
WhatIF: Branched Narrative Fiction Visualization for Authoring Emergent Narratives using Large Language Models
Branched Narrative Fiction (BNF) are non-linear games where players shape the story. WhatIF is a tool that helps developers design, analyze, and refine …
Read More
The Bentway: Human-Centric Design for Public Spaces
In 2023, at Autodesk Research we partnered with The Bentway in Toronto to use wearable sensors and cameras to capture how people experienced the public space …
Read More