ACM CHI 2024
Experiential Views
Towards Human Experience Evaluation of Designed Spaces using Vision-Language Models
Abstract
Experiential Views is a proof-of-concept in which we explore a method of helping architects and designers predict how building occupants might experience their designed spaces using AI technology based on Vision-Language Models. Our prototype evaluates a space using a pre-trained model that we fine-tuned with photos and renders of a building. These images were evaluated and labeled based on a preliminary set of three human-centric dimensions that characterize the Social, Tranquil, and Inspirational qualities of a scene. We developed a floor plan visualization and a WebGL-based 3D-viewer that demonstrate how architectural design software could be enhanced to evaluate areas of a built environment based on psychological or emotional criteria. We see this as an early step towards helping designers anticipate emotional responses to their designs to create better experiences for occupants.
Download publicationRelated Publications
2024
A hyperreduced reduced basis element method for reduced-order modeling of component-based nonlinear systemsThis method balances accuracy and computational speed through adaptive…
2023
DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable PhysicsInteractive programming system ensures users can refine generated code…
2022
Neural Implicit Style-Net: synthesizing shapes in a preferred style exploiting self supervisionWe introduce a novel approach to disentangle style from content in the…
2019
Relational Graph Representation Learning for Open-Domain Question AnsweringWe introduce a relational graph neural network with bi-directional…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us