Publication | ACADIA 2018
Digital Dérive
Reconstructing Urban Environments based on Human Experience
Abstract
Digital Dérive: Reconstructing Urban Environments based on Human Experience
Danil Nagy, James Stoddart, Lorenzo Villaggi, David Benjamin
ACADIA 2018
This paper describes a novel method for reconstructing urban environments based on individual occupant experience. The method relies on a low-cost off-the-shelf 360o camera to capture video and audio data from a natural walk through the city. It then uses a custom workflow based on an open-source Structure from Motion (SfM) library to reconstruct a dense point cloud from images extracted from the 360o video. The point cloud and audio data are then represented within a virtual reality (VR) model, creating a multisensory environment that immerses the viewer into the subjective experience of the occupant. This work questions the role of precision and fidelity in our experience and representation of a “real” physical environment. On the one hand, the resulting VR environment is less complete and has lower fidelity than digital environments created through traditional modeling and rendering workflows. On the other hand, because each point in the point cloud is literally sampled from the actual environment, the resulting model also captures more of the noise and imprecision that characterizes our world. The result is an uncanny immersive experience that is less precise than traditional digital environments, yet represents many more of the unique physical characteristics that define our urban experiences.
Download publicationRelated Resources
2024
Celebrating the work of Autodesk ResearchWatch our recap video highlighting some of the great work our teams…
2017
Simulating Use Scenarios in Hospitals using Multi-Agent NarrativesAnticipating building-related complexities ensuing from occupants’…
2009
TinkerCell: modular CAD tool for Synthetic BiologyAn ideal CAD application for engineering biological systems would…
2022
MoodCubes: Immersive Spaces for Collecting, Discovering and Envisioning Inspiration MaterialsIn early stages of creative processes, practitioners externalize and…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us