Publication | Graphics Interface Conference 2020
Workflow Graphs
A Computational Model of Collective Task Strategies for 3D Design Software
This work has contributed a conceptual approach for representing the different means by which a fixed goal can be achieved in feature rich software, based on recordings of user demonstrations, and has demonstrated a scalable pipeline for constructing such a representation for 3D modeling software. It has also presented a range of applications that could leverage this representation to support users in improving their skill sets over time. Overall, we see this work as a first step toward enabling a new generation of help and learning systems for feature-rich software, powered by data-driven models of tasks and workflows.
Download publicationAbstract
Workflow Graphs: A Computational Model of Collective Task Strategies for 3D Design Software
Minsuk Chang, Ben Lafreniere, Juho Kim, George Fitzmaurice, Tovi Grossman
Graphics Interface Conference 2020
This paper introduces Workflow graphs, or W-graphs, which encode how the approaches taken by multiple users performing a fixed 3D design task converge and diverge from one another. The graph’s nodes represent equivalent intermediate task states across users, and directed edges represent how a user moved between these states, inferred from screen recording videos, command log data, and task content history. The result is a data structure that captures alternative methods for performing sub-tasks (e.g., modeling the legs of a chair) and alternative strategies of the overall task. As a case study, we describe and exemplify a computational pipeline for building W-graphs using screen recordings, command logs, and 3D model snapshots from an instrumented version of the Tinkercad 3D modeling application, and present graphs built for two sample tasks. We also illustrate how W-graphs can facilitate novel user interfaces with scenarios in workflow feedback, on-demand task guidance, and instructor dashboards.
Associated Autodesk Researchers
Related Resources
2025
WhatELSE: Shaping Narrative Spaces at Configurable Level of Abstraction for AI-bridged Interactive StorytellingWe present an AI-bridged interactive narration authoring system that…
2024
TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityThis research provides an approachable editing experience by…
2023
Peek-At-You: An Awareness, Navigation, and View Sharing System for Remote Collaborative Content CreationRemote work improved by collaborative features such as conversational…
2017
Annotation Graphs: A Graph-Based Visualization for Meta-Analysis of Data based on User-Authored AnnotationsUser-authored annotations of data can support analysts in the activity…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us