George Fitzmaurice
Research Fellow, Human Computer Interaction and Visualization
Americas
Biography
George Fitzmaurice, Ph.D. is a Research Fellow and heads the Human Computer Interaction and Visualization Research group. In collaboration with his colleagues he has co-authored and published over 120 research papers and been awarded over 95 patents. During the last 25 years his research has focused on technology-assisted learning systems, knowledge capture and retrieval, highly interactive visualization systems, AR/VR and novel input, and interaction techniques. Some notable research transfer and product contributions include Maya 1.0 UI, SketchBook Pro UI design, the 3D Navigation tools (ViewCube™ and SteeringWheels™), Autodesk Screencast and Sketchbook Motion (awarded Apple iPad App of the Year for 2016).
Fitzmaurice received a B.Sc. in Mathematics with Computer Science at MIT, an M.Sc. in Computer Science at Brown University and a Ph.D. in Computer Science at the University of Toronto. He established the field of Graspable UIs which is the pre-cursor to Tangible UIs, and pioneered the concept of spatially-aware displays and situated information spaces with the Chameleon research project. In 2019 he was inducted into the ACM CHI Academy for his substantial contributions to the field of HCI.
In 2024 he was named an ACM Fellow. The ACM Fellows Award honors the remarkable contributions of exceptional members in the computing field. These individuals have illuminated the path for researchers, developers, practitioners, and end users of information technology globally.
Publications (137)
2024
AQuA: Automated Question-Answering in Software Tutorial Videos with Visual AnchorsAn automated approach leveraging a large language model augmented with…
2024
TimeTunnel Live: Recording and Editing Character Motion in Virtual RealityAn animation authoring interface for recording and editing motion in…
2024
TimeTunnel: Integrating Spatial and Temporal Motion Editing for Character Animation in Virtual RealityThis research provides an approachable editing experience by…
2023
WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AIUsing multi-modal generative AI to quickly and iteratively visualize…
2023
Identifying Visualization Opportunities to Help Architects Manage the Complexity of Building CodesInteractive visualizations have promising potential to aid design…
2023
Immersive Sampling: Exploring Sampling for Future Creative Practices in Media-Rich, Immersive SpacesSupporting creative practitioners in collecting materials beyond the…
2023
3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows3DALL-E integrated three large AI models within Fusion 360 to explore…
2023
Peek-At-You: An Awareness, Navigation, and View Sharing System for Remote Collaborative Content CreationRemote work improved by collaborative features such as conversational…
2023
Task-Centric Application Switching: How and Why Knowledge Workers Switch Software Applications for a Single TaskThis research studies task-centric application switching and…
2023
Vice VRsa: Balancing Bystander’s and VR user’s Privacy through Awareness Cues Inside and Outside VRPromoting mutual awareness and privacy among virtual reality users and…
2023
Tesseract: Querying Spatial Design Recordings by Manipulating Worlds in MiniatureNew immersive 3D design tools enable the creation of spatial design…
2022
Supercharging Trial-and-Error for Learning Complex Software ApplicationsDespite an abundance of carefully-crafted tutorials, trial-and-error…
2022
SkyGlyphs: Reflections on the Design of a Delightful VisualizationExploring data by leveraging curiosity, inciting delight, and…
2022
MoodCubes: Immersive Spaces for Collecting, Discovering and Envisioning Inspiration MaterialsIn early stages of creative processes, practitioners externalize and…
2022
”I don’t want to feel like I’m working in a 1960s factory”: The Practitioner Perspective on Creativity Support Tool AdoptionCreative practitioners reflect on their values to derive a value…
2022
In-Depth Mouse: Integrating Desktop Mouse into Virtual RealityVirtual Reality (VR) has the potential for productive knowledge work,…
2022
AvatAR: An Immersive Analysis Environment for Human Motion Data Combining Interactive 3D Avatars and TrajectoriesAnalysis of human motion data can reveal valuable insights about the…
2022
VideoPoseVR: Authoring Virtual Reality Character Animations with Online VideosWe present VideoPoseVR, a video-based animation authoring workflow…
2021
How Tall is that Bar Chart? Virtual Reality, Distance Compression and VisualizationsAs VR technology becomes more available, VR applications will be…
2021
Paper Forager: Supporting the Rapid Exploration of Research Document CollectionsWe present Paper Forager, a web-based system which allows users to…
2021
Think-Aloud Computing: Supporting Rich and Low-Effort Knowledge CaptureWhen users complete tasks on the computer, the knowledge they leverage…
2021
MeetingMate: an Ambient Interface for Improved Meeting Effectiveness and Corporate Knowledge SharingWe present MeetingMate, a system for improving meeting effectiveness…
2020
Workflow Graphs: A Computational Model of Collective Task Strategies for 3D Design SoftwareThis paper introduces Workflow graphs, or W-graphs, which encode how…
2020
AuthAR: Concurrent Authoring of Tutorials for AR Assembly GuidanceAugmented Reality (AR) can assist with physical tasks such as object…
2020
MicroMentor: Peer-to-Peer Software Help Sessions in Three Minutes or LessWhile synchronous one-on-one help for software learning is rich and…
2019
Geppetto: Enabling Semantic Design of Expressive Robot BehaviorsExpressive robots are useful in many contexts, from industrial to…
2019
Instrumenting and Analyzing Fabrication Activities, Users, and ExpertiseThe recent proliferation of fabrication and making activities has…
2018
Dream Lens: Exploration and Visualization of Large-Scale Generative Design DatasetsThis paper presents Dream Lens, an interactive visual analysis tool…
2018
Maestro: Designing a System for Real-Time Orchestration of 3D Modeling WorkshopsInstructors of 3D design workshops for children face many challenges,…
2018
SymbiosisSketch: Combining 2D & 3D Sketching for Designing Detailed 3D Objects in SituWe present SymbiosisSketch, a hybrid sketching system that combines…
2018
ElectroTutor: Test-Driven Physical Computing TutorialsA wide variety of tools for creating physical computing systems have…
2017
Same Stats, Different Graphs: Generating Datasets with Varied Appearance and Identical Statistics through Simulated AnnealingWhy graphical representation and visualization are so important to…
2017
Ivy: Exploring Spatially Situated Visual Programming for Authoring and Understanding Intelligent EnvironmentsThe availability of embedded, digital systems has led to a multitude…
2017
Trigger Action Circuits: Leveraging Generative Design to Enable Novices to Design and Build CircuitryThe dramatic decrease in price and increase in availability of…
2017
Experimental Evaluation of Sketching on Surfaces in VRSketching in immersive 3D virtual reality (VR) environments has great…
2017
No Need to Stop What You’re Doing: Exploring No-Handed Smartwatch InteractionSmartwatches have the potential to enable quick micro-interactions…
2017
WeBuild: Automatically Distributing Assembly Tasks Among Collocated Workers to Improve CoordinationPhysical construction and assembly tasks are often carried out by…
2017
DreamSketch: Early Stage 3D Design Explorations with Sketching and Generative DesignWe present DreamSketch, a novel 3D design interface that combines the…
2016
ChronoFab: Fabricating MotionWe present ChronoFab, a 3D modeling tool to craft motion sculptures,…
2016
Energy-Brushes: Interactive Tools for Illustrating Stylized Elemental DynamicsDynamic effects such as waves, splashes, fire, smoke, and explosions…
2016
Motion Amplifiers: Sketching Dynamic Illustrations Using the Principles of 2D AnimationWe present a sketching tool for crafting animated illustrations that…
2016
Crowdsourced FabricationIn recent years, extensive research in the HCI literature has explored…
2016
RetroFab: A Design Tool for Retrofitting Physical Interfaces using Actuators, Sensors and 3D PrintingWe present RetroFab, an end-to-end design and fabrication environment…
2016
ExoSkin: On-Body FabricationThere is a long tradition for crafting wearable objects directly on…
2016
The Effect of Visual Appearance on the Performance of Continuous Sliders and Visual Analogue ScalesSliders and Visual Analogue Scales (VASs) are input mechanisms which…
2015
Supporting Subtlety with Deceptive Devices and Illusory InteractionsMobile devices offer constant connectivity to the world, which can…
2015
Smart Makerspace: An Immersive Instructional Space for Physical TasksWe present the Smart Makerspace; a context-rich, immersive…
2015
Deploying CommunityCommands: A Software Command Recommender System Case StudyIn 2009 we presented the idea of using collaborative filtering within…
2015
NanoStylus: Enhancing Input on Ultra-Small Displays with a Finger-Mounted StylusDue to their limited input area, ultra-small devices, such as…
2015
MoveableMaker: Facilitating the Design, Generation, and Assembly of Moveable PapercraftIn this work, we explore moveables, i…
2015
Typing on Glasses: Adapting Text Entry to Smart EyewearText entry for smart eyewear is generally limited to speech-based…
2015
Dynamic Opacity Optimization for Scatter PlotsScatterplots are an effective and commonly used technique to show the…
2015
Candid Interaction: Revealing Hidden Mobile and Wearable Computing ActivitiesThe growth of mobile and wearable technologies has made it often…
2015
Tactum: A Skin-Centric Approach to Digital Design and FabricationSkin-based input has become an increasingly viable interaction model…
2014
HybridSpace: Integrating 3D Freehand Input and Stereo Viewing into Traditional Desktop ApplicationsTechnologies for 3D input and output are rapidly advancing, and are…
2014
Investigating the Feasibility of Extracting Tool Demonstrations from In-Situ Video ContentShort video demonstrations are effective resources for helping users…
2014
History Assisted View Authoring for 3D Models3D modelers often wish to showcase their models and associated…
2014
A Series of Tubes: Adding Interactivity to 3D Prints Using Internal Pipes3D printers offer extraordinary flexibility for prototyping theshape…
2014
An Investigation of Metrics For the in-situ Detection of Software ExpertiseTask-based analysis is a common and effective way to measure expertise…
2014
Kitty: Sketching Dynamic and Interactive IllustrationsWe present Kitty, a sketch-based tool for authoring dynamic and…
2014
Swipeboard: A Text Entry Technique for Ultra-Small Devices That Supports Novice to Expert TransitionsUltra-small smart devices, such as smart watches, have become…
2014
Draco: Bringing Life to Illustrations with Kinetic TexturesDraco is a prototype sketch-based interface from that allows artists…
2014
CADament: A Gamified Multiplayer Software Tutorial SystemWe present CADament, a gamified multiplayer tutorial system for…
2014
Video Lens: Rapid Playback and Exploration of Large Video Collections and Associated MetadataWe present Video Lens, a framework which allows users to visualize and…
2013
The Effect of Time-based Cost of Error in Target-directed Pointing TasksOne of the fundamental operations in today’s user interfaces is…
2013
Swifter: Improved Online Video ScrubbingOnline streaming video systems have become extremely popular, yet…
2013
YouMove: Enhancing Movement Training with an Augmented Reality MirrorYouMove is a novel system that allows users to record and learn…
2013
Patina: Smart Heatmaps for Visualizing Application UsageWe present Patina, an application independent system for collecting…
2013
Community Enhanced Tutorials: Improving Tutorials with Multiple DemonstrationsWeb-based tutorials are a popular help resource for learning how to…
2013
TutorialPlan: Automated Tutorial Generation from CAD DrawingsAuthoring tutorials for complex software applications is a time…
2012
Waken: Reverse Engineering Usage Information and Interface Structure from Software VideosWe explore the possibilities and opportunities related to reverse…
2012
GamiCAD: A Gamified Tutorial System for First Time AutoCAD UsersWe present GamiCAD, a gamified in-product, interactive tutorial system…
2012
Implanted User InterfacesWe examine implanted user interfaces of very small mobile devices…
2012
Delta: A Tool for Representing and Comparing WorkflowsTutorials and sample workflows for complicated, feature-rich software…
2012
Citeology: Visualizing Paper GenealogyCiteology is an interactive visualization that looks at the…
2012
Triggering Triggers and Burying Barriers to Customizing SoftwareGeneral-purpose software applications are usually not tailored for a…
2012
Magic Finger: Always-Available Input through Finger InstrumentationWe present Magic Finger, a small device worn on the fingertip, which…
2012
A Classification of Opening Posts in Commercial Software Help ForumsThe opening posts in software help forums reflect the users’…
2012
Swift: Reducing the Effects of Latency in Online Video ScrubbingWe first conduct a study using abstracted video content to measure the…
2011
Post-Deployment Usability: A Survey of Current PracticesDespite the growing research on usability in the pre-development…
2011
IP-QAT: In-Product Questions, Answers & TipsWe present IP-QAT, a new community-based question and answer system…
2011
Design and Evaluation of a Command Recommendation System for Software ApplicationsWe examine the use of modern recommender system technology to aid…
2011
Searching for Software Learning Resources using Application ContextUsers of complex software applications frequently need to consult…
2011
TwitApp: In-product Micro-Blogging for Design SharingWe describe TwitApp, an enhanced micro-blogging system integrated…
2011
AppMap: Exploring User Interface VisualizationsIn traditional graphical user interfaces, the majority of UI elements…
2011
Medusa: A Proximity-Aware Multi-touch TabletopWe present Medusa, a proximity aware multi-touch tabletop…
2011
Modern Software Product Support Processes and the Usage of Multimedia FormatsDespite being an important channel for end-user assistance, few…
2011
Sketch-Sketch Revolution: An Engaging Tutorial System for Guided Sketching and Application LearningWe describe Sketch-Sketch Revolution, a new tutorial system that…
2011
TouchCuts and TouchZoom: Enhanced Target Selection for Touch Displays using Finger Proximity SensingAlthough touch-screen laptops are increasing in popularity, users…
2011
Magic Desk: Bringing Multi-Touch Surfaces into Desktop WorkDespite the prominence of multi-touch technologies, there has been…
2010
The design and evaluation of multitouch marking menusDespite the considerable quantity of research directed towards…
2010
Chronicle: Capture, Exploration, and Playback of Document Workflow HistoriesWe describe Chronicle, a new system that allows users to explore…
2010
MouseLight: Bimanual interactions on digital paper using a pen and a spatially-aware mobile projectorMouseLight is a standalone mobile projector with the form factor of a…
2010
ToolClips: An investigation of contextual video assistance for functionality understandingWe investigate the use of on-line contextual video assistance to…
2009
PenLight: Combining a Mobile Projector and a Digital Pen for Dynamic Visual OverlayDigital pen systems, originally designed to digitize annotations made…
2009
The Design and Evaluation of Multi-Finger Mouse Emulation TechniquesWe explore the use of multi-finger input to emulate fullmouse…
2009
Toward the Digital Design Studio: Large Display ExplorationsInspired by our automotive and product design customers using large…
2009
CommunityCommands: Command Recommendations for Software ApplicationsWe explore the use of modern recommender system technology to address…
2009
A Survey of Software Learnability: Metrics, Methodologies and GuidelinesIt is well-accepted that learnability is an important aspect of…
2008
Safe 3D NavigationTypical commercial 3D CAD tools provide modal tools such as pan, zoom,…
2008
ViewCube: A 3D Orientation Indicator and ControllerLiterally hundreds of thousands of users of 2D computer-aided design…
2008
PieCursor: Merging Pointing and Command Selection for Rapid In-place Tool SwitchingWe describe a new type of graphical user interface widget called the…
2006
ShowMotion: Camera Motion based 3D Design ReviewWe describe a new interactive system for 3D design review, built to…
2005
Cinematic Meeting Facilities Using Large DisplaysWe have investigated large-display technology for corporate meeting…
2005
Spotlight: Directing Users’ Attention on Large DisplaysWe describe a new interaction technique, called a spotlight, for…
2005
When It Gets More Difficult, Use Both Hands – Exploring Bimanual Curve ManipulationIn this paper we investigate the relationship between bimanual…
2005
Applications of Large Displays, Guest Editor’s IntroductionThe emergence of large displays holds the promise of basking us in…
2005
HoverCam: Interactive 3D Navigation for Proximal Object InspectionWe describe a new interactive system for 3D design review, built to…
2004
A Remote Control Interface for Large DisplaysWe describe a new widget and interaction technique, known as a…
2003
Game-like Navigation and Responsiveness in Non-game ApplicationsVideo and computer games aim to give players a compelling interactive…
2003
Sentient Data Access via a Diverse Society of DevicesIt has been more than ten years since such “information…
2003
Tracking MenusWe describe a new type of graphical user interface widget, known as a…
2002
StyleCam: Interactive Stylized 3D Navigation using Integrated Spatial & Temporal ControlsWe describe a new type of graphical user interface widget, known as a…
2002
Boom Chameleon: Simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware displayWe introduce the Boom Chameleon, a novel input/output device…
2002
Creating Principal 3D Curves with Digital Tape DrawingPrevious systems have explored the challenges of designing an…
2001
User Interfaces for Volumetric DisplaysAlthough still in the prototype stage, three-dimensional volumetric…
2001
Interaction Techniques for 3D Modeling on Large DisplaysWe present an alternate interface for 3D modeling for use on large…
2000
Large displays in automotive designThe ability to display and interact with large-scale representations…
1999
Sampling, synthesis, and input devicesMany efforts in computer graphics focus on mimicking reality to…
1999
The Hotbox: efficient access to a large number of menu-itemsThe proliferation of multiple toolbars and UI widgets around the…
1999
Digital tape drawingTape drawing is the art of creating sketches on large scale upright…
1999
Exploring interactive curve and surface manipulation using a bend and twist sensitive input stripWe explore a new input device and a set of interaction techniques to…
1999
An exploration into supporting artwork orientation in the user interfaceRotating a piece of paper while drawing is an integral and almost…
1998
HMDs, Caves & Chameleon: A human-centric analysis of interaction in virtual spaceThere are a various approaches to implementing virtual reality (VR)…
1998
Compatibility and Interaction Style in Computer GraphicsRecent trends in human computer interaction have focused on…
1997
The Rockin’Mouse: Integral 3D manipulation on a planeA novel input device called the Rockin’Mouse is described and…
1997
The design of a GUI paradigm based on tablets, two-hands, and transparencyAn experimental GUI paradigm is presented which is based on the design…
1997
An empirical evaluation of Graspable User InterfacesThis paper reports on the experimental evaluation of a Graspable User…
1996
Graspable User InterfacesThis dissertation defines and explores Graspable User Interfaces, an…
1995
Bricks: Laying the Foundations for Graspable User InterfacesWe introduce the concept of Graspable User Interfaces that allow…
1993
Virtual Reality for Palmtop ComputersWe are exploring how virtual reahty theories can be applied toward…
1993
Situated Information Spaces and Spatially Aware Palmtop Computers.No longer will we need to be tethered to a stationary computer…
1992
The Envoy System: An Open Architecture for AgentsThe Envoy Framework addresses a need for computer-based assistants or…
1991
InternetExpress: An Inter-Desktop Multimedia Data-Transfer Service.Internet users today need to share multimedia data like text graphics,…
Projects (11)
2023
Project Reframe: Recording and Editing Motion in Virtual RealityIn a world where content creation has evolved dramatically, Autodesk…
2022
3D User Interfaces: Human Experience in 3D EnvironmentsDesigning user interfaces for interacting with 3D data involves a…
2022
Data Visualization and Visual AnalyticsVisual data representations leverage the power of human perception to…
2021
Novel Input & OutputThe nature and quality of interaction can be dramatically affected by…
2021
Software LearningThis learning project investigates advanced techniques for assisting…
2017
Project Dreamcatcher: Generative Design Solutions in CADWhat if a CAD system could generate thousands of design options that…
2011
OrgOrgChart: The Evolution of an OrganizationThis project looks at the evolution of a company’s structure over…
Be part of it
Join our diverse team of scientists and industry experts to help us lead the future of design.
Search Careers