Publication | ACM UIST 2023
WorldSmith
Iterative and Expressive Prompting for World Building with a Generative AI
Abstract
WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AI
Hai Dang, Frederik Brudy, George Fitzmaurice, Fraser Anderson
ACM UIST 2023
Crafting a rich and unique environment is crucial for fictional world-building, but can be difficult to achieve since illustrating a world from scratch requires time and significant skill. We investigate the use of recent multi-modal image generation systems to enable users iteratively visualize and modify elements of their fictional world using a combination of text input, sketching, and region-based filling. WorldSmith enables novice world builders to quickly visualize a fictional world with layered edits and hierarchical compositions. Through a formative study (4 participants) and first-use study (13 participants) we demonstrate that WorldSmith offers more expressive interactions with prompt-based models. With this work, we explore how creatives can be empowered to leverage prompt-based generative AI as a tool in their creative process, beyond current “click-once” prompting UI paradigms.
Download publicationRelated Resources
2024
Making the Future: Autodesk Researchers at AU 2024See how Autodesk Research will participate at AU 2024…
2024
PlotMap: Automated Layout Design for Building Game WorldsThis research presents novel AI methods for mapping stories to maps in…
2017
Annotation Graphs: A Graph-Based Visualization for Meta-Analysis of Data based on User-Authored AnnotationsUser-authored annotations of data can support analysts in the activity…
2021
Meshmixer: Mesh Technology for Interactive Design and FabricationMeshmixer is a prototype design tool based on high-resolution dynamic…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us