Publication | IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2022
JoinABLe
Learning Bottom-up Assembly of Parametric CAD Joints
An overview of assemblies in the Fusion 360 Gallery assembly dataset.
A critical part of assembly design in Fusion 360 and Inventor is aligning parts to one another to form joints. However, fully defining assembly joints is time-consuming for our customers and not fully automated. To address this challenge, we developed ‘JoinABLe’ a machine learning based approach to automatically create joints between pairs of parts in an assembly.
Download publicationAbstract
JoinABLe: Learning Bottom-up Assembly of Parametric CAD Joints
Karl D.D. Willis, Pradeep Kumar Jayaraman, Hang Chu, Yunsheng Tian, Yifei Li, Daniele Grandi, Aditya Sanghi, Linh Tran, Joseph G. Lambourne, Armando Solar-Lezama, Wojciech Matusik
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Physical products are often complex assemblies combining a multitude of 3D parts modeled in computer-aided design (CAD) software. CAD designers build up these assemblies by aligning individual parts to one another using constraints called joints. In this paper we introduce JoinABLe, a learning-based method that assembles parts together to form joints. JoinABLe uses the weak supervision available in standard parametric CAD files without the help of object class labels or human guidance. Our results show that by making network predictions over a graph representation of solid models we can outperform multiple baseline methods with an accuracy (79.53%) that approaches human performance (80%). Finally, to support future research we release the Fusion 360 Gallery assembly dataset, containing assemblies with rich information on joints, contact surfaces, holes, and the underlying assembly graph structure.
CAD assemblies contain valuable joint information describing how parts are locally constrained and positioned together. We use this weak supervision to learn a bottom-up approach to assembly. JoinABLe combines an encoder and joint axis prediction network together with a neurally guided joint pose search to assemble pairs of parts without class labels or human guidance.
Associated Researchers
Yunsheng Tian
Massachusetts Institute of Technology
Linh Tran
Autodesk AI Lab
Wojciech Matusik
MIT
Armando Solar-Lezama
MIT
Yifei Li
MIT
Related Resources
2023
Challenges in Extracting Insights from Life Cycle Assessment Documents During Early Stage DesignKnowledge transfer from LCA documents and building a structured…
2023
DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable PhysicsInteractive programming system ensures users can refine generated code…
2022
UNIST: Unpaired Neural Implicit Shape Translation NetworkWe introduce UNIST, the first deep neural implicit modelfor…
2021
Robotic assembly of timber joints using reinforcement learningIn architectural construction, automated robotic assembly is…
Get in touch
Something pique your interest? Get in touch if you’d like to learn more about Autodesk Research, our projects, people, and potential collaboration opportunities.
Contact us