TinkerXR: In-Situ, Reality-Aware CAD and 3D Printing Interface for Novices

Oğuz Arslan1, Artun Akdoğan1, Mustafa Doga Dogan2,1
1 Department of Computer Engineering, Bogazici University        2 Adobe Research, Basel, Switzerland

Proceedings of the 10th ACM Symposium on Computational Fabrication (SCF '25)
Paper Code (coming soon)

Abstract

Despite the growing accessibility of augmented reality (AR) for visualization, existing computer-aided design (CAD) systems remain confined to traditional screens or require complex setups or predefined parameters, limiting immersion and accessibility for novices. We present TinkerXR, an open source interface enabling in-situ design and fabrication through Constructive Solid Geometry (CSG) modeling. TinkerXR operates solely with a headset and 3D printer, allowing users to design directly in and for their physical environments. By leveraging spatial awareness, depth occlusion, recognition of physical constraints, reference objects, and hand movement controls, TinkerXR enhances realism, precision, and ease of use. Its AR-based workflow integrates design and 3D printing with a drag-and-drop interface for a 3D printer's virtual twin. A user study comparing TinkerXR with Tinkercad demonstrates higher accessibility, engagement, and ease of use for novices. By bridging the gap between digital creation and physical output, TinkerXR aims to transform everyday spaces into accessible and expressive creative studios.

Video

Key Features of TinkerXR

TinkerXR enables in-situ CAD and 3D printing in AR. The system features spatial awareness, depth occlusion, and use of physical objects and constraints for design. With Constructive Solid Geometry modeling, users can convert surfaces into interactive design canvases and interact with 3D printers' digital twins to prepare and initiate fabrication.

Spatial Awareness

Advanced spatial understanding allows TinkerXR to recognize and adapt to real-world environments, enabling context-aware design directly on physical surfaces.

Creating Objects

Intuitive object creation using hand gestures and Constructive Solid Geometry (CSG) primitives for building complex 3D models in AR space.

Object Manipulation Schema

Comprehensive interaction framework for manipulating 3D objects including translation, rotation, scaling, and Boolean operations in augmented reality.

Precision Measurement

Precision measurement tools and object combination workflows that enable accurate design and assembly of complex structures.

Integrated 3D Printing Workflow

TinkerXR integrates design with fabrication through a drag-and-drop interface for 3D printer virtual twins. The system includes built-in slicing capabilities and allows users to initiate printing directly from the AR interface, enabling the transition from digital design to physical creation.


3D Printer Integration

Direct integration with 3D printers through virtual twins enables fabrication workflow from AR design to physical output with drag-and-drop simplicity.

Slicing

Built-in slicing functionality allows users to prepare models for 3D printing directly within the AR interface, simplifying the fabrication workflow.

BibTeX

@misc{arslan2024tinkerxr,
  title={TinkerXR: In-Situ, Reality-Aware CAD and 3D Printing Interface for Novices}, 
  author={Oğuz Arslan and Artun Akdoğan and Mustafa Doga Dogan},
  year={2024},
  eprint={2410.06113},
  archivePrefix={arXiv},
  primaryClass={cs.HC},
  url={https://arxiv.org/abs/2410.06113}
}