ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos
This paper presents ArtiTwinSplat, a framework for constructing articulated, photo-realistic digital twins of objects directly from RGB-D videos in real-world environments.
The novelty of this paper lies in the automatic construction of articulated digital twins from RGB-D videos and the unsupervised discovery of articulation in real-world environments.
Before reading this…
Applications
- →Robotic system integration
- →Embodied AI
- →Human-robot collaboration
To understand this paper, make sure you know these concepts first:
- Understanding of digital twinsfind papers →
- Familiarity with RGB-D sensorsfind papers →
Abstract
More Like ThisDeploying robots in unstructured real-world environments needs accurate, interactive models of the objects. Constructing these models at scale remains a critical bottleneck for robotic system integration. We present ArtiTwinSplat, a framework that automatically constructs articulated, photo-realistic digital twins of objects directly from RGB-D videos, requiring no CAD models, simulation assets, or manual annotations. Our method is built on 3D Gaussian Splatting that preserve geometric fidelity and photometric realism, coupled with an unsupervised articulation discovery pipeline that recovers part structure and joint kinematics from observed motion alone. With tracking and optimization stages our method provides stable, queryable digital twins that support real-time rendering, viewpoint control, and interactive manipulation. Unlike prior methods confined to simulation, ArtiTwinSplat operates directly on real-world observations and produces twins that are immediately usable by downstream robot planning and learning systems. This method offers a practical, scalable pathway toward digital twin construction, lowering the integration barrier for articulated object manipulation in embodied AI and human-robot collaboration contexts.