PIXIE: A Zero-Shot texture-invariant 6D pose estimation framework for unseen objects with assembly defects
The paper introduces PIXIE, a zero-shot framework for estimating 6D pose of an object from an RGB image using only an untextured 3D model.
PIXIE is the first method to estimate 6D pose of an object using only an untextured 3D model and an RGB image.
Before reading this…
Applications
- →Robotics
- →Computer vision
- →Industrial environments
To understand this paper, make sure you know these concepts first:
- Understanding of 6D pose estimationfind papers →
- Familiarity with feature matching and PnP algorithmsfind papers →
Abstract
More Like This6D pose estimation remains a key challenge in robotics and computer vision, particularly in industrial environments. The deployment of currently available data-driven methods is often limited by resource-intensive data pipelines, reliance on textured 3D models, and sensitivity to geometric deviations caused by damages or assembly defects. We present PIXIE, a zero-shot framework that estimates the 6D pose of an object from an RGB image using only an untextured 3D model. Synthetic depth and normal maps are rendered from sampled reference viewpoints and matched to the query image via a pretrained cross-modality feature matcher. Matched keypoints are back-projected to obtain 2D--3D correspondences for PnP-based pose estimation. Relying exclusively on geometry makes the method inherently robust to lighting and texture variation, while correspondence filtering handles geometric deviations between the model and physical object. We evaluate on widely-used public benchmarks, reporting state-of-the-art results on texture-less objects without object-specific training, and introduce a novel dataset with assembly defects, texture variations, and occlusion to demonstrate real-world applicability.