Metraipolis › archive › dc_c74149173e00
DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients — arXiv:2609.36779
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.36779
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T18:42:05.136Z
- SHA-256 of the archived text
c1f7337f76559933fe6c7555480178ec3d6e51220abe2f493101e9f3d952a821- Stable URL of this page
https://metraipolis.com/documento/dc_c74149173e00
How to cite
DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients — arXiv:2609.36779 — arXiv (en), https://arxiv.org/abs/2609.36779 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_c74149173e00 (Metraipolis archive dc_c74149173e00, sha256 c1f7337f76559933fe6c7555480178ec3d6e51220abe2f493101e9f3d952a821)
BibTeX
@misc{dcc74149173e00,
title = {DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients — arXiv:2609.36779},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.36779},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_c74149173e00; sha256 c1f7337f76559933fe6c7555480178ec3d6e51220abe2f493101e9f3d952a821},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.36779. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Accurate hand-eye calibration is crucial for precision manipulation. Traditional methods rely on markers, with their precision dependent on marker accuracy and observability. In contrast, markerless methods, such as learning-based approaches, use deep neural networks to directly extract keypoints or features from images, enabling the computation of hand-eye transformation with a single image and without the need for physical markers. Recently, differentiable rendering-based methods for hand-eye calibration have leveraged physical models to render binary masks and compare them with observations, enabling hand-eye calibration without fiducial markers in the calibration stage and providing interpretable optimization. While the state-of-the-art differentiable rendering methods achieve remarkable accuracy, the use of binary masks can result in the loss of internal profile details, reducing precision. Additionally, these methods can also suffer from unstable optimization and local minima. In this study, we propose a novel RGB-based differentiable rendering framework that provides richer geometric and appearance cues by incorporating color and mask geometric features, thereby improving calibration accuracy and optimization stability. Additionally, we propose a mask-guided image-to-image translation method to ensure explicit preservation of color and geometric consistency throughout the translation. Our approach is validated through both simulation and real-world experiments, with results demonstrating strong accuracy and robustness and clear improvements over existing differentiable rendering methods. Our method achieves a grasping success rate of 88.9% and insertion success rate of 57.4% on the UR5e real-world experiment, outperforming the state-of-the-art differentiable rendering hand-eye calibration method EasyHeC by 46.3 and 48.1 percentage points, respectively. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-30 in cs.CV). Categorie arXiv: Robotics (cs.RO) ; Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR). Pagina del lavoro: https://arxiv.org/abs/2609.36779 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T18:04:24.968Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).