Get the latest tech news

Pose-free 3D Gaussian splatting via shape-ray estimation


While generalizable 3D Gaussian splatting enables efficient, high-quality rendering of unseen scenes, it heavily depends on precise camera poses for accurate geometry. In real-world scenarios, obtaining accurate poses is challenging, leading to noisy pose estimates and geometric misalignments. To address this, we introduce SHARE, a pose-free, feed-forward Gaussian splatting framework that overcomes these ambiguities by joint shape and camera rays estimation. Instead of relying on explicit 3D transformations, SHARE builds a pose-aware canonical volume representation that seamlessly integrates multi-view information, reducing misalignment caused by inaccurate pose estimates. Additionally, anchor-aligned Gaussian prediction enhances scene reconstruction by refining local geometry around coarse anchors, allowing for more precise Gaussian placement. Extensive experiments on diverse real-world datasets show that our method achieves robust performance in pose-free generalizable Gaussian splatting. Code is avilable at https://github.com/youngju-na/SHARE

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Gaussian

Gaussian

Photo of Pose

Pose

Photo of ray estimation

ray estimation

Related news:

News photo

Apple’s Persona technology uses Gaussian splatting to create 3D facial scans

News photo

UGMM-NN: Univariate Gaussian Mixture Model Neural Network

News photo

Gaussian Processes for Machine Learning (2006) [pdf]