Skip to yearly menu bar Skip to main content


Poster

SpectroMotion: Dynamic 3D Reconstruction of Specular Scenes

Cheng-De Fan · Chen-Wei Chang · Yi-Ruei Liu · Jie-Ying Lee · Jiun-Long Huang · Yu-Chee Tseng · Yu-Lun Liu


Abstract:

We present SpectroMotion, a novel approach that combines 3D Gaussian Splatting (3DGS) with physically-based rendering (PBR) and deformation fields to reconstruct dynamic specular scenes. Previous methods extending 3DGS to model dynamic scenes have struggled to represent specular surfaces accurately. Our method addresses this limitation by introducing a residual correction technique for accurate surface normal computation during deformation, complemented by a deformable environment map that adapts to time-varying lighting conditions. We implement a coarse-to-fine training strategy significantly enhancing scene geometry and specular color prediction. It is the only existing 3DGS method capable of synthesizing photorealistic real-world dynamic specular scenes, outperforming state-of-the-art methods in rendering complex, dynamic, and specular scenes.

Live content is unavailable. Log in and register to view live content