July 27-August 1, 2024, Denver, CO, USA | Keyang Ye, Qiming Hou, Kun Zhou
The paper presents a novel deferred shading method for rendering specular reflections using 3D Gaussian Splatting (3DGS). The key challenge is the accurate estimation of surface normals and the propagation of correct normal information across neighboring Gaussians. The method leverages per-pixel reflection gradients from deferred shading to bridge the optimization process, allowing for gradual propagation of correct normal estimates. This approach significantly improves the quality of specular reflections compared to existing methods, while maintaining real-time performance and comparable frame rates to vanilla 3DGS. The method outperforms state-of-the-art techniques in both synthetic and real-world scenes, demonstrating improved peak signal-to-noise ratio (PSNR) and more accurate normal and environment map estimations. The paper also discusses the limitations of the method, such as handling only one layer of reflective materials per pixel and the efficiency of normal propagation in concave scenes.The paper presents a novel deferred shading method for rendering specular reflections using 3D Gaussian Splatting (3DGS). The key challenge is the accurate estimation of surface normals and the propagation of correct normal information across neighboring Gaussians. The method leverages per-pixel reflection gradients from deferred shading to bridge the optimization process, allowing for gradual propagation of correct normal estimates. This approach significantly improves the quality of specular reflections compared to existing methods, while maintaining real-time performance and comparable frame rates to vanilla 3DGS. The method outperforms state-of-the-art techniques in both synthetic and real-world scenes, demonstrating improved peak signal-to-noise ratio (PSNR) and more accurate normal and environment map estimations. The paper also discusses the limitations of the method, such as handling only one layer of reflective materials per pixel and the efficiency of normal propagation in concave scenes.