EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Images

EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Images

29 May 2024 | Wangbo Yu*1,2, Chaoran Feng*1, Jiye Tang3, Xu Jia3, Li Yuan†1,2, Yonghong Tian†1,2
**Event Stream Assisted Gaussian Splatting (EvaGaussians)** is a novel framework that integrates event streams from an event camera to assist in reconstructing high-quality 3D Gaussian Splatting (3D-GS) from blurry images. The method leverages the high temporal resolution and dynamic range of event cameras to model the formation process of motion-blurred images and guide the deblurring reconstruction of 3D-GS. By jointly optimizing 3D-GS parameters and camera motion trajectories during exposure time, EvaGaussians can robustly recover intricate details and produce high-fidelity novel views. The method is evaluated on both synthetic and real-world datasets, demonstrating superior performance compared to existing techniques in restoring fine details and generating novel views. The code and datasets will be released for future research.**Event Stream Assisted Gaussian Splatting (EvaGaussians)** is a novel framework that integrates event streams from an event camera to assist in reconstructing high-quality 3D Gaussian Splatting (3D-GS) from blurry images. The method leverages the high temporal resolution and dynamic range of event cameras to model the formation process of motion-blurred images and guide the deblurring reconstruction of 3D-GS. By jointly optimizing 3D-GS parameters and camera motion trajectories during exposure time, EvaGaussians can robustly recover intricate details and produce high-fidelity novel views. The method is evaluated on both synthetic and real-world datasets, demonstrating superior performance compared to existing techniques in restoring fine details and generating novel views. The code and datasets will be released for future research.
Reach us at info@study.space