13 Jun 2024 | Kailu Wu, Fangfu Liu, Zhihan Cai, Runjie Yan, Hanyang Wang, Yating Hu, Yueqi Duan, Kaisheng Ma
Unique3D is a novel image-to-3D framework that efficiently generates high-quality 3D meshes from single-view images, achieving state-of-the-art generation fidelity and strong generalizability. The framework includes a multi-view diffusion model to generate multi-view images with normal maps, a multi-level upscale process to improve resolution, and an instant and consistent mesh reconstruction algorithm called ISOMER. ISOMER integrates color and geometric priors into mesh results, enabling high-fidelity, consistent, and efficient 3D mesh generation. The framework is trained on a filtered version of the Objaverse dataset with approximately 50k 3D data. It incorporates strategies such as noise offset channels, stricter dataset filtering, and expansion regularization to enhance quality and robustness. Unique3D can generate high-fidelity, diverse, and multi-view consistent meshes from single-view wild images within 30 seconds. Extensive experiments show that Unique3D outperforms existing methods in terms of geometric and textural details, demonstrating its effectiveness and generation fidelity. The method unlocks new possibilities for real-world deployment in 3D generative AI.Unique3D is a novel image-to-3D framework that efficiently generates high-quality 3D meshes from single-view images, achieving state-of-the-art generation fidelity and strong generalizability. The framework includes a multi-view diffusion model to generate multi-view images with normal maps, a multi-level upscale process to improve resolution, and an instant and consistent mesh reconstruction algorithm called ISOMER. ISOMER integrates color and geometric priors into mesh results, enabling high-fidelity, consistent, and efficient 3D mesh generation. The framework is trained on a filtered version of the Objaverse dataset with approximately 50k 3D data. It incorporates strategies such as noise offset channels, stricter dataset filtering, and expansion regularization to enhance quality and robustness. Unique3D can generate high-fidelity, diverse, and multi-view consistent meshes from single-view wild images within 30 seconds. Extensive experiments show that Unique3D outperforms existing methods in terms of geometric and textural details, demonstrating its effectiveness and generation fidelity. The method unlocks new possibilities for real-world deployment in 3D generative AI.