Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generation

Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generation

14 Mar 2024 | Fangfu Liu, Hanyang Wang, Weiliang Chen, Haowen Sun, and Yueqi Duan*
Make-Your-3D is a novel method for fast and consistent subject-driven 3D content generation. It aims to personalize high-fidelity 3D content from a single image of a subject with text-driven modifications within 5 minutes. The key insight is to harmonize the distributions of a multi-view diffusion model and an identity-specific 2D generative model, aligning them with the distribution of the desired 3D subject. The method involves a co-evolution framework that reduces the variance of distributions through identity-aware optimization and subject-prior optimization. Extensive experiments demonstrate that Make-Your-3D can produce high-quality, consistent, and subject-specific 3D content, outperforming existing methods in terms of quality, resolution, and speed.Make-Your-3D is a novel method for fast and consistent subject-driven 3D content generation. It aims to personalize high-fidelity 3D content from a single image of a subject with text-driven modifications within 5 minutes. The key insight is to harmonize the distributions of a multi-view diffusion model and an identity-specific 2D generative model, aligning them with the distribution of the desired 3D subject. The method involves a co-evolution framework that reduces the variance of distributions through identity-aware optimization and subject-prior optimization. Extensive experiments demonstrate that Make-Your-3D can produce high-quality, consistent, and subject-specific 3D content, outperforming existing methods in terms of quality, resolution, and speed.
Reach us at info@study.space