Alapfogalmak
MicroDreamer, an efficient and versatile algorithm for zero-shot 3D generation, can produce high-quality 3D meshes in about 20 seconds on a single A100 GPU by leveraging score-based iterative reconstruction.
Kivonat
The paper introduces an efficient and general algorithm called score-based iterative reconstruction (SIR) for zero-shot 3D generation. SIR is designed to minimize the number of function evaluations (NFEs) typically required by existing optimization-based methods.
Key highlights:
- SIR mimics the 3D reconstruction process, repeatedly optimizing 3D parameters given a single set of images produced by a pre-trained multi-view diffusion model, unlike the single optimization in existing methods.
- SIR enables optimization directly in the pixel space, further boosting efficiency compared to optimization in the latent space.
- The comprehensive system, named MicroDreamer, can efficiently generate neural radiance fields (NeRF) and 3D Gaussian splatting (3DGS), and refine 3DGS into high-quality meshes.
- Compared to the state-of-the-art optimization-based method, MicroDreamer is 5-20 times faster in generating NeRF and about twice as fast in generating meshes, while retaining comparable performance.
- MicroDreamer's speed is on par with feed-forward methods trained on extensive 3D data, with a very competitive 3D quality measured by CLIP similarity.
Statisztikák
MicroDreamer can generate NeRF 5-20 times faster than the state-of-the-art optimization-based method.
MicroDreamer can generate 3D meshes in about 20 seconds on a single A100 GPU, about twice as fast as the most competitive optimization-based baseline.
Idézetek
"MicroDreamer, an efficient and versatile algorithm for zero-shot 3D generation, can produce high-quality 3D meshes in about 20 seconds on a single A100 GPU by leveraging score-based iterative reconstruction."
"Compared to the state-of-the-art optimization-based method, MicroDreamer is 5-20 times faster in generating NeRF and about twice as fast in generating meshes, while retaining comparable performance."