Generating Consistent 360° Panoramic Images from Text Prompts

A novel dual-branch diffusion model, PanFusion, is proposed to generate high-quality and consistent 360° panoramic images from text prompts by leveraging the global layout guidance of the panorama branch and the rich prior knowledge of perspective image generation in the Stable Diffusion model.