DreamMotion introduces a novel approach to zero-shot video editing by leveraging score distillation sampling. The method focuses on distilling video scores from text-to-video diffusion models, avoiding the standard denoising process and instead using Delta Denoising Score gradients to modify appearance while maintaining motion integrity. By aligning spatial and temporal self-similarities between original and edited videos, structural deviations are minimized, ensuring smooth appearance modifications. The methodology is applicable to both cascaded and non-cascaded video diffusion frameworks, demonstrating superior results in altering appearances while preserving original structures and motions.
إلى لغة أخرى
من محتوى المصدر
arxiv.org
الرؤى الأساسية المستخلصة من
by Hyeonho Jeon... في arxiv.org 03-19-2024
https://arxiv.org/pdf/2403.12002.pdfاستفسارات أعمق