DreamMotion introduces a novel approach to zero-shot video editing by leveraging score distillation sampling. The method focuses on distilling video scores from text-to-video diffusion models, avoiding the standard denoising process and instead using Delta Denoising Score gradients to modify appearance while maintaining motion integrity. By aligning spatial and temporal self-similarities between original and edited videos, structural deviations are minimized, ensuring smooth appearance modifications. The methodology is applicable to both cascaded and non-cascaded video diffusion frameworks, demonstrating superior results in altering appearances while preserving original structures and motions.
A otro idioma
del contenido fuente
arxiv.org
Ideas clave extraídas de
by Hyeonho Jeon... a las arxiv.org 03-19-2024
https://arxiv.org/pdf/2403.12002.pdfConsultas más profundas