Увійти
ідея - Audio-visual generation
Audio-Driven Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model
This work presents a novel motion-decoupled framework to directly generate audio-driven co-speech gesture videos, without relying on structural human priors. The key innovations include a nonlinear TPS transformation to extract latent motion features, a transformer-based diffusion model to capture the temporal correlation between gestures and speech, and a refinement network to enhance visual details.
MoDiTalker: A Motion-Disentangled Diffusion Model for High-Fidelity Talking Head Generation
MoDiTalker, a novel motion-disentangled diffusion model, generates high-fidelity talking head videos by explicitly separating the generation process into audio-to-motion and motion-to-video stages.
Продукти
© 2024 by Linnk AI