ReGenNet introduces a novel approach to human action-reaction synthesis, focusing on asymmetric, dynamic, synchronous, and detailed interactions. The model generates instant and plausible human reactions conditioned on given actions. By annotating actor-reactor orders in datasets like NTU120, Chi3D, and InterHuman, ReGenNet achieves state-of-the-art results in FID scores, action recognition accuracy, diversity, and multi-modality. The model is modular and flexible for various settings of conditional action-reaction generation.
לשפה אחרת
מתוכן המקור
arxiv.org
תובנות מפתח מזוקקות מ:
by Liang Xu,Yiz... ב- arxiv.org 03-19-2024
https://arxiv.org/pdf/2403.11882.pdfשאלות מעמיקות