Bipartite Graph Diffusion Model for Human Interaction Generation - INRIA - Institut National de Recherche en Informatique et en Automatique Access content directly
Conference Papers Year : 2024

Bipartite Graph Diffusion Model for Human Interaction Generation

Abstract

The generation of natural human motion interactions is a hot topic in computer vision and computer animation. It is a challenging task due to the diversity of possible human motion interactions. Diffusion models, which have already shown remarkable generative capabilities in other domains, are a good candidate for this task. In this paper, we introduce a novel bipartite graph diffusion method (BiGraphDiff) to generate human motion interactions between two persons. Specifically, bipartite node sets are constructed to model the inherent geometric constraints between skeleton nodes during interactions. The interaction graph diffusion model is transformer-based, combining some state-of-theart motion methods. We show that the proposed achieves new state-of-the-art results on leading benchmarks for the human interaction generation task. Code, pre-trained models and additional results are available at https:// github.com/CRISTAL-3DSAM/BiGraphDiff.
Fichier principal
Vignette du fichier
wacv2024.pdf (22.08 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04274209 , version 1 (07-11-2023)

Licence

Attribution

Identifiers

  • HAL Id : hal-04274209 , version 1

Cite

Baptiste Chopin, Hao Tang, Mohamed Daoudi. Bipartite Graph Diffusion Model for Human Interaction Generation: The generation of natural human motion interactions is a hot topic in computer vision and computer animation. It is a challenging task due to the diversity of possible human motion interactions. Diffusion models, which have already shown remarkable generative capabilities in other domains, are a good candidate for this task. In this paper, we introduce a novel bipartite graph diffusion method (BiGraphDiff) to generate human motion interactions between two persons. Specifically, bipartite node sets are constructed to model the inherent geometric constraints between skeleton nodes during interactions. The interaction graph diffusion model is transformer-based, combining some state-of-the-art motion methods. We show that the proposed achieves new state-of-the-art results on leading benchmarks for the human interaction generation task. WACV 2024 - IEEE/CVF Winter Conference on Applications of Computer Vision, Jan 2024, WAIKOLOA (Hawaii), United States. ⟨hal-04274209⟩
116 View
3 Download

Share

Gmail Facebook X LinkedIn More