Multi-Person Interaction Generation from Two-Person Motion Priors

SIGGRAPH 2025 Conference Proceedings
University of Glasgow

Generating 10+ multi-person interactions, and complex time-varying interactions

Abstract

Generating realistic human motion with high-level controls is a crucial task for social understanding, robotics, and animation. With high-quality MOCAP data becoming more available recently, a wide range of data-driven approaches have been presented. However, modelling multi-person interactions still remains a less explored area. In this paper, we present Graph-driven Interaction Sampling, a method that can generate realistic and diverse multi-person interactions by leveraging existing two-person motion diffusion models as motion priors. Instead of training a new model specific to multi-person interaction synthesis, our key insight is to spatially and temporally separate complex multi-person interactions into a graph structure of two-person interactions, which we name the Pairwise Interaction Graph. We thus decompose the generation task into simultaneous single-person motion generation conditioned on one other's motion. In addition, to reduce artifacts such as interpenetrations of body parts in generated multi-person interactions, we introduce two graph-dependent guidance terms into the diffusion sampling scheme. Unlike previous work, our method can produce various high-quality multi-person interactions without having repetitive individual motions. Extensive experiments demonstrate that our approach consistently outperforms existing methods in reducing artifacts when generating a wide range of two-person and multi-person interactions.

Pairwise Interaction Graph

Architecture Diagram

Multi-person Examples

Time-varying Examples

Video

BibTeX

@misc{xu2025multipersoninteractiongenerationtwoperson,
      title={Multi-Person Interaction Generation from Two-Person Motion Priors}, 
      author={Wenning Xu and Shiyu Fan and Paul Henderson and Edmond S. L. Ho},
      year={2025},
      eprint={2505.17860},
      archivePrefix={arXiv},
      primaryClass={cs.GR},
      url={https://arxiv.org/abs/2505.17860}, 
}