PhD Fellowship Program 2024: A Unified Model for Human Motion-based Interaction
Start year: 2024
Summary: This study also aims to propose a multi-model framework that unifies several interaction tasks into a generalist model, named the Large Interaction Model (LIM). The framework is based on the diffusion model. For a better understanding of modalities, the study proposes using a Sparse Mixture of Experts (S-MoE) in the denoising network.