Xinyu Yi


Xinyu Yi

I'm currently a fifth-year Ph.D. student at Tsinghua University, supervised by Prof. Feng Xu. Before this, I obtained my B.S degree in Computer Science from School of the Gifted Young, University of Science and Technology of China in 2020.

I'm interested in human motion capture and physics-based human-environment interaction. I'm currently working on real-time human motion capture from sparse lightweight body-worn sensors.

Research


GlobalPose
Improving Global Motion Estimation in Sparse IMU-based Motion Capture with Physics

Xinyu Yi, Shaohua Pan, Feng Xu
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2025

TIC
Transformer IMU Calibrator: Dynamic On-body IMU Calibration for Inertial Motion Capture

Chengxu Zuo, Jiawei Huang, Xiao Jiang, Yuan Yao, Xiangren Shi, Rui Cao, Xinyu Yi, Feng Xu, Shihui Guo, Yipeng Qin
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2025 (Best Paper Award)

PNP
Physical Non-inertial Poser (PNP): Modeling Non-inertial Effects in Sparse-inertial Human Motion Capture

Xinyu Yi, Yuxiao Zhou, Feng Xu
Proc. of SIGGRAPH, 2024

HOIC
Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions with Physics

Haoyu Hu, Xinyu Yi, Zhe Cao, Jun-Hai Yong, Feng Xu
Proc. of SIGGRAPH, 2024

LIP
Loose Inertial Poser: Motion Capture with IMU-attached Loose-Wear Jacket

Chengxu Zuo, Yiming Wang, Lishuang Zhan, Shihui Guo, Xinyu Yi, Feng Xu, Yipeng Qin
Computer Vision and Pattern Recognition (CVPR), 2024

RobustCap
Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture

Shaohua Pan, Qi Ma, Xinyu Yi, Weifeng Hu, Xiong Wang, Xingkang Zhou, Jijunnan Li, Feng Xu
Proc. of SIGGRAPH Asia, 2023

EgoLocate
EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors

Xinyu Yi, Yuxiao Zhou, Marc Habermann, Vladislav Golyanik, Shaohua Pan, Christian Theobalt, Feng Xu
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2023

PIP
Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors

Xinyu Yi, Yuxiao Zhou, Marc Habermann, Soshi Shimada, Vladislav Golyanik, Christian Theobalt, Feng Xu
Computer Vision and Pattern Recognition (CVPR), 2022 (Best Paper Finalist)

PhysInteraction
Physical Interaction: Reconstructing Hand-object Interactions with Physics

Haoyu Hu, Xinyu Yi, Hao Zhang, Jun-Hai Yong, Feng Xu
Proc. of SIGGRAPH Asia, 2022

TransPose
TransPose: Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensors

Xinyu Yi, Yuxiao Zhou, Feng Xu
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2021

HierarIK
HierarIK: Hierarchical Inverse Kinematics Solver for Human Body and Hand Pose Estimation

Xinyu Yi, Yuxiao Zhou, Feng Xu
CAAI International Conference on Artificial Intelligence (CICAI), 2021 (Best Student Paper Finalist)

Education


School of Software, Tsinghua University Ph. D.
Sep 2020 - present
School of the Gifted Young, University of Science and Technology of China Bachelor
Sep 2016 - July 2020