Xinyu Yi


Xinyu Yi

I'm currently a fourth-year Ph.D. student at Tsinghua University, supervised by Prof. Feng Xu. Before this, I obtained my B.S degree in Computer Science from School of the Gifted Young, University of Science and Technology of China in 2020.

I'm interested in human motion capture and physics-based human-environement interaction. I'm currently working on real-time human motion capture from sparse lightweight body-worn sensors.

Research


PNP
Physical Non-inertial Poser (PNP): Modeling Non-inertial Effects in Sparse-inertial Human Motion Capture

Xinyu Yi, Yuxiao Zhou, Feng Xu
Proc. of SIGGRAPH, 2024

HOIC
Hand-Object Interaction Controller (HOIC): Deep Reinforcement Learning for Reconstructing Interactions with Physics

Haoyu Hu, Xinyu Yi, Zhe Cao, Jun-Hai Yong, Feng Xu
Proc. of SIGGRAPH, 2024

LIP
Loose Inertial Poser: Motion Capture with IMU-attached Loose-Wear Jacket

Chengxu Zuo, Yiming Wang, Lishuang Zhan, Shihui Guo, Xinyu Yi, Feng Xu, Yipeng Qin
Computer Vision and Pattern Recognition (CVPR), 2024

RobustCap
Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture

Shaohua Pan, Qi Ma, Xinyu Yi, Weifeng Hu, Xiong Wang, Xingkang Zhou, Jijunnan Li, Feng Xu
Proc. of SIGGRAPH Asia, 2023

EgoLocate
EgoLocate: Real-time Motion Capture, Localization, and Mapping with Sparse Body-mounted Sensors

Xinyu Yi, Yuxiao Zhou, Marc Habermann, Vladislav Golyanik, Shaohua Pan, Christian Theobalt, Feng Xu
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2023

PIP
Physical Inertial Poser (PIP): Physics-aware Real-time Human Motion Tracking from Sparse Inertial Sensors

Xinyu Yi, Yuxiao Zhou, Marc Habermann, Soshi Shimada, Vladislav Golyanik, Christian Theobalt, Feng Xu
Computer Vision and Pattern Recognition (CVPR), 2022 (Best Paper Finalist)

PhysInteraction
Physical Interaction: Reconstructing Hand-object Interactions with Physics

Haoyu Hu, Xinyu Yi, Hao Zhang, Jun-Hai Yong, Feng Xu
Proc. of SIGGRAPH Asia, 2022

TransPose
TransPose: Real-time 3D Human Translation and Pose Estimation with Six Inertial Sensors

Xinyu Yi, Yuxiao Zhou, Feng Xu
ACM Transactions on Graphics (Proc. of SIGGRAPH), 2021

HierarIK
HierarIK: Hierarchical Inverse Kinematics Solver for Human Body and Hand Pose Estimation

Xinyu Yi, Yuxiao Zhou, Feng Xu
CAAI International Conference on Artificial Intelligence (CICAI), 2021 (Best Student Paper Finalist)

Education


School of Software, Tsinghua University Ph. D.
Sep 2020 - present
School of the Gifted Young, University of Science and Technology of China Bachelor
Sep 2016 - July 2020