About

I’m a Ph.D student in Shanghai Jiao Tong University (SJTU), under the supervision of Prof. Cewu Lu and Yong-Lu Li. Prior to that, I received my Bachelor’s degree from SJTU in 2022.

My research focuses on how agents interact with objects. Prior to 2024, I concentrated on Human-Object Interaction (HOI) — detecting and recognizing interaction semantics between humans and objects, with representative works including PartMap, Symbol-LLM, and Pangea. Since then, I have expanded my research toward transferring HOI knowledge to robotic systems, and GPS represents an initial outcome of this ongoing effort.

Selected Publications

GPS: Geometric Primary Structure for Articulated Parts Perception in Robot Manipulation

Xiaoqian Wu, Yejie Guo, Xiaoyang Chen, Lixin Yang, Cewu Lu, Yong-Lu Li

CVPR 2026 (findings) [paper] [code] [project]

VR-based data collection system for articulated objects in real-world, which balances scalability and data quality.

Pangea Framework

From Isolated Islands to Pangea: Unifying Semantic Space for Human Action Understanding

Yong-Lu Li*, Xiaoqian Wu*, Xinpeng Liu, Yiming Dou, Yikun Ji, Junyi Zhang, Yixing Li, Jingru Tan, Xudong Lu, Cewu Lu

CVPR 2024 (highlight) [paper] [code] [project]

A unified framework that bridges isolated action datasets by learning shared semantic representations across different human activity domains.

Symbol-LLM Framework

Symbol-LLM: Leverage Language Models for Symbolic System in Visual Human Activity Reasoning

Xiaoqian Wu, Yong-Lu Li, Jianhua Sun, Cewu Lu

NeurIPS 2023 [paper] [code] [project]

Leverage Large Language Models and neuro-symbolic computation to generate human part primitives, thus improving activity reasoning.

Body-Part HOI Detection

Mining Cross-Person Cues for Body-Part Interactiveness Learning in HOI Detection

Xiaoqian Wu*, Yong-Lu Li*, Xinpeng Liu, Junyi Zhang, Yuzhe Wu, Cewu Lu

ECCV 2022 [paper] [code]

Human-Object Interaction learning from a global, scene-level perspective.

HAKE Knowledge Engine

HAKE: A Knowledge Engine Foundation for Human Activity Understanding

Yong-Lu Li, Xinpeng Liu, Xiaoqian Wu, Yizhuo Li, Zuoyu Qiu, Liang Xu, Yue Xu, Hao-Shu Fang, Cewu Lu

TPAMI 2022 [paper] [code] [project]

Program interpretable logic rules to infer human activity semantics.

Transferable Interactiveness Network

Transferable Interactiveness Knowledge for Human-Object Interaction Detection

Yong-Lu Li, Xinpeng Liu, Xiaoqian Wu, Xijie Huang, Liang Xu, Cewu Lu

TPAMI 2021 [paper] [code] [project]

Introduce transferable interactiveness knowledge to enhance human-object interaction detection.

Selected Awards

  • Huatai Securities Technology Scholarship (2025)
  • Shanghai Outstanding Graduates (2022)
  • National Scholarship (2019)