Toan Nguyen

Toan Nguyen

tientoan [at] usc [dot] edu

I am a CS Ph.D. student at the University of Southern California, started in Fall 2025. I am co-advised by Prof. Yue Wang and Prof. Daniel Seita. Prior to joining USC, I was an AI Resident at the FPT AI Center. I graduated from Ho Chi Minh City University of Science.

Nowadays, I'm particularly interested in:
  • Humanoid loco-manipulation: Developing whole-body loco-manipulation policies that exploit the humanoid form factor to perform challenging tasks in diverse environments.
  • Long-context robot learning: Enabling in-context imitation learning and robots that can reason, track progress, and self-correct in complex and long-horizon tasks.
  • Robot Safety: Robots that work safely and reliably alongside humans in unstructured open-world environments.

Feel free to reach out if you'd like to discuss ideas or explore collaboration opportunities!

Publications

* Equal contribution    † Equal advising

HOTICE paper visualization

HOTICE: Whole-Body Humanoid Object Transportation in Cluttered Environments

Toan Nguyen, Weiduo Yuan*, Siheng Zhao*, Yue Wang†, Daniel Seita†

Under Submission
Safety paper visualization

Towards Human-Centered Safety in Vision-Language-Action Robot Control: A Survey and Outlook

Nhat Chung*, Toan Nguyen*, Tianrun Hu, Yun Xing, Puming Jiang, Tuan-Anh Vu, Bohao Qu, Yedi Zhang, Yue Cao, Jie Zhang, Qing Guo, Yue Wang, Ming-Ming Cheng, Jin Song Dong, Cheston Tan, Harold Soh, David Hsu, Daniel Seita, Ivor Tsang

Preprint

ICLR: In-Context Imitation Learning with Visual Reasoning

Toan Nguyen, Weiduo Yuan, Songlin Wei, Hui Li, Daniel Seita†, Yue Wang†

IROS 2026
RobotDesign1M paper visualization

RobotDesign1M: A Large-scale Dataset for Robot Design Understanding

Tri Le, Toan Nguyen, Quang Tran, Quang Nguyen, Baoru Huang, Hoan Nguyen, Minh Nhat Vu, Tung Duc Ta, Anh Nguyen

IROS 2026

SlotVLA: Towards Modeling of Object-Relation Representations in Robotic Manipulation

Taisei Hanyu*, Nhat Chung*, Huy Le, Toan Nguyen, Yuki Ikebe, Anthony Gunderman, Duy Nguyen Ho Minh, Khoa Vo, Tung Kieu, Kashu Yamazaki, Chase Rainwater, Anh Nguyen, Ngan Le

ICRA 2026
RoboMemo paper visualization

Rethinking Progression of Memory State in Robotic Manipulation: An Object-Centric Perspective

Nhat Chung*, Taisei Hanyu*, Toan Nguyen, Huy Le, Frederick Bumgarner, Duy Nguyen Ho Minh, Khoa Vo, Kashu Yamazaki, Chase Rainwater, Tung Kieu, Anh Nguyen, Ngan Le

AAAI 2026

Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance

Toan Nguyen, Minh Nhat Vu, Baoru Huang, An Vuong, Quan Vuong, Dung Nguyen, Ngan Le, Thieu Vo, Anh Nguyen

ECCV 2024 🏆 ORAL PRESENTATION
HabiCrowd paper visualization

HabiCrowd: A High Performance Simulator for Crowd-Aware Visual Navigation

An Vuong, Toan Nguyen, Minh Nhat Vu, Baoru Huang, Dung Nguyen, Binh Huynh, Thieu Vo, Anh Nguyen

IROS 2024

Language-Conditioned Affordance-Pose Detection in 3D Point Clouds

Toan Nguyen, Minh Nhat Vu, Baoru Huang, Tuan Vo, Vy Truong, Ngan Le, Thieu Vo, Bac Le, Anh Nguyen

ICRA 2024
OpenKD paper visualization

Open-Vocabulary Affordance Detection using Knowledge Distillation and Text-Point Correlation

Tuan Vo, Minh Nhat Vu, Baoru Huang, Toan Nguyen, Ngan Le, Thieu Vo, Anh Nguyen

ICRA 2024

Language-Driven Scene Synthesis Using Multi-Conditional Diffusion Model

An Vuong, Minh Nhat Vu, Toan Nguyen, Baoru Huang, Dung Nguyen, Thieu Vo, Anh Nguyen

NeurIPS 2023

Open-Vocabulary Affordance Detection in 3D Point Clouds

Toan Nguyen, Minh Nhat Vu, An Vuong, Dung Nguyen, Thieu Vo, Ngan Le, Anh Nguyen

IROS 2023 🏅 BEST PAPER FINALIST 🎓 BEST STUDENT PAPER FINALIST

Other Projects

USC CSCI 699 - Robotic Perception - Fall 2025

Active Perception with VLMs

We developed an active perception system leveraging vision-language models on a Dexmate Vega humanoid.

3D Policy Learning with 3D Foundation Models

USC CSCI 699 - Robot Learning - Fall 2025

3D Policy Learning with 3D Foundation Models

We leveraged 3D foundation models to reconstruct rich 3D scene representations for policy learning on an SO-100 robot arm, eliminating the need for expensive depth sensors.

Vision-Language Model as a Judge for Robot Policy A/B Evaluation

USC CSCI 662 - Advanced Natural Language Processing - Spring 2026

Vision-Language Model as a Judge for Robot Policy A/B Evaluation

We used vision-language models as automated judges to perform pairwise A/B comparisons of robot policy rollouts, offering a scalable alternative to human evaluation.

Professional Services

  • Teaching Assistant: USC CSCI 102 - Introduction to Programming Fall 2026
  • Conference Reviewer: RSS, ICRA, IROS, ECCV
  • Journal Reviewer: RA-L, T-RL
  • Organizer: URoS - USC robotics reading group and seminar series