I'm a Ph.D. candidate in Computer Science at National University of Singapore. My advisor is Professor Leong Tze Yun.

My research interests include Reinforcement Learning, Reward Shaping, AI Agent Decision-Making, Large Language Models, and Robotics.


NEW!    I'm looking for researcher job/intern opportunities. I'd very much welcome your consideration. My CV is available to download here.

Publications

ICML 2025

Catching Two Birds with One Stone: Reward Shaping with Dual Random Networks for Balancing Exploration and Exploitation
Haozhe Ma, Fangling Li, Jing Yu Lim, Zhengding Luo, Thanh Vinh Vo, Tze-Yun Leong.
42nd International Conference on Machine Learning (ICML), 2025

ICLR 2025

Highly Efficient Self-Adaptive Reward Shaping for Reinforcement Learning
Haozhe Ma, Zhengding Luo, Thanh Vinh Vo, Kuankuan Sima, Tze-Yun Leong.
13th International Conference on Learning Representations (ICLR), 2025

ICML 2024

Reward Shaping for Reinforcement Learning with An Assistant Reward Agent.
Haozhe Ma, Kuankuan Sima, Thanh Vinh Vo, Di Fu, Tze-Yun Leong.
41st International Conference on Machine Learning (ICML), 2024

Preprint

Knowledge Sharing and Transfer via Centralized Reward Agent for Multi-Task Reinforcement Learning
Haozhe Ma, Zhengding Luo, Thanh Vinh Vo, Kuankuan Sima, Tze-Yun Leong.

AAMAS 2024
Oral

Mixed-Initiative Bayesian Sub-Goal Optimization in Hierarchical Reinforcement Learning.
Haozhe Ma, Thanh Vinh Vo, Tze-Yun Leong.
23rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2024

Neural Networks

GFANC-RL: Reinforcement Learning-based Generative Fixed-filter Active Noise Control.
Zhengding Luo*, Haozhe Ma*, Dongyuan Shi, Woon-Seng Gan.
*Equal contribution.
Neural Networks Journal, 2024. (Impact Factor: 6.0)

CoLLAs 2024

Decoupled Prompt-Adapter Tuning for Continual Activity Recognition
Di Fu, Thanh Vinh Vo, Haozhe Ma, Tze-Yun Leong.
Conference on Lifelong Learning Agents (CoLLAs), 2024

AAMAS 2023

Hierarchical Reinforcement Learning with Human-AI Collaborative Sub-Goals Optimization.
Haozhe Ma, Thanh Vinh Vo, Tze-Yun Leong.
22rd International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2023
(extended abstract)

AAAI Sym. 2023

Human-AI Collaborative Sub-Goal Optimization in Hierarchical Reinforcement Learning.
Haozhe Ma, Thanh Vinh Vo, Tze-Yun Leong.
Inaugural Summer Symposium Series 2023 of AAAI, 2023

Education

National University of Singapore (NUS)

Computer Science, School of Computing

National University of Singapore (NUS)

Computer Science, School of Computing

Xi'an Jiaotong University (XJTU)

Computer Science, Qian Xuesen Top Class

Awards

PhD Research Achievement Award of National University of Singapore (AY2023-2024).    

Research Incentive Award of School of Computing of National University of Singapore (AY2022-2023)

Research Scholarship from the Ministry of Education in Singapore (2022-2026).

Scholarship of International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2024).

Outstanding Student Scholarship of Xi’an Jiaotong University.

SiYuan Student Scholarship of Xi'an Jiaotong University.

Academic Duty

Student Area Search Committee for faculty recruitment for School of Computing, National University of Singapore.

Reviewers of conferences: ICLR, ICML, NeurIPS, AAMAS, etc.

Teaching Assistant of the undergraduate course Foundations of Artificial Intelligence.

Teaching Assistant of the graduate course AI Planning and Decision Making.

Open-Sourse Projects

[ICLR 2025] Highly Efficient Self-Adaptive Reward Shaping for Reinforcement Learning

[ICML 2024] Reward Shaping for Reinforcement Learning with an Assistant Reward Agent

Efficient Reinforcement Learning Algorithms and Environments by PyTorch

Flat Reinforcement Learning Algorithms on StartCraft II Mini-Games

Tutorial and Document: Using StarCraft II as Learning Environment

Auto Text Recognition and Translation by Pasting Screenshots