Attendance and Security System Based on Building Video Surveillance. - Kailai Sun; Qianchuan Zhao; Jianhong Zou; Xiaoteng Ma (ICSCIB, 2018)

Bi-level Proximal Policy optimization for Stochastic Coordination of EV Charging Load with Uncertain Wind Power. - Teng Long; Xiaoteng Ma; Qing-Shan Jia (CCTA, 2019)

Steward: smart edge based joint QoE optimization for adaptive video streaming. - Xiaoteng Ma; Qing Li 006; Jimeng Chai; Xi Xiao; Shu-Tao Xia; Yong Jiang 001 (NOSSDAV, 2019)

Fairness Control of Traffic Light via Deep Reinforcement Learning. - Chenghao Li 002; Xiaoteng Ma; Li Xia; Qianchuan Zhao; Jun Yang 028 (CASE, 2020)

Distributional Soft Actor Critic for Risk Sensitive Learning. - Xiaoteng Ma; Qiyuan Zhang; Li Xia; Zhengyuan Zhou; Jun Yang 028; Qianchuan Zhao (CoRR, 2020)

Wasserstein Distance guided Adversarial Imitation Learning with Reward Shape Exploration. - Ming Zhang 015; Yawei Wang 002; Xiaoteng Ma; Li Xia; Jun Yang 028; Zhiheng Li 001; Xiu Li 001 (CoRR, 2020)

SOAC: The Soft Option Actor-Critic Architecture. - Chenghao Li 002; Xiaoteng Ma; Chongjie Zhang; Jun Yang 028; Li Xia; Qianchuan Zhao (CoRR, 2020)

Modeling the Interaction between Agents in Cooperative Multi-Agent Reinforcement Learning. - Xiaoteng Ma; Yiqin Yang; Chenghao Li 002; Yiwen Lu; Qianchuan Zhao; Jun Yang 028 (AAMAS, 2021)

Average-Reward Reinforcement Learning with Trust Region Methods. - Xiaoteng Ma; Xiaohang Tang; Li Xia; Jun Yang 028; Qianchuan Zhao (IJCAI, 2021)

Believe What You See: Implicit Constraint Approach for Offline Multi-Agent Reinforcement Learning. - Yiqin Yang; Xiaoteng Ma; Chenghao Li 002; Zewu Zheng; Qiyuan Zhang; Gao Huang 001; Jun Yang 028; Qianchuan Zhao (NeurIPS, 2021)

Modeling the Interaction between Agents in Cooperative Multi-Agent Reinforcement Learning. - Xiaoteng Ma; Yiqin Yang; Chenghao Li 002; Yiwen Lu; Qianchuan Zhao; Yang Jun (CoRR, 2021)

MGPSN: Motion-Guided Pseudo Siamese Network for Indoor Video Head Detection. - Kailai Sun; Xiaoteng Ma; Qianchuan Zhao; Peng Liu 008 (CoRR, 2021)

Learning to Discover Task-Relevant Features for Interpretable Reinforcement Learning. - Qiyuan Zhang; Xiaoteng Ma; Yiqin Yang; Chenghao Li 002; Jun Yang 028; Yu Liu 036; Bin Liang 001 (IEEE Robotics Autom. Lett., 2021)

Video Super-Resolution and Caching - An Edge-Assisted Adaptive Video Streaming Solution. - Aoyang Zhang; Qing Li 006; Ying Chen; Xiaoteng Ma; Longhao Zou; Yong Jiang 001; Zhimin Xu; Gabriel-Miro Muntean (IEEE Trans. Broadcast., 2021)

Efficient Continuous Control with Double Actors and Regularized Critics. - Jiafei Lyu; Xiaoteng Ma; Jiangpeng Yan; Xiu Li 001 (AAAI, 2022)

Offline Reinforcement Learning with Value-based Episodic Memory. - Xiaoteng Ma; Yiqin Yang; Hao Hu 006; Jun Yang 028; Chongjie Zhang; Qianchuan Zhao; Bin Liang 001; Qihan Liu (ICLR, 2022)

Mildly Conservative Q-Learning for Offline Reinforcement Learning. - Jiafei Lyu; Xiaoteng Ma; Xiu Li 001; Zongqing Lu 002 (NeurIPS, 2022)

Exploit Reward Shifting in Value-Based Deep-RL: Optimistic Curiosity-Based Exploration and Conservative Exploitation via Linear Reward Shaping. - Hao Sun; Lei Han 001; Rui Yang 010; Xiaoteng Ma; Jian Guo; Bolei Zhou (NeurIPS, 2022)

RORL: Robust Offline Reinforcement Learning via Conservative Smoothing. - Rui Yang 010; Chenjia Bai; Xiaoteng Ma; Zhaoran Wang 001; Chongjie Zhang; Lei Han 001 (NeurIPS, 2022)

MagNet: Cooperative Edge Caching by Automatic Content Congregating. - Junkun Peng; Qing Li 006; Xiaoteng Ma; Yong Jiang 001; Yutao Dong; Chuang Hu; Meng Chen 005 (WWW, 2022)

Knowledge-based Temporal Fusion Network for Interpretable Online Video Popularity Prediction. - Shisong Tang; Qing Li 006; Xiaoteng Ma; Ci Gao; Dingmin Wang; Yong Jiang 001; Qian Ma; Aoyang Zhang; Hechang Chen (WWW, 2022)

Distributionally Robust Offline Reinforcement Learning with Linear Function Approximation. - Xiaoteng Ma; Zhipeng Liang; Jose H. Blanchet; Mingwen Liu; Li Xia; Jiheng Zhang; Qianchuan Zhao; Zhengyuan Zhou (CoRR, 2022)

Exploiting Reward Shifting in Value-Based Deep RL. - Hao Sun; Lei Han 001; Rui Yang 010; Xiaoteng Ma; Jian Guo; Bolei Zhou (CoRR, 2022)

Mean-Semivariance Policy Optimization via Risk-Averse Reinforcement Learning. - Xiaoteng Ma; Shuai Ma; Li Xia; Qianchuan Zhao (J. Artif. Intell. Res., 2022)

QAVA: QoE-Aware Adaptive Video Bitrate Aggregation for HTTP Live Streaming Based on Smart Edge Computing. - Xiaoteng Ma; Qing Li 006; Longhao Zou; Junkun Peng; Jianer Zhou; Jimeng Chai; Yong Jiang 001; Gabriel-Miro Muntean (IEEE Trans. Broadcast., 2022)

Learning-Based Joint QoE Optimization for Adaptive Video Streaming Based on Smart Edge. - Xiaoteng Ma; Qing Li 006; Yong Jiang 001; Gabriel-Miro Muntean; Longhao Zou (IEEE Trans. Netw. Serv. Manag., 2022)

Uncertainty-Driven Trajectory Truncation for Data Augmentation in Offline Reinforcement Learning. - Junjie Zhang; Jiafei Lyu; Xiaoteng Ma; Jiangpeng Yan; Jun Yang 028; Le Wan; Xiu Li 001 (ECAI, 2023)

What is Essential for Unseen Goal Generalization of Offline Goal-conditioned RL? - Rui Yang 010; Lin Yong; Xiaoteng Ma; Hao Hu 006; Chongjie Zhang; Tong Zhang 001 (ICML, 2023)

Mean-Semivariance Policy Optimization via Risk-Averse Reinforcement Learning (Extended Abstract). - Xiaoteng Ma; Shuai Ma; Li Xia; Qianchuan Zhao (IJCAI, 2023)

Cross-Domain Policy Adaptation via Value-Guided Data Filtering. - Kang Xu; Chenjia Bai; Xiaoteng Ma; Dong Wang 028; Bin Zhao 001; Zhen Wang 004; Xuelong Li 001; Wei Li 235 (NeurIPS, 2023)

Single-Trajectory Distributionally Robust Reinforcement Learning. - Zhipeng Liang; Xiaoteng Ma; Jose H. Blanchet; Jiheng Zhang; Zhengyuan Zhou (CoRR, 2023)

Uncertainty-driven Trajectory Truncation for Model-based Offline Reinforcement Learning. - Junjie Zhang; Jiafei Lyu; Xiaoteng Ma; Jiangpeng Yan; Jun Yang 028; Le Wan; Xiu Li 001 (CoRR, 2023)

What is Essential for Unseen Goal Generalization of Offline Goal-conditioned RL? - Rui Yang 010; Yong Lin; Xiaoteng Ma; Hao Hu 006; Chongjie Zhang; Tong Zhang 001 (CoRR, 2023)

VRCT: A Viewport Reconstruction-Based 360° Video Caching Solution for Tile-Adaptive Streaming. - Ziwen Ye; Qing Li 006; Xiaoteng Ma; Dan Zhao 003; Yong Jiang 001; Lianbo Ma; Bo Yi; Gabriel-Miro Muntean (IEEE Trans. Broadcast., 2023)

A unified algorithm framework for mean-variance optimization in discounted Markov decision processes. - Shuai Ma; Xiaoteng Ma; Li Xia (Eur. J. Oper. Res., 2023)

Learning Diverse Risk Preferences in Population-Based Self-Play. - Yuhua Jiang; Qihan Liu; Xiaoteng Ma; Chenghao Li 002; Yiqin Yang; Jun Yang 028; Bin Liang 001; Qianchuan Zhao (AAAI, 2024)

Efficient Multi-agent Reinforcement Learning by Planning. - Qihan Liu; Jianing Ye; Xiaoteng Ma; Jun Yang 028; Bin Liang 001; Chongjie Zhang (ICLR, 2024)

SEABO: A Simple Search-Based Method for Offline Imitation Learning. - Jiafei Lyu; Xiaoteng Ma; Le Wan; Runze Liu 002; Xiu Li 001; Zongqing Lu 002 (ICLR, 2024)

Single-Trajectory Distributionally Robust Reinforcement Learning. - Zhipeng Liang; Xiaoteng Ma; José H. Blanchet; Jun Yang 028; Jiheng Zhang; Zhengyuan Zhou (ICML, 2024)

Smart Data-Driven Proactive Push to Edge Network for User-Generated Videos. - Xiaoteng Ma; Qing Li 006; Junkun Peng; Gareth Tyson; Ziwen Ye; Shisong Tang; Qian Ma; Shengbin Meng; Gabriel-Miro Muntean (INFOCOM, 2024)

NeuralPlane: An Efficiently Parallelizable Platform for Fixed-wing Aircraft Control with Reinforcement Learning. - Chuanyi Xue; Qihan Liu; Xiaoteng Ma; Xinyao Qin; Gui Ning; Yang Qi; Jinsheng Ren; Bin Liang; Jun Yang (NeurIPS, 2024)

KEPC-Push: A Knowledge-Enhanced Proactive Content Push Strategy for Edge-Assisted Video Feed Streaming. - Ziwen Ye; Qing Li 006; Chunyu Qiao; Xiaoteng Ma; Yong Jiang 001; Qian Ma; Shengbin Meng; Zhenhui Yuan; Zili Meng (USENIX ATC, 2024)

Episodic Novelty Through Temporal Distance. - Yuhua Jiang; Qihan Liu; Yiqin Yang; Xiaoteng Ma; Dianyu Zhong; Hao Hu 006; Jun Yang 028; Bin Liang 001; Bo Xu 002; Chongjie Zhang; Qianchuan Zhao (ICLR, 2025)

Cross-Domain Offline Policy Adaptation with Optimal Transport and Dataset Constraint. - Jiafei Lyu; Mengbei Yan; Zhongjian Qiao; Runze Liu 002; Xiaoteng Ma; Deheng Ye; Jingwen Yang; Zongqing Lu 002; Xiu Li 001 (ICLR, 2025)

DSAC: Distributional Soft Actor-Critic for Risk-Sensitive Reinforcement Learning. - Xiaoteng Ma; Junyao Chen; Li Xia; Jun Yang 028; Qianchuan Zhao; Zhengyuan Zhou (J. Artif. Intell. Res., 2025)

Deep Learning and Supply Chain based Enterprise Strategic Marketing Operation Management System Construction. - Xiaoteng Ma; Liufeng Wang (Scalable Comput. Pract. Exp., 2025)

CVaR-Constrained Policy Optimization for Safe Reinforcement Learning. - Qiyuan Zhang; Shu Leng; Xiaoteng Ma; Qihan Liu; Xueqian Wang 001; Bin Liang 001; Yu Liu 036; Jun Yang 028 (IEEE Trans. Neural Networks Learn. Syst., 2025)

Label Unbalance in High-frequency Trading. - Zijian Zhao 002; Xuming Zhang; Jiayu Wen; Mingwen Liu; Xiaoteng Ma (CoRR, 2025)

Integrating Diffusion-based Multi-task Learning with Online Reinforcement Learning for Robust Quadruped Robot Control. - Xinyao Qin; Xiaoteng Ma; Yang Qi; Qihan Liu; Chuanyi Xue; Gui Ning; Qinyu Dong; Jun Yang; Bin Liang (CoRR, 2025)