English
教职工
李升波

长聘教授,博士生导师

地址:清华大学李兆基科技大楼A643室

电话:(010) 6279-6150

邮件: lishbo[AT]tsinghua.edu.cn

课题组网站http://www.idlab-tsinghua.com

个人主页: https://www.researchgate.net/profile/Shengbo_Li



个人主页


2004-2009

清华大学,汽车系

工学博士

2007

斯坦福大学,机械系

联合培养

2004-2006

清华大学,汽车系

工学硕士

2000-2004

北京科技大学,机械学院

工学学士



2020-至今

清华大学,车辆学院

长聘教授

2014-2020

清华大学,汽车系

副教授/长聘副教授

2015

加州伯克利大学

访问学者

2012-2014

清华大学,汽车系

助理研究员

2009-2011

密歇根大学

博士后


自动驾驶与智能汽车

具身智能移动机器人

强化学习与神经网络

最优控制与最优滤波

分布式控制与群体智能


<强化学习与控制>English, 研究生

<车辆控制工程>English, 研究生

<智能化汽车>(中文), 本科生

Ÿ   Associate Editor of IEEE TNNLS, since 2023

Ÿ ISC of 7th FAST-zero, Kanazawa, Japan, 2023

Ÿ   TPC and Session Chairman of CICV, Beijing, China, 2022

Ÿ   Vice Chairman of STC of China Industrial Cooperation Association, 2022

Ÿ   Vice Chairman of CVCI 2022, Nanjing, China, 2022

Ÿ   ISC of 15th AVEC’22, Kanagawa, Japan, 2022

Ÿ   ISC of 7th FAST-zero, Kanazawa, Japan, 2023

Ÿ   Senior Editor of IEEE OJ ITS, since 2022

Ÿ   Associate Editor of Automotive Innovation (Springer), 2020-2022

Ÿ   Board of Governor (BoG) of IEEE ITS Society, 2018-2020

Ÿ   Associate Editor of JICV (Emerald), since 2018

Ÿ   Associate Editor of IEEE ITS, since 2017

Ÿ   Associate Editor of IEEE ITS Magazine, since 2017

Ÿ   Chairman of Organization Committee of AVEC, Beijing, 2018

Ÿ   TPCs of IEEE IV Symposiums and IEEE ITS Conferences, Since 2012



2024施普林格 · 自然:中国新发展奖
2022教育部青年科技奖
2021中国自动化学会自然科学一等奖

国家高层次科技创新领军人才

清华大学青年教师教学优秀奖
2020中国汽车工业科技进步特等奖

科技部中青年科技创新领军人才

清华大学第17届良师益友奖
2019

交通运输行业中青年科技创新领军人才

2018国家科技进步二等奖

中国汽车工业优秀青年科技人才奖

北京市自然科学基金首届杰青项目负责人
2017清华大学青年教师学术新人奖
2016教育部青年长江学者

国家自然科学基金优青项目负责人
2013国家技术发明二等奖



· 发表论文230余篇,含SCI论文>140篇
· 期刊/会议的各类优秀论文奖16项,提名奖3次,包括IEEE ITSC、IEEE IVS、IET、ITS、ICCAS、IFAC MECC、CAA CVCI、IEEE ICUS、CCCC、IEEE ITSM、L4DC等

· 谷歌学者引用数超过25000次,学术影响因子H-index为78,入选ESI高被引论文(学科前1%)15篇

· 发表IEEE期刊论文90余篇,期刊影响因子>8.0论文70余篇

· 英文专著/教材2部(Springer出版社),中文译著1部(机械工业出版社),包括:S Eben Li. Reinforcement Learning for Sequential Decision and Optimal Control. Springer Verlag, Singapore, 2023


【代表论文】

[1] Jingliang Duan, Wenxuan Wang, Liming Xiao, Jiaxin Gao, Shengbo Li, Chang Liu, Ya-Qin Zhang, Bo Cheng, Keqiang Li. Distributional Soft Actor-Critic with Three Refinements. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 47, Issue: 5, 2025: 3935-3946. 

[2] Yao Lyu, Xiangteng Zhang, Shengbo Li, Jingliang Duan, Letian Tao, Qing Xu, Lei He, Keqiang Li. Conformal Symplectic Optimization for Stable Reinforcement Learning. IEEE Transactions on Neural Networks and Learning Systems, Vol. 36, Issue: 6, 2025: 11049-11063. 

[3] Yinuo Wang, Wenxuan Wang, Xujie Song, Tong Liu, Yuming Yin, Liangfa Chen, Likun Wang, Jingliang Duan, Shengbo Li. ODE-based Smoothing Neural Network for Reinforcement Learning Tasks. The 13th International Conference on Learning Representations (ICLR), Singapore, 2025. 

[4] Haitong Ma, Changliu Liu, Shengbo Li, Sifa Zheng, Wenchao Sun, Jianyu Chen. Chen, Jianyu. Learn Zero-Constraint-Violation Safe Policy in Model-Free Constrained Reinforcement Learning. IEEE Transactions on Neural Networks and Learning Systems, Vol. 36, Issue: 2, 2025: 2327-2341. 

[5] Xujie Song, Liangfa Chen, Tong Liu, Wenxuan Wang, Yinuo Wang, Shentao Qin, Yinsong Ma, Jingliang Duan, Shengbo Li. LipsNet++: Unifying Filter and Controller into a Policy Network. The 42nd International Conference on Machine Learning (ICML), Vancouver, Canada, 2025. 

[6] Wenxuan Wang, Jingliang Duan, Xujie Song, Liming Xiao, Liangfa Chen, Yinuo Wang, Bo Cheng, Shengbo Li. Smooth Filtering Neural Network for Reinforcement Learning. IEEE Transactions on Intelligent Vehicles, Volume: 10, Issue: 5, 2025 : 3103-3112. 

[7] Jie Li, Letian Tao, Wenjun Zou, Yuhang Zhang, Bin Shuai, Jingliang Duan, Shengbo Li, Hao Sun, Yiru Wang, Yu Gao, Yuwen Heng, Anqing Jiang. Towards Robust Motion Control in Multi-Source Uncertain Scenarios by Robust Policy Iteration. Communications in Transportation Research, Vol. 5, 2025: 100191. 

[8] Yuheng Lei, Yao Lyu, Guojian Zhan, Tao Zhang, Jiangtao Li, Jianyu Chen, Shengbo Li, Sifa Zheng. Zeroth-Order Actor-Critic: An Evolutionary Framework for Sequential Decision Problems. IEEE Transactions on Evolutionary Computation, Vol. 29, Issue: 2, 2025: 555-569. 

[9] Wenhan Cao, Chang Liu, Zhiqian Lan, Shengbo Li, Wei Pan, Angelo Alessandri. Robust Bayesian Inference for Moving Horizon Estimation. Automatica, vol. 173, 2025: 112108. 

[10] Chen Chen, Zhipeng Liu, Weiqiang Liang, Mingming Wang, Zhiqian Lan, Guojian Zhan, Yao Lyu, Bingbing Nie, Shengbo Li. PODAR: A Collision Risk Model Offering Valid Signals for Vehicular Interactions. IEEE Intelligent Transportation Systems Magazine, 2025: 2-22. 

[11] Yuhang Zhang, Yujie Yang, Shengbo Li, Yao Lyu, Jingliang Duan, Zhilong Zheng, Dezhao Zhang. Feasible Policy Iteration With Guaranteed Safe Exploration. IEEE Transactions on Cybernetics, Vol. 55, Issue: 5, 2025: 2327-2340. 

[12] Ziang Zheng, Guojian Zhan, Bin Shuai, Shengtao Qin, Jiangtao Li, Tao Zhang, Shengbo Li. Transferable Latent-to-Latent Locomotion Policy for Efficient and Versatile Motion Control of Diverse Legged Robots. The 38th IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Hangzhou, China, 2025. 

[13] Xiangteng Zhang, Yao Lyu, Shengbo Li, Jingliang Duan, Guojian Zhan, Chang Liu, Bo Cheng, Keqiang Li. Understanding Connection between PMP and HJB Equations from the Perspective of Hamilton Dynamics. IEEE Transactions on Artificial Intelligence, Early Access, 2025: 1-11. 

[14] Weixian He, Zeyu He, Wenhan Cao, Haoyu Gao, Tong Liu, Bin Shuai, Chang Liu, Shengbo Li. Design and Experimental Test of Datatic Approximate Optimal Filter in Nonlinear Dynamic Systems. The 19th IEEE International Conference on Control & Automation (IEEE ICCA), Tallinn, Estonia, 2025. 

[15] Guojian Zhan, Xin An, Yuxuan Jiang, Jingliang Duan, Huichan Zhao, Shengbo Li. Physics Informed Neural Pose Estimation for Real-Time Shape Reconstruction of Soft Continuum Robots. IEEE Robotics and Automation Letters, Vol. 10, Issue: 7, 2025: 6975-6982. 

[16] Tianyi Zhang, Wenhan Cao, Chang Liu, Tao Zhang, Jiangtao Li, Shengbo Li. Robust State Estimation for Legged Robots with Dual Beta Kalman Filter. IEEE Robotics and Automation Letters, Vol. 10, Issue: 8, 2025: 7955-7962. 

[17] Tong Liu, Yinuo Wang, Xujie Song, Wenjun Zou, Liangfa Chen, Likun Wang, Bin Shuai, Jingliang Duan, Shengbo Li. Distributional Soft Actor-Critic with Diffusion Policy. The 28th IEEE International Conference on Intelligent Transportation Systems (IEEE ITSC), Gold Coast, Australia, 2025. 

[18] Yangang Ren, Yao Lyu, Wenxuan Wang, Shengbo Li, Zeyang Li, Jingliang Duan. Smooth Policy Iteration for Zero-Sum Markov Games. Neurocomputing, Vol. 630, 2025: 129666. 

[19] Yujia Wu, Haoyang Dong, Yougang Bian, Fei Zhao, Shengbo Li. Distributed Sliding Mode Control for Nonlinear Multi-Agent Consensus. International Journal of Robust and Nonlinear Control, Early Access, 2025. 

[20] Guojian Zhan, Ziang Zheng, Shengbo Li. Canonical Form of Datatic Description in Control Systems. The 2025 American Control Conference (ACC), Denver, CO, USA, 2025. 

[21] Tianyi Zhang, Wenhan Cao, Chang Liu, Feihong Zhang, Wei Wu, Shengbo Li. NANO-SLAM: Natural Gradient Gaussian Approximation for Vehicle SLAM. The 28th IEEE International Conference on Intelligent Transportation Systems (IEEE ITSC), Gold Coast, Australia, 2025. 

[22] Guofa Li, Jun Yan, Yifan Qiu, Qingkun Li, Jie Li, Shengbo Li, Paul Green. Lightweight Strategies for Decision-Making of Autonomous Vehicles in Lane Change Scenarios Based on Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems, Vol. 26, Issue: 5, 2025: 7245-7261. 

[23] Wenyu Li, Jiale Geng, Yunqi Cheng, Liye Tang, Jingliang Duan, Feng Duan, Shengbo Li. Real-Time Resilient Tracking Control for Autonomous Vehicles Through Triple Iterative Approximate Dynamic Programming. IEEE Transactions on Intelligent Transportation Systems, Vol. 26, Issue: 1, 2025: 1015-1028. 

[24] Jie Li, Shengbo Li, Jingliang Duan, Yao Lyu, Wenjun Zou, Yang Guan, Yuming Yin. Relaxed Policy Iteration Algorithm for Nonlinear Zero-Sum Games with Application to H-infinity Control. IEEE Transactions on Automatic Control, vol. 69, Issue: 1, 2024: 426-433. 

[25] Guojian Zhan, Yuxuan Jiang, Shengbo Li, Yao Lyu, Xiangteng Zhang, Yuming Yin. A transformation-aggregation framework for state representation of autonomous driving systems. IEEE Transactions on Intelligent Transportation Systems, Vol. 25, Issue: 7, 2024: 7311-7322.

[26] Yuxuan Jiang, Guojian Zhan, Zhiqian Lan, Chang Liu, Bo Cheng, Shengbo Li. A Reinforcement Learning Benchmark for Autonomous Driving in General Urban Scenarios. IEEE Transactions on Intelligent Transportation Systems. vol. 25, Issue: 5, 2024: 4335-4345.

[27] Dongjie Yu, Wenjun Zou, Yujie Yang, Haitong Ma, Shengbo Li, Yuming Yin. Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificate. IEEE Transactions on Automation Science and Engineering, Vol. 21, Issue: 3, July 2024: 4129-4142.

[28] Yujie Yang, Yuhang Zhang, Wenjun Zou, Jianyu Chen, Yuming Yin, Shengbo Li. Synthesizing Control Barrier Functions with Feasible Region Iteration for Safe Reinforcement Learning. IEEE Transactions on Automatic Control, Vol. 69, Issue: 4, 2024: 2713-2720. 

[29] Yinan Zheng, Jianxiong Li, Dongjie Yu, Yujie Yang, Shengbo Li, Xianyuan Zhan, Jingjing Liu. Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model. The 12th International Conference on Learning Representations (ICLR), Vienna, Austria, 2024.

[30] Haicheng Liao, Zhenning Li, Huanming Shen, Wenxuan Zeng, Dongping Liao, Guofa Li, Shengbo Li, Chengzhong Xu. BAT: Behavior-Aware Human-Like Trajectory Prediction for Autonomous Driving. The 38th Association for the Advancement of Artificial Intelligence Conference on Artificial Intelligence (AAAI), Vancouver, Canada, 2024.

[31] Chen Chen, Zhiqian Lan, Guojian Zhan, Yao Lyu, Bingbing Nie, Shengbo Li. Quantifying the Individual Differences of Drivers’ Risk Perception via Potential Damage Risk Model. IEEE Transactions on Intelligent Transportation Systems, Vol. 25, Issue: 7, 2024: 8093-8104.

[32] Jingliang Duan, Yangang Ren, Fawang Zhang, Jie Li, Shengbo Li, Yang Guan, Keqiang Li. Encoding Distributional Soft Actor-Critic for Autonomous Driving in Multi-Lane Scenarios. IEEE Computational Intelligence Magazine, Vol. 19, Issue: 2, 2024: 96-112.

[33] Haotian Zheng, Haitong Ma, Sifa Zheng, Shengbo Li, Jianqiang Wang. Synthesize Efficient Safety Certificates for Learning-Based Safe Control Using Magnitude Regularization. The 40th IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 2024. 

[34] Haicheng Liao, Shangqian Liu, Yongkang Li, Zhenning Li, Chengyue Wang, Yunjian Li, Shengbo Li, Chengzhong Xu. Human Observation-Inspired Trajectory Prediction for Autonomous Driving in Mixed-Autonomy Traffic Environments. The 40th IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 2024.

[35] Zeyu Gao, Yao Mu, Chen Chen, Jingliang Duan, Ping Luo, Yanfeng Lu, Shengbo Li. Enhance Sample Efficiency and Robustness of End-to-End Urban Autonomous Driving via Semantic Masked World Model. IEEE Transactions on Intelligent Transportation Systems, Vol. 25, Issue: 10, 2024: 13067-13079. 

[36] Dongyoon Kim, Sen Yang, Wenjun Zou, Bin Shuai, Dezhao Zhang, Fang Zhang, Chang Liu, Shengbo Li. Control Safety Function for Explicit Safety-Critical Control of Autonomous Vehicles. The 35th IEEE Intelligent Vehicles Symposium (IEEE IV), Jeju Island, Republic of Korea, 2024. 

[37] Yujie Yang, Letian Tao, Likun Wang, Shengbo Li. Controllability Test for Nonlinear Datatic Systems. Communications in Transportation Research, Vol. 4, 2024: 100143. 

[38] Shentao Qin, Yujie Yang, Yao Mu, Jie Li, Wenjun Zou, Jingliang Duan, Shengbo Li. Feasible Reachable Policy Iteration. The 41st International Conference on Machine Learning (ICML), Vienna, Austria, 2024. 

[39] Fawang Zhang, Jingliang Duan, Haoyuan Xu, Hao Chen, Hui Liu, Shida Nie, Shengbo Li. Inverse Model Predictive Control: Learning Optimal Control Cost Functions for MPC. IEEE Transactions on Industrial Informatics, Vol. 20, Issue: 12, 2024: 13644-13655. 

[40] Zeyang Li, Chuxiong Hu, Yunan Wang, Yujie Yang, Shengbo Li. Safe Reinforcement Learning with Dual Robustness. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 46, Issue: 12, 2024: 10876-10890. 

[41] Yuxuan Jiang, Yujie Yang, Zhiqian Lan, Guojian Zhan, Shengbo Li, Qi Sun, Jian Ma, Tianwen Yu, Changwu Zhang. Rocket Landing Control with Random Annealing Jump Start Reinforcement Learning. The 37th IEEE/RSJ International Conference on Intelligent Robots and Systems (IEEE IROS), Abu Dhabi, UAE, 2024. 

[42] Jingliang Duan, Jie Li, Xuyang Chen, Kai Zhao, Shengbo Li, Lin Zhao. Optimization Landscape of Policy Gradient Methods for Discrete-time Static Output Feedback. IEEE Transactions on Cybernetics, Vol. 54, Issue: 6, 2024: 3588-3601. 

[43] Chengwei Pan, Jiale Geng, Wenyu Li, Feng Duan, Shengbo Li. Spiking Neural Network-Based Approximate Dynamic Programming for Vehicle Tracking Control. The 7th IEEE International Conference on Unmanned Systems (IEEE ICUS), Nanjing, China, 2024. 

[44] Yinuo Wang, Likun Wang, Yuxuan Jiang, Wenjun Zou, Tong Liu, Xujie Song, Wenxuan Wang, Liming Xiao, Jiang Wu, Jingliang Duan, Shengbo Li. Diffusion Actor-Critic with Entropy Regulator. The 38th Annual Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 2024. 

[45] Guojian Zhan, Yao Lyu, Shengbo Li, Yuxuan Jiang, Xiangteng Zhang, Letian Tao. Enhance Generality by Model-based Reinforcement Learning and Domain Randomization. The 7th CAA International Conference on Vehicular Control and Intelligence (CVCI), 2023: 27-29. 

[46] Wenxuan Wang, Yuhang Zhang, Jiaxin Gao, Yuxuan Jiang, Yujie Yang, Zhilong Zheng, Wenjun Zou, Jie Li, Congsheng Zhang, Wenhan Cao, Genjin Xie, Jingliang Duan, Shengbo Li. GOPS: A general optimal control problem solver for autonomous driving and industrial control applications. Communications in Transportation Research, Volume 3, 2023, 100096.

[47] Jie Li, Ryozo Nagamune, Shengbo Li, Yuhang Zhang. Robust Approximate Dynamic Programming for Nonlinear Systems with Both Model Error and External Disturbance. IEEE Transactions on Neural Networks and Learning Systems, Vol. 36, Issue: 1, 2023: 896-910. 

[48] Wei Wu, Chang Liu, Wenhan Cao, Chao Chen, Hongbo Li, Shengbo Li. Multi-sensor Calibration System for Mobile Robots. The 7th CAA International Conference on Vehicular Control and Intelligence (CVCI), Changsha, 2023. 

[49] Ziqing Gu, Lingping Gao, Haitong Ma, Shengbo Li, Sifa Zheng, Wei Jing, Junbo Chen. Safe-State Enhancement Method for Autonomous Driving via Direct Hierarchical Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems, vol. 24, No. 9, 2023, pp: 9966-9983. 

[50] Ziyu Lin, Jingliang Duan, Shengbo Li, Haitong Ma, Jie Li, Jianyu Chen, Bo Cheng, Jun Ma. Policy Iteration based Finite-Horizon Approximate Dynamic Programming for Continuous-Time Nonlinear Optimal Control. IEEE Transactions on Neural Networks and Learning Systems, vol. 34, No. 9, 2023, pp: 5255-5267. 

[51] Zeyang Li, Chuxiong Hu, Shengbo Li, Jia Cheng, Yunan Wang. Robust safe reinforcement learning under adversarial disturbances. The 62nd IEEE Conference on Decision and Control (IEEE CDC), Marina Bay Sands, Singapore, 2023. 

[52] Guojian Zhan, Yuxuan Jiang, Jingliang Duan, Shengbo Li, Bo Cheng, Keqiang Li. Continuous-Time Policy Optimization. The 41th American Control Conference (ACC), San Diego, CA, USA, 2023. 

[53] Yujie Yang, Yuxuan Jiang, Jianyu Chen, Shengbo Li, Ziqing Gu, Yuming Yin, Qian Zhang, Kai Yu. Belief State Actor-Critic Algorithm from Separation Principle for POMDP. The 41th American Control Conference (ACC), San Diego, CA, USA, 2023. 

[54] Wenhan Cao, Chang Liu, Zhiqian Lan, Yingxi Piao, Shengbo Li. Generalized Moving Horizon Estimation for Nonlinear Systems with Robustness to Measurement Outliers. The 41th American Control Conference (ACC), San Diego, CA, USA, 2023. 

[55] Guojian Zhan, Yao Lyv, Shengbo Li, Yuxuan Jiang, Xiangteng Zhang, Letian Tao. Enhanced Generality by Model-based Reinforcement Learning and Domain Randomization. The 7th CAA International Conference on Vehicular Control and Intelligence (CVCI), Changsha, China, 2023. 

[56] Yujie Yang, Yuxuan Jiang, Yichen Liu, Jianyu Chen, Shengbo Li. Model-free safe reinforcement learning through neural barrier certificate. IEEE Robotics and Automation Letters, vol. 8, No. 3, 2023, pp: 1295-1302. 

[57] Lian Hou, Shengbo Li, Bo Yang, Zheng Wang, Kimihiko Nakano. Integrated Graphical Representation of Highway Scenarios to Improve Trajectory Prediction of Surrounding Vehicles. IEEE Transactions on Intelligent Vehicles, vol. 8, No. 2, 2023, pp: 1638-1651. 

[58] Jie Li, Shengbo Li, Jingliang Duan, Yao Lyu, Wenjun Zou, Yang Guan, Yuming Yin. Relaxed Policy Iteration Algorithm for Nonlinear Zero-Sum Games with Application to H-infinity Control. IEEE Transactions on Automatic Control, vol. 69, Issue: 1, 2024: 426-433. 

[59] Baiyu Peng, Jingliang Duan; Jianyu Chen, Shengbo Li, Congsheng Zhang, Genjin Xie, Yang Guan, Yao Mark Mu, Enxin Sun. Model-based Chance-Constrained Reinforcement Learning via Separated Proportional -Integral Lagrangian. IEEE Transactions on Neural Networks and Learning Systems, vol 35, Issue: 1, 2024 : 466-478. 

[60] Yujie Yang, Yuhang Zhang, Wenjun Zou, Jianyu Chen, Yuming Yin, Shengbo Li. Synthesizing Control Barrier Functions with Feasible Region Iteration for Safe Reinforcement Learning. IEEE Transactions on Automatic Control, Vol. 69, Issue: 4, 2024: 2713-2720.

[61] Jie Li, Ryozo Nagamune, Shengbo Li, Yuhang Zhang. Robust Approximate Dynamic Programming for Nonlinear Systems with Both Model Error and External Disturbance. IEEE Transactions on Neural Networks and Learning Systems, Vol. 36, Issue: 1, 2023: 896-910. 

[62] Jingliang Duan, Jie Li, Xuyang Chen, Kai Zhao, Shengbo Li, Lin Zhao. Optimization Landscape of Policy Gradient Methods for Discrete-time Static Output Feedback. IEEE Transactions on Cybernetics, Vol. 54, Issue: 6, 2024: 3588-3601. 

[63] Ziyu Lin, Jingliang Duan, Shengbo Li, Haitong Ma, Jie Li, Jianyu Chen, Bo Cheng, Jun Ma. Policy Iteration based Finite-Horizon Approximate Dynamic Programming for Continuous-Time Nonlinear Optimal Control. IEEE Transactions on Neural Networks and Learning Systems, vol. 34, No. 9, 2023: 5255-5267. 

[64] Guojian Zhan, Yuxuan Jiang, Jingliang Duan, Shengbo Li, Bo Cheng, Keqiang Li. Continuous-Time Policy Optimization. The 41th American Control Conference (ACC), San Diego, CA, USA, 2023. 

[65] Yujie Yang, Yuxuan Jiang, Jianyu Chen, Shengbo Li, Ziqing Gu, Yuming Yin, Qian Zhang, Kai Yu. Belief State Actor-Critic Algorithm from Separation Principle for POMDP. The 41th American Control Conference (ACC), San Diego, CA, USA, 2023. 

[66] Wenhan Cao, Chang Liu, Zhiqian Lan, Yingxi Piao, Shengbo Li. Generalized Moving Horizon Estimation for Nonlinear Systems with Robustness to Measurement Outliers. The 41th American Control Conference (ACC), San Diego, CA, USA, 2023. 

[67] Lian Hou, Shengbo Li, Bo Yang, Zheng Wang, Kimihiko Nakano. Integrated Graphical Representation of Highway Scenarios to Improve Trajectory Prediction of Surrounding Vehicles. IEEE Transactions on Intelligent Vehicles, vol. 8, No. 2, 2023: 1638-1651.

[68] Yujie Yang, Jianyu Chen, Shengbo Li. Learning POMDP Models with Similarity Space Regularization: a Linear Gaussian Case Study. Proceedings of Machine Learning Research (L4DC), Palo Alto, CA, vol. 168, 2022: 1-12. 

[69] Haitong Ma, Changliu Liu, Shengbo Li, Sifa Zheng, Jianyu Chen. Joint Synthesis of Safety Certificate and Safe Control Policy using Constrained Reinforcement Learning. Proceedings of Machine Learning Research (L4DC), Palo Alto, CA, vol. 168, 2022:1-13. 

[70] Dongjie Yu, Haitong Ma, Shengbo Li, Jianyu Chen. Reachability constrained reinforcement learning. International Conference on Machine Learning (ICML), Hawaii, USA, 2022. 

[71] Zhengyu Liu, Jingliang Duan, Wenxuan Wang, Shengbo Li, Yuming Yin, Ziyu Lin, Bo Cheng. Recurrent Model Predictive Control: Learning an Explicit Recurrent Controller for Nonlinear Systems. IEEE Transactions on Industrial Electronics, vol. 69, No. 10, 2022: 10437-10446.

[72] Feng Gao, Yu Han, Shengbo Li, Shaobing Xu, Dongfang Dang. Accurate Pseudospectral Optimization of Nonlinear Model Predictive Control for High-performance Motion Planning. IEEE Transactions on Intelligent Vehicles, vol. 8, No. 2, 2022: 1034-1045. 

[73] Wenyu Li, Qingkun Li, Shengbo Li, Renjie Li, Yangang Ren, Wenjun Wang. Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving. IEEE Transactions on Intelligent Transportation Systems, vol. 23, No. 9, 2022: 15980-15992.

[74] Guofa Li, Yifan Yang, Shen Li, Xingda Qu, Nengchao Lyu, Shengbo Li. Decision making of autonomous vehicles in lane change scenarios: Deep reinforcement learning approaches with risk awareness. Transportation Research Part C: Emerging Technologies, vol. 134, 2022: 103452-103465. 

[75] Lian Hou, Shengbo Li, Bo Yang, Zheng Wang, Kimihiko Nakano. Structural Transformer Improves Speed-Accuracy Trade-off in Interactive Trajectory Prediction of Multiple Surrounding Vehicles. IEEE Transactions on Intelligent Transportation Systems, vol 23, No. 12, 2022: 24778-24790. 

[76] Yangang Ren, Jianhua Jiang, Guojian Zhan, Shengbo Li, Chen Chen, Keqiang Li, Jingliang Duan. Self-learned Intelligence for Integrated Decision and Control of Automated Vehicles at Signalized Intersections. IEEE Transactions on Intelligent Transportation Systems, vol. 23, No. 12, 2022: 24145-24156. 

[77] Jiaxin Gao, Shengbo Li, Fei Ma, Wenyu Li, Hao Sun. Maierdanjiang Maihemuti, Chun Jin. Accelerated convergence of time-splitting algorithm by relaxation method. IET Control Theory and Applications, vol. 16, No. 8, 2022: 776-788. 

[78] Yang Guan , Yangang Ren , Qi Sun , Shengbo Li, Haitong Ma, Jingliang Duan, Yifan Dai, Bo Cheng. Integrated decision and control: toward interpretable and computationally efficient driving intelligence. IEEE Transactions on Cybernetics, vol. 53, No. 2, 2022: 859-873.

[79] Jingliang Duan, Dongjie Yu, Shengbo Li, Wenxuan Wang, Yangang Ren, Ziyu Lin, Bo Cheng. Fixed-Dimensional and Permutation Invariant State Representation of Autonomous Driving. IEEE Transactions on Intelligent Transportation Systems, vol. 23, No. 7, 2022: 9518-9528.

[80] Yaoyu Chen, Guofa Li, Shen Li, Wenjun Wang, Shengbo Li, Bo Cheng. Exploring Behavioral Patterns of Lane Change Maneuvers for Human-Like Autonomous Driving. IEEE Transactions on Intelligent Transportation Systems, vol. 23, No. 9, 2022: 14322-14335.

[81] Baiyu Peng, Qi Sun, Shengbo Li, Dongsuk Kum, Yuming Yin, Junqing Wei. End-to-End Autonomous Driving through Double Dueling Deep Q-Network. Automotive Innovation, vol. 4, No. 3, 2021:328-337. 

[82] Yuhang Zhang, Yao Mu, Shengbo Li, Yangang Ren, Liye Tang, Yujie Yang. Steadily Learn to Drive with Virtual Memory. The Asia-Pacific Regional Conference of ISTVS, Harbin, China. 

[83] Wenhan Cao, Jianyu Chen, Jingliang Duan, Shengbo Li, Yao Lyu, Ziqing Gu, Yuhang Zhang. Reinforced Optimal Estimator. IFAC Modeling, Estimation, and Control Conference (MECC), Austin, Texas, USA, 2021. 

[84] Haitong Ma, Jianyu Chen, Shengbo Li, Ziyu Lin, Yang Guan, Yangang Ren, Sifa Zheng. Model-based Constrained Reinforcement Learning using Generalized Control Barrier Function. The 34th IEEE/RSJ International Conference on Intelligent Robots and Systems, Prague, Czech Republic, 2021. 

[85] Yang Guan, Ren Yangang, Haitong Ma, Shengbo Li, Qi Sun, Yifan Dai, Bo Cheng. Learn collision-free self-driving skills at urban intersections with model-based reinforcement learning. The 24th IEEE International Intelligent Transportation Systems Conference, Indianapolis, IN, USA, 2021.

[86] Ziqing GU, Yujie Yang, Jingliang Duan, Shengbo Li, Jianyu Chen, Wenhan Cao, Sifa Zheng. Belief state separated reinforcement learning for autonomous vehicle decision making under uncertainty. The 24th IEEE International Intelligent Transportation Systems Conference, Indianapolis, IN, USA, 2021. 

[87] Haitong Ma, Xiangteng Zhang, Shengbo Li, Ziyu Lin, Yao Lyu, Sifa Zheng. Feasibility Enhancement of Constrained Receding Horizon Control Using Generalized Control Barrier Function. IEEE International Conference on Industrial Cyber-Physical Systems, Victoria, 2021. 

[88] Baiyu Peng, Yao Mu, Yang Guan, Shengbo Li, Yuming Yin, Jianyu Chen. Model-Based Actor-Critic with Chance Constraint for Stochastic System. The 60th IEEE Conference on Decision and Control (IEEE CDC), Austin, Texas, USA, 2021.

[89] Yao Mu, Yuzheng Zhuang, Bin Wang, Guangxiang Zhu, Wulong Liu, Jianyu Chen, Ping Luo, Shengbo Li, Chongjie Zhang, Jianye Hao. Model-Based Reinforcement Learning via Imagination with Derived Memory. The 35rd Conference on Neural Information Processing Systems (NeurIPS), Virtual-only, 2021.

[90] Jingliang Duan, Yang Guan, Shengbo Li, Qi Sun, Yangang Ren, Bo Cheng. Distributional Soft Actor-Critic: Off-Policy Reinforcement Learning for Addressing Value Estimation Errors. IEEE Transactions on Neural Networks and Learning Systems, vol. 33, No. 11, 2021: 6584-6598.

[91] Yang Guan, Shengbo Li, Jingliang Duan, Jie Li, Yangang Ren, Bo Cheng. Direct and indirect reinforcement learning. International Journal of Intelligent Systems, vol. 36, No. 8, 2021: 4439-4467. 

[92] Shengbo Li, Zhitao Wang, Yang Zheng, Jiaxin Gao, Fei Ma, Keqiang Li. Synchronous and asynchronous parallel computation for large-scale optimal control of connected vehicles. Transportation Research Part C: Emerging Technologies, vol. 121, 2020:102842-102860.

[93] Jingliang Duan, Zhengyu Liu, Shengbo Li, Qi Sun, Zhenzhong Jia, Bo Cheng. Adaptive dynamic programming for nonaffine nonlinear optimal control problem with state constraints. NeuroComputing, vol. 484, 2022: 128-141. 

[94] Jianyu Chen, Shengbo Li, Masayoshi Tomizuka. Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learning. IEEE Transactions on Intelligent Transportation Systems, vol. 23, No. 6, 2021: 5068-5078.

[95] Long Xin, Yiting Kong, Shengbo Li, Jianyu Chen, Yang Guan, Masayoshi Tomizuka, Bo Cheng. Enable faster and smoother spatio-temporal trajectory planning for autonomous vehicles in constrained dynamic environment. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, vol. 235, No. 4, 2021: 1101-1112.

[96] Renjie Li, Yanan Li, Shengbo Li, Chaofei Zhang, Etienne Burdet and Bo Cheng. Indirect Shared Control for Cooperative Driving between Driver and Automation in Steer-by-Wire Vehicles. IEEE Transactions on Intelligent Transportation Systems, vol. 22, No. 12, 2021: 7826-7836. 

[97] Yang Zheng, Yougang Bian, Shen Li, Shengbo Li. Cooperative Control of Heterogeneous Connected Vehicles with Directed Acyclic Interactions. IEEE Intelligent Transportation Systems Magazine, vol. 13, No. 2, 2021:127-141. 

[98] Yao Mu, Baiyu Peng, Ziqing Gu, Shengbo Li, Chang Liu, Bingbing Nie, Jianfeng Zheng, Bo Zhang. Mixed Reinforcement Learning for Efficient Policy Optimization in Stochastic Environments. The 20th International Conference on Control, Automation and Systems, Busan, Korea, 2020. 

[99] Maierdanjiang Maihemuti, Shengbo Li, Jie Li, Jiaxin Gao, Wenyu Li, Hao Sun and Bo Cheng. Accelerated Convergence of Time-Splitting Algorithm for MPC using Cross-Node Consensus. The 23th IEEE Intelligent Vehicles Symposium, Las Vegas, USA, 2020. 

[100] Yangang Ren, Jingliang Duan, Shengbo Li, Yang Guan, Qi Sun. Improving Generalization of Reinforcement Learning with Minimax Distributional Soft Actor-Critic. The 23rd IEEE Intelligent Transportation Systems Conference, Rhodes, Greece, 2020.

[101] Keqiang Li, Yougang Bian, Shengbo Li, Biao Xu, Jianqiang Wang. Distributed Model Predictive Control of Multi-Vehicle Systems with Switching Communication Topologies. Transportation Research Part C: Emerging Technologies, vol. 118, 2020: 102717-102735.

[102] Lu Wen, Jingliang Duan, Shengbo Li, Shaobing Xu, Huei Peng. Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimization. The 23rd IEEE Intelligent Transportation Systems Conference, Rhodes, Greece, 2020. 

[103] Jie Li, Shengbo Li, Yang Guan, Jingliang Duan, Wenyu Li, Yuming Yin. Ternary Policy Iteration Algorithm for Nonlinear Robust Control. The 23rd IEEE Intelligent Transportation Systems Conference, Rhodes, Greece, 2020. 

[104] Keqiang Li, Shengbo Li, Feng Gao, Ziyu Lin, Jie Li, Qi Sun. Robust Distributed Consensus Control of Uncertain Multi-Agents Interacted by Eigenvalue-Bounded Topologies. IEEE Internet of Things Journal, vol. 7, No. 5, 2020: 3790-3798. 

[105] Yang Guan, Yangang Ren, Shengbo Li, Laiquan Luo, Qi Sun, Koji Taguchi. Centralized Cooperation for Connected and Automated Vehicles at Intersections by Proximal Policy Optimization. IEEE Transactions on Vehicular Technology, vol. 69, No. 11, 2020: 12597-12608.

[106] Lian Hou, Long Xin, Shengbo Li, Bo Cheng, Wengjun Wang, and Keqiang Li. Interactive Trajectory Prediction of Surrounding Road Users for Autonomous Driving using Structural-LSTM Network. IEEE Transactions on Intelligent Transportation Systems, vol. 21, No. 11, 2020: 4615-4625.

[107] Shengbo Li, Zhitao Wang, Yang Zheng, Keyou You. Stability of General Linear Dynamical Multi-Agent Systems under Switching Topologies with Positive Real Eigenvalues. Engineering, vol. 6, No. 6, 2020:688-694. 

[108] Yougang Bian, Shengbo Li, Biao Xu, Xiaohui Qin, Shen Li, Qing Xu, Jianqiang Wang, Keqiang Li. Behavioral Harmonization of Cyclic Vehicular Platoon in Closed Road Network. IEEE Transactions on Intelligent Vehicles, vol. 6, No. 3, 2021: 559-570.

[109] Long Xin, Yiting Kong, Shengbo Li, Jianyu Chen, Yang Guan, Masayoshi Tomizuka, Bo Cheng. Enable faster and smoother spatial-temporal trajectory planning for autonomous vehicles in constrained dynamic environment. IMechE Part D: J Automobile Engineering, vol. 235, No. 4, 2019: 104-105.

[110] Jingliang Duan, Shengbo Li, Yang Guan, Qi Sun, Bo Cheng. Hierarchical Reinforcement Learning for Self-Driving Decision-Making without Reliance on Labeled Driving Data. IET Intelligent Transport Systems, vol. 14, No. 5, 2020: 297-305. 

[111] Guofa Li, Shengbo Li, Ruobing Zou, Yuan Liao, Bo Cheng. Detection of Road Traffic Participants using Cost-Effective Arrayed Ultrasonic Sensors in Low-Speed Traffic Situations. Mechanical Systems and Signal Processing, vol. 132, 2019: 535-545. 

[112] Yujia Wu, Shengbo Li, Jorge Cortes, Kameshwar Poola. Distributed Sliding Mode Control for Nonlinear Heterogeneous Platoon Systems with Positive Definite Topologies. IEEE Transactions on Control Systems Technology, vol. 28, No. 4, 2020:1272-1283.

[113] Zhong Cao, Yi Zhang, Shengbo Li, Henry X Liu, Li Li. String Stability for Vehicular Platoon Control: Definitions and Analysis Methods. Annual Reviews in Control, vol. 47, 2019: 81-97.

[114] Kibeom Lee, Shengbo Li, Dongsuk Kum. Synthesis of Robust Lane Keeping Systems: Impact of Controller and Design Parameters on System Performance. IEEE Transactions on Intelligent Transportation Systems, vol. 20, No. 8, 2019: 3129-3141. 

[115] Shuangshuang Han, Dongpu Cao, Li Li, Lingxi Li, Shengbo Li, Nanning Zheng, Fei-Yue Wang. From Software-Defined Vehicles to Self-Driving Vehicles: A Report on CPSS-based Parallel Driving. IEEE Intelligent Transportation Systems Magazine, vol. 11, No. 1, 2019: 6-14.

[116] Zhitao Wang, Yang Zheng, Shengbo Li, Keyou You, Keqiang Li. Parallel Optimal Control for Cooperative Automation of Large-scale Connected Vehicles via ADMM. The 21st IEEE International Conference on Intelligent Transportation Systems, Maui, Hawaii, USA, 2018. 

[117] Biao Xu, Shengbo Li, Yougang Bian, Shen Li, Xuegang Jeff Ban, Jianqiang Wang, Keqiang Li. Distributed Conflict-Free Cooperation for Multiple Connected Vehicles at Unsignalized Intersections. Transportation Research Part C, vol. 93, 2018: 322-334. 

[118] Fang Zhang, Jon Gonzales, Shengbo Li, Francesco Borrelli, Keqiang Li. Drift Control for Cornering Maneuver of Autonomous Vehicles. Mechatronics, vol. 54, 2018: 167-174. 

[119] Feng Gao, Xiaosong Hu, Shengbo Li, Keqiang Li, Qi Sun. Distributed Adaptive Sliding Mode Control of Vehicular Platoon with Uncertain Interaction Topology. IEEE Transactions on Industrial Electronics, vol. 65, Issue 8, 2018: 6352-6361. 

[120] Shengbo Li, Xiaohui Qin, Yang Zheng, Jianqiang Wang, Keqiang Li, Hongwei Zhang. Distributed Platoon Control under Topologies with Complex Eigenvalues: Stability Analysis and Controller Synthesis. IEEE Transactions on Control System Technology, vol. 27, Issue 1, 2018: 206-220.

[121] Keqiang Li, Feng Gao, Shengbo Li, Yang Zheng, Hongbo Gao. Robust Cooperation of Connected Vehicle Systems with Eigenvalue-Bounded Interaction Topologies in the Presence of Uncertain Dynamics. Frontiers of Mechanical Engineering, vol. 13, Issue 3, 2018: 354-367.

[122] Shengbo Li, Yang Zheng, Keqiang Li, Feng Gao, Yujia Wu, Hongwei Zhang, J Karl Hedrick. Dynamical Modeling and Distributed Control of Connected and Automated Vehicles: Challenges and Opportunities. IEEE Intelligent Transportation Systems Magazine, vol. 9, Issue 3, 2017: 46-58. 

[123] Chang Liu, Shengbo Li, Diange Yang, J Karl Hedrick. Distributed Bayesian Filter using Measurement Dissemination for Multiple UGVs with Dynamically Changing Interaction Topologies. ASME-Journal of Dynamic Systems, Measurement and Control: Rudolph E. Kalman Special Issue, vol. 140, No. 3, 2018: 1-11.

[124] Shengbo Li, Guofa Li, Jiaying Yu, Chang Liu, Bo Cheng, Jianqiang Wang, Keqiang Li. Kalman Filter-Based Tracking of Moving Objects Using Linear Ultrasonic Sensor Array for Road Vehicles. Mechanical Systems and Signal Processing, vol. 98, 2018: 173-189. 

[125] Chang Liu, Shengbo Li, J Karl Hedrick. Measurement Dissemination based Distributed Bayesian Filter using LIFO Exchange Protocol for Networked Unmanned Vehicles. IEEE Transactions on Industrial Electronics, vol. 64, Issue 11, 2017: 8756-8766.

[126] Shengbo Li, Xiaohui Qin, Keqiang Li, Jianqiang Wang, Boyuan Xie. Robustness Analysis and Controller Synthesis of Homogeneous Vehicular Platoons with Bounded Parameter Uncertainty. IEEE/ASME Transactions on Mechatronics, vol. 22, Issue 2, 2017: 1014-1025.

[127] Shengbo Li, Renjie Li, Jianqiang Wang, Xiaosong Hu, Bo Cheng, Keqiang Li. Stabilizing Periodic Control of Automated Vehicle Platoon with Minimized Fuel Consumption. IEEE transactions on Transportation Electrification, vol. 3, Issue 1, 2017: 259-271. 

[128] Guofa Li, Shengbo Li, Bo Cheng, Paul A. Green. Estimation of Driving Style in Naturalistic Highway Traffic using Maneuver Transition Probabilities. Transportation Research Part C: Emerging Technologies, vol. 74, 2017: 113-125. 

[129] Yang Zheng, Shengbo Li, Keqiang Li, Francesco Borrelli, Karl Hedrick. Distributed Model Predictive Control for Heterogeneous Vehicle Platoons under Unidirectional Topologies. IEEE Transactions on Control System Technology, vol. 25, Issue 3, 2017: 899-910.

[130] Shengbo Li, Shaobing Xu, Dongsuk Kum. Efficient and Accurate Computation of Model Predictive Control using Pseudospectral Discretization. Neurocomputing, vol. 172, 2015: 363-372.

[131] Yang Zheng, Shengbo Li, Jianqiang Wang, Dongpu Cao, Keqiang Li. Stability and Scalability of Homogeneous Vehicular Platoon: Study on the Influence of Information Flow Topologies. IEEE Transactions on Intelligent Transportation Systems, vol. 17, No. 1, 2016: 14-26. 

[132] Yang Zheng, Shengbo Li, Keqiang Li, Le-Yi Wang. Stability Margin Improvement of Vehicular Platoon Considering Undirected Topology and Asymmetric Control. IEEE Transactions on Control System Technology, vol. 24, Issue 4, 2016: 1253-1265. 

[133] Shengbo Li, Shaobing Xu, Xiaoyu Huang, Bo Cheng, Huei Peng. Eco-Departure of Connected Vehicles with V2X Communication at Signalized Intersections. IEEE Transactions on Vehicular Technology, vol. 64, No. 12, 2015: 5439-5449. 

[134] Shaobing Xu, Shengbo Li, Xiaowu Zhang, Bo Cheng, Huei Peng. Fuel-optimal Cruising Strategy for Road Vehicles with Step-Gear Mechanical Transmission. IEEE Transactions on Intelligent Transportation System, vol. 16, Issue 6, 2015: 3496-3507.

[135] Shengbo Li, Kun Deng, Yang Zheng, Huei Peng. Effect of Pulse-and-Glide Strategy on Traffic Flow for a Platoon of Mixed Automated and Manually Driven Vehicles. Computer-Aided Civil and Infrastructure Engineering, vol. 30, No. 11, 2015: 892-905. 

[136] Feng Gao, Shengbo Li, Dongsuk Kum, Hui Zhang. Synthesis of Multiple Model Switching Controllers using H-Infinity Theory for Systems with Large Uncertainties. Neurocomputing, vol. 157, 2015: 118-124.

[137] Shengbo Li, Zhenzhong Jia, Keqiang Li, Bo Cheng. Fast Online Computation of a Model Predictive Controller and Its Application to Fuel Economy-Oriented Adaptive Cruise Control. IEEE Transactions on Intelligent Transportation System, vol. 16, No. 3, 2015: 1199-1209. 

[138] Shengbo Li, Kun Deng, Keqiang Li, Changsun Ahn. Terminal Sliding Mode Control of Automated Car-following System without Reliance on Acceleration Information. Mechatronics, vol. 30, 2015: 327-337. 

[139] Shaobing Xu, Shengbo Li, Kun Deng, Sisi Li, and Bo Cheng. A Unified Pseudospectral Computational Framework for Optimal Control of Road Vehicles. IEEE/ASME transactions on Mechatronics, vol. 20, Issue 4, 2015: 1499-1510.

[140] Shengbo Li, Keqiang Li, Jianqiang Wang. Economy Oriented Vehicle Adaptive Cruise Control with Coordinating Multiple Objectives Function. Vehicle System Dynamics, vol. 51, No. 1, 2013: 1-17. 

[141] Shengbo Li, Huei Peng. Strategies to Minimize Fuel Consumption of Passenger Cars during Car-Following Scenarios. IMechE Part D: J Automobile Engineering, vol. 226, No. 3, 2012: 419-429. 

[142] Shengbo Li, Huei Peng, Keqiang Li, Jianqiang Wang. Minimum Fuel Control Strategy in Automated Car-Following Scenarios. IEEE Transaction on Vehicle Technology, vol. 61, No. 3, 2012: 998-1007. 

[143] Shengbo Li, Keqiang Li, Rajesh Rajamani, Jianqiang Wang. Model Predictive Multi-Objective Vehicular Adaptive Cruise Control. IEEE Transactions on Control System Technology, vol. 19, No. 3, 2011: 556-566.