Bo Liu

Assistant Professor
Department of Computer Science and Software Engineering
3101P Shelby Center for Engineering Technology
Auburn University
Auburn, AL 36849-5347
boliu AT auburn DOT edu

[Brief Bio]


I am an assistant professor in Dept. Computer Science and Software Engineering, directing the Computational Automated Learning Laboratory. Previously I worked in the Autonomous Learning lab at UMass Amherst, working closely with Sridhar Mahadevan and Andy Barto. I also worked with Prof. Rich Sutton in the summer of 2018.


Sep 2018One AAAI-2019 papers accepted! "SDRL: Interpretable and Data-efficient Deep Reinforcement Learning Leveraging Symbolic Planning" is our 2nd publication on the topic of trustworthy and interpretable decision-making! Thanks to my collaborators!
Sep 2018Our paper "A Block Coordinate Ascent Algorithm for Mean-Variance Optimization" is accepted by NIPS-2018! This offers the first risk-sensitive RL method without the burden of tuning two-time-scale stepsizes, and also with provable sample complexity analysis! Thanks to my collaborators!
Aug 2018Our paper "Proximal Gradient Temporal Difference Learning: Stable Reinforcement Learning with Polynomial Sample Complexity" is accepted by Journal of Artificial Intelligence Research (JAIR)! This paper provides a family of stable, off-policy, linear complexity per-step, and provable sample complexity reinforcement learning algorithms based on the Legendre-Fenchel duality. Thanks to my collaborators!
Jul 2018Our paper "Hierarchical Feature Selection for Random Projection" is accepted by IEEE-TNN! Thanks to my collaborators!
Jun 2018Our paper "Stable and Efficient Policy Evaluation" is accepted by IEEE-TNN! This paper offers an attempt when you cannot obtain long traces (consecutive trajectories) in some problems. Thanks to my collaborators! Also congratulations to Daoming, who is the first author of the paper!
Apr 2018Our paper "PEORL: Integrating Symbolic Planning and Hierarchical Reinforcement Learning for Robust Decision-Making" is accepted by IJCAI-2018! This paper offers a unified framework between symbolic planning and data-driven decision-making. Thanks to my collaborators!
Aug 2017Our lab was awarded the Rhino-bird Award Fund by Tencent AI LAB! Thanks to Tencent!
Apr 2017You are welcome to submit your wonderful ideas on machine learning, data mining with applications to cyber systems! Check the ICDM-2017 workshop 'ML in Cyber!' See you in New Orleans in the sunny November!
May 2016 Our paper “Dantzig Selector with an Approximately Optimal Denoising Matrix and its Application to Reinforcement Learning” is accepted by UAI-2016! Thanks to my collaborators!
Apr 2016 Our paper “Proximal Gradient Temporal Difference Learning Algorithms” is accepted by IJCAI-2016! Thanks to my collaborators!
Dec 2015 Our Proximal Gradient TD work received high praise from Prof. Rich Sutton in NIPS-2015!
"Try the new true-gradient RL methods (Gradient-TD and proximal-gradient TD) developed by Maei (2011) and Mahadevan (2015) et al. These seem to me to be the best attempts to make TD methods with the robust convergence properties of stochastic gradient descent."
Nov 2015 Our paper “Uncorrelated Group LASSO” is accepted by AAAI-2016! Congratulations to my collaborators!
July 2015 Our paper “Finite-Sample Analysis of Proximal Gradient TD Algorithms” won the Facebook Best Student Paper Award of UAI 2015! Thanks to my collaborators!


PhD in Computer Science at University of Massachusetts Amherst, 2010 - 2015
Advisor: Sridhar Mahadevan

M.S in Computer Engineering at Stevens Institute of Technology, 2008 - 2010
M.S in Electrical Engineering at USTC, 2005 - 2008


Reinforcement Learning and Sequential Decision-Making
Large-scale Optimization
Decision-Making under Stochasticity and Uncertainty


Facebook Best Student Paper Award, UAI-2015
Machine Learning Conference Ratings
ACM PhD Dissertation Award Nomination, 2016
Google PhD Fellowship Nomination, 2013
Outstanding Reviewer Recognition, by Applied Soft Computing, 2014
Google PhD Fellowship Nomination, 2013
UAI Student Scholarship, 2012
Department Travel Grant, 2012
NIPS Student Travel Grant, 2010, 2012
ICNSC Doctoral Consortium Grant, 2010
ICCNS Student Fellowship, 2009