Bo Liu

Department of Computer Science
University of Massachusetts Amherst

140 Governors Drive
University of Massachusetts
Amherst, MA 01003
Email:  boliu AT cs DOT umass DOT edu

I am a PhD student, working with Professor Sridhar Mahadevan . I work in Autonomous Learning Lab, co-directed by Andrew Barto and Sridhar Mahadevan.



EDUCATION

06/2010 - present, PhD student, Computer Science, University of Massachusetts, Amherst, MA.

08/2008 - 07/2010, M.E., Computer Engineering, Stevens Institute of Technology, Hoboken, NJ.

09/2005 - 07/2008, M.E., Electrical Engineering, University of Science and Technology of China, China

RESEARCH INTEREST

Machine Learning, Data Mining, Graphical Model, Kernel Approaches, Stochastic Optimization.

PROJECTS

Compressed Sensing in Reinforcement Learning, Sep 2010 - present
Explore the capability of Compressed Sensing and Random Projection for feature compression in sequential decision making

Adaptive Basis Construction in Sequential Learning, May 2010 - present
Investigate efficient basis construction methods in high dimensional and massive data problem

Approximate Dynamic Programming in Cognitive Radio, Jan 2009 - May 2010
Implement ADP as a model-free approach in Cognitive Radio and power system

INDUSTRY EXPERIENCES

eBay Search, Jun 2011 - Sep 2011
I worked on dimensionality reduction and feature selection of massive data

SELECTED PUBLICATIONS

  • Bo Liu, Sridhar Mahadevan. Compressed Reinforcement Learning with Random Projections. Compressive Reinforcement Learning with Oblique Random Projections, Univ. of Massachusetts Technical Report UM-CS-2011-024.
  • Sridhar Mahadevan, Bo Liu. Basis Construction from Power Series Expansions of Value Functions. 24th Annual Conference on Neural Information Processing Systems (NIPS), Vancouver, B.C., Canada, 2010, December 6-8, full paper.
  • Bo Liu, Haibo He, Sheng Chen. Adaptive Dual Network Design for a Class of SIMO Systems with Nonlinear Time-variant Uncertainties. Acta Automatica Sinica, Vol.36, pp.564-572, 2010.
  • Bo Liu, Haibo He, Sheng Chen. A Dual-System Learning and Control Method for Machine Intelligence. Proc. Int. Conf. on Cognitive and Neural Systems (ICCNS'09), Boston, May 27-30, 2009.
  • Bo Liu, Haibo He, Daniel.Repperger. Two-Time-Scale Online Actor-Critic Paradigm Driven by POMDP. Best Paper Runner-up IEEE International Conference on Networking, Sensing and Control (ICNSC'10), Chicago, 2010.
  • Che Jing, Bo Liu. Adaptive Motion Control Based on Fourier Series and Sliding Mode Control. IEEE 7th World Congress on Intelligent Control and Automation (WCICA'08), pp.2964-2969, Chongqing, China, 2008.
  • Bo Liu, Xianyong Feng. Arbitrary-order Robust Differentiation Based Sliding Control on PM Stepper Motor. International Conference on Automation Science and Technology (iCAST'07), Best Paper Award, 7/300, Chinese Academy of Sciences, 2007.

    PATENT

    Zhang Yang, Wang Yong, Bo Liu, Shao Chang-xing. Hydraulic Flapgate. ZL200630188416.7.

    AWARDS

    NIPS Student Travel Grant
    24th Annual Conference on Neural Information Processing Systems (NIPS), Vancouver, December 6-9, 2010
    ICNSC Doctoral Consortium Grant
    The 2010 IEEE International Conference on Networking, Sensing and Control (ICNSC), Chicago, April 11-13, 2010
    ICCNS Student Fellowship
    Thirteenth International Conference on Cognitive and Neural Systems (ICCNS), Boston, May 27-30, 2009