Hao Liu


I am a research scientist at Google DeepMind. I am also an Assistant Professor of Machine Learning at Carnegie Mellon from Fall 2025.

Previously, I completed my Ph.D. in Computer Science at Berkeley, working with Pieter Abbeel, and my undergraduate in Computer Science at UESTC. I also spent two years part-time at Google as part of the Brain team.

My research interests focus on foundational problems in deep learning, neural networks, learning objectives, and solving superintelligence.
Research

  • Modeling text and video of millions tokens length using Ring Attention (paper'24,code).

  • Blockwise Transformer and Ring Attention (paper'24,paper'23,code).

  • Open language models: Koala, OpenLLaMa (blog'23,models).

  • ElasticTok: adapts computation based on available information in images/videos (paper'24,code).

  • Agentic Transformer for learning decision-making from trial-and-error sequences at scale (paper'23).

  • Reinforcement learning from unsupervised exploration (paper'22,paper'22,paper'21).

    • Publications
    email=haoxyliu@gmail.com