• Skip to main content
  • Skip to primary navigation
  • Departments
    • Bioengineering
    • Civil and Environmental Engineering
    • Electrical Engineering and Computer Sciences
    • Industrial Engineering and Operations Research
    • Materials Science and Engineering
    • Mechanical Engineering
    • Nuclear Engineering
    • Aerospace program
    • Engineering Science program
  • News
    • Berkeley Engineer magazine
    • Social media
    • News videos
    • News digest (email)
    • Press kit
  • Events
    • Events calendar
    • Commencement
    • Homecoming
    • Cal Day
    • Space reservations
    • View from the Top
    • Kuh Lecture Series
    • Minner Lecture
  • College directory
  • For staff & faculty
Berkeley Engineering

Educating leaders. Creating knowledge. Serving society.

  • About
    • Facts & figures
    • Rankings
    • Mission & values
    • Equity & inclusion
    • Voices of Berkeley Engineering
    • Leadership team
    • Milestones
    • Buildings & facilities
    • Maps
  • Admissions
    • Undergraduate admissions
    • Graduate admissions
    • New students
    • Visit
    • Maps
    • Admissions events
    • K-12 outreach
  • Academics
    • Undergraduate programs
    • Majors & minors
    • Undergraduate Guide
    • Graduate programs
    • Graduate Guide
    • Innovation & entrepreneurship
    • Kresge Engineering Library
    • International programs
    • Executive education
  • Students
    • New students
    • Advising & counseling
    • ESS programs
    • CAEE academic support
    • Student life
    • Wellness & inclusion
    • Undergraduate Guide
    • > Degree requirements
    • > Policies & procedures
    • Forms & petitions
    • Resources
  • Research & faculty
    • Centers & institutes
    • Undergrad research
    • Faculty
    • Sustainability and resiliency
  • Connect
    • Alumni
    • Industry
    • Give
    • Stay in touch
Home > News > Working like a dog
Robotic dog walking on gravelPhoto by Laura Smith

Working like a dog

Berkeley Engineer magazine Spring 2023
May 17, 2023
This article appeared in Berkeley Engineer magazine, Spring 2023
  • In this issue
    Illustration of blood cells

    Forever young

    Scott Moura holding an electric car charger

    Smart and in charge

    Prepping the Eureka-1 rocket for launch

    A Eureka-1 moment

    Students watching model airplane in wind tunnel

    Engineering new frontiers

    Upfront

    • Raising the stakes
    • Life isn't fair ... yet
    • Working like a dog
    • In training
    • As tough as they come
    • Speak and spell
    • Keep it cool
    • Stopping traffic

    New & noteworthy

    • Distinguished Teaching Awards
    • On the grid
    • With flexibility comes possibility
    • Farewell
  • Past issues

Berkeley researchers may be one step closer to making robot dogs our new best friends. Using advances in reinforcement learning (RL), two separate teams have developed cutting-edge approaches to shorten training times for quadruped robots, getting them to walk — and even roll over — in record time.

In a first for the robotics field, a team led by Sergey Levine, associate professor of electrical engineering and computer sciences, demonstrated a robot dog learning to walk without prior training in just 20 minutes. The robot relied solely on trial and error in the field to master the movements necessary to walk and adapt to different settings. Levine’s team was able to accelerate the learning speed by leveraging advances in RL algorithms and machine learning frameworks, enabling the robot to learn more efficiently from its mistakes while interacting with its environment. “We are studying how to allow the robot to learn from its mistakes and continue to improve while it is acting in the real world,” said Laura Smith, a Ph.D. student and co-author of the paper, along with postdoctoral researcher Ilya Kostrikov.

A different team at Berkeley, led by Pieter Abbeel, professor of electrical engineering and computer sciences, took another approach to helping a robot dog teach itself to roll over, stand up and walk in just one hour of real-world training time. The robot also proved it could adapt. Within 10 minutes, it learned to withstand pushes or quickly roll over and get back on its feet, without any resets or intervention from the researchers. The team — including Ph.D. student Alejandro Escontrela, Danijar Hafner, Philipp Wu (B.S.’19 EECS/ME) and Ken Goldberg, professor of industrial engineering and operations research and of electrical engineering and computer sciences — employed an RL algorithm named Dreamer that uses a learned-world model. This model is built with data gathered from the robot’s ongoing interactions with the world, with the robot using it to imagine potential outcomes. “The robot sort of dreams and imagines what the consequences of its actions would be and then trains itself in imagination to improve, thinking of different actions and exploring a different sequence of events,” said Escontrela.

Learn more: Step by step; A walk in the park: Learning to walk in 20 minutes with model-free reinforcement learning (arXiv); DayDreamer: World models for physical robot learning (arXiv)

Topics: AI & robotics
  • Contact
  • Give
  • Privacy
  • UC Berkeley
  • Accessibility
  • Nondiscrimination
  • instagram
  • X logo
  • linkedin
  • facebook
  • youtube
© 2025 UC Regents