Earlier work · Simulation

Training a Legged Robot Using Deep Reinforcement Learning

A collaborative course project studying simulated Half Cheetah locomotion with PPO and A2C in MuJoCo.

Deep reinforcement learningMuJoCo simulationPPOA2C

Learning locomotion in simulation

This earlier collaborative course project explored forward locomotion for a simulated Half Cheetah agent. It was completed within CIVE 7397: Deep Learning for Engineers at the University of Houston. The demonstrations are simulation screen recordings, not physical robot experiments.

Methodology

The methodology combines Proximal Policy Optimization (PPO) and Advantage Actor-Critic (A2C), custom policy networks of 512 × 512 and 128 × 128, and the Mujoco-py simulation environment. The task is to train the agent for running and compare the two algorithms.

The demonstrations illustrate simulated locomotion without establishing final reward values, learning curves, success rates, or a performance ranking between the algorithms.

Relationship to my doctoral research

This project studies deep reinforcement learning in simulation. My adaptive-control research uses a hybrid RL–IELM–MPC framework for physical robotic printing. Sensor-Guided Same-Layer Repair is a separate sensor-guided repair framework using a semi-empirical grey-box model and constrained spatial inverse planning; its demonstrated repair pathway does not use reinforcement learning.

RESEARCH IN VIEW

Legged robot reinforcement learning

Methodology

Methodology flowchart: Half Cheetah, PPO and A2C, 512 by 512 and 128 by 128 networks, Mujoco-py and running
Methodology · Simulated Half Cheetah locomotion with PPO and A2C.View figure (PDF) ↗

Simulation demonstrations

A2C Training (first 21 seconds)

First 21 seconds of A2C training with a simulated Half Cheetah agent in MuJoCo. This is a simulation recording, not a physical robot experiment.

PPO Training

PPO training of a simulated Half Cheetah agent in MuJoCo. The demonstration does not quantify rewards or comparative performance.