The continuous control series of problems run in a physics simulator called called MuJoCo, which stands for Multi-Joint dynamics with Contact. Most of the tasks consist of getting various types of robots to walk or move in complex ways.
HalfCheetah and Humanoid are two of the robots that can be taught to walk or run as part of the MuJoCo continuous control package. A still from the HalfCheetah environment is shown in the following screenshot:
MuJoCo is the first physics simulator designed for use with control-based optimization problems, and it provides consistent generalizations of state spaces in complex ...
