mirror of
https://github.com/gryf/coach.git
synced 2025-12-18 11:40:18 +01:00
74db141d5e
* SAC algorithm * SAC - updates to agent (learn_from_batch), sac_head and sac_q_head to fix problem in gradient calculation. Now SAC agents is able to train. gym_environment - fixing an error in access to gym.spaces * Soft Actor Critic - code cleanup * code cleanup * V-head initialization fix * SAC benchmarks * SAC Documentation * typo fix * documentation fixes * documentation and version update * README typo
85 lines
1.8 KiB
Markdown
85 lines
1.8 KiB
Markdown
# Clipped PPO
|
|
|
|
Each experiment uses 3 seeds and is trained for 10M environment steps.
|
|
The parameters used for Clipped PPO are the same parameters as described in the [original paper](https://arxiv.org/abs/1707.06347).
|
|
|
|
### Inverted Pendulum Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl inverted_pendulum
|
|
```
|
|
|
|
<img src="inverted_pendulum_clipped_ppo.png" alt="Inverted Pendulum Clipped PPO" width="800"/>
|
|
|
|
|
|
### Inverted Double Pendulum Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl inverted_double_pendulum
|
|
```
|
|
|
|
<img src="inverted_double_pendulum_clipped_ppo.png" alt="Inverted Double Pendulum Clipped PPO" width="800"/>
|
|
|
|
|
|
### Reacher Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl reacher
|
|
```
|
|
|
|
<img src="reacher_clipped_ppo.png" alt="Reacher Clipped PPO" width="800"/>
|
|
|
|
|
|
### Hopper Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl hopper
|
|
```
|
|
|
|
<img src="hopper_clipped_ppo.png" alt="Hopper Clipped PPO" width="800"/>
|
|
|
|
|
|
### Half Cheetah Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl half_cheetah
|
|
```
|
|
|
|
<img src="half_cheetah_clipped_ppo.png" alt="Half Cheetah Clipped PPO" width="800"/>
|
|
|
|
|
|
### Walker 2D Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl walker2d
|
|
```
|
|
|
|
<img src="walker2d_clipped_ppo.png" alt="Walker 2D Clipped PPO" width="800"/>
|
|
|
|
|
|
### Ant Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl ant
|
|
```
|
|
|
|
<img src="ant_clipped_ppo.png" alt="Ant Clipped PPO" width="800"/>
|
|
|
|
|
|
### Swimmer Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl swimmer
|
|
```
|
|
|
|
<img src="swimmer_clipped_ppo.png" alt="Swimmer Clipped PPO" width="800"/>
|
|
|
|
|
|
### Humanoid Clipped PPO - single worker
|
|
|
|
```bash
|
|
coach -p Mujoco_ClippedPPO -lvl humanoid
|
|
```
|
|
|
|
<img src="humanoid_clipped_ppo.png" alt="Humanoid Clipped PPO" width="800"/>
|