batchnorm fixes + disabling batchnorm in DDPG (#353)

Co-authored-by: James Casbon <casbon+gh@gmail.com>
2026-02-01 13:25:45 +01:00 · 2019-06-23 11:28:22 +03:00
parent 7b5d6a3f03
commit d6795bd524
22 changed files with 105 additions and 50 deletions
--- a/benchmarks/README.md
+++ b/benchmarks/README.md
@@ -38,6 +38,7 @@ The environments that were used for testing include:
 |**[Clipped PPO](clipped_ppo)**  | ![#2E8B57](https://placehold.it/15/2E8B57/000000?text=+) |Mujoco          | |
 |**[DDPG](ddpg)**                | ![#2E8B57](https://placehold.it/15/2E8B57/000000?text=+) |Mujoco          | |
 |**[SAC](sac)**                  | ![#2E8B57](https://placehold.it/15/2E8B57/000000?text=+) |Mujoco          | |
+|**[TD3](td3)**                  | ![#2E8B57](https://placehold.it/15/2E8B57/000000?text=+) |Mujoco          | |
 |**[NEC](nec)**                  | ![#2E8B57](https://placehold.it/15/2E8B57/000000?text=+) |Atari           | |
 |**[HER](ddpg_her)**                  | ![#2E8B57](https://placehold.it/15/2E8B57/000000?text=+) |Fetch           | |
 |**[DFP](dfp)**                  | ![#ceffad](https://placehold.it/15/ceffad/000000?text=+) |Doom            | Doom Battle was not verified |
--- a/benchmarks/ddpg/ant_ddpg.png
+++ b/benchmarks/ddpg/ant_ddpg.png
--- a/benchmarks/ddpg/half_cheetah_ddpg.png
+++ b/benchmarks/ddpg/half_cheetah_ddpg.png
--- a/benchmarks/ddpg/hopper_ddpg.png
+++ b/benchmarks/ddpg/hopper_ddpg.png
--- a/benchmarks/ddpg/humanoid_ddpg.png
+++ b/benchmarks/ddpg/humanoid_ddpg.png
--- a/benchmarks/ddpg/inverted_double_pendulum_ddpg.png
+++ b/benchmarks/ddpg/inverted_double_pendulum_ddpg.png
--- a/benchmarks/ddpg/inverted_pendulum_ddpg.png
+++ b/benchmarks/ddpg/inverted_pendulum_ddpg.png
--- a/benchmarks/ddpg/reacher_ddpg.png
+++ b/benchmarks/ddpg/reacher_ddpg.png
--- a/benchmarks/ddpg/swimmer_ddpg.png
+++ b/benchmarks/ddpg/swimmer_ddpg.png
--- a/benchmarks/ddpg/walker2d_ddpg.png
+++ b/benchmarks/ddpg/walker2d_ddpg.png