mirror of
https://github.com/gryf/coach.git
synced 2026-01-30 20:35:47 +01:00
2.2 KiB
2.2 KiB
| 1 | Episode # | Training Iter | In Heatup | ER #Transitions | ER #Episodes | Episode Length | Total steps | Epsilon | Shaped Training Reward | Training Reward | Update Target Network | Evaluation Reward | Shaped Evaluation Reward | Success Rate | Loss/Mean | Loss/Stdev | Loss/Max | Loss/Min | Learning Rate/Mean | Learning Rate/Stdev | Learning Rate/Max | Learning Rate/Min | Grads (unclipped)/Mean | Grads (unclipped)/Stdev | Grads (unclipped)/Max | Grads (unclipped)/Min | Discounted Return/Mean | Discounted Return/Stdev | Discounted Return/Max | Discounted Return/Min | Q/Mean | Q/Stdev | Q/Max | Q/Min |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 1 | 0.0 | 1.0 | 1117.0 | 1117.0 | 1117.0 | 1117.0 | 1.0 | 0.0 | -1.5180229894995567 | 0.6998808293377133 | -0.08930329112720292 | -3.148474706421977 | |||||||||||||||||||||
| 3 | 2 | 197.0 | 0.0 | 1905.0 | 1905.0 | 788.0 | 1905.0 | 0.9992198800000168 | -21.0 | -21.0 | 0.0 | 0.0064866334039760465 | 0.004131804922553068 | 0.03104443661868572 | 1.4448891306528823e-05 | 6.250000000000001e-05 | 1.3552527156068802e-20 | 6.25e-05 | 6.25e-05 | 0.03878765 | 0.023484444 | 0.22815436 | 0.00323429 | -2.4312329564518818 | 0.5717677860635341 | -0.7105532272722921 | -3.3662833646890835 | |||||||
| 4 | 3 | 436.0 | 0.0 | 2862.0 | 2862.0 | 957.0 | 2862.0 | 0.9982724500000376 | -20.0 | -20.0 | 0.0 | 0.005787130516174904 | 0.00260959432086106 | 0.01427764445543289 | 0.0001548390282550827 | 6.250000000000003e-05 | 2.7105054312137605e-20 | 6.25e-05 | 6.25e-05 | 0.028759224 | 0.011704876000000001 | 0.07163235 | 0.008223475 | -1.9651299496437336 | 0.7810357358559473 | -0.3655772928295825 | -3.2941461345643885 | -0.16823806 | 0.05095485599999999 | -0.08356075 | -0.26015088 | |||
| 5 | 4 | 627.0 | 0.0 | 3623.0 | 3623.0 | 761.0 | 3623.0 | 0.997519060000054 | -21.0 | -21.0 | 0.0 | 0.005963045392452745 | 0.0028514600960427012 | 0.014360946603119372 | 2.424295598757453e-05 | 6.250000000000001e-05 | 1.3552527156068802e-20 | 6.25e-05 | 6.25e-05 | 0.027299996 | 0.012375978999999999 | 0.07347562 | 0.0030203340000000004 | -2.5196481268264272 | 0.5839729089128289 | -0.7105532272722921 | -3.3699982440767453 | |||||||
| 6 | 5 | 855.0 | 0.0 | 4535.0 | 4535.0 | 912.0 | 4535.0 | 0.9966161800000736 | -20.0 | -20.0 | 0.0 | 0.006235880403357697 | 0.002686495318714779 | 0.015876490622758862 | 0.00016267428873106837 | 6.250000000000003e-05 | 2.7105054312137605e-20 | 6.25e-05 | 6.25e-05 | 0.028169753 | 0.01084809 | 0.07740243 | 0.011433218 | -1.9480557195901917 | 0.7908203737498453 | -0.21371412100620468 | -3.2726053764291825 | -0.19339468 | 0.031096203 | -0.15218829999999997 | -0.26763937 |