mirror of
https://github.com/gryf/coach.git
synced 2026-01-06 13:54:21 +01:00
2.2 KiB
2.2 KiB
| 1 | Episode # | Training Iter | In Heatup | ER #Transitions | ER #Episodes | Episode Length | Total steps | Epsilon | Shaped Training Reward | Training Reward | Update Target Network | Evaluation Reward | Shaped Evaluation Reward | Success Rate | Loss/Mean | Loss/Stdev | Loss/Max | Loss/Min | Learning Rate/Mean | Learning Rate/Stdev | Learning Rate/Max | Learning Rate/Min | Grads (unclipped)/Mean | Grads (unclipped)/Stdev | Grads (unclipped)/Max | Grads (unclipped)/Min | Discounted Return/Mean | Discounted Return/Stdev | Discounted Return/Max | Discounted Return/Min | Q/Mean | Q/Stdev | Q/Max | Q/Min |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 1 | 0.0 | 1.0 | 1117.0 | 1117.0 | 1117.0 | 1117.0 | 1.0 | 0.0 | -1.5180229894995567 | 0.6998808293377133 | -0.08930329112720292 | -3.148474706421977 | |||||||||||||||||||||
| 3 | 2 | 205.0 | 0.0 | 1937.0 | 1937.0 | 820.0 | 1937.0 | 0.9991882000000176 | -21.0 | -21.0 | 0.0 | 36.34445524564603 | 41.993139542609136 | 200.13507080078125 | 2.573660135269165 | 5.000000000000001e-05 | 6.776263578034403e-21 | 5e-05 | 5e-05 | 12.7432995 | 10.766466000000001 | 81.03363 | 3.42582 | -2.3361342922088504 | 0.784322378590693 | -0.38878391807422696 | -3.369599601005491 | |||||||
| 4 | 3 | 413.0 | 0.0 | 2768.0 | 2768.0 | 831.0 | 2768.0 | 0.9983655100000356 | -21.0 | -21.0 | 0.0 | 37.543445411783 | 41.50272860065348 | 266.24258422851557 | 2.552807331085205 | 5.0000000000000016e-05 | 1.3552527156068802e-20 | 5e-05 | 5e-05 | 38.67631 | 34.089546 | 285.27133 | 8.399524000000001 | -2.320394201181889 | 0.6047235028955231 | -0.7105532272722921 | -3.350537576335216 | -0.018642622935246142 | 0.009556171435240226 | -0.004845094565243928 | -0.03212798437627499 | |||
| 5 | 4 | 667.0 | 0.0 | 3783.0 | 3783.0 | 1015.0 | 3783.0 | 0.9973606600000572 | -20.0 | -20.0 | 0.0 | 35.145844577804326 | 33.76140476143935 | 133.99909973144528 | 3.20855712890625 | 5.000000000000001e-05 | 6.776263578034403e-21 | 5e-05 | 5e-05 | 51.623084999999996 | 26.665253000000003 | 171.20616 | 25.264019 | -1.7531357837449677 | 0.7448577440634202 | -0.1288331810939122 | -3.2971074888190803 | -0.04896596012507265 | 0.012271451729615605 | -0.028249878564020038 | -0.0641258182382444 | |||
| 6 | 5 | 867.0 | 0.0 | 4585.0 | 4585.0 | 802.0 | 4585.0 | 0.9965666800000744 | -21.0 | -21.0 | 0.0 | 33.21861356735229 | 33.802230749750514 | 171.11648559570312 | 3.1988396644592285 | 5.000000000000001e-05 | 6.776263578034403e-21 | 5e-05 | 5e-05 | 51.510967 | 29.626279999999998 | 225.32596 | 27.11263 | -2.406465837413259 | 0.5636980823469648 | -0.7105532272722921 | -3.36383697254212 | -0.03616584410942476 | 0.011201886243875388 | -0.015056172198383141 | -0.05481453027576209 |