mirror of
https://github.com/gryf/coach.git
synced 2026-02-15 05:25:55 +01:00
1.9 KiB
1.9 KiB
| 1 | Episode # | Training Iter | In Heatup | ER #Transitions | ER #Episodes | Episode Length | Total steps | Epsilon | Shaped Training Reward | Training Reward | Update Target Network | Evaluation Reward | Shaped Evaluation Reward | Success Rate | Loss/Mean | Loss/Stdev | Loss/Max | Loss/Min | Learning Rate/Mean | Learning Rate/Stdev | Learning Rate/Max | Learning Rate/Min | Grads (unclipped)/Mean | Grads (unclipped)/Stdev | Grads (unclipped)/Max | Grads (unclipped)/Min | Discounted Return/Mean | Discounted Return/Stdev | Discounted Return/Max | Discounted Return/Min | Q/Mean | Q/Stdev | Q/Max | Q/Min |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | 1 | 0.0 | 1.0 | 986.0 | 986.0 | 986.0 | 986.0 | 7.0 | 0.0 | -1.8205545076821419 | 0.7192845707051421 | -0.2081522550905921 | -3.1698994392478896 | |||||||||||||||||||||
| 3 | 2 | 0.0 | 1.0 | 1806.0 | 1806.0 | 820.0 | 1806.0 | 4.0 | 0.0 | -2.3370969394351864 | 0.575288014748253 | -0.7105532272722921 | -3.355172823288848 | |||||||||||||||||||||
| 4 | 3 | 206.0 | 0.0 | 2629.0 | 2629.0 | 823.0 | 2629.0 | 5.0 | -21.0 | -21.0 | 0.0 | 0.013241646022737044 | 0.013426115799074972 | 0.06692679971456528 | 0.000705955782905221 | 0.0002500000000000001 | 1.0842021724855042e-19 | 0.00025 | 0.00025 | 0.012983278999999999 | 0.004881826 | 0.032856163 | 0.00533005 | -2.3342722836314502 | 0.7834970909114538 | -0.38878391807422696 | -3.369599601005491 | |||||||
| 5 | 4 | 398.0 | 0.0 | 3397.0 | 3397.0 | 768.0 | 3397.0 | 3.0 | -21.0 | -21.0 | 0.0 | 0.014017146643709566 | 0.013581066769959666 | 0.06306872516870499 | 0.0006765050929971039 | 0.0002500000000000001 | 5.421010862427521e-20 | 0.00025 | 0.00025 | 0.012632045 | 0.004335136 | 0.02522624 | 0.005467761 | -2.4495140411664926 | 0.5558315778011723 | -0.7105532272722921 | -3.354852824180864 | |||||||
| 6 | 5 | 617.0 | 0.0 | 4274.0 | 4274.0 | 877.0 | 4274.0 | 6.0 | -21.0 | -21.0 | 0.0 | 0.014781689254851953 | 0.014562911817935488 | 0.07851850241422652 | 0.0011200609151273966 | 0.0002500000000000001 | 1.0842021724855042e-19 | 0.00025 | 0.00025 | 0.012727573999999998 | 0.004514621 | 0.035298187 | 0.0072377953000000005 | -2.24386277951745 | 0.7822289069788971 | -0.3810471181045498 | -3.3685376079191567 | -0.017959576 | 0.016207013 | 0.0050252294 | -0.04572457 |