Episode #,Training Iter,In Heatup,ER #Transitions,ER #Episodes,Episode Length,Total steps,Epsilon,Shaped Training Reward,Training Reward,Update Target Network,Evaluation Reward,Shaped Evaluation Reward,Success Rate,Loss/Mean,Loss/Stdev,Loss/Max,Loss/Min,Learning Rate/Mean,Learning Rate/Stdev,Learning Rate/Max,Learning Rate/Min,Grads (unclipped)/Mean,Grads (unclipped)/Stdev,Grads (unclipped)/Max,Grads (unclipped)/Min,Discounted Return/Mean,Discounted Return/Stdev,Discounted Return/Max,Discounted Return/Min,Q/Mean,Q/Stdev,Q/Max,Q/Min
1,0.0,1.0,1117.0,1117.0,1117.0,1117.0,1.0,,,0.0,,,,,,,,,,,,,,,,-1.5180229894995567,0.6998808293377133,-0.08930329112720292,-3.148474706421977,,,,
2,197.0,0.0,1905.0,1905.0,788.0,1905.0,0.9992908000000232,-21.0,-21.0,0.0,,,,0.0067403961892786675,0.0043218267539128705,0.03104443661868572,4.4621716369874775e-05,0.0002500000000000001,5.421010862427521e-20,0.00025,0.00025,0.023866987000000003,0.01743193,0.22815436,0.004472835,-2.4312329564518818,0.5717677860635341,-0.7105532272722921,-3.3662833646890835,,,,
3,436.0,0.0,2862.0,2862.0,957.0,2862.0,0.9984295000000516,-20.0,-20.0,0.0,,,,0.006779984783655944,0.003341004393095993,0.01628851890563965,0.00037204055115580564,0.0002500000000000001,1.0842021724855042e-19,0.00025,0.00025,0.01701229,0.0063794130000000004,0.042816594000000006,0.0057905857,-1.9651299496437336,0.7810357358559473,-0.3655772928295825,-3.2941461345643885,-0.031879205,0.019740151,-0.0044416133,-0.077873565
4,627.0,0.0,3623.0,3623.0,761.0,3623.0,0.9977446000000744,-21.0,-21.0,0.0,,,,0.006753587473251269,0.003223489523106914,0.014178510755300522,0.0004225387529004365,0.0002500000000000001,5.421010862427521e-20,0.00025,0.00025,0.014921344,0.0052625714,0.032878317000000004,0.0076742154,-2.5196481268264272,0.5839729089128289,-0.7105532272722921,-3.3699982440767453,,,,
5,855.0,0.0,4535.0,4535.0,912.0,4535.0,0.9969238000001012,-20.0,-20.0,0.0,,,,0.006566466095376343,0.0032564465770561412,0.01596076600253582,0.00040981321944855154,0.0002500000000000001,1.0842021724855042e-19,0.00025,0.00025,0.013728661999999999,0.00475778,0.04037358,0.00424472,-1.9480557195901917,0.7908203737498453,-0.21371412100620468,-3.2726053764291825,-0.038136218,0.013395666,-0.016326109,-0.0594768