gryf/coach
1
0
Fork 0
mirror of https://github.com/gryf/coach.git synced 2025-12-29 09:52:31 +01:00
Code Issues Projects Releases Wiki Activity
Files
72a1d9d426004269997f8b40bdd64f8ee582d91e
coach/rl_coach/traces/Doom_Basic_DFP/trace.csv
Itai Caspi 72a1d9d426 Itaicaspi/episode reset refactoring (#105) 
* reordering of the episode reset operation and allowing to store episodes only when they are terminated

* reordering of the episode reset operation and allowing to store episodes only when they are terminated

* revert tensorflow-gpu to 1.9.0 + bug fix in should_train()

* tests readme file and refactoring of policy optimization agent train function

* Update README.md

* Update README.md

* additional policy optimization train function simplifications

* Updated the traces after the reordering of the environment reset

* docker and jenkins files

* updated the traces to the ones from within the docker container

* updated traces and added control suite to the docker

* updated jenkins file with the intel proxy + updated doom basic a3c test params

* updated line breaks in jenkins file

* added a missing line break in jenkins file

* refining trace tests ignored presets + adding a configurable beta entropy value

* switch the order of trace and golden tests in jenkins + fix golden tests processes not killed issue

* updated benchmarks for dueling ddqn breakout and pong

* allowing dynamic updates to the loss weights + bug fix in episode.update_returns

* remove docker and jenkins file
2018-09-04 15:07:54 +03:00

10 KiB
Raw Blame History

1Episode #Training IterIn HeatupER #TransitionsER #EpisodesEpisode LengthTotal stepsEpsilonShaped Training RewardTraining RewardUpdate Target NetworkEvaluation RewardShaped Evaluation RewardSuccess RateLoss/MeanLoss/StdevLoss/MaxLoss/MinLearning Rate/MeanLearning Rate/StdevLearning Rate/MaxLearning Rate/MinGrads (unclipped)/MeanGrads (unclipped)/StdevGrads (unclipped)/MaxGrads (unclipped)/Min
210.01.065.01.065.065.00.50.0
320.01.0140.02.075.0140.00.50.0
430.01.0187.03.047.0187.00.50.0
540.01.0262.04.075.0262.00.50.0
650.01.0265.05.03.0265.00.50.0
760.01.0277.06.012.0277.00.50.0
870.01.0343.07.066.0343.00.50.0
980.01.0356.08.013.0356.00.50.0
1090.01.0366.09.010.0366.00.50.0
11100.01.0372.010.06.0372.00.50.0
12110.01.0447.011.075.0447.00.50.0
13120.01.0452.012.05.0452.00.50.0
14130.01.0456.013.04.0456.00.50.0
15140.01.0531.014.075.0531.00.50.0
16150.01.0535.015.04.0535.00.50.0
17160.01.0604.016.069.0604.00.50.0
18170.01.0634.017.030.0634.00.50.0
19180.01.0709.018.075.0709.00.50.0
20190.01.0746.019.037.0746.00.50.0
21200.01.0752.020.06.0752.00.50.0
22210.01.0761.021.09.0761.00.50.0
23220.01.0836.022.075.0836.00.50.0
24230.01.0902.023.066.0902.00.50.0
25240.01.0905.024.03.0905.00.50.0
26250.01.0909.025.04.0909.00.50.0
27260.01.0984.026.075.0984.00.50.0
28270.01.0993.027.09.0993.00.50.0
29280.01.01000.028.07.01000.00.50.0
30290.01.01012.029.012.01012.00.50.0
31300.01.01058.030.046.01058.00.50.0
323174.00.01133.031.075.01133.00.4962500000000004-310.0-310.00.010044.8693847656235242.98988461931422254.582031254401.9707031250.000100000000000000032.7105054312137605e-200.00010.000119706.6688858.3854568.9457987.5923
3332149.00.01208.032.075.01208.00.4925000000000008-330.0-330.00.03891.6225783889363637.62362697932925566.593261718752664.0036621093750.000100000000000000032.7105054312137605e-200.00010.00018448.4355481.04926043.8422302.9417
3433224.00.01283.033.075.01283.00.4887500000000013-350.0-350.00.03077.779415646115566.11686899085034660.556152343751820.8542480468750.000100000000000000032.7105054312137605e-200.00010.00017292.56934368.090318343.9021369.8833
3534269.00.01328.034.045.01328.00.4865000000000015-107.0-107.00.02778.7146329012785533.69046503861243798.9904785156251563.05603027343750.000100000000000000032.7105054312137605e-200.00010.00017935.25154627.650417427.2711315.7484
3635344.00.01403.035.075.01403.00.4827500000000019-350.0-350.00.02548.251075538429503.78953215000063885.1311035156251336.65441894531250.000100000000000000032.7105054312137605e-200.00010.00016998.51563740.055415615.9441059.72
3736419.00.01478.036.075.01478.00.4790000000000023-330.0-330.00.02403.516982619826544.66217669460073862.2246093751325.17932128906250.000100000000000000032.7105054312137605e-200.00010.00019307.7380000000015141.146526465.7521347.5527
3837494.00.01553.037.075.01553.00.4752500000000027-340.0-340.00.02239.989168734164523.12461871501063724.33593751135.01550292968750.000100000000000000032.7105054312137605e-200.00010.000111598.2280000000017139.876999999999532025.6429999999961107.6741
3938569.00.01628.038.075.01628.00.4715000000000032-340.0-340.00.02182.150799725507468.150836573423133649.645019531251002.24304199218760.000100000000000000032.7105054312137605e-200.00010.000112550.7137233.598636740.9021885.9489
4039572.00.01631.039.03.01631.00.471350000000003291.091.00.02704.028686523437118.60949707031252822.638183593752585.4191894531250.00010.00.00010.000125972.593807.83729780.42822164.754
4140604.00.01663.040.032.01663.00.4697500000000033-45.0-45.00.01930.68742124496502.98465135316963201.0930175781251072.4531259.999999999999996e-054.0657581468206416e-200.00010.000110140.7875985.699723714.362408.1848
4241638.00.01697.041.034.01697.00.4680500000000035-43.0-43.00.02243.9218897964015436.88113654552442995.5764160156251454.5295410156250.00010.00.00010.00019840.2969999999996234.15322699.381652.4387
4342713.00.01772.042.075.01772.00.4643000000000039-335.0-335.00.02289.5660070470867429.41541740819293671.474121093751392.27233886718750.000100000000000000032.7105054312137605e-200.00010.00019503.2655894.297423384.831498.6058
4443739.00.01798.043.026.01798.00.4630000000000041-6.0-6.00.02134.9425048828125455.0046475094313364.4748535156251390.660644531250.00010.00.00010.00019851.7715102.718321334.492035.835
4544814.00.01873.044.075.01873.00.4592500000000045-315.0-315.00.02201.6732433422194514.71959213444773464.291503906251020.76458740234380.000100000000000000032.7105054312137605e-200.00010.00018819.3545085.93821895.0921296.8114
4645889.00.01948.045.075.01948.00.4555000000000049-345.0-345.00.02207.215939083615554.42400541325724052.0490722656251164.01477050781250.000100000000000000032.7105054312137605e-200.00010.00019008.1615704.836999999999528084.9671202.0845
4746964.00.02023.046.075.02023.00.4517500000000053-335.0-335.00.02089.54076406118431.99180544665812953.167480468751021.19744873046880.000100000000000000032.7105054312137605e-200.00010.00018598.3064905.449722985.0179999999961388.7579999999998
4847983.00.02042.047.019.02042.00.450800000000005417.017.00.02057.0487060546875486.0345619886163028.08593751063.86169433593770.00010.00.00010.000112460.9839999999997062.585426178.942331.4316
49481008.00.02067.048.025.02067.00.4495500000000056-22.0-22.00.02126.609670003256519.23467446196073212.984863281251283.15136718750.00010.00.00010.000112462.7145630.72823076.6664272.0425
50491083.00.02142.049.075.02142.00.445800000000006-325.0-325.00.02137.4704177444046463.335560680914853200.3964843751114.65222167968770.000100000000000000032.7105054312137605e-200.00010.000111589.5119999999996253.30230283.9141995.5632
51501111.00.02170.050.028.02170.00.4444000000000061-23.0-23.00.02167.5146213107637418.64861963166672978.55957031251144.3991699218750.00011.3552527156068802e-200.00010.000110905.1616223.733430859.7342938.511
52511125.00.02184.051.014.02184.00.443700000000006247.047.00.02260.243361253005270.98462299655012814.17871093751916.07507324218750.000100000000000000021.3552527156068802e-200.00010.000110421.1909999999994779.914618740.244033.5125
53521147.00.02206.052.022.02206.00.44260000000000630.00.00.02312.171648297991431.83433936814213130.8591308593751384.2678222656250.00011.3552527156068802e-200.00010.000110536.3293903.03517744.5822334.9014
54531222.00.02281.053.075.02281.00.4388500000000067-345.0-345.00.02214.8194217166383490.61788983458743438.3751277.56921386718750.000100000000000000032.7105054312137605e-200.00010.00019800.9024857.225690.4020000000021710.8159
55541297.00.02356.054.075.02356.00.4351000000000072-345.0-345.00.02152.6272467535896493.853946922180853566.5798339843751254.2106933593750.000100000000000000032.7105054312137605e-200.00010.00018921.4735468.60822560.8121285.9827
56551304.00.02363.055.07.02363.00.434750000000007275.075.00.02388.065470377604576.7656612007863248.2116699218751657.52795410156250.00010.00.00010.000110461.3333841.944613288.7760000000022332.1982
57561379.00.02438.056.075.02438.00.4310000000000076-330.0-330.00.02083.6998043575804451.08861340021633321.6037597656251253.801269531250.000100000000000000032.7105054312137605e-200.00010.00017971.26374696.232425760.3629999999981254.4551
58571381.00.02440.057.02.02440.00.430900000000007695.095.00.01848.15783691406250.01848.15783691406251848.15783691406250.00010.00.00010.00019745.8570.09745.8579745.857
59581386.00.02445.058.05.02445.00.430650000000007776.076.00.02469.050109863281378.864452886161642849.7424316406252050.5490722656250.00010.00.00010.00014347.01461005.713755272.06452648.5105
60591461.00.02520.059.075.02520.00.4269000000000081-330.0-330.00.02129.3425457928633451.21328214284633655.2897949218751113.343261718750.000100000000000000032.7105054312137605e-200.00010.00018102.6464872.22622095.91591.7819
61601536.00.02595.060.075.02595.00.4231500000000085-345.0-345.00.02085.1278554555533437.585678812343290.23339843751268.54211425781250.000100000000000000032.7105054312137605e-200.00010.00019111.5745091.923325067.5179999999961348.4824
62611611.00.02670.061.075.02670.00.4194000000000089-350.0-350.00.02200.5184804555533462.48886248280583118.8723144531251072.39050292968770.000100000000000000032.7105054312137605e-200.00010.000111947.7026489.164625158.6111028.8323
63621686.00.02745.062.075.02745.00.4156500000000093-325.0-325.00.02026.1754109150654450.228288088017053065.60986328125987.62493896484380.000100000000000000032.7105054312137605e-200.00010.000110752.7660000000016122.65827771.9570000000021372.0846
64631761.00.02820.063.075.02820.00.4119000000000097-335.0-335.00.01894.7486151617927481.50402449921763235.630126953125915.20202636718760.000100000000000000032.7105054312137605e-200.00010.00019413.4624855.928724218.5641202.1124
65641772.00.02831.064.011.02831.00.4113500000000097649.049.00.01993.5283447265624453.25690123713084.9714355468751584.07092285156250.00010.00.00010.00018501.794672.49516319.7743136.5254
66651784.00.02843.065.012.02843.00.410750000000009838.038.00.01816.0982111150568312.480565766744862356.7399902343751309.1247558593750.00010.00.00010.000111706.2239999999986139.61321345.243042.6313
Reference in New Issue View Git Blame Copy Permalink