gryf/coach
1
0
Fork 0
mirror of https://github.com/gryf/coach.git synced 2026-08-26 21:51:54 +02:00
Code Issues Projects Releases Wiki Activity
265 Commits 4 Branches 2 Tags
2cc6abc3c4e3475358bd036e8e8e31128e320df3
Commit Graph
95 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zach Dwiel 2cc6abc3c4 update CartPole_PPO not addressed during rebase (#41) 2018-10-24 16:58:25 -07:00
zach dwiel f835ac902c fix renaming: save_checkpoint_sec -> checkpoint_save_secs 2018-10-24 10:52:18 -04:00
zach dwiel 3ba0df7d07 update GraphManager.act specified return type 2018-10-23 19:58:17 -04:00
zach dwiel def76b4cc6 update CartPole_PPO 2018-10-23 19:58:17 -04:00
zach dwiel 3e5e5475de update training worker 2018-10-23 19:58:17 -04:00
zach dwiel 430ca198e5 convert golden tests into pytest format 2018-10-23 19:58:17 -04:00
zach dwiel 787ab42578 remove extra call to super().store_episode 2018-10-23 19:58:17 -04:00
Zach Dwiel 700a175902 rename save_checkpoint_secs -> checkpoint_save_secs 2018-10-23 17:10:58 -04:00
Zach Dwiel 9804b033a2 rename save_checkpoint_dir -> checkpoint_save_dir 2018-10-23 17:10:58 -04:00
Zach Dwiel 201a2237a1 restructure looping mechanism inGraphManager 2018-10-23 17:10:58 -04:00
Zach Dwiel 52560a2aae introduce property GraphManager.current_step_counter 2018-10-23 17:10:04 -04:00
Zach Dwiel 776c94d551 reorder methods in GraphManager 2018-10-23 17:10:04 -04:00
Zach Dwiel 496a516de1 rename GraphManager.sync_graph -> sync 2018-10-23 17:08:29 -04:00
Zach Dwiel 5fee48dcfd remove argument keep_networks_in_sync from GraphManager.act, and move this feature into the only place that activated it: GraphManager.train_and_act 2018-10-23 17:08:29 -04:00
Zach Dwiel b2d864a5bd remove out of date documentation 2018-10-23 17:08:29 -04:00
Zach Dwiel d32d909238 move only invocation of GraphManager.handle_episode_ended inline 2018-10-23 17:08:29 -04:00
Zach Dwiel 18d84c5037 remove unnecessary timers from GraphManager 2018-10-23 16:58:17 -04:00
Zach Dwiel cd30efe52e remove unnecessary test result is None in GraphManager.act 2018-10-23 16:57:43 -04:00
Zach Dwiel 35d67cbd9b use phase context in GraphManager.evaluate 2018-10-23 16:57:43 -04:00
Zach Dwiel d3c341147e simplify GraphManager.act by removing arguments: continue_until_game_over and return_on_game_over 2018-10-23 16:57:43 -04:00
Zach Dwiel 8be980912c fixed typo from earlier commit 2018-10-23 16:57:43 -04:00
Zach Dwiel fbaf19543e capture stdout during preset tests 2018-10-23 16:57:43 -04:00
Zach Dwiel 517aac163a introduce graph_manager.phase_context; make sure that calls to graph_manager.train automatically set training phase 2018-10-23 16:57:43 -04:00
Zach Dwiel 7382a142bb remove unused steps parameter from GraphManager.train 2018-10-23 16:57:06 -04:00
Zach Dwiel 97f608ee5e reorder failing presets 2018-10-23 16:57:05 -04:00
Zach Dwiel ad68fa263d remove property GraphManager.training_start_time 2018-10-23 16:57:05 -04:00
Zach Dwiel bfc320cf83 disable failing tests for now 2018-10-23 16:57:05 -04:00
Zach Dwiel 01f3a0594b remove return values from GraphManager.act 2018-10-23 16:57:05 -04:00
Zach Dwiel b02f269464 graph_manager:heatup uses total_steps_counters looping mechanism like other loops. graph_manager:act no longer needs to return any values 2018-10-23 16:57:05 -04:00
Zach Dwiel 9f92064e67 cleanup graph_manager:act 2018-10-23 16:53:32 -04:00
Zach Dwiel b5305bd075 update dockerfile 2018-10-23 16:52:16 -04:00
Zach Dwiel 950f261201 extract method all_presets 2018-10-23 16:52:16 -04:00
Zach Dwiel ed3a3b39be add comments 2018-10-23 16:52:16 -04:00
Zach Dwiel 04038c9f40 improve integration test output format 2018-10-23 16:52:16 -04:00
Zach Dwiel a54ef2757f ignore deprecation warnings in test logging 2018-10-23 16:51:48 -04:00
Zach Dwiel acc7f70de3 enumerate each preset as its own test 2018-10-23 16:51:48 -04:00
Zach Dwiel 1e83a27bee update dockerfile and makefile 2018-10-23 16:51:48 -04:00
Zach Dwiel 67faa80ea0 allow custom number of training steps 2018-10-23 16:51:48 -04:00
Zach Dwiel d69332efd4 fixed bug in training worker 2018-10-23 16:51:48 -04:00
Zach Dwiel cd733b2404 add support for running kubernetes orchestrator from behind proxy 2018-10-23 16:51:48 -04:00
Zach Dwiel ad4d2c3053 add make stop_kubernetes 2018-10-23 16:51:48 -04:00
Zach Dwiel 5e85a0f972 use the number of heat up steps specified in schedule parameters 2018-10-23 16:51:48 -04:00
Zach Dwiel 13d81f65b9 add redis options to training worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 04f32a0f02 add heatup step to training worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 7c1f0dce4f include registry in image name 2018-10-23 16:47:46 -04:00
Zach Dwiel 0812a94fbd first pass at kubernetes 2018-10-23 16:47:46 -04:00
Zach Dwiel 3328b25549 reenable redis; better error message 2018-10-23 16:47:46 -04:00
Zach Dwiel 009cf670f3 fix simple typos; temporarily disable redis in rollout worker 2018-10-23 16:47:46 -04:00
Zach Dwiel f5b7122d56 weight for checkpoint before trying to start rollout worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 4352d6735d add training worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 6541bc76b9 working checkpoints 2018-10-23 16:41:57 -04:00
Zach Dwiel 433bc3e27b standardizing variable access 2018-10-23 16:40:33 -04:00
Zach Dwiel e34b9ae9cf allow specifying preset as a commandline parameter to rollout worker 2018-10-23 16:40:33 -04:00
Zach Dwiel 3714d8ec80 extract functions display_all_presets_and_exit, expand_preset 2018-10-23 16:40:33 -04:00
Zach Dwiel 747000647f add dockerfile 2018-10-23 16:40:33 -04:00
Zach Dwiel bc664c4169 add the first pass of rollout_worker.py 2018-10-23 16:40:33 -04:00
Zach Dwiel 61ed6b8ce4 add better defaults to TaskParameters 2018-10-23 16:40:33 -04:00
Zach Dwiel 5758c2f23e typo; increased detail in comment 2018-10-23 16:35:06 -04:00
Zach Dwiel a1295d16b3 first pass that transition collection interface 2018-10-23 16:35:06 -04:00
Zach Dwiel dc77c54ad9 add to gitignore 2018-10-23 16:35:06 -04:00
Zach Dwiel 9f1f9e5ab4 replace ExperienceReplay._num_transitions with len(ExperienceReplay.transitions) 2018-10-23 16:34:38 -04:00
Zach Dwiel cccfe88f9b remove unused method: update_last_transition_info 2018-10-23 16:34:38 -04:00
Zach Dwiel fb21251157 add horizontal scaling document 2018-10-23 16:34:38 -04:00
Zach Dwiel 673911ff7f very minor cleanup 2018-09-12 10:51:56 -04:00
Zach Dwiel 4fe9cba445 remove debug 2018-02-21 10:05:57 -05:00
Zach Dwiel eba900067c remove debug 2018-02-21 10:05:57 -05:00
Zach Dwiel d1bf83047c remove debug 2018-02-21 10:05:57 -05:00
Zach Dwiel ef46e194af remove unused commented code 2018-02-21 10:05:57 -05:00
Zach Dwiel d9303e731e remove python2 compatibility 2018-02-21 10:05:57 -05:00
Zach Dwiel ec68bd4959 make sure that for now observation spaces all include an observation key 2018-02-21 10:05:57 -05:00
Zach Dwiel 0740ebcdac by default assume state["observation"] is where the image for rendering can be found 2018-02-21 10:05:57 -05:00
Zach Dwiel f9f92a42fd cleanup debugging code 2018-02-21 10:05:57 -05:00
Zach Dwiel 86362683b1 comment 2018-02-21 10:05:57 -05:00
Zach Dwiel 8fc24a2bbe fix bc_agent 2018-02-21 10:05:57 -05:00
Zach Dwiel d8f5a35013 fix qr_dqn_agent 2018-02-21 10:05:57 -05:00
Zach Dwiel e1ad86417f fix n_step_q_agent 2018-02-21 10:05:57 -05:00
Zach Dwiel 5cf10e5f52 fix bug in ddpg 2018-02-21 10:05:57 -05:00
Zach Dwiel 8248caf35e fix more agents 2018-02-21 10:05:57 -05:00
Zach Dwiel 98f57a0d87 fix ddpg 2018-02-21 10:05:57 -05:00
Zach Dwiel 943e41ba58 fix nec_agent 2018-02-21 10:05:57 -05:00
Zach Dwiel ee6e0bdc3b fix keep_dims -> keepdims 2018-02-21 10:05:57 -05:00
Zach Dwiel 39a28aba95 fix clipped ppo 2018-02-21 10:05:57 -05:00
Zach Dwiel 85afb86893 temp commit 2018-02-21 10:05:57 -05:00
Zach Dwiel fff8c8f568 provide a helpful error message in the event that an exploration policy returns a vector of actions instead of a single action during value optimization agent 2018-01-20 14:11:24 -05:00
Zach Dwiel 40e5c628c6 add options for more verbose test errors 2018-01-16 22:08:46 -05:00
Zach Dwiel 8f026bb46f Merge pull request #42 from NervanaSystems/print_parameters 
provide a command line option which prints the tuning_parameters to stdout
 2018-01-11 11:28:24 -05:00
Zach Dwiel c7b11f1e9a provide a command line option which prints the tuning_parameters to stdout 2018-01-10 16:28:41 -05:00
Zach Dwiel 9b963c86d0 Merge pull request #41 from NervanaSystems/allow_direct_entry_point 
allow specifying gym environments via entry point syntax: module.package:class
 2018-01-10 12:18:12 -05:00
Zach Dwiel cc76a9ad70 allow specifying gym environments via entry point syntax: module.package:class 2018-01-10 10:14:23 -05:00
Zach Dwiel 499e78596a Merge pull request #38 from NervanaSystems/nec_lstm 
update nec and value optimization agents to work with recurrent middleware
 2018-01-08 14:01:34 -05:00
Zach Dwiel 6c79a442f2 update nec and value optimization agents to work with recurrent middleware 2018-01-05 20:16:51 -05:00
Zach Dwiel 7bdba396d2 Update add_env.md 2017-11-14 17:57:55 +02:00
Zach Dwiel 9ae2905a76 clean up input embeddings setup 2017-11-14 17:39:18 +02:00
Zach Dwiel aceddfadc9 Merge pull request #3 from cclauss/patch-1 
Simplify w/ dict.get() default value, ternary if
 2017-10-22 20:46:36 -04:00
Zach Dwiel 6fec9f972f Merge pull request #7 from zac-hopkinson/master 
Fixes installer issues #5 and #6
 2017-10-22 20:42:57 -04:00