gryf/coach
1
0
Fork 0
mirror of https://github.com/gryf/coach.git synced 2026-08-27 06:01:50 +02:00
Code Issues Projects Releases Wiki Activity
512 Commits 4 Branches 2 Tags
f52ff1784d83b1411cb86d0e7ec4f77a4e711e3d
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zach Dwiel 7b0fccb041 Add RedisDataStore (#295) 
* GraphManager.set_session also sets self.sess

* make sure that GraphManager.fetch_from_worker uses training phase

* remove unnecessary phase setting in training worker

* reorganize rollout worker

* provide default name to GlobalVariableSaver.__init__ since it isn't really used anyway

* allow dividing TrainingSteps and EnvironmentSteps

* add timestamps to the log

* added redis data store

* conflict merge fix
 2019-08-28 21:15:58 +03:00
zach dwiel 88f9c926ab update comment describing why the output filters don't modify Agent.last_action_info 2019-04-09 12:14:27 -04:00
zach dwiel fd2c210915 rename AgentInterface.emulate_observe_on_trainer or observe_transition and call from AgentInterface.observe 2019-04-09 12:14:27 -04:00
zach dwiel f8741522e4 merge AgentInterface.emulate_act_on_trainer and AgentInterface.act 2019-04-09 12:14:27 -04:00
zach dwiel f2fead57e5 change method interface: AgentInterface.emulate_act_on_trainer(transition: Transition) -> emulate_act_on_trainer(action: ActionType) 2019-04-09 12:14:27 -04:00
zach dwiel b20e795ce0 create method LevelManager.acting_agent() 2019-04-09 12:14:27 -04:00
zach dwiel 54fdfe2da8 simplify rollout worker steps with new magic methods on StepMethod 2019-04-09 12:14:27 -04:00
zach dwiel 2cb078b4c2 add __truediv__, __rtruediv__ and __eq__ to StepMethod 2019-04-09 12:14:27 -04:00
zach dwiel 83da5cde2f remove unnecessary parentheses 2019-04-09 12:14:27 -04:00
zach dwiel dddaefb210 fixed bug in rollout worker where total number of improved steps are not taken 2019-04-09 12:14:27 -04:00
zach dwiel 06de3b0f07 update LevelManager type signature 2019-04-09 12:14:27 -04:00
zach dwiel f16cd3cb1e remove unused ActionInfo.action_intrinsic_reward 2019-04-09 12:14:27 -04:00
zach dwiel 7d79433c05 remove unused parameter scale_external_reward_by_intrinsic_reward_value 2019-04-09 12:14:27 -04:00
Zach Dwiel 2291cee2c6 allow serializing from/to arrays/str from GlobalVariableSaver (#285) 2019-04-04 11:09:19 -04:00
Zach Dwiel 8672f8b542 Fix golden tests (#199) 
* remove unused functions utils.read_json and utils.write_json
* increase verbosity of golden tests; detect errors in golden tests
 2019-01-16 17:38:11 -08:00
Zach Dwiel fedb4cbd7c Cleanup and refactoring (#171) 2019-01-15 10:04:53 +02:00
Zach Dwiel cd812b0d25 more clear names for methods of Space (#181) 
* rename Space.val_matches_space_definition -> contains; Space.is_point_in_space_shape -> valid_index
* rename valid_index -> is_valid_index
 2019-01-14 15:02:53 -05:00
Zach Dwiel 0ccc333d77 raise value error if there is an invalid action space (#179) 2019-01-13 11:06:48 +02:00
Zach Dwiel 8e3ee818f8 update circle ci config to match new golden test presets (#167) 2018-12-21 10:10:31 -05:00
zach dwiel e08accdc22 allow case insensitive selected level name matching 2018-12-11 12:35:30 -05:00
Zach Dwiel d0248e03c6 add meaningful error message in the event that the action space is not one that can be used (#151) 2018-12-11 09:09:24 +02:00
Zach Dwiel 5b11fa5656 check for local mujoco key in build process (#105) 
approved by scott.
 2018-11-18 10:57:30 +02:00
Zach Dwiel 2cc6abc3c4 update CartPole_PPO not addressed during rebase (#41) 2018-10-24 16:58:25 -07:00
zach dwiel f835ac902c fix renaming: save_checkpoint_sec -> checkpoint_save_secs 2018-10-24 10:52:18 -04:00
zach dwiel 3ba0df7d07 update GraphManager.act specified return type 2018-10-23 19:58:17 -04:00
zach dwiel def76b4cc6 update CartPole_PPO 2018-10-23 19:58:17 -04:00
zach dwiel 3e5e5475de update training worker 2018-10-23 19:58:17 -04:00
zach dwiel 430ca198e5 convert golden tests into pytest format 2018-10-23 19:58:17 -04:00
zach dwiel 787ab42578 remove extra call to super().store_episode 2018-10-23 19:58:17 -04:00
Zach Dwiel 700a175902 rename save_checkpoint_secs -> checkpoint_save_secs 2018-10-23 17:10:58 -04:00
Zach Dwiel 9804b033a2 rename save_checkpoint_dir -> checkpoint_save_dir 2018-10-23 17:10:58 -04:00
Zach Dwiel 201a2237a1 restructure looping mechanism inGraphManager 2018-10-23 17:10:58 -04:00
Zach Dwiel 52560a2aae introduce property GraphManager.current_step_counter 2018-10-23 17:10:04 -04:00
Zach Dwiel 776c94d551 reorder methods in GraphManager 2018-10-23 17:10:04 -04:00
Zach Dwiel 496a516de1 rename GraphManager.sync_graph -> sync 2018-10-23 17:08:29 -04:00
Zach Dwiel 5fee48dcfd remove argument keep_networks_in_sync from GraphManager.act, and move this feature into the only place that activated it: GraphManager.train_and_act 2018-10-23 17:08:29 -04:00
Zach Dwiel b2d864a5bd remove out of date documentation 2018-10-23 17:08:29 -04:00
Zach Dwiel d32d909238 move only invocation of GraphManager.handle_episode_ended inline 2018-10-23 17:08:29 -04:00
Zach Dwiel 18d84c5037 remove unnecessary timers from GraphManager 2018-10-23 16:58:17 -04:00
Zach Dwiel cd30efe52e remove unnecessary test result is None in GraphManager.act 2018-10-23 16:57:43 -04:00
Zach Dwiel 35d67cbd9b use phase context in GraphManager.evaluate 2018-10-23 16:57:43 -04:00
Zach Dwiel d3c341147e simplify GraphManager.act by removing arguments: continue_until_game_over and return_on_game_over 2018-10-23 16:57:43 -04:00
Zach Dwiel 8be980912c fixed typo from earlier commit 2018-10-23 16:57:43 -04:00
Zach Dwiel fbaf19543e capture stdout during preset tests 2018-10-23 16:57:43 -04:00
Zach Dwiel 517aac163a introduce graph_manager.phase_context; make sure that calls to graph_manager.train automatically set training phase 2018-10-23 16:57:43 -04:00
Zach Dwiel 7382a142bb remove unused steps parameter from GraphManager.train 2018-10-23 16:57:06 -04:00
Zach Dwiel 97f608ee5e reorder failing presets 2018-10-23 16:57:05 -04:00
Zach Dwiel ad68fa263d remove property GraphManager.training_start_time 2018-10-23 16:57:05 -04:00
Zach Dwiel bfc320cf83 disable failing tests for now 2018-10-23 16:57:05 -04:00
Zach Dwiel 01f3a0594b remove return values from GraphManager.act 2018-10-23 16:57:05 -04:00
Zach Dwiel b02f269464 graph_manager:heatup uses total_steps_counters looping mechanism like other loops. graph_manager:act no longer needs to return any values 2018-10-23 16:57:05 -04:00
Zach Dwiel 9f92064e67 cleanup graph_manager:act 2018-10-23 16:53:32 -04:00
Zach Dwiel b5305bd075 update dockerfile 2018-10-23 16:52:16 -04:00
Zach Dwiel 950f261201 extract method all_presets 2018-10-23 16:52:16 -04:00
Zach Dwiel ed3a3b39be add comments 2018-10-23 16:52:16 -04:00
Zach Dwiel 04038c9f40 improve integration test output format 2018-10-23 16:52:16 -04:00
Zach Dwiel a54ef2757f ignore deprecation warnings in test logging 2018-10-23 16:51:48 -04:00
Zach Dwiel acc7f70de3 enumerate each preset as its own test 2018-10-23 16:51:48 -04:00
Zach Dwiel 1e83a27bee update dockerfile and makefile 2018-10-23 16:51:48 -04:00
Zach Dwiel 67faa80ea0 allow custom number of training steps 2018-10-23 16:51:48 -04:00
Zach Dwiel d69332efd4 fixed bug in training worker 2018-10-23 16:51:48 -04:00
Zach Dwiel cd733b2404 add support for running kubernetes orchestrator from behind proxy 2018-10-23 16:51:48 -04:00
Zach Dwiel ad4d2c3053 add make stop_kubernetes 2018-10-23 16:51:48 -04:00
Zach Dwiel 5e85a0f972 use the number of heat up steps specified in schedule parameters 2018-10-23 16:51:48 -04:00
Zach Dwiel 13d81f65b9 add redis options to training worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 04f32a0f02 add heatup step to training worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 7c1f0dce4f include registry in image name 2018-10-23 16:47:46 -04:00
Zach Dwiel 0812a94fbd first pass at kubernetes 2018-10-23 16:47:46 -04:00
Zach Dwiel 3328b25549 reenable redis; better error message 2018-10-23 16:47:46 -04:00
Zach Dwiel 009cf670f3 fix simple typos; temporarily disable redis in rollout worker 2018-10-23 16:47:46 -04:00
Zach Dwiel f5b7122d56 weight for checkpoint before trying to start rollout worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 4352d6735d add training worker 2018-10-23 16:47:46 -04:00
Zach Dwiel 6541bc76b9 working checkpoints 2018-10-23 16:41:57 -04:00
Zach Dwiel 433bc3e27b standardizing variable access 2018-10-23 16:40:33 -04:00
Zach Dwiel e34b9ae9cf allow specifying preset as a commandline parameter to rollout worker 2018-10-23 16:40:33 -04:00
Zach Dwiel 3714d8ec80 extract functions display_all_presets_and_exit, expand_preset 2018-10-23 16:40:33 -04:00
Zach Dwiel 747000647f add dockerfile 2018-10-23 16:40:33 -04:00
Zach Dwiel bc664c4169 add the first pass of rollout_worker.py 2018-10-23 16:40:33 -04:00
Zach Dwiel 61ed6b8ce4 add better defaults to TaskParameters 2018-10-23 16:40:33 -04:00
Zach Dwiel 5758c2f23e typo; increased detail in comment 2018-10-23 16:35:06 -04:00
Zach Dwiel a1295d16b3 first pass that transition collection interface 2018-10-23 16:35:06 -04:00
Zach Dwiel dc77c54ad9 add to gitignore 2018-10-23 16:35:06 -04:00
Zach Dwiel 9f1f9e5ab4 replace ExperienceReplay._num_transitions with len(ExperienceReplay.transitions) 2018-10-23 16:34:38 -04:00
Zach Dwiel cccfe88f9b remove unused method: update_last_transition_info 2018-10-23 16:34:38 -04:00
Zach Dwiel fb21251157 add horizontal scaling document 2018-10-23 16:34:38 -04:00
Zach Dwiel 673911ff7f very minor cleanup 2018-09-12 10:51:56 -04:00
Zach Dwiel 4fe9cba445 remove debug 2018-02-21 10:05:57 -05:00
Zach Dwiel eba900067c remove debug 2018-02-21 10:05:57 -05:00
Zach Dwiel d1bf83047c remove debug 2018-02-21 10:05:57 -05:00
Zach Dwiel ef46e194af remove unused commented code 2018-02-21 10:05:57 -05:00
Zach Dwiel d9303e731e remove python2 compatibility 2018-02-21 10:05:57 -05:00
Zach Dwiel ec68bd4959 make sure that for now observation spaces all include an observation key 2018-02-21 10:05:57 -05:00
Zach Dwiel 0740ebcdac by default assume state["observation"] is where the image for rendering can be found 2018-02-21 10:05:57 -05:00
Zach Dwiel f9f92a42fd cleanup debugging code 2018-02-21 10:05:57 -05:00
Zach Dwiel 86362683b1 comment 2018-02-21 10:05:57 -05:00
Zach Dwiel 8fc24a2bbe fix bc_agent 2018-02-21 10:05:57 -05:00
Zach Dwiel d8f5a35013 fix qr_dqn_agent 2018-02-21 10:05:57 -05:00
Zach Dwiel e1ad86417f fix n_step_q_agent 2018-02-21 10:05:57 -05:00
Zach Dwiel 5cf10e5f52 fix bug in ddpg 2018-02-21 10:05:57 -05:00
Zach Dwiel 8248caf35e fix more agents 2018-02-21 10:05:57 -05:00