Enabling-more-agents-for-Batch-RL-and-cleanup (#258)

allowing for the last training batch drawn to be smaller than batch_size + adding support for more agents in BatchRL by adding softmax with temperature to the corresponding heads + adding a CartPole_QR_DQN preset with a golden test + cleanups
This commit is contained in:
Gal Leibovich authored and GitHub committed 2019-03-21 16:10:29 +02:00
1 parent abec59f367
commit 6e08c55ad5
24 files changed
+152 -69

No files matched your search

@@ -113,10 +113,6 @@ class ExperienceReplay(Memory):
yield sample_data
## usage example
# for o in random_seq_generator(list(range(10)), 4):
# print(o)
def _enforce_max_length(self) -> None:
"""
Make sure that the size of the replay buffer does not pass the maximum size allowed.