c02b575 | zlsh80826 | 01 April 2019, 22:37:32 UTC | ppo2: use time.perf_counter() instead of time.time() for time measurement (#847) | 01 April 2019, 22:37:32 UTC |
897fa31 | Pastafarianist | 29 March 2019, 20:25:56 UTC | Avoid using default config while requesting available GPUs (#863) | 29 March 2019, 20:25:56 UTC |
d51f8be | Brett Daley | 28 March 2019, 16:21:48 UTC | Report episode rewards/length in A2C and ACKTR (#856) | 28 March 2019, 16:21:48 UTC |
3f2f45a | Jacob Hilton | 25 March 2019, 21:33:15 UTC | Merge pull request #860 from openai/build-retro-env-framestack-fix run.py framestack bug fix | 25 March 2019, 21:33:15 UTC |
b64974e | Jacob Hilton | 24 March 2019, 19:27:14 UTC | build_env now doesn't apply frame stack to retro games twice | 24 March 2019, 19:27:14 UTC |
1b09243 | pzhokhov | 16 March 2019, 18:54:47 UTC | remove f-strings for python 3.5 compatibility (#854) | 16 March 2019, 18:54:47 UTC |
1259f6a | Peter Zhokhov | 12 March 2019, 00:44:03 UTC | check for environment being vectorized in the play logic in run.py | 12 March 2019, 00:44:03 UTC |
74101a9 | pzhokhov | 12 March 2019, 00:28:51 UTC | fix freeze of ppo2 (#849) * fix freeze of ppo2 * unit test for freeze, updated docstring * more docstring update * set number of threads to 1 in the test | 12 March 2019, 00:28:51 UTC |
90d6677 | JongGyun Kim | 06 March 2019, 23:13:01 UTC | remove one of duplicated lines. (#813) | 06 March 2019, 23:13:01 UTC |
b875fb7 | pzhokhov | 27 February 2019, 23:35:31 UTC | release Internal changes (#800) * joshim5 changes (width and height to WarpFrame wrapper) * match network output with action distribution via a linear layer only if necessary (#167) * support color vs. grayscale option in WarpFrame wrapper (#166) * support color vs. grayscale option in WarpFrame wrapper * Support color in other wrappers * Updated per Peters suggestions * fixing test failures * ppo2 with microbatches (#168) * pass microbatch_size to the model during construction * microbatch fixes and test (#169) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * Peterz joshim5 subclass ppo2 model (#170) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * subclassing the model to make microbatched version of model WIP * made microbatched model a subclass of ppo2 Model * flake8 complaint * mpi-less ppo2 (resolving merge conflict) * flake8 and mpi4py imports in ppo2/model.py * more un-mpying * merge master * updates to the benchmark viewer code + autopep8 (#184) * viz docs and syntactic sugar wip * update viewer yaml to use persistent volume claims * move plot_util to baselines.common, update links * use 1Tb hard drive for results viewer * small updates to benchmark vizualizer code * autopep8 * autopep8 * any folder can be a benchmark * massage games image a little bit * fixed --preload option in app.py * remove preload from run_viewer.sh * remove pdb breakpoints * update bench-viewer.yaml * fixed bug (#185) * fixed bug it's wrong to do the else statement, because no other nodes would start. * changed the fix slightly * Refactor her phase 1 (#194) * add monitor to the rollout envs in her RUN BENCHMARKS her * Slice -> Slide in her benchmarks RUN BENCHMARKS her * run her benchmark for 200 epochs * dummy commit to RUN BENCHMARKS her * her benchmark for 500 epochs RUN BENCHMARKS her * add num_timesteps to her benchmark to be compatible with viewer RUN BENCHMARKS her * add num_timesteps to her benchmark to be compatible with viewer RUN BENCHMARKS her * add num_timesteps to her benchmark to be compatible with viewer RUN BENCHMARKS her * disable saving of policies in her benchmark RUN BENCHMARKS her * run fetch benchmarks with ppo2 and ddpg RUN BENCHMARKS Fetch * run fetch benchmarks with ppo2 and ddpg RUN BENCHMARKS Fetch * launcher refactor wip * wip * her works on FetchReach * her runner refactor RUN BENCHMARKS Fetch1M * unit test for her * fixing warnings in mpi_average in her, skip test_fetchreach if mujoco is not present * pickle-based serialization in her * remove extra import from subproc_vec_env.py * investigating differences in rollout.py * try with old rollout code RUN BENCHMARKS her * temporarily use DummyVecEnv in cmd_util.py RUN BENCHMARKS her * dummy commit to RUN BENCHMARKS her * set info_values in rollout worker in her RUN BENCHMARKS her * bug in rollout_new.py RUN BENCHMARKS her * fixed bug in rollout_new.py RUN BENCHMARKS her * do not use last step because vecenv calls reset and returns obs after reset RUN BENCHMARKS her * updated buffer sizes RUN BENCHMARKS her * fixed loading/saving via joblib * dust off learning from demonstrations in HER, docs, refactor * add deprecation notice on her play and plot files * address comments by Matthias * 1.5 months of codegen changes (#196) * play with resnet * feed_dict version * coinrun prob and more stats * fixes to get_choices_specs & hp search * minor prob fixes * minor fixes * minor * alternative version of rl_algo stuff * pylint fixes * fix bugs, move node_filters to soup * changed how get_algo works * change how get_algo works, probably broke all tests * continue previous refactor * get eval_agent running again * fixing tests * fix tests * fix more tests * clean up cma stuff * fix experiment * minor changes to eval_agent to make ppo_metal use gpu * make dict space work * modify mac makefile to use conda * recurrent layers * play with bn and resnets * minor hp changes * minor * got rid of use_fb argument and jtft (joint-train-fine-tune) functionality built test phase directly into AlgoProb * make new rl algos generateable * pylint; start fixing tests * fixing tests * more test fixes * pylint * fix search * work on search * hack around infinite loop caused by scan * algo search fixes * misc changes for search expt * enable annealing, overriding options of Op * pylint fixes * identity op * achieve use_last_output through masking so it automatically works in other distributions * fix tests * minor * discrete * use_last_output to be just a preference, not a hard constraint * pred delay, pruning * require nontrivial inputs * aliases for get_sm * add probname to probs * fixes * small fixes * fix tests * fix tests * fix tests * minor * test scripts * dualgru network improvements * minor * work on mysterious bugs * rcall gpu-usage command for kube * use cache dir that’s not in code folder, so that it doesn’t get removed by rcall code rsync * add power mode to gpu usage * make sure train/test actually different * remove VR for now * minor fixes * simplify soln_db * minor * big refactor of mpi eda * improve mpieda for multitask * - get rid of timelimit hack - add __del__ to cleanup SubprocVecEnv * get multitask working better * fixes * working on atari, various * annotate ops with whether they’re parametrized * minor * gym version * rand atari prob * minor * SolnDb bugfix and name change * pyspy script * switch conv layers * fix roboschool/bullet3 * nenvs assertion * fix rand atari * get rid of blanket exception catching fix soln_db bug * fix rand_atari * dynamic routing as cmdline arg * slight modifications to test_mpi_map and pyspy-all * max_tries argument for run_until_successs * dedup option in train_mle * simplify soln_db * increase atari horizon for 1 experiment * start implementing reward increment * ent multiplier * create cc dsl other misc fixes * cc ops * q_func -> qs in rl_algos_cc.py * fix PredictDistr * rl_ops_cc fixes, MakeAction op * augment algo agent to support cc stuff * work on ddpg experiments * fix blocking temporarily change logger * allow layer scaling * pylint fixes * spawn_method * isolate ddpg hacks * improve pruning * use spawn for subproc * remove use of python -c in rcall * fix pylint warning * fix static * maybe fix local backend * switch to DummyVecEnv * making some fixes via pylint * pylint fixes * fixing tests * fix tests * fix tests * write scaffolding for SSL in Codegen * logger fix * fix error * add EMA op to sl_ops * save many changes * save * add upsampler * add sl ops, enhance state machine * get ssl search working — some gross hacking * fix session/graph issue * fix importing * work on mle * - scale embeddings in gru model - better exception handling in sl_prob - use emas for test/val - use non-contrib batch_norm layer * improve logging * option to average before dumping in logger * default arguments, etc * new ddpg and identity test * concat fix * minor * move realistic ssl stuff to third-party (underscore to dash) * fixes * remove realistic_ssl_evaluation * pylint fixes * use gym master * try again * pass around args without gin * fix tests * separate line to install gym * rename failing tests that should be ignored * add data aug * ssl improvements * use fixed time limit * try to fix baselines tests * add score_floor, max_walltime, fiddle with lr decay * realistic_ssl * autopep8 * various ssl - enable blocking grad for simplification - kl - multiple final prediction * fix pruning * misc ssl stuff * bring back linear schedule, don’t use allgather for collecting stats (i’ve been getting nondeterministic errors from the old code) * save/load weights in SSL, big stepsize * cleanup SslProb * fix * get rid of kl coef * fix simplification, lower lr * search over hps * minor fixes * minor * static analysis * move files and rename things for improved consistency. still broken, and just saving before making nontrivial changes * various * make tests pass * move coinrun_train to codegen since it depends on codegen * fixes * pylint fixes * improve tests fix some things * improve tests * lint * fix up db_info.py, tests * mostly restore master version of envs directory, except for makefile changes * fix tests * improve printing * minor fixes * fix fixmes * pruning test * fixes * lint * write new test that makes tf graphs of random algos; fix some bugs it caught * add —delete flag to rcall upload-code command * lint * get cifar10 lazily for testing purposes * disable codegen ci tests for now * clean up rl_ops * rename spec classes * td3 with identity test * identity tests without gin files * remove gin.configurable from AlgoAgent * comments about reduction in rl_ops_cc * address @pzhokhov comments * fix tests * more linting * better tests * clean up filtering a bit * fix concat * delayed logger configuration (#208) * delayed logger configuration * fix typo * setters and getters for Logger.DEFAULT as well * do away with fancy property stuff - unable to get it to work with class level methods * grammar and spaces * spaces * use get_current function instead of reading Logger.CURRENT * autopep8 * disable mpi in subprocesses (#213) * lazy_mpi load * cleanups * more lazy mpi * don't pretend that class is a module, just use it as a class * mass-replace mpi4py imports * flake8 * fix previous lazy_mpi imports * silly recursion * try os.environ hack * better prefix test, work with mpich * restored MPI imports * removed commented import in test_with_mpi * restored codegen from master * remove lazy mpi * restored changes from rl-algs * remove extra files * address Chris' comments * use spawn for shmem vec env as well (#2) (#219) * lazy_mpi load * cleanups * more lazy mpi * don't pretend that class is a module, just use it as a class * mass-replace mpi4py imports * flake8 * fix previous lazy_mpi imports * silly recursion * try os.environ hack * better prefix test, work with mpich * restored MPI imports * removed commented import in test_with_mpi * restored codegen from master * remove lazy mpi * restored changes from rl-algs * remove extra files * port mpi fix to shmem vec env * increase the mpi test default timeout * change humanoid hyperparameters, get rid of clip_Frac annealing, as it's apparently dangerous * remove clip_frac schedule from ppo2 * more timesteps in humanoid run * whitespace + RUN BENCHMARKS * baselines: export vecenvs from folder (#221) * baselines: export vecenvs from folder * put missing function back in * add missing imports * more imports * longer mpi timeout? * make default logger configuration the same as call to logger.configure() (#222) * Vecenv refactor (#223) * update karl util * restore pvi flag * change rcall auto cpu behavior, move gin.configurable, add os.makedirs * vecenv refactor * aux buf index fix * add num aux obs * reset level with enter * restore high difficulty flag * bugfix * restore train_coinrun.py * tweaks * renaming * renaming * better arguments handling * more options * options cleanup * game data refactor * more options * args for train_procgen * add close handler to interactive base class * use debug build if debug=True, fix range on aux_obs * add ProcGenEnv to __init__.py, add missing imports to procgen.py * export RemoveDictWrapper and build, update train_procgen.py, move assets download into env creation and replace init_assets_and_build with just build * fix formatting issues * only call global init once * fix path in setup.py * revert part of makefile * ignore IDE files and folders * vec remove dict * export VecRemoveDictObs * remove RemoveDictWrapper * remove IDE files * move shared .h and .cpp files to common folder, update build to use those, dedupe env.cpp * fix missing header * try unified build function * remove old scripts dir * add comment on build * upload libenv with render fixes * tell qthreads to die when we unload the library * pyglet.app.run is garbage * static fixes * whoops * actually vsync is on * cleanup * cleanup * extern C for libenv interface * parse util rcall arg * high difficulty fix * game type enums * ProcGenEnv subclasses * game type cleanup * unrecognized key * unrecognized game type * parse util reorg * args management * typo fix * GinParser * arg tweaks * tweak * restore start_level/num_levels setting * fix create_procgen_env interface * build fix * procgen args in init signature * fix * build fix * fix logger usage in ppo_metal/run_retro * removed unnecessary OrderedDict requirement in subproc_vec_env * flake8 fix * allow for non-mpi tests * mpi test fixes * flake8; removed special logic for discrete spaces in dummy_vec_env * remove forked argument in front of tests - does not play nicely with subprocvecenv in spawned processes; analog of forked in ddpg/test_smoke * Everyrl initial commit & a few minor baselines changes (#226) * everyrl initial commit * add keep_buf argument to VecMonitor * logger changes: set_comm and fix to mpi_mean functionality * if filename not provided, don't create ResultsWriter * change variable syncing function to simplify its usage. now you should initialize from all mpi processes * everyrl coinrun changes * tf_distr changes, bugfix * get_one * bring back get_next to temporarily restore code * lint fixes * fix test * rename profile function * rename gaussian * fix coinrun training script * change random seeding to work with new gym version (#231) * change random seeding to work with new gym version * move seeding to seed() method * fix mnistenv * actually try some of the tests before pushing * more deterministic fixed seq * misc changes to vecenvs and run.py for benchmarks (#236) * misc changes to vecenvs and run.py for benchmarks * dont seed global gen * update more references to assert_venvs_equal * Rl19 (#232) * everyrl initial commit * add keep_buf argument to VecMonitor * logger changes: set_comm and fix to mpi_mean functionality * if filename not provided, don't create ResultsWriter * change variable syncing function to simplify its usage. now you should initialize from all mpi processes * everyrl coinrun changes * tf_distr changes, bugfix * get_one * bring back get_next to temporarily restore code * lint fixes * fix test * rename profile function * rename gaussian * fix coinrun training script * rl19 * remove everyrl dir which appeared in the merge for some reason * readme * fiddle with ddpg * make ddpg work * steps_total argument * gpu count * clean up hyperparams and shape math * logging + saving * configuration stuff * fixes, smoke tests * fix stats * make load_results return dicts -- easier to create the same kind of objects with some other mechanism for passing to downstream functions * benchmarks * fix tests * add dqn to tests, fix it * minor * turned annotated transformer (pytorch) into a script * more refactoring * jax stuff * cluster * minor * copy & paste alec code * sign error * add huber, rename some parameters, snapshotting off by default * remove jax stuff * minor * move maze env * minor * remove trailing spaces * remove trailing space * lint * fix test breakage due to gym update * rename function * move maze back to codegen * get recurrent ppo working * enable both lstm and gru * script to print table of benchmark results * various * fix dqn * add fixup initializer, remove lastrew * organize logging stats * fix silly bug * refactor models * fix mpi usage * check sync * minor * change vf coef, hps * clean up slicing in ppo * minor fixes * caching transformer * docstrings * xf fixes * get rid of 'B' and 'BT' arguments * minor * transformer example * remove output_kind from base class until we have a better idea how to use it * add comments, revert maze stuff * flake8 * codegen lint * fix codegen tests * responded to peter's comments * lint fixes * minor changes to baselines (#243) * minor changes to baselines * fix spaces reference * remove flake8 disable comments and fix import * okay maybe don't add spec to vec_env * Merge branch 'master' of github.com:openai/games the commit. * flake8 complaints in baselines/her | 27 February 2019, 23:35:31 UTC |
675b100 | Peter Zhokhov | 27 February 2019, 22:22:24 UTC | raised the tolerance on the test_microbatches test | 27 February 2019, 22:22:24 UTC |
adc4388 | Peter Zhokhov | 27 February 2019, 20:49:40 UTC | fixes to catch changes in gym | 27 February 2019, 20:49:40 UTC |
5b41c92 | Rishav1 | 31 January 2019, 18:23:38 UTC | fix #795: Making tf_util._Function consistent (#796) * fix #795: Making tf_util._Function consistent The fix involves using the placeholder name to crossreference passed kwargs values, just like the tf_util.function expects. Also, the givens are updated before the parameters to make it behave like it's supposed to. * test: Adding test for issue #795 | 31 January 2019, 18:23:38 UTC |
ab02fae | Peter Zhokhov | 31 January 2019, 00:21:57 UTC | fixes related to new gym and new flake8 | 31 January 2019, 00:21:57 UTC |
b55eda1 | ethanwaldie | 23 January 2019, 03:22:28 UTC | Added required arguments to the policy builder in the ACER model to (#784) * Added required arguments to the policy builder in the ACER model to fix the issue #783 * Changed the step model from nbatch to nenvs * Updated nsteps to be 1. | 23 January 2019, 03:22:28 UTC |
57e05eb | pzhokhov | 10 January 2019, 06:30:52 UTC | remove noop code (#781) | 10 January 2019, 06:30:52 UTC |
01ab1d8 | Nikhil Barhate | 09 January 2019, 19:21:53 UTC | fixed typo (#779) | 09 January 2019, 19:21:53 UTC |
7368343 | Alex Ray | 04 January 2019, 23:49:51 UTC | Merge pull request #777 from openai/aray-extra-imports add an argument for importing extra modules from run | 04 January 2019, 23:49:51 UTC |
4d0746b | Alex Ray | 03 January 2019, 19:33:31 UTC | add an argument for importing extra modules from run | 03 January 2019, 19:33:31 UTC |
5115707 | Ankesh Anand | 21 December 2018, 20:47:48 UTC | Recognize nightly tf builds (#763) * Recognize nightly tf builds * Use LooseVersion instead of StrictVersion to recongnize nightly build numbers Nightly version numbers are of the form `1.3.0.dev20181215` but it's not a valid version number for `StrictVersion`, while `LooseVersion` still recognizes it. | 21 December 2018, 20:47:48 UTC |
6c44fb2 | pzhokhov | 19 December 2018, 22:44:08 UTC | refactor HER - phase 1 (#767) * joshim5 changes (width and height to WarpFrame wrapper) * match network output with action distribution via a linear layer only if necessary (#167) * support color vs. grayscale option in WarpFrame wrapper (#166) * support color vs. grayscale option in WarpFrame wrapper * Support color in other wrappers * Updated per Peters suggestions * fixing test failures * ppo2 with microbatches (#168) * pass microbatch_size to the model during construction * microbatch fixes and test (#169) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * Peterz joshim5 subclass ppo2 model (#170) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * subclassing the model to make microbatched version of model WIP * made microbatched model a subclass of ppo2 Model * flake8 complaint * mpi-less ppo2 (resolving merge conflict) * flake8 and mpi4py imports in ppo2/model.py * more un-mpying * merge master * updates to the benchmark viewer code + autopep8 (#184) * viz docs and syntactic sugar wip * update viewer yaml to use persistent volume claims * move plot_util to baselines.common, update links * use 1Tb hard drive for results viewer * small updates to benchmark vizualizer code * autopep8 * autopep8 * any folder can be a benchmark * massage games image a little bit * fixed --preload option in app.py * remove preload from run_viewer.sh * remove pdb breakpoints * update bench-viewer.yaml * fixed bug (#185) * fixed bug it's wrong to do the else statement, because no other nodes would start. * changed the fix slightly * Refactor her phase 1 (#194) * add monitor to the rollout envs in her RUN BENCHMARKS her * Slice -> Slide in her benchmarks RUN BENCHMARKS her * run her benchmark for 200 epochs * dummy commit to RUN BENCHMARKS her * her benchmark for 500 epochs RUN BENCHMARKS her * add num_timesteps to her benchmark to be compatible with viewer RUN BENCHMARKS her * add num_timesteps to her benchmark to be compatible with viewer RUN BENCHMARKS her * add num_timesteps to her benchmark to be compatible with viewer RUN BENCHMARKS her * disable saving of policies in her benchmark RUN BENCHMARKS her * run fetch benchmarks with ppo2 and ddpg RUN BENCHMARKS Fetch * run fetch benchmarks with ppo2 and ddpg RUN BENCHMARKS Fetch * launcher refactor wip * wip * her works on FetchReach * her runner refactor RUN BENCHMARKS Fetch1M * unit test for her * fixing warnings in mpi_average in her, skip test_fetchreach if mujoco is not present * pickle-based serialization in her * remove extra import from subproc_vec_env.py * investigating differences in rollout.py * try with old rollout code RUN BENCHMARKS her * temporarily use DummyVecEnv in cmd_util.py RUN BENCHMARKS her * dummy commit to RUN BENCHMARKS her * set info_values in rollout worker in her RUN BENCHMARKS her * bug in rollout_new.py RUN BENCHMARKS her * fixed bug in rollout_new.py RUN BENCHMARKS her * do not use last step because vecenv calls reset and returns obs after reset RUN BENCHMARKS her * updated buffer sizes RUN BENCHMARKS her * fixed loading/saving via joblib * dust off learning from demonstrations in HER, docs, refactor * add deprecation notice on her play and plot files * address comments by Matthias | 19 December 2018, 22:44:08 UTC |
146bbf8 | Timothy Lee | 30 November 2018, 01:28:09 UTC | Removed code that prevented changes to actor loss when training with demos (#740) | 30 November 2018, 01:28:08 UTC |
f3a5aba | pzhokhov | 27 November 2018, 01:57:25 UTC | added smoke tests of ddpg (#734) | 27 November 2018, 01:57:25 UTC |
97e0391 | pzhokhov | 27 November 2018, 01:56:41 UTC | Fix ppo2 with MPI bug, other minor fixes (#735) * joshim5 changes (width and height to WarpFrame wrapper) * match network output with action distribution via a linear layer only if necessary (#167) * support color vs. grayscale option in WarpFrame wrapper (#166) * support color vs. grayscale option in WarpFrame wrapper * Support color in other wrappers * Updated per Peters suggestions * fixing test failures * ppo2 with microbatches (#168) * pass microbatch_size to the model during construction * microbatch fixes and test (#169) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * Peterz joshim5 subclass ppo2 model (#170) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * subclassing the model to make microbatched version of model WIP * made microbatched model a subclass of ppo2 Model * flake8 complaint * mpi-less ppo2 (resolving merge conflict) * flake8 and mpi4py imports in ppo2/model.py * more un-mpying * merge master * updates to the benchmark viewer code + autopep8 (#184) * viz docs and syntactic sugar wip * update viewer yaml to use persistent volume claims * move plot_util to baselines.common, update links * use 1Tb hard drive for results viewer * small updates to benchmark vizualizer code * autopep8 * autopep8 * any folder can be a benchmark * massage games image a little bit * fixed --preload option in app.py * remove preload from run_viewer.sh * remove pdb breakpoints * update bench-viewer.yaml * fixed bug (#185) * fixed bug it's wrong to do the else statement, because no other nodes would start. * changed the fix slightly | 27 November 2018, 01:56:41 UTC |
25ecb64 | pzhokhov | 27 November 2018, 00:30:37 UTC | fixed issue with wrong output layer variable names in ddpg (#733) | 27 November 2018, 00:30:37 UTC |
7dc6bc7 | Prabhat Nagarajan | 27 November 2018, 00:19:09 UTC | fixes typo (#732) * fixes typo * adds apostrophe | 27 November 2018, 00:19:09 UTC |
7139a66 | Christopher Hesse | 21 November 2018, 23:00:51 UTC | Merge pull request #728 from openai/christopherhesse-patch-1 Update README.md | 21 November 2018, 23:00:51 UTC |
8607dca | Christopher Hesse | 21 November 2018, 22:57:10 UTC | Update README.md | 21 November 2018, 22:57:10 UTC |
9f9835f | pzhokhov | 21 November 2018, 20:51:15 UTC | Update __init__.py | 21 November 2018, 20:51:15 UTC |
d3fed18 | sedand | 14 November 2018, 22:50:59 UTC | Fixed comment on example usage in jupyter-notebook (#396) Cause of error: Import name must be results_plotter, not log_viewer. | 14 November 2018, 22:50:59 UTC |
339d564 | Roman Ring | 14 November 2018, 20:22:42 UTC | add docs for layer_norm param in DQN baseline (#107) | 14 November 2018, 20:22:42 UTC |
a75bc37 | Buck Shlegeris | 14 November 2018, 20:20:55 UTC | fix typo in a comment (#161) | 14 November 2018, 20:20:55 UTC |
87b3a04 | Peter Zhokhov | 14 November 2018, 20:16:53 UTC | autopep8 | 14 November 2018, 20:16:53 UTC |
c5b1a1b | Brent Komer | 13 November 2018, 21:08:32 UTC | typo fix (#230) | 13 November 2018, 21:08:32 UTC |
c59a109 | JohannesAck | 13 November 2018, 21:03:48 UTC | Parameter documentation for tf_util.function (#349) * Added parameter documentation This parameter was thus far not documented and is non-intuitive when unfamiliar with tf. * Added parameter documentation | 13 November 2018, 21:03:48 UTC |
5cd6601 | James Alan Preiss | 13 November 2018, 19:09:11 UTC | case-insensitive sort for human-readable logger (#289) | 13 November 2018, 19:09:11 UTC |
0a13da8 | Xiaoquan Kong | 13 November 2018, 19:08:21 UTC | Change variable name from `inpt` to `input_` (#297) | 13 November 2018, 19:08:21 UTC |
18b6390 | Vladislav Zavadskyy | 13 November 2018, 19:03:55 UTC | Typo fix (#287) | 13 November 2018, 19:03:55 UTC |
52255be | pzhokhov | 09 November 2018, 19:18:05 UTC | microbatches in ppo2, custom frame size in WarpFrame, matching fc layer only when needed (#707) * joshim5 changes (width and height to WarpFrame wrapper) * match network output with action distribution via a linear layer only if necessary (#167) * support color vs. grayscale option in WarpFrame wrapper (#166) * support color vs. grayscale option in WarpFrame wrapper * Support color in other wrappers * Updated per Peters suggestions * fixing test failures * ppo2 with microbatches (#168) * pass microbatch_size to the model during construction * microbatch fixes and test (#169) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * Peterz joshim5 subclass ppo2 model (#170) * microbatch fixes and test * tiny cleanup * added assertions to the test * vpg-related fix * subclassing the model to make microbatched version of model WIP * made microbatched model a subclass of ppo2 Model * flake8 complaint * mpi-less ppo2 (resolving merge conflict) * flake8 and mpi4py imports in ppo2/model.py * more un-mpying | 09 November 2018, 19:18:05 UTC |
d80acbb | AurelianTactics | 08 November 2018, 18:13:07 UTC | Removing print spam from Wrapper (#705) * DDPG has unused 'seed' argument DeepQ, PPO2, ACER, trpo_mpi, A2C, and ACKTR have the code for: ``` from baselines.common import set_global_seeds ... def learn(...): ... set_global_seeds(seed) ``` DDPG has the argument 'seed=None' but doesn't have the two lines of code needed to set the global seeds. * DDPG: duplicate variable assignment variable nb_actions assigned same value twice in space of 10 lines nb_actions = env.action_space.shape[-1] * DDPG: noise_type 'normal_x' and 'ou_x' cause assert noise_type default 'adaptive-param_0.2' works but the arguments that change from parameter noise to actor noise (like 'normal_0.2' and 'ou_0.2' cause an assert message and DDPG not to run. Issue is noise following block: ''' if self.action_noise is not None and apply_noise: noise = self.action_noise() assert noise.shape == action.shape action += noise ''' noise is not nested: [number_of_actions] actions is nested: [[number_of_actions]] Can either nest noise or unnest actions * Revert "DDPG: noise_type 'normal_x' and 'ou_x' cause assert" * DDPG: noise_type 'normal_x' and 'ou_x' cause AssertionError noise_type default 'adaptive-param_0.2' works but the arguments that change from parameter noise to actor noise (like 'normal_0.2' and 'ou_0.2') cause an assert message and DDPG not to run. Issue is the following block: ''' if self.action_noise is not None and apply_noise: noise = self.action_noise() assert noise.shape == action.shape action += noise ''' noise is not nested: [number_of_actions] action is nested: [[number_of_actions]] Hence the shapes do not pass the assert line even though the action += noise line is correct * Removing Print Spam from Wrapper Prints a line every time a video is saved or not saved. Seems unnecessary. | 08 November 2018, 18:13:07 UTC |
556b198 | pzhokhov | 08 November 2018, 18:11:45 UTC | Internal minifixes (#694) * joshim5 changes (width and height to WarpFrame wrapper) * match network output with action distribution via a linear layer only if necessary (#167) * support color vs. grayscale option in WarpFrame wrapper (#166) * support color vs. grayscale option in WarpFrame wrapper * Support color in other wrappers * Updated per Peters suggestions * fixing test failures | 08 November 2018, 18:11:45 UTC |
cc88804 | pzhokhov | 08 November 2018, 01:20:52 UTC | Update viz.ipynb | 08 November 2018, 01:20:52 UTC |
c14d307 | pzhokhov | 08 November 2018, 01:19:42 UTC | move viz docs to a notebook entirely (#704) * viz docs * writing vizualization docs * documenting plot_util * docstrings in plot_util * autopep8 and flake8 * spelling (using default vim spellchecker and ingoring things like dataframe, docstring and etc) * rephrased viz.md a little bit * more examples of viz code usage in the docs * replaced vizualization doc with notebook | 08 November 2018, 01:19:42 UTC |
0b71d4c | pzhokhov | 08 November 2018, 01:19:25 UTC | remove unused args of DDPG class (#702) | 08 November 2018, 01:19:25 UTC |
7bb405c | pzhokhov | 07 November 2018, 22:25:35 UTC | Update viz.md | 07 November 2018, 22:25:35 UTC |
8b95576 | pzhokhov | 07 November 2018, 01:02:20 UTC | more viz + build fixes (#703) * viz docs * writing vizualization docs * documenting plot_util * docstrings in plot_util * autopep8 and flake8 * spelling (using default vim spellchecker and ingoring things like dataframe, docstring and etc) * rephrased viz.md a little bit * more examples of viz code usage in the docs | 07 November 2018, 01:02:20 UTC |
9d4fb76 | Peter Zhokhov | 06 November 2018, 17:58:43 UTC | making num_envs and video length smaller in test_video_recorder to prevent hanging on travis | 06 November 2018, 17:58:43 UTC |
664ec6f | Peter Zhokhov | 06 November 2018, 03:19:39 UTC | catch bugfixes in gym | 06 November 2018, 03:19:39 UTC |
3917321 | Peter Zhokhov | 06 November 2018, 01:00:40 UTC | revert over-spellchecking | 06 November 2018, 01:00:40 UTC |
6e607ef | coord.e | 05 November 2018, 22:32:17 UTC | Add video recorder (#666) * Fix: Return the result of rendering from dummyvecenv * Add: Add a video recorder wrapper for vecenv * Change: Use VecVideoRecorder with --video_monitor flag * Change: Overwrite the metadata only when it isn't defined * Add: Define __del__ to make the file correctly closed in exit * Fix: Bump epidode_id in reset() * Fix: Use hasattr to check the existence of .metadata * Fix: Make directory when it doesn't exist * Change: Kepp recording for `video_length` steps, then close Because reset() is not what it is in normal gym.Env * Add: Enable to specify video_length from command line argument * Delete: Delete default value, None, of video_callable * Change: Use self.recorded_frames and self.recording to manage intervals * Add: Log the status of video recording * Fix: Fix saving path * Change: Place metadata in the base VecEnv * Delete: Delete unused imports * Fix: epidode_id => step_id * Fix: Refine the flag name * Change: Unify the flag name folloing to previous change * [WIP] Add: Add a test of VecVideoRecorder * Fix: Use PongNoFrameskip-v0 because SimpleEnv doesn't have render() * Change; Use TemporaryDirectory * Fix: minimal successful test * Add: Test against parallel environments * Add: Test against different type of VecEnvs * Change: Test against different length and interval of video capture * Delete: Reduce the number of tests * Change: Test if the output video is not empty * Add: Add some comments * Fix: Fix the flag name * Add: Add docstrings * Fix: Install ffmpeg in testing container for VecVideoRecorder's test * Fix: Delete unused things * Fix: Replace `video_callable` with `record_video_trigger` * Fix: Improve the explanation of `record_video_trigger` argument * Fix: Close owning vecenv in VecVideoRecorder.close to resolve memory leak | 05 November 2018, 22:32:17 UTC |
c74ce02 | pzhokhov | 05 November 2018, 22:31:15 UTC | visualization code docs / bugfixes (#701) * viz docs * writing vizualization docs * documenting plot_util * docstrings in plot_util * autopep8 and flake8 * spelling (using default vim spellchecker and ingoring things like dataframe, docstring and etc) * rephrased viz.md a little bit | 05 November 2018, 22:31:15 UTC |
ab59de6 | pzhokhov | 31 October 2018, 18:15:41 UTC | mpi-less baselines (#689) * make baselines run without mpi wip * squash-merged latest master * further removing MPI references where unnecessary * more MPI removal * syntax and flake8 * MpiAdam becomes regular Adam if Mpi not present * autopep8 * add assertion to test in mpi_adam; fix trpo_mpi failure without MPI on cartpole * mpiless ddpg | 31 October 2018, 18:15:41 UTC |
a071fa7 | Mathieu Poliquin | 30 October 2018, 17:17:46 UTC | Add retro to ppo2 defaults (#682) * Adds retro to ppo2 defaults Created defaults for retro, copied from Atari defaults for now. Tested with SuperMarioBros-Nes * ppo2 retro defaults to atari | 30 October 2018, 17:17:46 UTC |
637bf55 | Mathieu Poliquin | 30 October 2018, 17:16:15 UTC | Use deepmind wrapper for retro (#685) * Use deepmind wrapper for retro * moved wrap_deepmind_retro after Monitor wrapper | 30 October 2018, 17:16:15 UTC |
165c622 | AurelianTactics | 30 October 2018, 17:13:39 UTC | DDPG: noise_type 'normal_x' and 'ou_x' cause AssertionError (#680) * DDPG has unused 'seed' argument DeepQ, PPO2, ACER, trpo_mpi, A2C, and ACKTR have the code for: ``` from baselines.common import set_global_seeds ... def learn(...): ... set_global_seeds(seed) ``` DDPG has the argument 'seed=None' but doesn't have the two lines of code needed to set the global seeds. * DDPG: duplicate variable assignment variable nb_actions assigned same value twice in space of 10 lines nb_actions = env.action_space.shape[-1] * DDPG: noise_type 'normal_x' and 'ou_x' cause assert noise_type default 'adaptive-param_0.2' works but the arguments that change from parameter noise to actor noise (like 'normal_0.2' and 'ou_0.2' cause an assert message and DDPG not to run. Issue is noise following block: ''' if self.action_noise is not None and apply_noise: noise = self.action_noise() assert noise.shape == action.shape action += noise ''' noise is not nested: [number_of_actions] actions is nested: [[number_of_actions]] Can either nest noise or unnest actions * Revert "DDPG: noise_type 'normal_x' and 'ou_x' cause assert" * DDPG: noise_type 'normal_x' and 'ou_x' cause AssertionError noise_type default 'adaptive-param_0.2' works but the arguments that change from parameter noise to actor noise (like 'normal_0.2' and 'ou_0.2') cause an assert message and DDPG not to run. Issue is the following block: ''' if self.action_noise is not None and apply_noise: noise = self.action_noise() assert noise.shape == action.shape action += noise ''' noise is not nested: [number_of_actions] action is nested: [[number_of_actions]] Hence the shapes do not pass the assert line even though the action += noise line is correct | 30 October 2018, 17:13:39 UTC |
93c7cc2 | Peter Zhokhov | 29 October 2018, 22:25:38 UTC | Merge branch 'master' of github.com:openai/baselines | 29 October 2018, 22:25:38 UTC |
de36116 | Peter Zhokhov | 29 October 2018, 22:25:31 UTC | update tensorflow version check regex to parse version like 1.2.3rc4 (previously only 1.2.3-rc4) | 29 October 2018, 22:25:31 UTC |
e2b4182 | Mathieu Poliquin | 29 October 2018, 20:30:41 UTC | Set 'cnn' as default network for retro (#683) | 29 October 2018, 20:30:41 UTC |
8e56dde | pzhokhov | 24 October 2018, 18:01:59 UTC | Multidiscrete action space compatibility for policy gradient-based methods (#677) * multidiscrete space compatibility * flake8 and syntax | 24 October 2018, 18:01:59 UTC |
c3bd8ce | Juliano Laganá | 24 October 2018, 17:00:31 UTC | Adds description of param_noise parameter in deepq.learn method (#675) | 24 October 2018, 17:00:31 UTC |
84ea7aa | AurelianTactics | 24 October 2018, 16:59:46 UTC | DDPG has unused 'seed' argument (#676) DeepQ, PPO2, ACER, trpo_mpi, A2C, and ACKTR have the code for: ``` from baselines.common import set_global_seeds ... def learn(...): ... set_global_seeds(seed) ``` DDPG has the argument 'seed=None' but doesn't have the two lines of code needed to set the global seeds. | 24 October 2018, 16:59:46 UTC |
88300ed | Peter Zhokhov | 24 October 2018, 16:57:57 UTC | fix raise NotImplemented() complaints of latest flake8 | 24 October 2018, 16:57:57 UTC |
583ba08 | pzhokhov | 23 October 2018, 18:22:27 UTC | Update cmd_util.py | 23 October 2018, 18:22:27 UTC |
014a559 | pzhokhov | 23 October 2018, 17:01:25 UTC | refactor ACER (#664) * make acer use vecframestack * acer passes mnist test with 20k steps * acer with non-image observations and tests * flake8 * test acer serialization with non-recurrent policies | 23 October 2018, 17:01:25 UTC |
4ed1350 | Isaac Poulton | 23 October 2018, 17:00:09 UTC | Fixed TypeError on creating atari vec envs (#671) | 23 October 2018, 17:00:09 UTC |
8513d73 | Rishabh Jangir | 23 October 2018, 02:04:40 UTC | HER : new functionality, enables demo based training (#474) * Add, initialize, normalize and sample from a demo buffer * Modify losses and add cloning loss * Add demo file parameter to train.py * Introduce new params in config.py for demo based training * Change logger.warning to logger.warn in rollout.py;bug * Add data generation file for Fetch environments * Update README file | 23 October 2018, 02:04:40 UTC |
c28acb2 | Xingdong Zuo | 23 October 2018, 02:01:26 UTC | [Clean-up]: delete `running_stat` and `filters` as they are replaced by `running_mean_std` and not used anymore (#614) * Delete filters.py * Delete running_stat.py | 23 October 2018, 02:01:26 UTC |
c5d9c4a | pzhokhov | 23 October 2018, 01:36:39 UTC | wrap retro envs correctly for other (non-deepq) algorithms (#669) * wrap retro envs correctly for other (non-deepq) algorithms * flake and csh comments * flake and csh comments | 23 October 2018, 01:36:39 UTC |
c0fa11a | pzhokhov | 22 October 2018, 16:15:04 UTC | minor fixes from internal (#665) * sync internal changes. Make ddpg work with vecenvs * B -> nenvs for consistency with other algos, small cleanups * eval_done[d]==True -> eval_done[d] * flake8 and numpy.random.random_integers deprecation warning * Merge branch 'master' of github.com:openai/games into peterz_track_baselines_branch | 22 October 2018, 16:15:04 UTC |
bd390c2 | Peter Zhokhov | 20 October 2018, 00:50:54 UTC | updated docstring for deepq | 20 October 2018, 00:50:54 UTC |
d0cc325 | pzhokhov | 19 October 2018, 15:54:21 UTC | store session at policy creation time (#655) * sync internal changes. Make ddpg work with vecenvs * B -> nenvs for consistency with other algos, small cleanups * eval_done[d]==True -> eval_done[d] * flake8 and numpy.random.random_integers deprecation warning * store session at policy creation time * coexistence tests * fix a typo * autopep8 * ... and flake8 * updated todo links in test_serialization | 19 October 2018, 15:54:21 UTC |
fc7f9ce | pzhokhov | 18 October 2018, 23:07:14 UTC | disable gym subpackages in setup.py (#661) * disable gym subpackages in setup.py * include gym[atari] in test requirements * gym[atari] -> atari-py in test requirements | 18 October 2018, 23:07:14 UTC |
3677dc1 | Matthew Rahtz | 18 October 2018, 20:54:39 UTC | Set allow_growth=True for MuJoCo session (#643) | 18 October 2018, 20:54:39 UTC |
ef96f38 | Matthew Rahtz | 16 October 2018, 23:28:23 UTC | Drop S and M args so that --play works (#636) | 16 October 2018, 23:28:23 UTC |
a03dacd | pzhokhov | 16 October 2018, 23:26:46 UTC | sync internal changes. Make ddpg work with vecenvs (#654) * sync internal changes. Make ddpg work with vecenvs * B -> nenvs for consistency with other algos, small cleanups * eval_done[d]==True -> eval_done[d] * flake8 and numpy.random.random_integers deprecation warning | 16 October 2018, 23:26:46 UTC |
e57f81b | Tianhong Dai | 16 October 2018, 23:22:06 UTC | revise the readme of ddpg (#653) | 16 October 2018, 23:22:06 UTC |
28aca63 | Peter Zhokhov | 09 October 2018, 16:48:31 UTC | update benchmark results | 09 October 2018, 16:48:31 UTC |
7bfbcf1 | Erik Doffagne | 04 October 2018, 17:31:22 UTC | Fixed typos in README (#635) | 04 October 2018, 17:31:22 UTC |
394339d | pzhokhov | 04 October 2018, 03:53:58 UTC | Update README.md | 04 October 2018, 03:53:58 UTC |
10c205c | pzhokhov | 02 October 2018, 23:33:19 UTC | Debug codegen ppo (#123) * disabled tests, running benchmarks only * dummy commit to RUN BENCHMARKS * benchmark ppo_metal; disable all but Bullet benchmarks * ppo2, codegen ppo and ppo_metal on Bullet RUN BENCHMARKS * run benchmarks on Roboschool instead RUN BENCHMARKS * run ppo_metal on Roboschool as well RUN BENCHMARKS * install roboschool in cron rcall user_config * dummy commit to RUN BENCHMARKS * import roboschool in codegen/contcontrol_prob.py RUN BENCHMARKS * re-enable tests, flake8 * get entropy from a distribution in Pred RUN BENCHMARKS * gin for hyperparameter injection; try codegen ppo close to baselines ppo RUN BENCHMARKS * provide default value for cg2/bmv_net_ops.py * dummy commit to RUN BENCHMARKS * make tests and benchmarks parallel; use relative path to gin file for rcall compatibility RUN BENCHMARKS * syntax error in run-benchmarks-new.py RUN BENCHMARKS * syntax error in run-benchmarks-new.py RUN BENCHMARKS * path relative to codegen/training for gin files RUN BENCHMARKS * another reconcilliation attempt between codegen ppo and baselines ppo RUN BENCHMARKS * value_network=copy for ppo2 on roboschool RUN BENCHMARKS * make None seed work with torch seeding RUN BENCHMARKS * try sequential batches with ppo2 RUN BENCHMARKS * try ppo without advantage normalization RUN BENCHMARKS * use Distribution to compute ema NLL RUN BENCHMARKS * autopep8 * clip gradient norm in algo_agent RUN BENCHMARKS * try ppo2 without vfloss clipping RUN BENCHMARKS * trying with gamma=0.0 - assumption is, both algos should be equally bad RUN BENCHMARKS * set gamma=0 in ppo2 RUN BENCHMARKS * try with ppo2 with single minibatch RUN BENCHMARKS * try with nminibatches=4, value_network=copy RUN BENCHMARKS * try with nminibatches=1 take two RUN BENCHMARKS * try initialization for vf=0.01 RUN BENCHMARKS * fix the problem with min_istart >= max_istart * i have no idea RUN BENCHMARKS * fix non-shared variance between old and new RUN BENCHMARKS * restored baselines.common.policies * 16 minibatches in ppo_roboschool.gin * fixing results of merge * cleanups * cleanups * fix run-benchmarks-new RUN BENCHMARKS Roboschool8M * fix syntax in run-benchmarks-new RUN BENCHMARKS Roboschool8M * fix test failures * moved gin requirement to codegen/setup.py * remove duplicated build_softq in get_algo.py * linting * run softq on continuous action spaces RUN BENCHMARKS Roboschool8M | 03 October 2018, 21:38:32 UTC |
62fe7c4 | pzhokhov | 02 October 2018, 22:54:14 UTC | disable async acktr (#129) * disable async acktr * linting * linting * linting | 03 October 2018, 21:38:32 UTC |
fbdf55f | Xingyou Song | 01 October 2018, 18:39:14 UTC | Xsong lqr ddpg (#125) * allows vec_envs to work * allows vec_envs to work * fixed branch with correct ddpg * running experiments jointly now * changed to subproc * changed to subproc * changed to subproc * small fix md * removed placeholder * removed placeholder * added ppotest * probably fixed ddpg hyperparam issues * checkpoint * edited readme * added orthogonal * added orthogonal * added ddpg-vecenv * reverted ddpg to old baselines | 03 October 2018, 21:38:32 UTC |
9ee804c | Christopher Hesse | 01 October 2018, 17:38:07 UTC | minor change to install.py and baselines run.py (#121) | 03 October 2018, 21:38:32 UTC |
4cf7dc9 | John Schulman | 30 September 2018, 21:54:44 UTC | Big refactor (#124) * massive revision inspired by soup: algo folder works * porting rl commands, WIP * various * git subrepo push --remote=git@github.com:openai/codegen.git --branch=refactor codegen subrepo: subdir: "codegen" merged: "aa27e069" upstream: origin: "git@github.com:openai/codegen.git" branch: "refactor" commit: "aa27e069" git-subrepo: version: "0.4.0" origin: "git@github.com:ingydotnet/git-subrepo.git" commit: "74339e8" * various * rewrite RL stuff in new framework * fix almost everything * woohoo tests pass * more tests * reformatting * fixes * write tests for embeddings * re-remove cg2 * pylint * minor * move smooth_helpers import; seems to cause nondeterministic failure in parallel pytest | 03 October 2018, 21:38:32 UTC |
e820b86 | Xingyou Song | 27 September 2018, 20:11:11 UTC | ppo2 now has eval stats (#120) * ppo2 now has eval stats * fixed spaces * fixed kwargs ordering * whitespace fix | 03 October 2018, 21:38:32 UTC |
858afa8 | pzhokhov | 26 September 2018, 22:28:52 UTC | Refactor DDPG (#111) * run ddpg on Mujoco benchmark RUN BENCHMARKS * autopep8 * fixed all syntax in refactored ddpg * a little bit more refactoring * autopep8 * identity test with ddpg WIP * enable test_identity with ddpg * refactored ddpg RUN BENCHMARKS * autopep8 * include ddpg into style check * fixing tests RUN BENCHMARKS * set default seed to None RUN BENCHMARKS * run tests and benchmarks in separate buildkite steps RUN BENCHMARKS * cleanup pdb usage * flake8 and cleanups * re-enabled all benchmarks in run-benchmarks-new.py * flake8 complaints * deepq model builder compatible with network functions returning single tensor * remove ddpg test with test_discrete_identity * make ppo_metal use make_vec_env instead of make_atari_env * make ppo_metal use make_vec_env instead of make_atari_env * fixed syntax in ppo_metal.run_atari | 03 October 2018, 21:38:32 UTC |
4121d9c | pzhokhov | 03 October 2018, 21:37:40 UTC | fix DQN learning bug (#632) * Update run.py * Update utils.py * Update utils.py | 03 October 2018, 21:37:40 UTC |
34ae319 | Peter Zhokhov | 27 September 2018, 19:51:43 UTC | add a note about DQN algorithms not performing well | 27 September 2018, 19:51:43 UTC |
4402b8e | Thomas Simonini | 24 September 2018, 16:54:41 UTC | Updated A2C and PPO2 comments (#612) * Updated A2C and PPO2 comments * Fixed format errors to respect PEP 8 style guide | 24 September 2018, 16:54:41 UTC |
555a5cb | ahuhn | 22 September 2018, 00:22:56 UTC | Adding num_env to readme example (#609) * Adding num_env to readme example * Updated readme example fix | 22 September 2018, 00:22:56 UTC |
8158f35 | Thomas Simonini | 21 September 2018, 20:12:31 UTC | Wrote some comments to explain the A2C and PPO2 implementation (#607) * added comments in A2C and PPO2 * Fixed format errors to respect PEP 8 style guide | 21 September 2018, 20:12:31 UTC |
a7fd8a4 | cclauss | 20 September 2018, 23:40:03 UTC | Run flake8 to find syntax errors and undefined names (#439) __E901,E999,F821,F822,F823__ are the "showstopper" flake8 issues that can halt the runtime with a SyntaxError, NameError, etc. The other flake8 issues are merely "style violations" -- useful for readability but they do not effect runtime safety. This PR therefore recommends a flake8 run of those tests on the entire codebase. * F821: undefined name `name` * F822: undefined name `name` in `__all__` * F823: local variable `name` referenced before assignment * E901: SyntaxError or IndentationError * E999: SyntaxError -- failed to compile a file into an Abstract Syntax Tree | 20 September 2018, 23:40:03 UTC |
e791565 | John Schulman | 20 September 2018, 20:31:25 UTC | Codegen more abstract abstract classes 3a (#106) * Soup code, arch search on CIFAR-10 * Oh I understood how choice_sequence() worked * Undo some pointless changes * Some beautification 1 * Some beautification 2 * An attempt to debug test_get_algo_outputs() number 70, unsuccessful. * Code style warning * Code style warnings, more * wip * wip * wip * fix almost everything; soup machine still broken * revert mpi_eda changes * minor fixes | 20 September 2018, 23:19:07 UTC |
7859f60 | XFFXFF | 20 September 2018, 23:16:44 UTC | prioritized experience replay bug (#527) | 20 September 2018, 23:16:44 UTC |
0f4ae2f | pzhokhov | 20 September 2018, 23:05:26 UTC | refactor acktr (#560) * refactor acktr * setup.cfg now tests style/syntax in acktr as well * flake8 complaints * added note about continuous action spaces for acktr into the README.md | 20 September 2018, 23:05:26 UTC |
0e7048b | pzhokhov | 19 September 2018, 22:04:54 UTC | Update README.md | 19 September 2018, 22:04:54 UTC |
75983ba | pzhokhov | 19 September 2018, 22:04:01 UTC | Update README.md | 19 September 2018, 22:04:01 UTC |
85be745 | Alfredo Canziani | 19 September 2018, 16:43:45 UTC | Add possibility of plotting timesteps vs episodes (#578) * Add possibility of plotting timesteps vs episodes * Remove leftover from personal project patch * Auto plt.tight_layout() on resize window event Calls `plt.tight_layout()` if a `resize_event` is issued. This means that the plot will look good even after the user has resized the plotting window. | 19 September 2018, 16:43:45 UTC |
115b59d | Geoffrey Irving | 18 September 2018, 22:52:57 UTC | Merge pull request #598 from openai/irving-rc Fix setup.py for tensorflow -rc versions | 18 September 2018, 22:52:57 UTC |
d34049c | Xingdong Zuo | 18 September 2018, 21:14:38 UTC | Update running_mean_std.py (#585) | 18 September 2018, 21:14:38 UTC |