https://github.com/PaddlePaddle/PARL

sort by:
Revision Author Date Message Commit Date
5f71cd4 release 1.1.2 (#119) 03 August 2019, 11:59:30 UTC
8f96d4a release 1.2rc0 (#115) 03 August 2019, 08:10:14 UTC
50f3bd3 Compatibility (#118) * fix the vital issue on compatibility * resolve the warning log * yapf * yapf 03 August 2019, 08:09:57 UTC
a13dcce new setup (#114) 02 August 2019, 15:46:33 UTC
b29a1ec first pr (#113) * first pr * start a worker when the master is started. * First PR & Fix logger bugs. * update docs for a2c, impala and ga3c * update doc * yapf modification * update logger * yapf correct * yapf * setup.py * old setup.py * worker 86 02 August 2019, 14:35:58 UTC
7cc9677 add docs for the cluster (#112) * add docs for the cluster * mispelling issues * minor change * fix comment * fix comments from yuxiang * fix comment * fix the bug of hyperlink * rename 02 August 2019, 05:36:55 UTC
ee07ec2 release version 1.1.1 (#111) * release version 1.1.1 * add version requirement of tensorboard 01 August 2019, 11:14:12 UTC
7dafee7 Save params (#107) * new feature: save params * add unittest for save()/retore() * add an example demonstrating the usage * rename the variable * yapf * fix comment 01 August 2019, 04:24:08 UTC
2f11d0c fix the bug in building the the docs (#104) * fix the bug in building the the docs * update the version of the required Paddle 31 July 2019, 06:25:41 UTC
fb9af35 Basic docs (#103) * fix the compatibility issue * fix the comment issue * support paddle 1.5.1 and replace PE with compiler * yapf&copyright * yapf * fix the teamcity problem * fix the teamcity problem * fix comment * only support paddle 1.5.1 * Cmake * fix comment * add documentaion for basic classes * change the order of three basic classes * fix commemt & yapf * comment #2 * yapf#3 * fix commemt@zhs * minor change * modify comment * Update algorithm.py * Update agent.py * Update algorithm.py 30 July 2019, 06:05:56 UTC
6e58ccf fix issue#101 (#102) * fix issue#101 * yapf 29 July 2019, 05:40:13 UTC
564a374 fix some problems of tensorboard (#100) * fix some problems of tensorboard * yapf 28 July 2019, 16:08:34 UTC
d33f300 replace PE with compiler(new feature in paddle151). (#99) * fix the compatibility issue * fix the comment issue * support paddle 1.5.1 and replace PE with compiler * yapf&copyright * yapf * fix the teamcity problem * fix the teamcity problem * fix comment * only support paddle 1.5.1 * Cmake * fix comment 26 July 2019, 12:24:30 UTC
3351633 fix the compatibility issue in the A2C example. (#98) * fix the compatibility issue * fix the comment issue 25 July 2019, 09:10:46 UTC
d18f19a add the tutorial: getting started (#97) * add the tutorial: getting started * fix commemt * minor change 25 July 2019, 02:08:51 UTC
0e17427 remove previous algorithms; use the forward function in parl.Model (#96) * remove previous algorithms; use the forward function in parl.Model * remove abundant lines * yapf 24 July 2019, 12:12:11 UTC
6efa787 breaking changes#1 (#95) * intra-version: move parl.framework into parl.core.fluid * add folder: parl.core * remove former test folders * yapf * yapf0.24 24 July 2019, 03:46:57 UTC
ee3e8dc Tensorboard (#93) * add tensorboardX * yapf * Code License 18 July 2019, 07:08:22 UTC
b7e3274 Add some papers (#92) * Update model-based.md 17 July 2019, 06:43:10 UTC
c046601 add the folder:papers, and add model-based papers (#90) 11 July 2019, 02:48:34 UTC
9dc152f make the quickstart more compact (#88) * make the quickstart more compact * remove args in the main function * yapf * add gif * remove render * Update README.md * Update README.md * Update README.md 10 July 2019, 08:29:38 UTC
f8e594c add unittest for compling the docs (#87) * add unittest for compling the docs * record the time of change * remove unused requirements * reduce font size of the changelog 09 July 2019, 05:25:37 UTC
96c5826 Documents cn (#85) * Update README.cn.md * Update README.md * Update README.md * Update README.cn.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md 05 July 2019, 05:25:11 UTC
079d740 Onlinedocs (#84) * test * add installation of the current package * remove the dependencies file 04 July 2019, 12:15:44 UTC
02090ca create docs (#82) * test_docs * Create index.md * Delete index.md * check yapf * remove source * Update conf.py * update requirements * add a new line at the end * Fix End of Files * fix-end-of-line * remove requirements.txt * Update .readthedocs.yml 04 July 2019, 07:53:07 UTC
255ef4f refine A2C example (#80) * refine A2C example * fix unittest in python2; fix codestyle * fix codestyle * refine comment 18 June 2019, 02:27:52 UTC
c3b34fd add exception traceback of remote function calling (#79) * add traceback of remote function calling * assert traceback information 04 June 2019, 11:24:51 UTC
48fc1de support serialize/deserialize instance of custom class (#77) * support serialize/deserialize instance of custom class * update version requirement of dependences * remove requirements of unittest which are included in parl * use fashion style of pyarrow serialization context; add thread safe unittest of serialize/deserialize * add thread-safe test of remote module; add more exception tips of serialize/deserialize * refine comment 13 May 2019, 10:07:06 UTC
6c6ec6c add test for speed of serialize and deserialize in communication (#76) 09 May 2019, 11:39:40 UTC
7be5574 add __version__ description in package(#74) Now we can check the parl version by calling parl.__version__ 29 April 2019, 06:35:04 UTC
e01966f add test for import parl (#73) * add test for import parl * fix error of check_style * change pip source * refine naming 24 April 2019, 10:58:31 UTC
2bbaa11 fix bug of import parl (#72) * add benchmark of GA3C * fix bug of import parl without paddle * fix codestyle 23 April 2019, 13:37:56 UTC
858c4f0 add benchmark of GA3C (#71) 23 April 2019, 09:51:17 UTC
3b97394 add A2C benchmark; add more information in PyPI homepage (#70) * add A2C benchmark; add more information in PyPI homepage * filter picture in PyPI homepage 19 April 2019, 08:25:05 UTC
efa5a8c release v1.1 (#69) 19 April 2019, 05:20:21 UTC
f12b790 Update README.md (#68) * Update README.md * Update Dockerfile * Update build.sh 19 April 2019, 03:09:53 UTC
ed4f432 compatible queue definition (#66) * add compatible queue definition 18 April 2019, 12:17:10 UTC
3556c78 Refine (#67) * fix typo * Update README.md * Update README.md * Update README.md * soft depend on fluid; add module to monitor client status * improve performance of IMPALA example * fix bug of some client cannot exit normally * refine comment * . 18 April 2019, 12:16:46 UTC
432d75b Add a Chinese documentation (#65) * Update README.md * Create README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.cn.md * Update README.md * Update README.md * Update README.md * Update README.cn.md 18 April 2019, 08:07:44 UTC
3c511e8 GA3C example (#63) * add IMPALA algorithm and some common utils * update README.md * refactor files structure of impala algorithm; seperate numpy utils from utils * add hyper parameter scheduler module; add entropy and lr scheduler in impala * clip reward in atari wrapper instead of learner side; fix codestyle * add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers * Update README.md * add a3c algorithm, A2C example and rl_utils * require training in single gpu/cpu * only check cpu/gpu num in learner * refine Readme * update impala benchmark picture; update Readme * add benchmark result of A2C * move get_params/set_params in agent_base * add GA3C example * Update README.md * Update README.md * Update README.md * Update README.md * refine Readme * add benchmark * add default safe eps in numpy logp calculation * refine document; make unittest stable 17 April 2019, 14:13:53 UTC
3984683 A2C example (#62) * add IMPALA algorithm and some common utils * update README.md * refactor files structure of impala algorithm; seperate numpy utils from utils * add hyper parameter scheduler module; add entropy and lr scheduler in impala * clip reward in atari wrapper instead of learner side; fix codestyle * add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers * Update README.md * add a3c algorithm, A2C example and rl_utils * require training in single gpu/cpu * only check cpu/gpu num in learner * refine Readme * update impala benchmark picture; update Readme * add benchmark result of A2C * move get_params/set_params in agent_base * fix shell script cannot run in ubuntu * refine comment and document * Update README.md * Update README.md 15 April 2019, 12:54:20 UTC
452050a add some introduction for our parallelization feature (#61) * Update remote_decorator.py * Update README.md * add an figure for the demonstration about parallelization * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md * add a link to IMPALA 13 April 2019, 06:07:49 UTC
b28289a implement of IMPALA with the newest parallel design (#60) * add IMPALA algorithm and some common utils * update README.md * refactor files structure of impala algorithm; seperate numpy utils from utils * add hyper parameter scheduler module; add entropy and lr scheduler in impala * clip reward in atari wrapper instead of learner side; fix codestyle * add benchmark result of impala; refine code of impala example; add obs_format in atari_wrappers * Update README.md 08 April 2019, 03:26:26 UTC
7346a23 add api set_params/get_params in Model (#56) * add api set_params/get_params in Model; add Interface of Network and LayerFunc to solve circular imports; refine parameter_names api of Model * remove licence in third party code; remove interface of Network and LayerFunc; move get_parameter_pairs and get_parameter_names api to Network * refine comment * refine commment 26 March 2019, 06:18:02 UTC
d8449b7 update documents (#58) * Update README.md * Update train.py * Update README.md * Update agent_base.py * Update train.py * Update train.py * Update train.py 11 March 2019, 06:41:56 UTC
348db1f new feature: parl.remote (#54) * refine remote module, add heartbeat machanism and unittest * yapf * yapf * support get ip address in CentOS, add dependence * yapf * add dependence in Dockerfile * refine message_tag, Compatible with Python2 and python3 * refine unittest and comments * remove ParlError, use to_pybytes api to compatible with Python 2 and python 3 * Not need to use to_pybytes * use parl-test docker image for unittest, which has python2 and python3 env * test different release order of sockets * test for different closing way fo context and socket * tmp commit for debug in teamcity * tmp commit for debug in teamcity * tmp commit for debug in teamcity * use zmq.context destroy to close multi-thread socket, refine RemoteError * set linger=0 for command socket in RemoteObject * remove close context unittest * fix codestyle * fix codestyle * rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually * rename parl.remote to parl.remote_class; will not exit client when having errors in function call; use sepereate server port in unittest to avoiding closing server manually * fix typo * remove unnecessary try/except in reply loop of client * import RemoteManager to parl; refine comment 07 March 2019, 04:58:19 UTC
e80604f run unittest in python2 and python3 (#55) * run unittest in python2 and python3 * refine structure of repo * refine structure of repo * add --fix-misssing * fix teamcity * add --fix-misssing * update paddle version in python2 05 March 2019, 06:06:39 UTC
46188cd Update some docs. (#51) * Update model_base.py * Update README.md * Update README.md 01 March 2019, 08:52:32 UTC
bbde58f first version of network communication (#49) * first version of network communication * fix code styple problems * add a script to get machine's information * code styple problems#2 * fix unit test problems * update dockfile to fix the installation issue of cmake * thread-saftey ensurance & copright * resolve comments 27 February 2019, 04:20:02 UTC
65ad2a4 fix PPO bug; add more benchmark result (#47) * fix PPO bug; add more benchmark result * refine code * update benchmark of PPO, after fix bug * refine code 14 February 2019, 03:06:52 UTC
6fdf444 Add more dqn benchmark result and unify train scripts (#46) * add more dqn benchmark result; unify train scripts * resize benchmark picture * resize benchmark picture, refine comments of args * change dependence, mujoco only support python3 now 24 January 2019, 12:11:32 UTC
7a7583a Refine documents of PARL (#43) * remove not used files, add benchmark for DQN and DDPG, add Parameters management Readme * Update README.md * Update README.md * add parl dependence in examples, use np shuffle instead of sklean * fix codestyle * refine readme of nips example * fix bug * fix code style * Update README.md * Update README.md * Update README.md * refine document and remove outdated design doc * Update README.md * Update README.md * refine comment * release version 1.0 * gif of examples * Update README.md * update Readme 18 January 2019, 03:31:19 UTC
4163d73 update readme for competition folder (#42) * Update README.md * add experimental results 15 January 2019, 09:27:20 UTC
cdb5005 NeurIPS2018-AI-for-Prosthetics-Challenge training code (#40) * NeurIPS2018-AI-for-Prosthetics-Challenge training code * remove model_zoo, provide download link * remove model_zoo, provide download link * add restore_from_one_head api, refine README, fix logger bug * fix test bug * fix rpm bug, refine ddpg train script * fix rpm bug, refine Readme 15 January 2019, 02:10:21 UTC
f8de849 add PPO example (#39) * add PPO example * Update Readme * Update Readme * fix codestyle * Update Readme * refine action mapping * add more unitest case * remove unnecessary params initialize, add more comments, add benchmark result * rename * remove PARL dependence in readme of examples 04 January 2019, 02:47:06 UTC
bd37f47 Provide synchronizable create_parameter in PARL (#38) * Provide synchronizable create_parameter in PARL * use AttrHold to make LayerFunc support more than two parameters * refine code * refine code * fix #25 28 December 2018, 06:09:07 UTC
53c9478 Add DDPG example (#36) * add DDPG example, fix some tiny bug * add license * unify code structure * unify code structure * refine gputils, fix seed in QuickStart * use white noise in DDPG * fix codestyle 14 December 2018, 16:08:01 UTC
58e8fe2 add a episode in quick start to show the final test reward (#37) * add a episode to show the final test reward * make code more clear 12 December 2018, 03:40:39 UTC
cdd4622 Add QuickStart example (#35) * add QuickStart example, refine DQN example * add examples link * refine the naming, and add quick start training result 07 December 2018, 02:45:47 UTC
4a4366a DQN example (#33) * add DQN example, add Agent unittest * refine readme * refine code * simplify code 04 December 2018, 13:30:02 UTC
5be4ca0 Update README.md (#34) a more detailed example for DQN model. 04 December 2018, 13:11:27 UTC
b249dee add testing module of NeurIPS2018-AI-for-Prosthetics-Challenge (#32) * add testing module of NeurIPS2018-AI-for-Prosthetics-Challenge, add dependencies of setup * add copyright * add google drive link * fix depedencie * refine setup 30 November 2018, 09:21:36 UTC
ec005b5 add introduction about abstractions and features in README and logo (#31) * Update README.md * Update README.md * add diagram/logo * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md 29 November 2018, 08:19:42 UTC
c6f50c3 add setup.py for installation (#30) * add setup.py for installation * rename agent.py to make it consistent with other framework base * namespace bug 27 November 2018, 08:56:32 UTC
3c46b7c fix bug of logger (#29) 27 November 2018, 01:57:42 UTC
e11b40c sync paras in program, fix deepcopy bug, python3 compatibility (#28) * sync paras in program, fix deepcopy bug, python3 compatibility * refactor code, add plutil directory, clean import order * remove old comment * refine comment * fix codestyle * cache sync program, add gputils module, refine model_base unittest * fix codestyle * refine sync params cache * add fetch_value module 26 November 2018, 06:15:23 UTC
942c3c5 add logger module (#27) * add logger module * refine comment * add license * refine set_level api * refine unittest * fix codestyle with yapf * add termcolor dependency 22 November 2018, 04:35:16 UTC
1a1e1f0 redesign basic class in PARL (#26) * redesign basic class in PARL * code style fixed * update yaml's version * update yaml's version & update code to fix style problem * add debug message for function * delete test code * rename function: has_fun -> has_func 20 November 2018, 09:37:25 UTC
2fc4e8c support for Paddle-v1.1 (#24) 13 November 2018, 07:18:18 UTC
b32f894 add IARL directory for camera-ready paper of CoRL2018 code will be released before 31.October (#20) 29 September 2018, 22:37:25 UTC
8001db6 fix wrapper of dynamic_lstm cannot support h_0 and c_0 parameter (#17) * fix wrapper of dynamic_lstm cannot support h_0 and c_0 initialization, fix bug of wrapper of dynamic_gru * use sampling_id of fluid to sampling ids * remove test simple games unittest, avoid timeout * change pip source 11 September 2018, 07:39:41 UTC
21a9efe added test_simple_games (#15) added test_simple_games 11 June 2018, 18:54:58 UTC
4b4b582 preliminary implementations of the ComputationTask, Algorithm, and Model classes (#9) * prelimary implementations of ComputationTask, Algorithm and Model classes * remove "model_func" from the args of an algorithm * a clean clone() function for Algorithm and Model * add use_next_value as a input to learn() * further re-structure * added Feedforward and RLAlgorithm classes * maxid -> argmax * discrete_distribution -> category_distribution * category -> categorical * revisions 05 June 2018, 23:09:34 UTC
2ce5711 add design doc (#13) add design doc 01 June 2018, 02:14:13 UTC
6fae20c CI: Add dockerfile to install missing package. (#14) 01 June 2018, 00:10:36 UTC
406ffdb A simple replay buffer (#5) * simple replay buffer and its test * add error handling * add test for deep copy 28 May 2018, 04:09:15 UTC
7b0407b CI: enable ci task. (#10) 22 May 2018, 00:43:45 UTC
e60103f improve CMakeLists.txt (#8) 18 May 2018, 07:52:19 UTC
04c220b use cmake to manage unittests 18 May 2018, 05:27:18 UTC
3f82a9b update 17 May 2018, 06:16:37 UTC
ad049bc revisions 17 May 2018, 06:16:37 UTC
b5965b4 simplify the code 17 May 2018, 06:16:37 UTC
1e32a71 parameter sharing in fluid with simple test cases 17 May 2018, 06:16:37 UTC
cb920ff Merge pull request #1 from emailweixu/develop pre-commit hook 25 April 2018, 20:53:10 UTC
326b7ff pre-commit hook To use it, run "pre-commit install" at repo root. 25 April 2018, 19:49:43 UTC
f355bc6 Initial commit 25 April 2018, 17:54:23 UTC
back to top