https://github.com/twitter/heron

sort by:
Revision Author Date Message Commit Date
eb5090b update storm 2.2.0 ISpout open() (#3567) * updateispout * fix-style * minchange * updateibolt Co-authored-by: Huijun Wu <huijunw@twitter.com> 12 July 2020, 08:33:01 UTC
9e0c782 mkdir for storm api 2.2.0 (#3566) * mkdirstormapi2 * fixjavalicenseheader * fixstyle Co-authored-by: Huijun Wu <huijunw@twitter.com> 11 July 2020, 23:39:59 UTC
b760eab fixtoolchain (#3563) 11 July 2020, 20:23:49 UTC
1c62485 Make the integration test script executable. (#3565) 10 July 2020, 21:38:33 UTC
278c05a zookeeper to 3.5.8 (#3555) * Upgrade zookeeper3.5.8 Co-authored-by: Huijun Wu <huijunw@twitter.com> Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> 10 July 2020, 21:11:09 UTC
4f7f90f Python 3 upgrade (#3522) * Initial Python 3 upgrade effort * Fixes towards python3 support * update heronpy release scripts for python3 * update dist Dockerfiles to only use python3 * remove python2 from docker images * upgrade pylint for python3 support * upgrade PEX so transative dependencies are captured Additionally: * fix Ubuntu 16.04 images * fix linting issues found by newer pylint There is an issue with encapsulation in the builds where the global python3 environment is used while PEX installs a nested transitive dependency of pylint: `pylint>astroid>wrapt`. This seems to be because of logic in its setup.py which can be disabled with `WRAPT_INSTALL_EXTENSIONS=false` * Fix new pylint issues * update setuptools * Make pex_pytest non-zip-safe * Rough proto_library fix The issue encountered was https://github.com/protocolbuffers/protobuf/issues/1491 which may be fixed by a pending PR to protoc, or with a switch to the official protobuf rules and the import_prefix parameter to proto_library. * WIP: Fix python3 incompatibilities * bytes vs str issues * update kazoo * order of processes in executor test changed due to dict ordering? * some places needed / switched to // - may be more not caught by tests * add travis_wait as some stages going over 10 minutes without output in CI TODO: * make sure the kazoo upgrade is correct, it was done only by updating package versoin * Try fixing build time issue in travis * Upgrade docker rules * Upgrade to python3 in CI * Fix python integration tests * Fix more bytes vs str errors + update vagrant * Update Travis to Python3.7 + fix Vagrant on mac * Reduce requirement to python3.6 + py3 fixes * use universal_newline in popen instead of text in Popen for py3.6 * fix bytes/str issues in deserialisation * fix file open modes * use set instead of sets.Set * fix __import__(level) default * Update cloudpickle * Fix python addressing of release.yaml * Additions to get docker image builds working and tested * use new external pkg_* rules * add python to compile docker images until pkg_* * add --host_force_python=PY3 to other bazel.rc files * WIP: Add CI for docker images/releases * use kind to create ephemeral clusters * start consolidating scripts with python * Fix helm chart * bytes vs str fix * Mention Python 3.6 requirement in README.md * updatedockerfile Co-authored-by: Neng Lu <nlu@twitter.com> Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> Co-authored-by: bed debug <huijunwu@users.noreply.github.com> Co-authored-by: huijunwu <huijun.wu.2010@gmail.com> 07 July 2020, 00:24:27 UTC
7544160 Adding missing baseUrl (#3553) 03 July 2020, 12:37:11 UTC
897df21 Revert "upgradezookeeper3.5.8" This reverts commit 00e4e81d77153ac4017967e78c59a3b9b72e5609. 03 July 2020, 02:11:21 UTC
00e4e81 upgradezookeeper3.5.8 03 July 2020, 02:01:31 UTC
5084318 Fixing RVO optimization (#3549) 02 July 2020, 00:53:30 UTC
fb970eb Distribution Dockerfile missing ncat and other cleanup (#3552) * Distribution Dockerfile cleanup 01 July 2020, 06:45:46 UTC
cc815d8 Updated to make site look better on mobile (#3547) 25 June 2020, 14:15:34 UTC
e461308 HeronPy: Add missing TOPOLOGY_CONTAINER_MAX_RAM_HINT (#3544) TOPOLOGY_CONTAINER_MAX_RAM_HINT should be there for FirstFitDecreasingPacking 25 June 2020, 06:05:24 UTC
8057559 Updated Docusaurus config to fix Javadocs CSS bug (#3546) * Updated Docusaurus config to ignore Javadocs CSS * Refactored and updated gitignore rules * Website build script cleanup 25 June 2020, 02:23:51 UTC
9377b10 Embedded Trykker font (#3541) 18 June 2020, 11:53:48 UTC
c666100 adjusting packages for javadocs (#3537) 10 June 2020, 10:21:19 UTC
d03c112 fixing javadocs (#3536) * fixing javadocs * Adding back Pulsar Streamlet example * Excluding examples folder from javadocs * clean up Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> 07 June 2020, 12:56:36 UTC
4308eaf Fix use of non-default base url value (#3535) 03 June 2020, 01:33:28 UTC
270f77e Fix service url in Helm chart (#3534) The template string in the values.yaml wasn't rendered, so this patch renders the default value in the template 02 June 2020, 01:55:02 UTC
b16853b correcting heron urls (#3532) * correcting heron urls * clean up 31 May 2020, 16:34:50 UTC
a7291ce get javadocs generation script passing (#3533) * add ./contrib/**/*.jar files to classpath * exclude ./tools/**/*.java from input (e.g. cppcheck+checkstyle) 31 May 2020, 16:34:18 UTC
a651e90 Build python package in virtualenv (#3529) 30 May 2020, 00:29:38 UTC
59a3c4a adding nostyle (#3527) 29 May 2020, 20:04:07 UTC
e06dc8f Workaround trailing slashes on website (#3531) This is as the website deployment 301s to add trailing slashes, and Docusurus does not yet support that. Without one of the two yielding, this workaround strips the trailing slash so the hrefs made still work. Solution pinched from docusurus issue: https://github.com/facebook/docusaurus/issues/2394 29 May 2020, 03:49:56 UTC
c713f43 Fix ubunt14.04 docker file (#3526) 26 May 2020, 18:09:12 UTC
89a1e50 Update osx documentation (3453) (#3530) As specified here: https://github.com/apache/incubator-heron/issues/3452#issuecomment-625435818, heron now requires bazel version 3.0.0 26 May 2020, 16:17:11 UTC
d05f6e9 Fix Heron Shell PID Extractor (#3528) * Fix Heron Shell PID Extractor * read pid file 19 May 2020, 03:30:05 UTC
07b5d8c Fix ubuntu16.04 docker file (#3525) * fix ubuntu 16.04 docker file * Fix ubuntu docker file 17 May 2020, 17:24:07 UTC
e0bb08a Set Java SupportedSourceVersion to 11 (#3524) 14 May 2020, 04:34:56 UTC
e065171 Fix centos7 docker build (#3523) 10 May 2020, 01:17:44 UTC
a295942 Pin http_file and http_archive resources in WORKSPACE (#3520) 01 May 2020, 23:45:10 UTC
cf08e71 Make Java optional in CLI and check JAVA_BIN (#3521) 01 May 2020, 23:44:11 UTC
c7a5ab4 Adding Ubuntu 20.04 Dockerfiles (#3519) 30 April 2020, 23:27:01 UTC
7bfa0c7 Fix debian9 docker file and clean up centos8 and ubuntu18.04 (#3518) 23 April 2020, 16:23:21 UTC
ec7a87a Update issue templates (#3379) * Update issue templates * Update bug_report.md Co-authored-by: Josh Fischer <josh@joshfischer.io> 22 April 2020, 02:48:24 UTC
78d7145 Adding missing pkg-config package to Debian 9 build (#3517) 21 April 2020, 09:18:33 UTC
923b8b9 Add cppunit-devel for Bazel 3 (#3513) * Add cppunit-devel for centos Dockerfile * Add cppunit-devel for Dockerfile 19 April 2020, 16:58:35 UTC
2a4f112 Upgrading Bazel to 3.0.0 (#3510) * Bazel 3.0.0 * Updated to use `rules_jvm_external` * Buildozer cleanup 16 April 2020, 05:18:53 UTC
32d3051 Joshfischer/update site build (#3509) * remove user params * adjust user settings * adjust user settings * adjust path * clean up whitespace 13 April 2020, 21:35:47 UTC
c024da2 Fix snake yaml that caused unit test failures (#3506) Fix snakeyaml caused unit test failures 09 April 2020, 15:47:12 UTC
f90784a remove gitmodule file (#3508) 09 April 2020, 14:11:52 UTC
ed6fd81 Add an example with Streamlet API using component config (#3496) An example Streamlet topology demonstrating how to set cpu and memory limits per component. 08 April 2020, 20:16:01 UTC
0f27ef4 Fix style 07 April 2020, 06:53:59 UTC
9d77767 Use safe constructor in yaml deserialization 06 April 2020, 09:25:33 UTC
b069e45 Support custom metrics rules for PrometheusSink (#3493) * Support Java 11 * config travis to use oracle jdk 11 * Java 11 support (#3399) * Support Java 11 * config travis to use oracle jdk 11 * Add check jdk version * Fix command arguments. Change insert gc_options Update list Fix gc-logging * Add missing parameter * typo * Add pause time * wip * Support jmx_exporter format configuration. * Fix checkstyle * Remove unused * Java 11 support (#3399) * Support Java 11 * config travis to use oracle jdk 11 * Add check jdk version * Fix command arguments. Change insert gc_options Update list Fix gc-logging * wip * Support jmx_exporter format configuration. * Fix checkstyle * Remove unused * Update kafkaOffset metrics * Add Rules * Make log/sink/consume Streamlet component support setName and setNumPartitions (#3459) * Patch to fix cppcheck with newer glibc (#3471) * Add documents for setting up a docker based development environment (#3475) * Improve concurrency for needed parts. (#3107) * Change concurrent Map * Change concurrent Map * HashMap changes for unneeded parts. * HashMap changes for unneeded parts. * Review changes * Changes HashMap for unneeded parts. * Improve concurrency for needed parts. * Remove unused imports. * Remove unused imports. * Remove unused imports. * Fix NPE (cherry picked from commit 545d3814b315c29d3e396309a2ededaad193ec32) * Fix WhitespaceAround * Add dummy Object * Fix ConstantName (cherry picked from commit 8d6d5067072e92d6e276f93e18297ddedc647c6c) * Update kafkaOffset metrics * Add Rules * Update line is longer than 100 characters * Update line is longer than 100 characters * Add attrNameSnakeCase or other metrics fix * fix checkstyle Co-authored-by: Ning Wang <wangninggm@gmail.com> Co-authored-by: Ning Wang <nwang@twitter.com> Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> 02 April 2020, 05:14:28 UTC
a6a4bf8 Travis CI update to Ubuntu 18.04 (#3497) Updated Travic CI to use Ubuntu Bionic 18.04 02 April 2020, 00:01:05 UTC
d2c5303 Fix copy Maven artifacts permission error (#3503) 31 March 2020, 04:50:25 UTC
c3d29a4 rolling back docusaurus version (#3501) 28 March 2020, 10:21:29 UTC
f76f479 fixstmgrcrash (#3492) Co-authored-by: Huijun Wu <huijunw@twitter.com> 25 March 2020, 22:49:53 UTC
9ddbeb6 updating docs for compiling (#3483) * updating docs for compiling * clean up docs 24 March 2020, 20:36:49 UTC
43c7c74 Update Debian docker build with JDK11 and correct debian version (#3487) * Debian9 docker build fix * Fix Debian docker build with JDK11 Co-authored-by: tahlia <tahlia@stormeye.io> 12 March 2020, 01:15:59 UTC
576e0c7 Joshfischer/debian10 java11 (#3481) Added Debian 10 Dockerfiles 08 March 2020, 05:51:20 UTC
6846f70 Revert "Upgrade to Python3 (#3431)" (#3478) This reverts commit 257b1a439588a22b2d7959338ce7be50b02c4708 05 March 2020, 05:18:10 UTC
ee1c44a Improve concurrency for needed parts. (#3107) * Change concurrent Map * Change concurrent Map * HashMap changes for unneeded parts. * HashMap changes for unneeded parts. * Review changes * Changes HashMap for unneeded parts. * Improve concurrency for needed parts. * Remove unused imports. * Remove unused imports. * Remove unused imports. * Fix NPE (cherry picked from commit 545d3814b315c29d3e396309a2ededaad193ec32) * Fix WhitespaceAround * Add dummy Object * Fix ConstantName (cherry picked from commit 8d6d5067072e92d6e276f93e18297ddedc647c6c) 04 March 2020, 15:21:08 UTC
98a084a Add documents for setting up a docker based development environment (#3475) 03 March 2020, 01:51:26 UTC
a6ec96e Patch to fix cppcheck with newer glibc (#3471) 29 February 2020, 10:49:20 UTC
f0b6e1b Make log/sink/consume Streamlet component support setName and setNumPartitions (#3459) 21 February 2020, 09:19:17 UTC
1c59862 Update README for Java 11 (#3464) 21 February 2020, 05:01:01 UTC
4379fe1 Update website for java 11 (#3462) 20 February 2020, 06:52:40 UTC
1476076 Java 11 support (#3454) * Support Java 11 * config travis to use oracle jdk 11 * Java 11 support (#3399) * Support Java 11 * config travis to use oracle jdk 11 * Add check jdk version * Fix command arguments. Change insert gc_options Update list Fix gc-logging * Add missing parameter * typo * Add pause time * Add python3 for docker files * Revert "config travis to use oracle jdk 11" This reverts commit edaa84f4a6665a1bbd4a93feb67eb67f62476d9a. * Update unitest * Update unittest * Add JDK11 UnitTest * Add Unittest using Docker. * Add full test * Change JDK11 * Ignore PowerMock used for testing is not compatible with Java 11. * Change JDK11 for travis.yml * Update python * Update library requests, pylint * Revert "Update library requests, pylint" This reverts commit 7706d34a7b108846b1d4ada8c74e7f6ce65911c0. * Add ignore * Refactoring ReflectionUtils Co-authored-by: Ning Wang <wangninggm@gmail.com> 19 February 2020, 16:17:29 UTC
0a6cecb adding examples folder to classpath (#3458) 18 February 2020, 14:26:21 UTC
db255f4 removing symlink. Adding contributing guidelines back (#3450) * removing symlink. Adding contributing guidelines back * clean up 14 February 2020, 12:53:48 UTC
783581b adding new committers (#3451) 14 February 2020, 03:40:18 UTC
d179c83 Bump mixin-deep from 1.3.1 to 1.3.2 in /website2/website (#3391) Bumps [mixin-deep](https://github.com/jonschlinkert/mixin-deep) from 1.3.1 to 1.3.2. - [Release notes](https://github.com/jonschlinkert/mixin-deep/releases) - [Commits](https://github.com/jonschlinkert/mixin-deep/compare/1.3.1...1.3.2) Signed-off-by: dependabot[bot] <support@github.com> 10 February 2020, 18:38:24 UTC
c9d18e6 Add redirect from github pages to new apache site (#3448) * adding redirect for gh pages * updating asf.yaml to use redirect * correct page title. remove hostname * update index * update asf.yaml and index * removing theme 10 February 2020, 12:15:15 UTC
b22f442 remove old site (#3446) 10 February 2020, 12:14:39 UTC
d43f6bd Use netcat-bsd in Debian (#3447) 09 February 2020, 20:18:43 UTC
f7371e1 Added execute permission to dev-env-create.sh (#3443) 07 February 2020, 17:36:35 UTC
3b66e97 Improve docker dev env script (#3441) 03 February 2020, 06:48:42 UTC
b964cf4 explicitly making the site indexable (#3442) * explicitly making the site indexable * remove submodule 02 February 2020, 19:06:05 UTC
0599224 Update license files for JSXTransformer.js (#3437) 01 February 2020, 13:44:25 UTC
7927299 add downloader-core filegroup (#3439) * add downloader-core filegroup * remove failing test 31 January 2020, 18:57:50 UTC
91dbabf Updated to use default Kubernetes client discovery logic (#3432) * Updated to use default Kubernetes client discovery logic * Removed kubectl-proxy container * Remove kubectl-proxy image property * Syntax cleanup * Added missing kubernetes dependency 17 January 2020, 02:34:11 UTC
b16973a Updated rules_scala to fix https issue (#3436) 16 January 2020, 08:04:53 UTC
257b1a4 Upgrade to Python3 for the whole repo (#3431) * migrate to python3 * update README * update travis 10 January 2020, 17:25:13 UTC
485b708 Updated Helm to 3.0.2 (#3430) 10 January 2020, 14:28:50 UTC
e51f265 Updated to support Kubernetes 1.16 (#3426) * Updating to fix deprecated Kubernetes APIs * Removing the old controller logic * Formatting cleanup * Trying to use latest k8s java client * Updated to use the latest K8s client * Updated tools k8s limits * Fix for missing statefulset selector in Helm chart * Updated to K8s client 7.0.0 * Code cleanup * Updated gson and added gson-fire dependencies * Updates to better handle k8s resource delete 10 January 2020, 14:28:15 UTC
2f0c1db update readme (#3429) * update readme * fix typo 08 January 2020, 08:31:26 UTC
a745e3e Updates to make Zookeeper work (#3424) Netcat was not included in the centos image. Also the zookeeper scripts were not executable. 21 December 2019, 07:38:44 UTC
5cd8ff9 Update getting-started-local-single-node.md (#3425) Wget link for macos 20 December 2019, 20:55:08 UTC
cb8212f update bazel_config for Mac OS 10.14 (#3420) * update bazel_config for Mac OS 10.14 * revert libtool check 14 December 2019, 09:18:29 UTC
367b44a Removing old com.twitter namespace references (#3415) 14 December 2019, 09:17:26 UTC
73f2487 Joshfischer/site build mods (#3422) * moving .asf.yaml on each site build * correct folder path * add repo metadata configs to asf.yaml 14 December 2019, 09:16:49 UTC
a565a6b Updated compile docker images to include `tree` package (#3423) 14 December 2019, 09:16:02 UTC
7ef2e15 Fix Helm values.yml typo (#3421) The yaml was not valid because of a missing space. Helm install would fail without this fix. 14 December 2019, 09:15:14 UTC
869c82e make python code compatible with both python2 and python3 (#3412) * make code compatible with both python2 and 3 13 December 2019, 20:13:31 UTC
468aed1 Joshfischer/apache content (#3419) * adding apache content to footer * add version for 0.20.2-incubating * adding back branch whoami block 10 December 2019, 13:08:28 UTC
340e654 Update zk version to 3.4.14 in dist and install zk in ubuntu 16/18 di… (#3411) * Update zk version to 3.4.14 in dist and install zk in ubuntu 16/18 dist docker image * fix path * Add back docker ARG 10 December 2019, 07:55:38 UTC
dcd1b92 Joshfischer/finalize-ci-website (#3418) * adding asf.yaml * removing .htaccess during the CI site build * adding apache header * commenting out publish block for last test * ready to deploy for prod * removing incorrect rm command * clear all contents of content directory before republish * attemtpting to correct cp command * update asf yaml for prod * remove htaccess file * clean up. remove htaccess file 09 December 2019, 17:23:45 UTC
de8b554 joshfischer/asf site (#3414) * add asf site redirect * git-site-role commit from publish_site.sh * updating compile docker script to run as host user * attempting to add host user * adding host user to docker container * remove user flag * add user flag back. Update path * update path * correcting user gropus * modifying directory path of volume in container * correcting npm command * adding encoding flag to javadocs command * comment out javadocs script * attempting to list heronpy version * changing environment variable name for debugging jenkins * attempting to remove heron version from pip script * adding back javadocs to makefile. tweaking version matrix * flipping encoding flag * correct javadoc path * creating paths for java and py docs * pivoting to use gh token * removing duplicated htacess file 06 December 2019, 02:50:02 UTC
d8d811a Fix jQuery license and add missing license files (#3407) 30 November 2019, 07:55:19 UTC
06b5acc Update Kubernetes proxy URLs (#3405) 28 November 2019, 14:14:20 UTC
4bca2e5 BUG: bookie statefulset helm template specifies incorrect service name (#3410) * Update bookie template to use correct service name * helm add bookie toleration for unready endpoints 28 November 2019, 07:49:11 UTC
d8db1c5 Add parallelism calculator in Heron UI (#3401) 15 November 2019, 08:05:26 UTC
ae2d1f7 Make topology details section scrollable in Heron UI (#3400) 11 November 2019, 22:40:04 UTC
909c7a0 Support Catalina for Mac (#3398) 11 November 2019, 06:59:40 UTC
06a55e9 Re-organize UI elements in Heorn UI topology page (#3397) 10 November 2019, 03:36:14 UTC
bd06dc8 Update the instruction for using the docker based development environment (#3395) 08 November 2019, 02:07:43 UTC
1f5f23d Add tables for component running info (#3394) * Add tables for component running info * format capacity utilization 07 November 2019, 19:06:26 UTC
135fb76 Helm chart Bookkeeper fix (#3381) * Kubernetes Statefulset bug fix * Update bookie.yaml Updated to only use hostname with Statefulset 07 November 2019, 08:11:16 UTC
back to top