https://github.com/twitter/heron

sort by:
Revision Author Date Message Commit Date
6814e85 adding versioned docs for release candidate 30 November 2020, 04:25:12 UTC
a4140f2 Typo fix (#3637) 27 November 2020, 19:17:37 UTC
72d6374 Fix for large int that Helm was changing to scientific notation (#3635) 23 November 2020, 23:18:54 UTC
83b8226 Fixes to heron-ui arg name changes (#3634) 23 November 2020, 23:18:04 UTC
5bde52f correct reference to values in yaml file (#3632) 20 November 2020, 13:15:27 UTC
bbe2e89 Apache Rat additional excludes rules added (#3631) * adding website2 folder and travis toolchain bazel rule to .rat_excludes * adding missed directory for generated site docs 18 November 2020, 08:39:56 UTC
ce5a568 Upgrade to Bazel 3.7 (#3630) 16 November 2020, 16:43:54 UTC
790e62d Update travis-ci.com in README (#3629) 16 November 2020, 01:28:32 UTC
97a9168 Clean heron-ui backend (#3597) * Clean heron-ui backend * replace tornado server with FastAPI+Jinja2+Uvicorn * factor out torado from heron.tools.common * add type annotations * expose port 8889 of Vagrant VM for heron-ui * pin to latest 4.x version of Tornado * visual changes to container pages This should only be an internal refactor. Async querying of the tracker was dropped, but could be reintroduced using [aiohttp](https://docs.aiohttp.org/en/stable/) if speed becomes an issue for requests that aggregate tracker data. * Remove duplicate tracker process 11 November 2020, 07:14:04 UTC
f5a9abe Rename "topology master" to "topology manager" (#3624) 06 November 2020, 05:41:44 UTC
ec44c53 Use click instead of argparse in py instance (#3598) * Use click instead of argparse in py instance * Improve heron-python-instance option name consistency * Rename instance/st_heron_instance.py to instance.py to avoid [this kind of runtime warning](https://stackoverflow.com/questions/43393764/python-3-6-project-structure-leads-to-runtimewarning). 03 November 2020, 15:33:38 UTC
4847584 Purge heron-admin (#3585) * remove heron-admin binary from release * remove nomad binary from release * remove "standalone" cluster config from release and documentation 03 November 2020, 15:12:20 UTC
cadf985 Updating to Bazel 3.5.0 (#3627) 03 November 2020, 05:35:04 UTC
ec2cff2 Added more Helm chart Bookkeeper config items (#3628) 03 November 2020, 05:32:39 UTC
3be9f06 clean up site docs (#3626) * clean up * Update website2/docs/topology-development-streamlet-api.md Co-authored-by: Oliver Bristow <evilumbrella+github@gmail.com> * clean up duplicates * clean up * last version clean up * commit before reset * adding version to link Co-authored-by: Oliver Bristow <evilumbrella+github@gmail.com> 31 October 2020, 14:29:39 UTC
64e8167 Clean tracker top level code (#3602) * Allow arbitrary whitespace in queries * DRY up Multiply/Divide/Subtract * use snake_case * code simplification 31 October 2020, 00:39:27 UTC
aa292ef Adding python3-venv to Debian image (#3625) 30 October 2020, 18:57:51 UTC
98ada0f Use click instead of argparse in tracker (#3599) 30 October 2020, 18:56:26 UTC
612de8d Updated Kryo to 5.0.0 (#3621) 19 October 2020, 01:08:13 UTC
90d8a61 Fix documentation CI build process (#3620) Co-authored-by: Huijun Wu <huijunw@twitter.com> 16 October 2020, 06:59:35 UTC
fe1c199 Added ability to disable base_url in Helm chart (#3619) 23 September 2020, 22:55:24 UTC
a3cda19 Stop using "cluster admin" role and restrict to k8s namespace (#3618) 21 September 2020, 04:00:55 UTC
c6f634b Adding missing ENV variables for Centos 7 image (#3617) 14 September 2020, 21:14:44 UTC
b400818 Fixing typo in Helm chart template 12 September 2020, 07:25:48 UTC
11d6332 Fix Helm chart to support clustered Zookeepers (#3611) 08 September 2020, 02:49:57 UTC
f3ba285 Updating Kryo to 5.0.0-RC9 (#3593) 24 August 2020, 19:20:25 UTC
96dda44 Dockerfiles Python 3 cleanup (#3601) 21 August 2020, 21:21:17 UTC
35ec34b Updated to fix Kubernetes scale issue (#3607) 21 August 2020, 19:14:51 UTC
ee73293 Unvendor (#3603) * Unvendor kashmir * Unvendor cpplint * Fix cpplint issues 14 August 2020, 19:03:37 UTC
c3b6433 Adding Bazel version check (#3605) 14 August 2020, 17:45:01 UTC
1f79018 Deep clean heron-explorer (#3588) * Deep clean heron-explorer * use click instead of argparse pattern * list all topologies instead of just 20 * not strictly the same CLI argument names but same functionality * add smoke testes for heron-tracker and heron-explorer in local-test-runner * heron-explorer clean PR feedback 10 August 2020, 21:22:31 UTC
9d4541b Switch to pigz to support multi-core tar command (#3595) * Update build-artifacts.sh * Update build-exec-docker.sh * Update build-docker.sh 31 July 2020, 03:59:54 UTC
3d210cc Updating docker build to fix Python Click library issue (#3596) 31 July 2020, 03:59:06 UTC
ac82daf Changing JRE to JDK (#3592) 29 July 2020, 13:30:06 UTC
607560d Remove unused heron.tools.common.src.python.utils.heronparser (#3591) 29 July 2020, 13:29:37 UTC
f764d9a Reordering the init containers in the Helm chart (#3589) 29 July 2020, 05:55:12 UTC
0c858ca Fix licenses in 2020/7/20 master (#3590) 28 July 2020, 05:44:42 UTC
39cf3a7 Correct heron-executor CLI usage (#3587) 27 July 2020, 13:55:34 UTC
0c9b209 Fix log-reader for Python3 (#3580) * Fix log-reader for Python3 Signed-off-by: thinker0 <thinker0@linecorp.com> * typo Signed-off-by: thinker0 <thinker0@linecorp.com> * Revert commit Co-authored-by: thinker0 <thinker0@linecorp.com> 26 July 2020, 07:45:42 UTC
d9c06bd Replace graph code in tracker (#3579) 26 July 2020, 04:25:17 UTC
8f78034 Support lifecycle for aurora (#3581) Co-authored-by: thinker0 <thinker0@linecorp.com> 26 July 2020, 04:24:57 UTC
f35ba15 Upgrade to Bazel 3.4.1 (#3576) * Upgrade to Bazel 3.4.1 * Fixing ArrayToString error see https://errorprone.info/bugpattern/ArrayToString * Updating Docker rules and Pkg rules * Updating `rules_python` 23 July 2020, 16:44:22 UTC
82ee354 Unvendor pyobj + fix py2->py3 compatability fixes. (#3574) This also uses the longer DataWatcher handler signature to avoid a TypeError, which it relies on to indicate it should retry with the shorter signature. Without this change, exceptions can be reported messily due to a raise in the except path being reasonably expected. 22 July 2020, 11:03:46 UTC
42b87fe Update website URL in README (#3578) 21 July 2020, 13:57:49 UTC
1c7fd11 Unvendor cloudpickle (#3568) 20 July 2020, 19:26:06 UTC
a5459f1 allfix (#3577) Signed-off-by: Huijun Wu <huijunw@twitter.com> Co-authored-by: Huijun Wu <huijunw@twitter.com> 20 July 2020, 05:16:45 UTC
cd42fa8 Strip old python requirements (#3569) * Remove enum34+future+argparse * Remove six * DRY up zkstatemanager.py * Remove pycrypto * Remove external dependancies for unittest2+mock+py 20 July 2020, 03:21:26 UTC
8a825e4 Updated Bookkeeper to 4.11.0 (#3571) 20 July 2020, 00:03:13 UTC
c419bc0 Add Ant dependency to Vagrant machine (#3573) 19 July 2020, 19:22:49 UTC
fd0ec5f Fix Jenkins Doc generation (#3572) * fix doc CI * update py3 * update pip3 Co-authored-by: Huijun Wu <huijunw@twitter.com> 18 July 2020, 16:19:02 UTC
14bc58b fix jenkins debian10 (#3570) * fixci * useopenjdk * order * updatedebian9 Co-authored-by: Huijun Wu <huijunw@twitter.com> 18 July 2020, 10:17:33 UTC
e1dda9a Updates to Kubernetes scheduler to fix dockerenv issue (#3550) * Updates to Kubernetes scheduler to create Headless service * Use FQDN instead of hostname when running in Kubernetes environment 14 July 2020, 17:02:36 UTC
eb5090b update storm 2.2.0 ISpout open() (#3567) * updateispout * fix-style * minchange * updateibolt Co-authored-by: Huijun Wu <huijunw@twitter.com> 12 July 2020, 08:33:01 UTC
9e0c782 mkdir for storm api 2.2.0 (#3566) * mkdirstormapi2 * fixjavalicenseheader * fixstyle Co-authored-by: Huijun Wu <huijunw@twitter.com> 11 July 2020, 23:39:59 UTC
b760eab fixtoolchain (#3563) 11 July 2020, 20:23:49 UTC
1c62485 Make the integration test script executable. (#3565) 10 July 2020, 21:38:33 UTC
278c05a zookeeper to 3.5.8 (#3555) * Upgrade zookeeper3.5.8 Co-authored-by: Huijun Wu <huijunw@twitter.com> Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> 10 July 2020, 21:11:09 UTC
4f7f90f Python 3 upgrade (#3522) * Initial Python 3 upgrade effort * Fixes towards python3 support * update heronpy release scripts for python3 * update dist Dockerfiles to only use python3 * remove python2 from docker images * upgrade pylint for python3 support * upgrade PEX so transative dependencies are captured Additionally: * fix Ubuntu 16.04 images * fix linting issues found by newer pylint There is an issue with encapsulation in the builds where the global python3 environment is used while PEX installs a nested transitive dependency of pylint: `pylint>astroid>wrapt`. This seems to be because of logic in its setup.py which can be disabled with `WRAPT_INSTALL_EXTENSIONS=false` * Fix new pylint issues * update setuptools * Make pex_pytest non-zip-safe * Rough proto_library fix The issue encountered was https://github.com/protocolbuffers/protobuf/issues/1491 which may be fixed by a pending PR to protoc, or with a switch to the official protobuf rules and the import_prefix parameter to proto_library. * WIP: Fix python3 incompatibilities * bytes vs str issues * update kazoo * order of processes in executor test changed due to dict ordering? * some places needed / switched to // - may be more not caught by tests * add travis_wait as some stages going over 10 minutes without output in CI TODO: * make sure the kazoo upgrade is correct, it was done only by updating package versoin * Try fixing build time issue in travis * Upgrade docker rules * Upgrade to python3 in CI * Fix python integration tests * Fix more bytes vs str errors + update vagrant * Update Travis to Python3.7 + fix Vagrant on mac * Reduce requirement to python3.6 + py3 fixes * use universal_newline in popen instead of text in Popen for py3.6 * fix bytes/str issues in deserialisation * fix file open modes * use set instead of sets.Set * fix __import__(level) default * Update cloudpickle * Fix python addressing of release.yaml * Additions to get docker image builds working and tested * use new external pkg_* rules * add python to compile docker images until pkg_* * add --host_force_python=PY3 to other bazel.rc files * WIP: Add CI for docker images/releases * use kind to create ephemeral clusters * start consolidating scripts with python * Fix helm chart * bytes vs str fix * Mention Python 3.6 requirement in README.md * updatedockerfile Co-authored-by: Neng Lu <nlu@twitter.com> Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> Co-authored-by: bed debug <huijunwu@users.noreply.github.com> Co-authored-by: huijunwu <huijun.wu.2010@gmail.com> 07 July 2020, 00:24:27 UTC
7544160 Adding missing baseUrl (#3553) 03 July 2020, 12:37:11 UTC
897df21 Revert "upgradezookeeper3.5.8" This reverts commit 00e4e81d77153ac4017967e78c59a3b9b72e5609. 03 July 2020, 02:11:21 UTC
00e4e81 upgradezookeeper3.5.8 03 July 2020, 02:01:31 UTC
5084318 Fixing RVO optimization (#3549) 02 July 2020, 00:53:30 UTC
fb970eb Distribution Dockerfile missing ncat and other cleanup (#3552) * Distribution Dockerfile cleanup 01 July 2020, 06:45:46 UTC
cc815d8 Updated to make site look better on mobile (#3547) 25 June 2020, 14:15:34 UTC
e461308 HeronPy: Add missing TOPOLOGY_CONTAINER_MAX_RAM_HINT (#3544) TOPOLOGY_CONTAINER_MAX_RAM_HINT should be there for FirstFitDecreasingPacking 25 June 2020, 06:05:24 UTC
8057559 Updated Docusaurus config to fix Javadocs CSS bug (#3546) * Updated Docusaurus config to ignore Javadocs CSS * Refactored and updated gitignore rules * Website build script cleanup 25 June 2020, 02:23:51 UTC
9377b10 Embedded Trykker font (#3541) 18 June 2020, 11:53:48 UTC
c666100 adjusting packages for javadocs (#3537) 10 June 2020, 10:21:19 UTC
d03c112 fixing javadocs (#3536) * fixing javadocs * Adding back Pulsar Streamlet example * Excluding examples folder from javadocs * clean up Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> 07 June 2020, 12:56:36 UTC
4308eaf Fix use of non-default base url value (#3535) 03 June 2020, 01:33:28 UTC
270f77e Fix service url in Helm chart (#3534) The template string in the values.yaml wasn't rendered, so this patch renders the default value in the template 02 June 2020, 01:55:02 UTC
b16853b correcting heron urls (#3532) * correcting heron urls * clean up 31 May 2020, 16:34:50 UTC
a7291ce get javadocs generation script passing (#3533) * add ./contrib/**/*.jar files to classpath * exclude ./tools/**/*.java from input (e.g. cppcheck+checkstyle) 31 May 2020, 16:34:18 UTC
a651e90 Build python package in virtualenv (#3529) 30 May 2020, 00:29:38 UTC
59a3c4a adding nostyle (#3527) 29 May 2020, 20:04:07 UTC
e06dc8f Workaround trailing slashes on website (#3531) This is as the website deployment 301s to add trailing slashes, and Docusurus does not yet support that. Without one of the two yielding, this workaround strips the trailing slash so the hrefs made still work. Solution pinched from docusurus issue: https://github.com/facebook/docusaurus/issues/2394 29 May 2020, 03:49:56 UTC
c713f43 Fix ubunt14.04 docker file (#3526) 26 May 2020, 18:09:12 UTC
89a1e50 Update osx documentation (3453) (#3530) As specified here: https://github.com/apache/incubator-heron/issues/3452#issuecomment-625435818, heron now requires bazel version 3.0.0 26 May 2020, 16:17:11 UTC
d05f6e9 Fix Heron Shell PID Extractor (#3528) * Fix Heron Shell PID Extractor * read pid file 19 May 2020, 03:30:05 UTC
07b5d8c Fix ubuntu16.04 docker file (#3525) * fix ubuntu 16.04 docker file * Fix ubuntu docker file 17 May 2020, 17:24:07 UTC
e0bb08a Set Java SupportedSourceVersion to 11 (#3524) 14 May 2020, 04:34:56 UTC
e065171 Fix centos7 docker build (#3523) 10 May 2020, 01:17:44 UTC
a295942 Pin http_file and http_archive resources in WORKSPACE (#3520) 01 May 2020, 23:45:10 UTC
cf08e71 Make Java optional in CLI and check JAVA_BIN (#3521) 01 May 2020, 23:44:11 UTC
c7a5ab4 Adding Ubuntu 20.04 Dockerfiles (#3519) 30 April 2020, 23:27:01 UTC
7bfa0c7 Fix debian9 docker file and clean up centos8 and ubuntu18.04 (#3518) 23 April 2020, 16:23:21 UTC
ec7a87a Update issue templates (#3379) * Update issue templates * Update bug_report.md Co-authored-by: Josh Fischer <josh@joshfischer.io> 22 April 2020, 02:48:24 UTC
78d7145 Adding missing pkg-config package to Debian 9 build (#3517) 21 April 2020, 09:18:33 UTC
923b8b9 Add cppunit-devel for Bazel 3 (#3513) * Add cppunit-devel for centos Dockerfile * Add cppunit-devel for Dockerfile 19 April 2020, 16:58:35 UTC
2a4f112 Upgrading Bazel to 3.0.0 (#3510) * Bazel 3.0.0 * Updated to use `rules_jvm_external` * Buildozer cleanup 16 April 2020, 05:18:53 UTC
32d3051 Joshfischer/update site build (#3509) * remove user params * adjust user settings * adjust user settings * adjust path * clean up whitespace 13 April 2020, 21:35:47 UTC
c024da2 Fix snake yaml that caused unit test failures (#3506) Fix snakeyaml caused unit test failures 09 April 2020, 15:47:12 UTC
f90784a remove gitmodule file (#3508) 09 April 2020, 14:11:52 UTC
ed6fd81 Add an example with Streamlet API using component config (#3496) An example Streamlet topology demonstrating how to set cpu and memory limits per component. 08 April 2020, 20:16:01 UTC
0f27ef4 Fix style 07 April 2020, 06:53:59 UTC
9d77767 Use safe constructor in yaml deserialization 06 April 2020, 09:25:33 UTC
b069e45 Support custom metrics rules for PrometheusSink (#3493) * Support Java 11 * config travis to use oracle jdk 11 * Java 11 support (#3399) * Support Java 11 * config travis to use oracle jdk 11 * Add check jdk version * Fix command arguments. Change insert gc_options Update list Fix gc-logging * Add missing parameter * typo * Add pause time * wip * Support jmx_exporter format configuration. * Fix checkstyle * Remove unused * Java 11 support (#3399) * Support Java 11 * config travis to use oracle jdk 11 * Add check jdk version * Fix command arguments. Change insert gc_options Update list Fix gc-logging * wip * Support jmx_exporter format configuration. * Fix checkstyle * Remove unused * Update kafkaOffset metrics * Add Rules * Make log/sink/consume Streamlet component support setName and setNumPartitions (#3459) * Patch to fix cppcheck with newer glibc (#3471) * Add documents for setting up a docker based development environment (#3475) * Improve concurrency for needed parts. (#3107) * Change concurrent Map * Change concurrent Map * HashMap changes for unneeded parts. * HashMap changes for unneeded parts. * Review changes * Changes HashMap for unneeded parts. * Improve concurrency for needed parts. * Remove unused imports. * Remove unused imports. * Remove unused imports. * Fix NPE (cherry picked from commit 545d3814b315c29d3e396309a2ededaad193ec32) * Fix WhitespaceAround * Add dummy Object * Fix ConstantName (cherry picked from commit 8d6d5067072e92d6e276f93e18297ddedc647c6c) * Update kafkaOffset metrics * Add Rules * Update line is longer than 100 characters * Update line is longer than 100 characters * Add attrNameSnakeCase or other metrics fix * fix checkstyle Co-authored-by: Ning Wang <wangninggm@gmail.com> Co-authored-by: Ning Wang <nwang@twitter.com> Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> 02 April 2020, 05:14:28 UTC
a6a4bf8 Travis CI update to Ubuntu 18.04 (#3497) Updated Travic CI to use Ubuntu Bionic 18.04 02 April 2020, 00:01:05 UTC
d2c5303 Fix copy Maven artifacts permission error (#3503) 31 March 2020, 04:50:25 UTC
c3d29a4 rolling back docusaurus version (#3501) 28 March 2020, 10:21:29 UTC
back to top