| 3ed8de9 | Saad Ur Rahman | 15 May 2022, 15:48:51 UTC | Merge branch 'master' into saadurrahman/native-python-rules-phase1 | 15 May 2022, 15:48:51 UTC |
| 8d38e0e | choi se | 15 May 2022, 04:45:56 UTC | Update rules-scala of Scala (#3832) | 15 May 2022, 04:45:56 UTC |
| dc2d9f6 | Saad Ur Rahman | 07 May 2022, 15:30:27 UTC | [3821] Remove deprecated Host Path, NFS, and EBS support for Kubernetes (#3825) * Removed deprecated loading of EBS, NFS, and Host Path via topology configurations for Kubernetes. * Refactored creation of NFS, Host Path, Empty Directory, and Persistent Volume Claims (templates and volumes) for Kubernetes to a hybrid-factory pattern for volume generation. | 07 May 2022, 15:30:27 UTC |
| c18ff1b | Nicholas Nezis | 05 May 2022, 01:06:11 UTC | Update Debian Docker images from 10 to 11 (#3828) * Updated Debian 10 to 11 due to Python 3.8 dependency | 05 May 2022, 01:06:11 UTC |
| 820679c | Nicholas Nezis | 04 May 2022, 02:33:35 UTC | Added License file to published Jars (#3827) * Added disclaimers filegroup as jar resource * Updated shade rules based on namespaces found in built jar | 04 May 2022, 02:33:35 UTC |
| c12b3c6 | Josh Fischer | 02 May 2022, 06:32:29 UTC | Publish unshaded Maven artifacts with dependencies (#3778) Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> | 02 May 2022, 06:32:29 UTC |
| 5fac487 | Nicholas Nezis | 01 May 2022, 14:06:06 UTC | Upgrade Kryo to 5.3.0 (#3824) | 01 May 2022, 14:06:06 UTC |
| b53b7fa | Nicholas Nezis | 30 April 2022, 13:02:56 UTC | Updated Netty to 4.1.76.Final (#3823) | 30 April 2022, 13:02:56 UTC |
| 6de4202 | dependabot[bot] | 29 April 2022, 18:29:27 UTC | Bump async from 2.6.3 to 2.6.4 in /website2/website (#3822) Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4. - [Release notes](https://github.com/caolan/async/releases) - [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md) - [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4) --- updated-dependencies: - dependency-name: async dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> | 29 April 2022, 18:29:27 UTC |
| 3fdf1f8 | choi se | 27 April 2022, 18:25:47 UTC | Fix HealthManager (#3819) Bug fixes in the HealthManager endpoint. | 27 April 2022, 18:25:47 UTC |
| 7db7c24 | choi se | 14 April 2022, 19:44:58 UTC | Support legacy API of HealthManger (#3818) Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> | 14 April 2022, 19:44:58 UTC |
| fd6a5fa | dependabot[bot] | 13 April 2022, 22:37:03 UTC | Bump prismjs from 1.19.0 to 1.27.0 in /website2/website (#3815) Bumps [prismjs](https://github.com/PrismJS/prism) from 1.19.0 to 1.27.0. - [Release notes](https://github.com/PrismJS/prism/releases) - [Changelog](https://github.com/PrismJS/prism/blob/master/CHANGELOG.md) - [Commits](https://github.com/PrismJS/prism/compare/v1.19.0...v1.27.0) --- updated-dependencies: - dependency-name: prismjs dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> | 13 April 2022, 22:37:03 UTC |
| f07203a | choi se | 12 April 2022, 13:43:59 UTC | Remove ByteSize for protobuf (#3816) Updates to remove warning: 'ByteSize' is deprecated. | 12 April 2022, 13:43:59 UTC |
| 909f60a | dependabot[bot] | 12 April 2022, 00:28:28 UTC | Bump url-parse from 1.4.7 to 1.5.10 in /website2/website (#3813) Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.4.7 to 1.5.10. - [Release notes](https://github.com/unshiftio/url-parse/releases) - [Commits](https://github.com/unshiftio/url-parse/compare/1.4.7...1.5.10) --- updated-dependencies: - dependency-name: url-parse dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> | 12 April 2022, 00:28:28 UTC |
| 700125f | Nicholas Nezis | 12 April 2022, 00:26:51 UTC | Updates to Heron UI and Tracker code to work with Python 3 updates (#3786) * Fix for missing physical plan in UI * Fix the Heron UI timeline metrics * Removed Tracker EnvelopeAPI Router which was not working * Updated AckingTopology to not burn so much CPU * Updated pylint due to build issue which resulted in lots of format updates Co-authored-by: choi se <thinker0@gmail.com> Co-authored-by: choi se <357785+thinker0@users.noreply.github.com> Co-authored-by: Saad Ur Rahman <surahman@users.noreply.github.com> Co-authored-by: Saad Ur Rahman <saadurrahman@apache.org> | 12 April 2022, 00:26:51 UTC |
| ae4099f | dependabot[bot] | 11 April 2022, 03:07:03 UTC | Bump lodash from 4.17.15 to 4.17.21 in /website2/website (#3812) Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.21. - [Release notes](https://github.com/lodash/lodash/releases) - [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.21) --- updated-dependencies: - dependency-name: lodash dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> | 11 April 2022, 03:07:03 UTC |
| 547b7d9 | Billy Romansky | 11 April 2022, 01:09:47 UTC | Replace Helm chart's generic Bookkeeper platform property with specific properties (#3798) | 11 April 2022, 01:09:47 UTC |
| f353404 | dependabot[bot] | 11 April 2022, 01:05:19 UTC | Bump minimist from 1.2.5 to 1.2.6 in /website2/website (#3811) Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6. - [Release notes](https://github.com/substack/minimist/releases) - [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6) --- updated-dependencies: - dependency-name: minimist dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> | 11 April 2022, 01:05:19 UTC |
| 06e9f75 | choi se | 06 April 2022, 03:38:34 UTC | Add SLF4JBridgeHandler (#3809) | 06 April 2022, 03:38:34 UTC |
| b7d92a9 | choi se | 02 April 2022, 04:15:55 UTC | Add logback.xml (#3807) | 02 April 2022, 04:15:55 UTC |
| bfdccb3 | Nicholas Nezis | 29 March 2022, 02:27:19 UTC | Updated Bazel rules_pkg build dependency to 0.6.0 (#3806) | 29 March 2022, 02:27:19 UTC |
| af7053e | Nicholas Nezis | 26 March 2022, 19:20:21 UTC | Update cppcheck to 2.7 (#3804) | 26 March 2022, 19:20:21 UTC |
| a68931e | Nicholas Nezis | 26 March 2022, 19:13:38 UTC | Updated to fix MacOS cppcheck RuntimeError (#3803) | 26 March 2022, 19:13:38 UTC |
| 7ee6160 | Nicholas Nezis | 26 March 2022, 19:12:30 UTC | Removing prevously missed refs to removed files (#3805) | 26 March 2022, 19:12:30 UTC |
| 8841d1c | Nicholas Nezis | 25 March 2022, 20:55:40 UTC | Added Bazel Platform auto discovery (and lots of other related cleanup) (#3779) * Added Bazel platforms dependency * Updated BUILD files to use platform info * Updates to remove platform setting in the scripts * Removing TravisCI special config. * Remove outdated Applatix CI scripts * Remove outdated Docker bazel.rc * Removed Mesos/Marathon from Vagrantfile init.sh * travis build.sh cleanup * Some Dockerfile cleanup * Removing OS detect script * Remove referenced to deleted bazelrc from the various Dockerfiles * Added comment to give hint about need to upgrade Docker version for anyone trying to build Ubuntu 22.04 image * Create Dockerfile.dist.ubuntu22.04 (#3800) Co-authored-by: Windham Wong <windhamwong@nva-hk.com> Co-authored-by: Saad Ur Rahman <surahman@users.noreply.github.com> | 25 March 2022, 20:55:40 UTC |
| bcaa38d | choi se | 25 March 2022, 17:42:11 UTC | Upgrade protobuf to 3.16.1 CVE-2021-22569 (#3797) * Upgrade protobuf to 3.16.1 to address CVE-2021-22569 - protobuf < 3.16.1 contains DoS vulnerability CVE-2021-22569, https://nvd.nist.gov/vuln/detail/CVE-2021-22569. * Fix include (cherry picked from commit 52ed112dc14bc831afe25c1e3a66a96d9d4e7f06) * Update protobuf-3.16.0 of Python Update protobuf-java-3.16.1 of Java * typo conflit | 25 March 2022, 17:42:11 UTC |
| 3bca1c0 | Windham Wong | 25 March 2022, 15:54:30 UTC | Update build-docker.sh (#3799) Removing the debug message on build-docker.sh | 25 March 2022, 15:54:30 UTC |
| 9cfc5c4 | choi se | 24 March 2022, 05:33:32 UTC | Update to Guice 5.1.0 to support JDK17 (#3792) | 24 March 2022, 05:33:32 UTC |
| b12a396 | choi se | 21 March 2022, 07:00:22 UTC | Remove fixed young generation heap space of instance (#3789) | 21 March 2022, 07:00:22 UTC |
| da52c12 | choi se | 21 March 2022, 06:17:11 UTC | Change Log4J to SLF4J for Java Logging (#3791) | 21 March 2022, 06:17:11 UTC |
| ef20cf5 | Nicholas Nezis | 19 March 2022, 23:49:21 UTC | Remove unnecessary Bookkeeper format init container from Helm chart (#3795) Co-authored-by: Billy Romansky <wromansky@protonmail.com> | 19 March 2022, 23:49:21 UTC |
| a06dcd4 | choi se | 18 March 2022, 15:37:50 UTC | Remove use of unsecure git protocol in build dependency (#3794) | 18 March 2022, 15:37:50 UTC |
| 4f27c18 | choi se | 06 March 2022, 14:01:30 UTC | Fix conflict in Rocky 8 Dockerfile (#3787) | 06 March 2022, 14:01:30 UTC |
| eacedb5 | choi se | 06 March 2022, 04:32:02 UTC | Add Rocky 8 container option (#3773) Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> | 06 March 2022, 04:32:02 UTC |
| b7f6f3c | choi se | 05 March 2022, 18:22:35 UTC | Add back legacy CentOS 7 with newer gcc and Python (#3772) | 05 March 2022, 18:22:35 UTC |
| 2baa27c | Nicholas Nezis | 02 March 2022, 04:32:06 UTC | Removing old Tornado asynchronous annotations from Heron shell (#3781) | 02 March 2022, 04:32:06 UTC |
| 1a54477 | Nicholas Nezis | 28 February 2022, 08:45:09 UTC | Added missing packing plan handler in heron-tracker (#3783) | 28 February 2022, 08:45:09 UTC |
| ebd7cea | Nicholas Nezis | 26 February 2022, 19:54:11 UTC | Update to fix Heron UI Jinja2 issue (#3777) | 26 February 2022, 19:54:11 UTC |
| 485ac31 | Nicholas Nezis | 26 February 2022, 07:20:51 UTC | Fixing a type which broke the helm chart (#3775) | 26 February 2022, 07:20:51 UTC |
| f9a5f18 | Saad Ur Rahman | 28 January 2022, 23:57:34 UTC | [Build] Workspace rules for protobuf Added rules for native Bazel protobuf Java and CC as well as for Python. - Java and CC: https://github.com/bazelbuild/rules_proto - Python: https://thethoughtfulkoala.com/posts/2020/05/08/py-protobuf-bazel.html | 28 January 2022, 23:57:34 UTC |
| 278c9cb | Saad Ur Rahman | 28 January 2022, 22:50:27 UTC | [Build] heron/common/tests/python/pex_loader/testdata/src/BUILD Updated. No Python requirements. | 28 January 2022, 22:50:27 UTC |
| 3cec822 | Saad Ur Rahman | 28 January 2022, 21:54:17 UTC | [Build] examples/src/python/BUILD Updated. No Python requirements. | 28 January 2022, 21:54:17 UTC |
| 818ce32 | Saad Ur Rahman | 28 January 2022, 21:40:05 UTC | [Build] Workspace cleanup Removed redundant <py_repositories>. Build passing locally. | 28 January 2022, 21:40:05 UTC |
| 132b292 | Saad Ur Rahman | 28 January 2022, 17:53:33 UTC | [Build] removed <newgenproto.bzl> There are no references to this file in any of the build scripts. A full build with the complete test battery, without this file, yielded no issues. | 28 January 2022, 19:39:50 UTC |
| 6ed1539 | Saad Ur Rahman | 28 January 2022, 19:39:17 UTC | [Build] Workspace Added pip_install entry. | 28 January 2022, 19:39:50 UTC |
| abb2767 | Oliver Bristow | 25 January 2022, 16:37:11 UTC | Upgrade Python to 3.8 as a minimum. Also simplified Tracker implementation. (#3646) Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> Co-authored-by: Saad Ur Rahman <saadurrahman@apache.org> Co-authored-by: Nicholas Nezis nanezis <nanezis@ip-10-113-78-208.evoforge.org> | 25 January 2022, 16:37:11 UTC |
| 638cff1 | Nicholas Nezis | 24 January 2022, 19:25:58 UTC | Fixed a segfault issue on macOS. Deleting item invalidated the iterator. (#3767) | 24 January 2022, 19:25:58 UTC |
| b970b65 | Nicholas Nezis | 24 January 2022, 13:18:27 UTC | Updated to Google Test 1.11.0 which now directly supports Bazel (#3765) | 24 January 2022, 13:18:27 UTC |
| 8dee12c | Nicholas Nezis | 24 January 2022, 13:17:21 UTC | Upgrade to Bazel 4.2.2 (#3764) | 24 January 2022, 13:17:21 UTC |
| 0c42102 | Saad Ur Rahman | 23 January 2022, 16:46:30 UTC | Ubuntu 22.04 Support (#3761) - Added a Ubuntu 22.04 Docker Container. - Update to support compiling and linking of <libunwind 1.5.0> with the C++14 standard. g++ seems to be defaulting to C++17 which is not compatible with <libunwind 1.5.0>'s dynamic exception specifications. | 23 January 2022, 16:46:30 UTC |
| 41d9dab | Saad Ur Rahman | 21 January 2022, 23:24:37 UTC | libunwind 1.5.0 Upgrade (#3760) This library is used by C++ components to maintain a call history. Upgrading to newer Linux kernels necessitates this update. | 21 January 2022, 23:24:37 UTC |
| ee369ef | Nicholas Nezis | 18 January 2022, 02:56:44 UTC | HeronPy 0.20.5 release prep cleanup (#3759) | 18 January 2022, 02:56:44 UTC |
| 482f14f | Nicholas Nezis | 17 January 2022, 16:50:38 UTC | Helm chart cleanup (#3758) * Upgrade to Helm 3.7.2 * Add disclaimer files * Updated Chart.yaml to v2 apiVersion (Helm 3) | 17 January 2022, 16:50:38 UTC |
| 1cb0d9d | Nicholas Nezis | 05 January 2022, 04:38:05 UTC | Updated Dhalion to 0.2.6 (#3757) | 05 January 2022, 04:38:05 UTC |
| bbf8167 | Nicholas Nezis | 04 January 2022, 22:38:51 UTC | Updated Netty to 4.1.72 (#3755) | 04 January 2022, 22:38:51 UTC |
| 2f94032 | Nicholas Nezis | 04 January 2022, 21:35:45 UTC | Updated Kubernetes client library to 14.0.0 (#3754) * Updated Kubernetes client library to 14.0.0 * Removed explicit dependency on `snakeyml`. Instead the proper version will be calculated as a transitive dependency. | 04 January 2022, 21:35:45 UTC |
| bc61f7d | Nicholas Nezis | 04 January 2022, 18:13:17 UTC | Updated External JVM Rules plugin to 4.2 (#3753) | 04 January 2022, 18:13:17 UTC |
| f96cc7b | Nicholas Nezis | 04 January 2022, 13:46:32 UTC | Added Docker to Vagrant VM init script (#3756) * Added docker to the Vagrant VM init script * Updated the subnet to match the Vagrant allowed range | 04 January 2022, 13:46:32 UTC |
| fab089c | Saad Ur Rahman | 03 January 2022, 15:11:51 UTC | Added missing Javadocs to Kubernetes V1Controller (#3752) | 03 January 2022, 15:11:51 UTC |
| fd30626 | Saad Ur Rahman | 19 December 2021, 06:03:32 UTC | [Heron-3723] Add Kubernetes support for Empty Dir, Host Path, and NFS via CLI (#3747) Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> | 19 December 2021, 06:03:32 UTC |
| 48911ae | Nicholas Nezis | 19 December 2021, 05:54:36 UTC | Updated to fix missing anticrlf dependency in Heron shell process. (#3749) | 19 December 2021, 05:54:36 UTC |
| f573455 | Josh Fischer | 15 December 2021, 17:23:28 UTC | adding Saad (#3748) | 15 December 2021, 17:23:28 UTC |
| 2d4963a | choi se | 10 December 2021, 11:05:01 UTC | Fix dependency (#3746) | 10 December 2021, 11:05:01 UTC |
| b501496 | Windham Wong | 06 December 2021, 05:37:25 UTC | Bump kazoo library from 2.7.0 to 2.8.0 to fix a compatibility issue of Python 3.8 (#3743) | 06 December 2021, 05:37:25 UTC |
| c6631cc | Saad Ur Rahman | 05 December 2021, 17:10:39 UTC | [Heron-3724] Separate the Manager and Executors. (#3741) All of the changes below are pertaining to the Kubernetes Scheduler. * Topology's Executors and Manager separated into individual StatefulSets. * Added the ability to specify individual Pod Templates for a topology's Executors and Manager via the CLI. * Added the ability to specify Persistent Volume Claims for a topology's Executors and Manager via the CLI. * Added the ability to specify resource Requests and Limits for a topology's Executors and Manager via the CLI. | 05 December 2021, 17:10:39 UTC |
| 5a1b981 | Saad Ur Rahman | 30 November 2021, 05:20:34 UTC | [Heron-3723] Add support for Persistent Volumes for stateful storage (#3725) Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> Co-authored-by: Josh Fischer <josh@joshfischer.io> Co-authored-by: zhangshaoning <32099766+zhangshaoning1@users.noreply.github.com> Co-authored-by: Huijun Wu <huijunwu@users.noreply.github.com> Co-authored-by: Huijun Wu <huijunw@twitter.com> | 30 November 2021, 05:20:34 UTC |
| 382fd15 | Saad Ur Rahman | 20 November 2021, 02:25:02 UTC | Added ability to restart a topology on Kubernetes (#3740) | 20 November 2021, 02:25:02 UTC |
| 6b883be | Huijun Wu | 17 November 2021, 05:56:51 UTC | Protect from arbitrary json file reading and writing in integration_test http_server (#3739) | 17 November 2021, 05:56:51 UTC |
| b295bf5 | Saad Ur Rahman | 15 November 2021, 06:37:45 UTC | Fixed CI Pipeline Failures Involving the <stmgr_unittest> (#3735) | 15 November 2021, 06:37:45 UTC |
| 5038eba | Nicholas Nezis | 13 November 2021, 16:59:24 UTC | Bump Netty to 4.1.70 (#3729) | 13 November 2021, 16:59:24 UTC |
| ddbd253 | Nicholas Nezis | 13 November 2021, 16:58:57 UTC | Updated deprecated policy/v1beta1 to policy/v1 PodDisruptionBudget API (#3737) | 13 November 2021, 16:58:57 UTC |
| a3d28a3 | choi se | 13 November 2021, 03:52:13 UTC | Fix get_heron_tracker_dir (#3734) | 13 November 2021, 03:52:13 UTC |
| c32c09a | choi se | 12 November 2021, 19:45:50 UTC | Fix `get_heron_dir` which is causing Python processes to fail (#3731) | 12 November 2021, 19:45:50 UTC |
| 4f588cf | Windham Wong | 11 November 2021, 04:28:52 UTC | Helm: Adding option to switch the Kubernetes services between NodePort and ClusterIP (#3721) * Adding option to switch the apiserver service between NodePort and ClusterIP * Now support custom NodePort port number * Better value.yaml settings for nodeport config * Some cleanup and allows K8s to auto-pick nodeport * Fixing typo Co-authored-by: Windham Wong <windham.wong@stormeye.io> Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> | 11 November 2021, 04:28:52 UTC |
| 813e9d0 | choi se | 11 November 2021, 04:13:07 UTC | Update pip-2020-resolver of PexBuilder to fix darwin building (#3727) | 11 November 2021, 04:13:07 UTC |
| ff7093f | choi se | 08 November 2021, 23:46:22 UTC | Updated glog and gflags libraries (#3728) | 08 November 2021, 23:46:22 UTC |
| b1e6519 | Saad Ur Rahman | 02 November 2021, 13:41:31 UTC | [Heron 3707] ConfigMap Pod Template Support Documentation (#3717) * [Docs] Initial document. * [Docs] <ConfigMaps> section. * [Docs] generating and registering a ConfigMap. * [Docs] linking into the sidebar. * [Docs] updated for the CONFIG-MAP-NAME.POD-TEMPLATE-NAME. * [Docs] updates with output from <minkube kubectl> and for commands. * [Docs] updates on how to disable and remove topologies in the event of an error. * [Docs] added items overwritten by Heron in Pod Templates. * [Docs] minor typos and additions. * [Docs] customisation of Heron's executor and support for auxiliary containers. * [Docs] fixed dangling references within the Scheduler and cleaned up the State Manager in the event of a failed topology submission. * [Docs] fixed description of Tolerations. * [Docs] added info on Toleration merging. * [Docs] updates for namespace and removal of deprecated taints. * [Docs] Heron config values for Limits take precedence. | 02 November 2021, 13:41:31 UTC |
| 837c4f2 | Saad Ur Rahman | 02 November 2021, 13:40:39 UTC | [HERON-3707] ConfigMap Pod Template Support (#3710) * [Kubernetes] setup basic mount info for Pod ConfigMap. * [Kubernetes] updated function signature to handle Pod Template ConfigMap name. * [kubernetes] extracting Pod Template ConfigMap name from <Config>. * [kubernetes] checking for Pod Template ConfigMap and appropriately adding to Stateful Set. * [kubernetes] Java Style lint fix. * [Tests] Kubernetes Controller tests for Pod Template ConfigMap. * [Tests] Kubernetes Constants and Context tests for Pod Template ConfigMap. * [Tests] Kubernetes V1Controller test suite stubbed. * [Tests] Java style lint fixed. * [Tests] Kubernetes V1Controller Pod Template ConfigMap volume mount. * [Kubernetes] cleaned up to begin work on <loadPodFromTemplate>. * [Kubernetes] created <loadPodFromTemplate>. * [Tests] Begun mock test setup of <loadPodFromTemplate>. * [Kubernetes] style check/linting fix. * [Kubernetes] refactoring <V1Controller> and <KubernetesController>. * [Kubernetes] added description to failed to locate exception. * [Tests] <loadPodFromTemplate> Pod Template checks. * [Kubernetes] check for no ConfigMaps set. * [Tests] working on mocking null list of V1ConfigMapList. * [Kubernetes] refactoring <loadPodFromTemplate> Adding checks for null pointers. Default constructed V1 objects tend to have uninitialised fields set to null by default. Extracting <getConfigMaps> to method to support mocking. * [Tests] Stubbed <getConfigMaps> and testing <loadPodFromTemplate>. * [Kubernetes] <loadPodFromTemplate> adjusted to get <V1PodTemplateSpec> from <V1PodTemplate>. * [Kubernetes] check for empty Pod Template in ConfigMap. * [Tests] Valid Pod Template test. * [Tests] Invalid Pod Template. * [Tests] refactored test data to their respective tests. * [Kubernetes] refactored <loadPodFromTemplate> for readability. * [Kubernetes] params for <getConfigMaps> tweaked. Judging from <release-11.0.0/kubernetes/src/main/java/io/kubernetes/client/openapi/apis/CoreV1Api.java> "optional" means the field can be set to <null>. * [Kubernetes] <getPodTemplateLocation> extracting ConfigMap and Pod Template names. * [Tests] <getPodTemplateLocation> for correct and incorrect parsing. * [Kubernetes] <getPodTemplateLocation> catching empty names. * [Tests] <getPodTemplateLocation> separated tests for ConfigMap and Pod Template names. * [Kubernetes] updated <loadPodFromTemplate> to use ConfigMap and Pod Template names. * [Tests] updated tests for <loadPodFromTemplate> to use ConfigMap and Pod Template names. * [Kubernetes] added INFO logging to <loadPodFromTemplate> for the deployed Pod Template. * [Kubernetes] Bug fixes in error messages for <loadPodFromTemplate>. * [Kubernetes] bug fix and test for missing delimiter in <getPodTemplateLocation>. * [Kubernetes] <getConfigMaps> namespace access updated. * [Kubernetes] <configureRBAC> basic logic. TODO: get API key for K8s. * [Tests] cleaned up <V1Controller> tests. * [Kubernetes] <configureRBAC> more detailed error log. * [Kubernetes] <configureRBAC> role configurations. * [Kubernetes] refactored <loadFromPodTemplate>. * [Tests] switched to <ConfigMapBuilder> in <V1ControllerTest>. * [Kubernetes] switched to <V1RoleBuilder> in <configureRBAC>. * [Kubernetes] made <loadPodFromTemplate> protected. Removed illegal reflection access to avoid support issues with newer testing frameworks. * [Kubernetes] removed <configureRBAC>. RBAC must be configured using Role/ClusterRole and RoleBinding/ClusterRoleBinding to the Heron <heron-apiserver> ServiceAccount. * [Kubernetes] <getPodTemplateLocation> error message passed up. * [Kubernetes] refactored <getPodSpec> to <finalizePodSpec>. Heron should have the final say on the Pod Spec. This is as much a point of security as an operational one. * [Kubernetes] Added boot flag to disable Pod Templates. * [Tests] testing to validate boot flag for disabled Pod Templates. * [Kubernetes] Wiring in boot flag to disable Pod Templates in <loadPodFromTemplate>. * [Tests] disabled Pod Templates output validation. * [Kubernetes] Added class scoped variable <isPodTemplateDisabled>. * [Kubernetes] <getContainer> modified to utilise supplied executor container. * [Kubernetes] <getContainer> <V1EnvVar>s. Environment variables merged with Heron defaults taking precedence. * [Kubernetes] <getContainer> Limits. Resource Limits merged with Heron defaults taking precedence. * [Kubernetes] disabled Pod Templates will return error when attempting to submit. * [Kubernetes] <API Server> configs. Updated RBAC API version and added a commented flag command to disable to Pod Templates. * [Kubernetes] <configureExecutorContainer> Refactored <getContainer> to <configureExecutorContainer>. Permitting additional containers for side-car purposes. * [Kubernetes] <configureExecutorContainer> Switched to <TreeSet> with custom comparator for <V1EnvVar> name. <V1EnvVar>'s comparator performs a complete element wise comparison. * [Kubernetes] <configureExecutorContainer> Merged executor container ports with ports provided in Pod Template. Heron defaults take precedence. * [Kubernetes] <mountVolumeIfPresent> Merge volume mounts with those provided in Pod Template. Heron defaults take precedence. * [Kubernetes] <V1Controller> general cleanup of new code and comments. * [Kubernetes] <mountVolumeIfPresent> Error check for malformed Pod Template. * [Kubernetes] <configureContainerPorts> Refactored <getContainerPorts> and moved port merge with error handling to it. * [Kubernetes] <configureExecutorContainer> Removed a redundant <limit> put into the HashMap. * [Kubernetes] <addVolumesIfPresent> Merging Pod Template volume configs with Heron defaults. Heron values take precedence. * [Kubernetes] <configureExecutorContainer> Allow user values for CPU and MEMORY limits to override those provided by Heron. * [Scheduler-Core] <LaunchRunner> handling <submit> errors better. Some Schedulers, such as K8s, throw exceptions instead of returning false when <submit> fails. This leaves the Topology Manager with dangling references. An addition RPC call to the Scheduler is required to completely clear the state. * [Kubernetes] <V1Controller> General cleanup in tests and class. * [Kubernetes] code review changes. Code review from @nwangtw. <KubernetesContext.getPodTemplateConfigMapDisabled> switched to <equalsIgnoreCase>. * [Scheduler-Core] code review changes. Code review from @nwangtw. <LaunchRunner> error message assembly improved. <LaunchRunner> added <FINE> level logging for failure to clear failed topology launch from Scheduler. * [Tests] <configureContainerPorts>. * [Kubernetes] <API Server> configs. Code review from @nwangtw, @nicknezis. Updated command to disable Pod Templates to <false> by default. * [Kubernetes] <configureContainerEnvVars> Logic for merging environment variables extracted to a method for testing. * [Tests] <configureContainerEnvVars>. * [Kubernetes] <configureExecutorContainer> Wired in <configureContainerEnvVars> and removed old code. * Update for Helm chart * Updated version to match the other k8s ClusterRoleBindings * [Kubernetes] <configureContainerResources> Logic to configure container's resources extracted to method to facilitate testing. * [Kubernetes] <configureExecutorContainer> Removed old logic and wired <configureContainerResources> into <configureExecutorContainer>. * [Tests] <testConfigureContainerPorts>. Added a test for debugging ports. * [Kubernetes] <addVolumesIfPresent>. Exposed for testing. * [Tests] <addVolumesIfPresent>. Testing on a <hostPath> volume but will generalise across others. * [Kubernetes] <mountVolumeIfPresent>. Exposed for testing. * [Tests] <mountVolumeIfPresent>. Tested by setting a Volume Mount in the Config and then a custom Volume Mount in the container. * [Tests] <addVolumesIfPresent>. Cleaned up tests. * [Tests] <mountVolumesIfPresent>. Testing for when no Volume Mounts should be set. * [Tests] <addVolumesIfPresent>. Testing for when no Volumes should be set. * Attempt to fix Travis CI build * [Tests] <configureContainerEnvVars> <configureContainerPorts>. Extracted logic to generate executor environment variables, ports, and debugging ports. This is to resolve production-testing code inconsistencies which may arise. * [Tests] <V1ControllerTests> General cleanup and simplification of test suite. * Travis fix take 3 * Travis CI fix * [Kubernetes] <V1ControllerUtils> Added nested utility class to improve code maintainability. <mergeListDedupe> will merge two input lists by keeping all values in one and deduplicating the second list. * [Tests] <mergeListDedupe>. Full battery of tests null lists, merged lists, and thrown errors. * [Kubernetes] <V1Controller>. Switched to using <mergeListsDedupe> to improve code maintainability. Effects: <addVolumesIfPresent> <configureContainerEnvVars> <configureContainerPorts> <mountVolumeIfPresent> * [Kubernetes] <V1Controller> cleaned up unneeded returns when using setter methods. * [Kubernetes] <V1Controller>. Merging Pod Specification Tolerations and deduplicating on the <V1Tolerations::key>. * [Tests] <configureTolerations>. Test for a null, empty, and merging of Toleration lists. * [Kubernetes] <configurePodSpec>. Wired in <configureTolerations> * [Tests] cleaning up code. * [Kubernetes] <configurePodSpec>. Added check for multiple executor container specs in Pod Template. Will throw error if detected. * [Tests] <V1Controller> general cleanup. * [Kubernetes] Constants Updated tolerations to remove deprecated taints. * [Kubernetes] <V1Controller> <getConfigMap> retrieving a single named ConfigMap in a specific namespace. <loadPodFromTemplate> logic updated to handle a single ConfigMap. * [Tests] <V1Controller> Fixed and cleaned up tests after switching to <readNamespacedConfigMap>. * [Kubernetes] <V1Controller> Error message cleanup. * [Tests] <V1Controller> Test description cleanup. * [Kubernetes] <KubernetesUtils> Javadoc cleanup. * [Tests] <KubernetesUtils> Test description cleanup. * [Tests] <V1Controller> <configureContainerResources> Heron values take precedence for limits. * [Kubernetes] <V1Controller> <configureContainerResources> Heron values take precedence for limits. * Add support for reading configmap * Removed deprecated k8s tolerations Co-authored-by: Nicholas Nezis <nicholas.nezis@gmail.com> | 02 November 2021, 13:40:39 UTC |
| 2190502 | Huijun Wu | 30 September 2021, 18:32:07 UTC | updatelogging (#3718) Co-authored-by: Huijun Wu <huijunw@twitter.com> | 30 September 2021, 18:32:07 UTC |
| e5a6858 | zhangshaoning | 24 September 2021, 11:25:01 UTC | Fix heron-downloader cannot load the jar package correctly (#3709) 1. Install heron in the linux system to the /usr/lib/heron directory 2. Create symbolic links of several executable files in heron/bin to the /usr/bin directory 3. Try to call the heron* program separately, and the heron-downloader program fails to load the jar package correctly, and other programs are normal | 24 September 2021, 11:25:01 UTC |
| 396f2b8 | Josh Fischer | 17 September 2021, 14:58:37 UTC | mirror link change (#3716) | 17 September 2021, 14:58:37 UTC |
| 836e01b | Josh Fischer | 17 September 2021, 11:12:19 UTC | pointing older releases to be retrieved from archive.a.o (#3714) * pointing older releases to be retrieved from archive.a.o * typo | 17 September 2021, 11:12:19 UTC |
| 7322335 | Saad Ur Rahman | 12 September 2021, 19:53:35 UTC | [docs] Added instructions for setting up Intellij IDEA with the Bazel plugin. (#3712) | 12 September 2021, 19:53:35 UTC |
| b2a4e82 | Nicholas Nezis | 02 September 2021, 03:27:38 UTC | Updated to allow for external Helm version when building on a non-versioned branch (#3708) | 02 September 2021, 03:27:38 UTC |
| 4d9a7de | Josh Fischer | 21 August 2021, 21:34:06 UTC | fix label | 21 August 2021, 21:34:06 UTC |
| 2032068 | Josh Fischer | 21 August 2021, 21:33:06 UTC | update labels | 21 August 2021, 21:33:06 UTC |
| 58efb99 | Josh Fischer | 21 August 2021, 21:24:15 UTC | Update asf yaml (#3706) * update asf.yaml | 21 August 2021, 21:24:15 UTC |
| 5f95840 | Nicholas Nezis | 21 August 2021, 21:10:59 UTC | Bumped Bazel to 4.1.0 (#3703) | 21 August 2021, 21:10:59 UTC |
| d883db3 | Nicholas Nezis | 02 August 2021, 03:17:54 UTC | Fixed Kubernetes scheduler to provide Java remote debug ports (#3704) | 02 August 2021, 03:17:54 UTC |
| 5d7295f | Nicholas Nezis | 01 August 2021, 20:41:28 UTC | Updated Kryo to 5.2.0 (#3705) | 01 August 2021, 20:41:28 UTC |
| ed93aa5 | Nicholas Nezis | 11 July 2021, 02:25:04 UTC | Add ability to add Kubernetes Secrets and SecretKeyRefs (#3702) | 11 July 2021, 02:25:04 UTC |
| 6aa6ae6 | Nicholas Nezis | 09 July 2021, 01:00:44 UTC | Add support for dynamic kubernetes labels on pod and service (#3701) | 09 July 2021, 01:00:44 UTC |
| bded8f5 | Nicholas Nezis | 08 July 2021, 13:00:41 UTC | Added support for adding Kubernetes annotations to the topology pod and service (#3699) | 08 July 2021, 13:00:41 UTC |
| 3215a76 | Bouryu | 17 June 2021, 20:44:15 UTC | Adding missing heron s3 region into kubernetes config (#3697) Co-authored-by: Windham Wong <windhamwong@nva-hk.com> | 17 June 2021, 20:44:15 UTC |
| addbb35 | choi se | 15 June 2021, 05:14:25 UTC | Fix extra.links of heron-tracker (#3696) | 15 June 2021, 05:14:25 UTC |
| 33b11e6 | Josh Fischer | 02 June 2021, 01:12:16 UTC | 0.20.4 site changes (#3695) * links * initial changes * adding versioned docs; updating heron:bazel matrix * fix property * updating urls; making install docs more clear * clean up versioned getting started docs * remove duplicated text * adding simple docker instructions * clean up more urls, adding release article for 0.20.4-incubating * clean up more urls, adding release article for 0.20.4-incubating * fix typo * grammar * attempt to remove noindex * fix maven command * adding missed commands in versioned docs | 02 June 2021, 01:12:16 UTC |
| 22148db | Nicholas Nezis | 24 May 2021, 00:21:16 UTC | Update Bookkeeper to 4.13.0 and Zookeeper to 3.6.3 (#3692) * Update to Bookkeeper and Zookeeper * Committed this by accident * Updating Guava to fix submit failure * Updating BK image versions | 24 May 2021, 00:21:16 UTC |
| f5316ec | Josh Fischer | 23 May 2021, 13:46:21 UTC | links (#3694) | 23 May 2021, 13:46:21 UTC |
| 83a742f | Josh Fischer | 28 April 2021, 21:08:37 UTC | Adding disclaimers to release artifacts (#3689) | 28 April 2021, 21:08:37 UTC |
| db5c992 | Nicholas Nezis | 18 April 2021, 06:18:12 UTC | Use the proper featured Zookeeper config generation script (#3688) * Updates to make Zookeeper configurable through the Helm chart logic | 18 April 2021, 06:18:12 UTC |
