90a615d | Huijun Wu | 23 January 2018, 20:07:28 UTC | fix mismatch container id between packing alg and aurora (#2582) * fix packing container id and aurroa container id mismatch * fix import * fix import * fix import 2 * add import * add import 3 * fix unit tests * fix style * fix style 2 * fix style 3 * add fix for aurora json parser * debug * update debug * add debug * fix optional ornul * add debug * add debug print * update container diff calc * fix stderr * fix update packing plan proto * clean code * clean shell util * address comment and fix unit test * addresscomments * fix unit test * add import * update spi according to ashvin suggestion * fix style * fix style 2 * fix ning comment * fix ning comment | 23 January 2018, 20:07:28 UTC |
5e47399 | Luc Perkins | 23 January 2018, 19:55:20 UTC | add section on setting the service URL for a standalone cluster (#2682) | 23 January 2018, 19:55:20 UTC |
fe51f4a | Luc Perkins | 23 January 2018, 19:09:05 UTC | Heron standalone docs update (WIP) (#2676) * add instructions on stopping the cluster * clarify EDITOR setting * document standalone 'get' command | 23 January 2018, 19:09:05 UTC |
729e393 | Luc Perkins | 23 January 2018, 19:07:24 UTC | JSON output for heron-admin standalone cluster info command (#2675) * add json pretty print for cluster info * fix output falsely pointing to apiserver * fix get service-url command | 23 January 2018, 19:07:24 UTC |
c0ec563 | Ning Wang | 23 January 2018, 17:42:38 UTC | Don't drop tuples during backpressure in DrainTupleStream (cross stream manager traffic) (#2679) | 23 January 2018, 17:42:38 UTC |
d1f72fe | Ali Ahmed | 23 January 2018, 00:51:07 UTC | Remove cmake requirement in bazel configure (#2661) | 23 January 2018, 00:51:07 UTC |
89fdb37 | cckellogg | 23 January 2018, 00:20:02 UTC | Add k8s pod tolerations for topologies. (#2677) | 23 January 2018, 00:20:02 UTC |
c88e815 | Luc Perkins | 22 January 2018, 19:44:04 UTC | Heron standalone mode documentation (WIP) (#2614) * add new doc and add doc to TOC * add some example commands * more standalone instructions * change syntax of inventory.yaml * finish draft of doc | 22 January 2018, 19:44:04 UTC |
e2de6a4 | Karthik Ramasamy | 20 January 2018, 18:59:58 UTC | move scripts/docker to scripts/images (#2672) * build docker images in build-artifacts.sh * rename scripts/docker to scripts/images for building docker images | 20 January 2018, 18:59:58 UTC |
a78ef88 | Luc Perkins | 19 January 2018, 21:23:41 UTC | Kubernetes installation with Helm docs (#2606) * add new doc plus modify TOC * begin adding instructions for different platforms * add more specific minikube startup instructions * more small changes * update instructions for changed heron charts URL * add new GKE instructions for resources * fix helm charts repo URL * add links to GCE machine type docs * add gke-small resource config to heron repo * finishing touches on helm doc * remove reference to SSDs on GKE machines * add section on RBAC permissions * change machine type for dev cluster | 19 January 2018, 21:23:41 UTC |
15af8a5 | Ning Wang | 19 January 2018, 17:54:38 UTC | Use the minimal ram size for components instead of the last one (#2659) This is needed because in packing algorithms there is no guarantee that the ram size for each instance works across whole topology. | 19 January 2018, 17:54:38 UTC |
bec0da9 | John Crawford | 18 January 2018, 21:12:03 UTC | Fix for running topologies with DC/OS 1.10 or Marathon 1.5 (#2670) | 18 January 2018, 21:12:03 UTC |
da26e85 | Karthik Ramasamy | 18 January 2018, 21:09:56 UTC | moved eco to the top level (#2669) * moved eco to the top level and packaged to be shipped with storm compatibility layer * move eco yaml files into the eco-examples directory * moved eco example yaml files | 18 January 2018, 21:09:56 UTC |
2d86042 | dancollins34 | 18 January 2018, 05:39:34 UTC | Add support for custom evictor and trigger policies (#2653) * Add support for custom evictor and trigger policies Add support in both the streamlet and topology apis for the usage of custom eviction policies extending com.twitter.heron.api.windowing.EvictionPolicy and trigger policies extending com.twitter.heron.api.windowing.TriggerPolicy to enable user-defined windowing schemes. * Fixed Checkstyle Issues Fixed Checkstyle Issues * Fixed extra line errors, reorganized if statement in WIndowedBoltExecutor to require both Policies to be provided if one of them is * Reversed policy order to fix null pointer exception * Trial push (local compilation not working for some reason, going to push then pull clean copy) * Added Changes necessary to allow custom trigger policies to attach WindowManager, Config object, TriggerHandler and EvictionPolicy * Fixed test errors due to lack of setting necessary paramters and defining "started" again for CountTriggerPolicy * Remove flags and checks on AbstractBaseTriggerPolicy | 18 January 2018, 05:39:34 UTC |
850461c | Karthik Ramasamy | 18 January 2018, 00:12:04 UTC | modified the helm chart (#2668) | 18 January 2018, 00:12:04 UTC |
a02d4cb | cckellogg | 17 January 2018, 19:26:34 UTC | Update k8s stateful sets termination and pod management. (#2666) - use parallel for pod management - use 0 seconds for a terminmation grace period for pods | 17 January 2018, 19:26:34 UTC |
dbad3de | Ali Ahmed | 16 January 2018, 19:14:24 UTC | Add no checkstyle build targets (#2660) | 16 January 2018, 19:14:24 UTC |
1ac7341 | SreeV | 16 January 2018, 08:38:37 UTC | update README.md [https://github.com/twitter/heron/issues/2664] (#2665) * update README.md [https://github.com/twitter/heron/issues/2664] * update README.md further [https://github.com/twitter/heron/issues/2664] | 16 January 2018, 08:38:37 UTC |
e5c96b0 | Huijun Wu | 09 January 2018, 23:56:38 UTC | RoundRobinPacking implements IRepacking (#2600) * from maosong diff * revert format * refine code * format code * refactor func name * address comments * add unit test * fix style and import * fix unit test * add parallelism postive check * fix style * adopt @ning comment * revert param check to pass unit test | 09 January 2018, 23:56:38 UTC |
400caa4 | Josh Fischer | 09 January 2018, 17:09:24 UTC | Joshfischer/eco config (#2658) * initial addition of directory structure * clean up * adding base config for build file \ fixing linting issues * saving progress. Still need to fix missing class definition on ParseException * fixing shaded dependency issue * starting experimentation on how to approach loading config from yaml file * experimenting with snake yaml to extract topology defintion * adding start of topology and component definitions * refactor * successfully populating ecoTopologyDefinition from yaml * clean up * clean up * fixed versioning error * saving progress, still working through building topology from yaml * saving progress * cleaning up styles * checking default config values * adding test for customized config map * transitioning to support heron api * removing last of streamlet api from eco * making a pivot to match storm flux behavior better * saving before chaos * saving progress, running into issue with verifying the toplogy * adding some logging for debugging * printing topology definition. Adding tests * saving with failing test, still working through investigation * back to working * saving progress * finishing eco parser test * handling exception * package change * package change * adding missed id * MVP of ECO at this commit * fixing styles, pulling topology name from topology definition file * fixing spelling * clean up * clean up * refatoring eco builder package * start to removing static calls * removing static calls * still working through linting errors * fixing lint errors * fixing setter * adding test * start to verfiying bean references * verifying components * fixing tests * worked passed constructor argument issue. Now need to deal with backtypes from Storm * saving before restructure * building kafka topology * fixing imports for test * fixing folder structure * refactor for testability * removing more statics * cleaning up eco builders * confirmation config builder maps as expected * finishing configBuilder test * cleaning up BoltBuilder * verfiying component builder * replacing java logger * adding tests * adding verification of building implementations of IRichBolts * clean up * adding mocks for testing * fixing classNotFound errors * coverage on all of stream bulder * need to refactor ObjectBuilder * moving static call * adding verifcation to test * clean up * clean up * verifying path of building objects with args * covering other path * starting on builder utility * verifying className * adding test * adding test * clean up * adding test * clean up * clean up * fixing checkstyle errors * fixing linting issues * fixing linting issues * fixing linting issues * fixing linting issues * linting issues * fixing checkstyle * fixing checkstyle * saving progress * adding simple wordcount eco example * adding examples * checkstyles | 09 January 2018, 17:09:24 UTC |
d609b7c | Supun Kamburugamuve | 08 January 2018, 22:22:38 UTC | Fixing the slurm scheduler (#2657) * Fixing the slurm scheduler to work with api changes * Fixing the slurm scheduler to work with api changes * Fixing an error with the tests | 08 January 2018, 22:22:38 UTC |
fde69b7 | Nicholas Nezis | 06 January 2018, 20:16:21 UTC | Updated to use brew delivered bazel (#2655) | 06 January 2018, 20:16:21 UTC |
0e06ad7 | Ning Wang | 03 January 2018, 21:01:47 UTC | Fix a typo in comment (#2654) | 03 January 2018, 21:01:47 UTC |
a1953b9 | cckellogg | 03 January 2018, 00:41:04 UTC | Add k8s support for aws ebs volume mounts. (#2650) | 03 January 2018, 00:41:04 UTC |
adb3cf9 | Ning Wang | 02 January 2018, 23:43:32 UTC | Increase wait time in MetricsCacheSinkTest and TMasterSinkTest (#2646) * Increase wait time in MetricsCacheSinkTest and TMasterSinkTest Restart wait time is changed to 3 times of reconnect time from 2. - One reconnect time at beginning and - another delay of reconnect time caused by exception handler and - an extra second. | 02 January 2018, 23:43:32 UTC |
e6c7c12 | Karthik Ramasamy | 02 January 2018, 23:11:11 UTC | added a quick fix (#2652) | 02 January 2018, 23:11:11 UTC |
0ae3f3a | Ning Wang | 02 January 2018, 21:54:17 UTC | Decouple increment and log to avoid potential error (#2644) | 02 January 2018, 21:54:17 UTC |
5011cd9 | Karthik Ramasamy | 02 January 2018, 21:45:45 UTC | bookkeeper using emptyDir (#2649) * bookkeeper using emptyDir * volumes should be aligning with containers | 02 January 2018, 21:45:45 UTC |
b7a2486 | Ning Wang | 02 January 2018, 20:59:54 UTC | Fix aurora scheduler (#2645) * Fix aurora scheduler (added a few binding values missed in PR #2632) | 02 January 2018, 20:59:54 UTC |
0f55e1e | Karthik Ramasamy | 02 January 2018, 00:07:45 UTC | make the yaml cpp tarball (#2648) * make the yaml cpp tarball downloadable * no need for script file env file generation | 02 January 2018, 00:07:45 UTC |
c42c87d | Boyang Jerry Peng | 31 December 2017, 01:39:56 UTC | Refactoring and improving standalone mode (#2633) * Refactoring and improving standalone mode * cleaning up * fixing formatting * adding running heron-ui and heron-tracker * fixing test * fixing build file | 31 December 2017, 01:39:56 UTC |
c32eaa7 | Ning Wang | 27 December 2017, 18:37:17 UTC | Add python encoding (#2631) * add python encoding * more clean up * Change python2.7 to python We hope the python code to be version independent, so remove most 2.7 version number and keep only those that had specified 2.7 before. * missed 3 files | 27 December 2017, 18:37:17 UTC |
fdb8d27 | Huijun Wu | 26 December 2017, 23:58:36 UTC | keep topology defn during update (#2602) This PR keeps topology defn during update. | 26 December 2017, 23:58:36 UTC |
63b9497 | Ning Wang | 26 December 2017, 23:53:32 UTC | Refactor aurora scheduler to use SchedulerUtils to construct arguments (#2632) Refactor aurora scheduler code to be more consistent with other schedulers. Topology arguments are hardcoded in aurora config file currently instead of using the shared functions in SchedulerUtils. It is hard to maintain and it is causing compatibility issue (since config file is in client and the setup code is in core). | 26 December 2017, 23:53:32 UTC |
a7a0b99 | Ali Ahmed | 25 December 2017, 19:15:58 UTC | Update docker build images with bazel 0.9.0 (#2641) | 25 December 2017, 19:15:58 UTC |
407ff8e | cckellogg | 23 December 2017, 23:36:20 UTC | Move the logical plan format to the tracker. (#2639) | 23 December 2017, 23:36:20 UTC |
086b2d7 | Karthik Ramasamy | 23 December 2017, 17:45:34 UTC | move to bazel 0.9.0 and cleanups (#2637) * move to bazel 0.9.0 * lots of cleanup * fix the pex issue for bazel in linux | 23 December 2017, 17:45:34 UTC |
c569ba1 | cckellogg | 23 December 2017, 17:35:58 UTC | Add instance groups to the physical plan response. (#2636) | 23 December 2017, 17:35:58 UTC |
bb36167 | Karthik Ramasamy | 22 December 2017, 20:49:04 UTC | added targets for heron tools, heron and heron-core (#2635) | 22 December 2017, 20:49:04 UTC |
77904c2 | Eren Avsarogullari | 22 December 2017, 07:11:18 UTC | [Streamlet] Reinforce usage of StreamletNamePrefixes for more type-safety (#2627) * [Streamlet] Reinforce using StreamletNamePrefixes for more type-safety * [Streamlet] Fix documentation issues * Review comment is addressed. | 22 December 2017, 07:11:18 UTC |
9b17e30 | cckellogg | 22 December 2017, 00:06:47 UTC | Add cluster role and environment info to sink context. (#2634) * Add cluster role and environment info to sink context. This patch exposes cluster, role and environment to the SinkContext so metric sinks can export this information. * Remove log. | 22 December 2017, 00:06:47 UTC |
c591fda | Boyang Jerry Peng | 20 December 2017, 00:47:03 UTC | Multi node standalone cluster for heron (#2611) * adding Heron standalone cluster mode * cleaning up * addressing comments * cleaning up * correcting logic * improving method to check if ip or hostname is self * cleaning up * resolving merge conflicts * addressing comments | 20 December 2017, 00:47:03 UTC |
843dbd4 | Ning Wang | 19 December 2017, 22:03:56 UTC | Add new state-manager-config-file argument for aurora (#2630) * Add new state-manager-config-file argument for aurora * Add environment variables for aurora * format | 19 December 2017, 22:03:56 UTC |
f4aeae9 | Ning Wang | 19 December 2017, 04:42:16 UTC | Fix unit tests (MetricsCacheSinkTest, TMasterSinkTest) (#2629) | 19 December 2017, 04:42:16 UTC |
9c55749 | Luc Perkins | 18 December 2017, 19:59:16 UTC | remove problematic link (#2628) | 18 December 2017, 19:59:16 UTC |
f2caa54 | Luc Perkins | 15 December 2017, 19:47:39 UTC | Fix website asset pipeline + add publish script (#2626) * small fix to make clean command * add publish script * add publish script * update website version * add python six installation step * add git push step | 15 December 2017, 19:47:39 UTC |
d1c28de | Luc Perkins | 15 December 2017, 19:46:32 UTC | Revert "Fix website asset pipeline + add publish script (WIP) (#2624)" (#2625) This reverts commit 081435408ebb82177a74cda0fee0919f73f845bb. | 15 December 2017, 19:46:32 UTC |
0814354 | Luc Perkins | 15 December 2017, 19:46:03 UTC | Fix website asset pipeline + add publish script (WIP) (#2624) Fix website asset pipeline + add publish script | 15 December 2017, 19:46:03 UTC |
061ef99 | Karthik Ramasamy | 14 December 2017, 01:31:45 UTC | use gtest as a artifact rather than a tarball (#2623) | 14 December 2017, 01:31:45 UTC |
097c7bc | Karthik Ramasamy | 13 December 2017, 15:52:03 UTC | use cereal from artifact rather than a tarball (#2622) * use cereal as an artifact rather than a tarball * remove protobuf include directory | 13 December 2017, 15:52:03 UTC |
2ac72ee | Karthik Ramasamy | 13 December 2017, 07:09:19 UTC | use protobuf artifactory rather than tarball (#2621) | 13 December 2017, 07:09:19 UTC |
e374885 | Karthik Ramasamy | 13 December 2017, 01:16:30 UTC | use gflags as a artifact instead of tar ball (#2620) * use gflags as a artifact instead of tar ball * make sure that check style skips external/ | 13 December 2017, 01:16:30 UTC |
300cb2f | cckellogg | 13 December 2017, 01:15:57 UTC | Fix api server create config cluster mode. (#2617) * Fix api server create config cluster mode. - Use config cluster mode if we are not running locally. * Fix unit test. | 13 December 2017, 01:15:57 UTC |
58cfc5b | Karthik Ramasamy | 12 December 2017, 22:31:45 UTC | generate helm charts (#2619) * generate helm charts * cleanup echo statements | 12 December 2017, 22:31:45 UTC |
be5a36b | Karthik Ramasamy | 12 December 2017, 19:41:49 UTC | generate docker image and push for development (#2613) * added test docker image push * change publish to dev publish * modified helm charts * added alignment based on Chris's comments * update the service for heron-apiserver * change the path for release.yaml in apiserver * move zookeeper wait to script file in the container * print zk host and zk port correctly * update the base docker image to version 0.4.0 * name of the cluster should not contain zookeeper * remove heron-core-release target | 12 December 2017, 19:41:49 UTC |
8d0fcfe | Ning Wang | 12 December 2017, 18:43:52 UTC | Refactor heron client main.py (#2607) * Refactor heron client main.py Refactor main function of heron client into two steps, 1. set up command handlers 2. execute command and make it possible to customize heron client by creating new handlers. | 12 December 2017, 18:43:52 UTC |
5cdbfa0 | Karthik Ramasamy | 12 December 2017, 14:32:06 UTC | convert git repo for bazel dockers rules to artifiact (#2618) | 12 December 2017, 14:32:06 UTC |
49567c6 | cckellogg | 11 December 2017, 00:14:05 UTC | Fix bookkeeper statefulset yaml. (#2609) | 11 December 2017, 00:14:05 UTC |
7c4d1a5 | Karthik Ramasamy | 08 December 2017, 03:42:06 UTC | make a single heron package for each platform, removed api, tools, cl… (#2608) * make a single heron package for each platform, removed api, tools, client and instead a single package called heron * prepare the docker image using only tools and core only | 08 December 2017, 03:42:06 UTC |
86bcac2 | Luc Perkins | 07 December 2017, 22:02:20 UTC | update java API docs (#2604) | 07 December 2017, 22:02:20 UTC |
02020a7 | Luc Perkins | 07 December 2017, 22:01:01 UTC | Kubernetes configuration (#2507) * begin adding configs list * begin adding kubernetes configs * add config list shortcode plus more kubernetes configs * more k8s configs * finish adding k8s configs and modify shortcode template * add brief intro sentence | 07 December 2017, 22:01:01 UTC |
b5759c2 | Karthik Ramasamy | 07 December 2017, 03:53:06 UTC | Delete index.yaml Not needed since Helm needs to host the charts. | 07 December 2017, 03:53:06 UTC |
b045ad8 | Karthik Ramasamy | 07 December 2017, 00:17:39 UTC | change version and add index to package (#2603) | 07 December 2017, 00:17:39 UTC |
20bd753 | Karthik Ramasamy | 06 December 2017, 23:37:48 UTC | use bazel docker rules (#2545) * use bazel docker rules * Update WORKSPACE * fix the installation * update tests * change pex source * removed commented lines | 06 December 2017, 23:37:48 UTC |
b99a75a | Boyang Jerry Peng | 05 December 2017, 23:39:38 UTC | adding Nomad scheduler support for Heron (#2601) * adding Nomad scheduler support for Heron * adding unit tests * cleaning up * addressing comments * addressing comments | 05 December 2017, 23:39:38 UTC |
ef22068 | cckellogg | 02 December 2017, 19:02:02 UTC | Add nfs volumes to kubernetes. (#2598) | 02 December 2017, 19:02:02 UTC |
e2fee5d | Sanjeev Kulkarni | 02 December 2017, 00:11:22 UTC | Assign pplan helper before doing state activate. (#2599) | 02 December 2017, 00:11:22 UTC |
db120ea | Karthik Ramasamy | 30 November 2017, 19:54:32 UTC | easy install for kubernetes (#2590) * easy install for kubernetes * remove depedency charts * added notes | 30 November 2017, 19:54:32 UTC |
f42ce24 | Sanjeev Kulkarni | 30 November 2017, 09:17:28 UTC | Add ability for users to allow tuple drops upon backpressure detection (#2593) * Add ability for users to allow tuple drops upon backpressure detection * Undo examples change * Address feedback | 30 November 2017, 09:17:28 UTC |
c24ba96 | Ning Wang | 29 November 2017, 23:00:37 UTC | Add null protection in config translation code (#2597) This change contains only null pointer checks. check job hasn't finished yet but it has been running for awhile so compiling should be successful now. | 29 November 2017, 23:00:37 UTC |
1791577 | Huijun Wu | 29 November 2017, 16:36:52 UTC | imporve print (#2594) | 29 November 2017, 16:36:52 UTC |
6690eb2 | Ning Wang | 29 November 2017, 08:36:34 UTC | Use yaml lib to generate override.yaml (#2596) | 29 November 2017, 08:36:34 UTC |
972e8c9 | Eren Avsarogullari | 28 November 2017, 18:04:26 UTC | [Streamlet] Support abstraction and type safety more (#2589) * [Streamlet] Support abstraction and type safety more * Add UT coverage for default Streamlet name creation * PrefixType enum is removed because of addressing via other PR | 28 November 2017, 18:04:26 UTC |
fe0d624 | Ning Wang | 28 November 2017, 02:55:46 UTC | Add config translations for getComponentConfiguration() (#2592) | 28 November 2017, 02:55:46 UTC |
2847855 | Huijun Wu | 27 November 2017, 22:55:00 UTC | [work in progress] fix a bug for `deactivated heron-instance` during `heron update` (#2580) fix a bug for `deactivated heron-instance` during `heron update` | 27 November 2017, 22:55:00 UTC |
e9aee44 | Luc Perkins | 27 November 2017, 22:44:22 UTC | Standardize builder interfaces and remove Resources class (#2559) * add second useKryoSerializer option * add setters for all configs in Builder * add enum for prefix names * use prefix name enum in streamlet class constructors * change streamlet examples to use new builder * remove trailing space caught by checkstyle * fix checkstyle issues * fix javadoc variable names to satisfy checkstyle * fix starred import statement and remove unnecessary java List import * reverse static and final in Builder class designation * fix order of imports in FilesystemSinkTopology * remove ByteAmount dependency from streamlet API * fix example topology that uses ByteAmount * add missing javadoc for methods | 27 November 2017, 22:44:22 UTC |
bd2056f | cckellogg | 27 November 2017, 18:47:42 UTC | Fix gcs bookkeeper apiserver yaml. (#2591) | 27 November 2017, 18:47:42 UTC |
75b495d | Karthik Ramasamy | 27 November 2017, 18:38:49 UTC | Reduce the docker image size (#2578) * reduce the docker image size * reduce the docker size image using open jdk 8 slim image * incorporated comments | 27 November 2017, 18:38:49 UTC |
27c1d5e | cckellogg | 27 November 2017, 05:39:23 UTC | Add the ability to mount volumes for topologies in k8s. (#2588) * Add the ability to mount volumes for topologies in k8s. * Fix config property exception message. * Fix checkstyle and host path constant. | 27 November 2017, 05:39:23 UTC |
58031e2 | biebiep | 24 November 2017, 04:07:53 UTC | Fix for "Marathon scheduler generates json based on "old method"" (#2583) * Corrected Marathon POST message to fit specification in https://github.com/mesosphere/marathon/commit/261880df99113f0e1b3e03791e0850b1da2457d1 * Update MarathonScheduler.java * Fix style issues Fixed travis style issues => "Checkstyle ends with 8 errors": Spaces around "+" (added 8 spaces) * fix style issues Fix: Line is longer than 100 characters (found 106). | 24 November 2017, 04:07:53 UTC |
d7ee1b5 | Eren Avsarogullari | 24 November 2017, 02:29:32 UTC | [Streamlet] Small refactoring is proposed and UT coverage is extended (#2570) * Small refactoring is proposed and UT coverage is extended * Error message is updated * Review comments are addressed | 24 November 2017, 02:29:32 UTC |
dbf652c | Eren Avsarogullari | 24 November 2017, 02:29:10 UTC | Add ConsumerStreamlet name to stageNames Set to avoid duplication (#2574) | 24 November 2017, 02:29:10 UTC |
343015a | Maosong Fu | 22 November 2017, 19:56:16 UTC | Add batch support for AuroraScheduler to remove containers (#2579) * Add batch support for AuroraScheduler to remove containers Currently, the AuroraScheduler will remove containers one by one, very slow. This pull request allows AuroraScheduler to remove containers in one batch. * Make add containers support verbose option | 22 November 2017, 19:56:16 UTC |
90dcfb3 | Luc Perkins | 22 November 2017, 18:36:31 UTC | Streamlet theoretical documentation (WIP) (#2452) * add diagram and some more explanation * add example fodder * re-arrange JS creation * s/functional/streamlet * begin adding section on join types * more operations docs * transform operation docs * clarify transform operations * s/CVS/CSV * add docs for sink operations * add docs for clone operations * split off non-kv-streamlet operations * split off material into separate doc * some more restructuring (beginning to eliminate KV streamlet discussion) * remove references to KV streamlets * finish draft of join docs * fix broken tables * begin adding section on repartitioning * add new diagram * finish draft | 22 November 2017, 18:36:31 UTC |
df62689 | cckellogg | 22 November 2017, 00:32:41 UTC | Refactor kubernetes scheduler to use statefulsets. (#2560) * Refactor kubernetes scheduler to use statefulsets. * Fix more conflict issues. * Revert minikube apiserver yaml. * Fix spelling mistake. * Find max number of instances in a container for opening debugging ports. | 22 November 2017, 00:32:41 UTC |
9e0d48f | Maosong Fu | 21 November 2017, 08:31:21 UTC | Fix wrong stmgr log (#2577) Currently, the stmgr logs incorrectly for state change: it logs the new state to old state. This pull requests fixes it by logging the old state to new state. | 21 November 2017, 08:31:21 UTC |
4e4b3de | Maosong Fu | 19 November 2017, 01:52:12 UTC | Log when stmgr broadcasts physical plan (#2573) Currently, it is hard to trace the destination instances that a stmgr sends new physical plan to, especially during run-time scaling. This pull request logs it down for better tracing and debug. Tested with LocalScheduler. | 19 November 2017, 01:52:12 UTC |
4d44f5b | Huijun Wu | 19 November 2017, 01:02:41 UTC | add exception handling for metricscache process (#2572) * add exception handling for quiting process * address comment * update comment * put halt in finally | 19 November 2017, 01:02:41 UTC |
d29a6b5 | Luc Perkins | 18 November 2017, 00:55:14 UTC | Streamlet API cleanup (#2567) * push name checking/setting logic into a single method * remove unnecessary return calls in void functions * use class variables to set default name * change variable name to satisfy checkstyle * switch variables to private | 18 November 2017, 00:55:14 UTC |
874feb3 | Luc Perkins | 17 November 2017, 23:23:24 UTC | remove unused kubernetes config (#2568) | 17 November 2017, 23:23:24 UTC |
70614ba | Luc Perkins | 17 November 2017, 21:49:00 UTC | bump version (#2569) | 17 November 2017, 21:49:00 UTC |
863038e | Maosong Fu | 17 November 2017, 20:30:44 UTC | Fix sample ComponentJVMOptionsTopology (#2565) * Fix sample topology Currently, ComponentJVMOptionsTopology specifies a NewSize greater than the heap size. This pull request: - fixes it - adds the sample to add component-level config for a particular component | 17 November 2017, 20:30:44 UTC |
1684c27 | Maosong Fu | 17 November 2017, 08:25:19 UTC | Fix the logging of System Config (#2566) Currently, when heron-instance tries to log the System Config, it will only log the reference value, since there is no correct override for SystemConfig.toString(). This pull request fixes this issue by overriding the SystemConfig.toString(). | 17 November 2017, 08:25:19 UTC |
89e9169 | Maosong Fu | 17 November 2017, 08:20:56 UTC | Log component's config when constructing the instance (#2564) Currently, people are having a hard time to figure out the actual configs applying to a component: - There are a lot of transformations and overrides - The actual configs applied are not directly visible This pull request logs the actual configs applying to the instance during the actual config construction for an instance. It makes debug easier. Furthermore, it is invoked only when having new PhysicalPlanHelper, so it does not hurt runtime performance. | 17 November 2017, 08:20:56 UTC |
9011208 | Huijun Wu | 17 November 2017, 06:08:10 UTC | enhance heron-shell /killexecutor (#2557) * add killing process * update killpg to kill * address comment * address comment * update comment * update log | 17 November 2017, 06:08:10 UTC |
c1e0c01 | Sanjeev Kulkarni | 17 November 2017, 01:16:37 UTC | Beefed up the kryo check to catch during submission time (#2562) * Beefed up the kryo check to catch during submission time * Fixed unittest | 17 November 2017, 01:16:37 UTC |
8315ff3 | Ning Wang | 16 November 2017, 19:22:17 UTC | Fix StreamletImplTest unit test (#2561) | 16 November 2017, 19:22:17 UTC |
fcac777 | Huijun Wu | 16 November 2017, 08:34:39 UTC | fix metricscache location bug (#2556) * fix metricscache location in zk after session reconnection * add corner case handling * address comment 2 * update comment * minor update * add comment | 16 November 2017, 08:34:39 UTC |
7c2f931 | Eren Avsarogullari | 16 November 2017, 07:41:23 UTC | Streamlet name needs to be robust for blank values (#2558) | 16 November 2017, 07:41:23 UTC |
162b097 | Boyang Jerry Peng | 16 November 2017, 03:00:20 UTC | Refactoring windowing (#2547) * refactoring windowing to reduce complexity - change to using timers rather than tick tuples - removing unneccessary locks * cleaning up | 16 November 2017, 03:00:20 UTC |