| 4d8f086 | kramasamy | 19 August 2017, 02:20:14 UTC | remove old gflags | 19 August 2017, 02:20:14 UTC |
| 006c80d | kramasamy | 18 August 2017, 06:02:27 UTC | upgrade gflags and glog | 18 August 2017, 06:02:27 UTC |
| f946fe1 | Thomas Cooper | 18 August 2017, 04:52:42 UTC | Fixed libtool install command in ubuntu 16.04 (#2208) * Fixed libtool install command in ubuntu 16.04 * Fixed path in docker readme | 18 August 2017, 04:52:42 UTC |
| 21d65d0 | Sanjeev Kulkarni | 17 August 2017, 21:46:51 UTC | Upgrade libevent to a more recent stable version (#2209) | 17 August 2017, 21:46:51 UTC |
| f24444e | Sanjeev Kulkarni | 17 August 2017, 00:29:11 UTC | Replace all localhost by 127.0.0.1 (#2204) * Replace all localhost by 127.0.0.1 * removed unneeded change * Fix unittest | 17 August 2017, 00:29:11 UTC |
| e85b232 | Luc Perkins | 16 August 2017, 00:14:04 UTC | Documentation changes for 0.15.0 release (#2201) * update versions in the website's config.yaml * begin adding brew install instructions to quick start guide * fix python doc issue | 16 August 2017, 00:14:04 UTC |
| 00f81db | bed debug | 15 August 2017, 23:12:34 UTC | replace hard coded stmgr port in stmgr_unittest (#1852) * add target to CountDownLatch wait() * check intermediate result * update countDown() * add timeout to CountDownLatch wait() * add test for CountDownLatch * fix mark's comment * change to bind 0 * rephrase comment and refactor d->duration * add debug log * add tuple debug print * remove duplicate common.stmgr_ports_.reserve(common.num_stmgrs_); * add debug print * register new port to tmaster * sync port for tmaster client in dummy stmgr * fix code style * remove print to save test time * fix looper location in the vector * recover dummy instance cpp * clean dummy stmgr * clean debug print in stmgr unit test * clean debug print in stmgr unit test again * fix mtmgr checking * add publisher port setter for metrics mgr client * update checking * update comment * fix bug after merge master * move setPort() to constructor * update comment and style * fix test * move FetchTMasterLocation() after StartStmgrServer() so that the tmaster_client_ will be set actual stmgr_port * print stmgr_port * add log print * update and try again friday * fix tmaster restart on new location test * remove redundant debug log * clean unnecessary change * turn on all tests * address sanjeev comment | 15 August 2017, 23:12:34 UTC |
| fd966ed | Runhang Li | 15 August 2017, 23:11:24 UTC | Fix requests version, fix default env. (#2202) | 15 August 2017, 23:11:24 UTC |
| 7a54db0 | Karthik Ramasamy | 15 August 2017, 21:49:24 UTC | cleanup the dependencies for generating heron storm jar (#2191) * cleanup the dependencies for generating heron storm jar * added basics-java dependency to heron-storm jar | 15 August 2017, 21:49:24 UTC |
| aa04322 | Sanjeev Kulkarni | 15 August 2017, 05:00:24 UTC | Fix the stateful component overloaded functions in window bolt (#2199) | 15 August 2017, 05:00:24 UTC |
| 33d61fe | Sanjeev Kulkarni | 15 August 2017, 04:34:37 UTC | Remove unused third party packages (#2198) | 15 August 2017, 04:34:37 UTC |
| 62b8214 | Sanjeev Kulkarni | 15 August 2017, 01:28:00 UTC | Expose all API related classes in Python Packaging (#2197) * Move python packaging to be based on connectors instead of spouts * Removed debug messages * Fix the right version for HERON_VERSION | 15 August 2017, 01:28:00 UTC |
| 4f05db6 | Sanjeev Kulkarni | 14 August 2017, 23:32:41 UTC | Update cpplint to the latest release. Minor fixes in the code along the way (#2196) * Update cpplint to the latest release. Minor fixes in the code along the way * Removed excessive printing | 14 August 2017, 23:32:41 UTC |
| c77d3b4 | Ashvin | 14 August 2017, 21:15:49 UTC | Add health manager operation mode (#2181) * Add health manager operation mode * Add healthMgr to heron core package | 14 August 2017, 21:15:49 UTC |
| ba816dd | Ashvin | 14 August 2017, 21:09:24 UTC | Fix log level and parameters (#2195) | 14 August 2017, 21:09:24 UTC |
| b9cfd6e | Sanjeev Kulkarni | 14 August 2017, 20:30:07 UTC | Move over from using iteritems to items since its more python3 friendly (#2194) * Move over from using iteritems to items since its more python3 friendly * One missed iteritems in cpplint | 14 August 2017, 20:30:07 UTC |
| d8c9a3a | Sanjeev Kulkarni | 14 August 2017, 19:48:50 UTC | Fix python examples now that spouts have moved to connectors (#2193) | 14 August 2017, 19:48:50 UTC |
| 0782fa0 | Karthik Ramasamy | 14 August 2017, 15:08:30 UTC | Upgrade to gtest 1.8 (#2192) * Upgrade to gtest 1.8 and it includes gmock 1.8 Remove the old gmock 1.7 directory in third_party * include the googletest 1.8 zip | 14 August 2017, 15:08:30 UTC |
| c7fa60b | Sanjeev Kulkarni | 13 August 2017, 01:58:14 UTC | Follow pythonic idiom of _ instead of camelCase in DSL (#2190) * Follow pythonic idiom of _ instead of camelCase in DSL * Fix build | 13 August 2017, 01:58:14 UTC |
| ff36602 | Sanjeev Kulkarni | 12 August 2017, 16:58:40 UTC | Follow Python idiom of using _ instead of camelCase (#2189) * Follow Python idiom of using _ instead of camelCase * Fixed dsl to follow stateful changes | 12 August 2017, 16:58:40 UTC |
| b5d3291 | Sanjeev Kulkarni | 12 August 2017, 04:07:03 UTC | HeronTupleSet needs src task id (#2187) | 12 August 2017, 04:07:03 UTC |
| 9714095 | Sanjeev Kulkarni | 12 August 2017, 03:00:52 UTC | Certain information should be printed only in debug mode (#2186) | 12 August 2017, 03:00:52 UTC |
| bc3d6d2 | Sanjeev Kulkarni | 12 August 2017, 03:00:06 UTC | Fix import name in python examples (#2185) | 12 August 2017, 03:00:06 UTC |
| afde0ac | cckellogg | 12 August 2017, 02:25:56 UTC | Create a connectors directory for spouts and bolts (sources/sinks) (#2176) * Create a connectors directory for spouts and bolts (sources/sinks) * Add subdirectories for connectors. * Moved from spouts to connectors | 12 August 2017, 02:25:56 UTC |
| 3af8305 | cckellogg | 12 August 2017, 01:47:26 UTC | Verify cluster name matches when submitting through apiserver. (#2184) | 12 August 2017, 01:47:26 UTC |
| bfcf50d | cckellogg | 11 August 2017, 22:00:24 UTC | Add topology resource unit tests. (#2179) | 11 August 2017, 22:00:24 UTC |
| 0c10b1f | Sanjeev Kulkarni | 11 August 2017, 21:00:51 UTC | Remove spi dependency from simulator since TopologyUtils moved from spi (#2182) | 11 August 2017, 21:00:51 UTC |
| 7c585ad | Sanjeev Kulkarni | 11 August 2017, 17:20:30 UTC | Moved TopologyUtils from spi to common (#2180) * Moved TopologyUtils from spi to common * Fixed unittest | 11 August 2017, 17:20:30 UTC |
| e1ed629 | cckellogg | 10 August 2017, 19:13:00 UTC | Add base framework for api server. (#2094) * Add base framework for api server. * Fix build issues. * Remove extra newlines. * add config files as resources into api server jar * package heron api server into tools * Implement submit/kill/activate/deactivate for the rest api server. * Remove excess logging and print statements from SubmitterMain. * Add help flag and remove println and hardcoded directory. * Add apiserver tests for the ConfigUtils. * Add user and verion params for submit topology. * Add release file flag for apiserver. The api server will read the, build version, build user and build tag from the release file and use those values for submitting topologies. * Set the submit_user when submitting a topology. * adding URL based handling in heron submit * Fix activate/deactivate/kill api paths in cli. * support multiple deployment modes * Return status 200 for a successful kill topology. * Catch exceptions as opposed to runtime exceptions in topology resources. * Update topology actions to check for status code 200. kill/activate/deactivate endpoints will return a http status code of 200 when successful. * fix printing debug information * Add script to start the api server. * package heron api server * get the actual binary since heron-apiserver is a symbolic link * Add base-template flag and method to find where the jar is installed. * Print error message if there is a parsing exception. * Add error message when server fails to start. * Update bind exception message. * Add port flag for api server. * added the service-url parameter * - Remove HERON_VERSION from docker files - Add error message reporting for service mode deployment * remove debug print out * Fix how yaml files are written to files. * Pass extra parameters to update and restart extra parameters Added exception handling for requests call * Apply submit overrides and add version endpoint. * Add restart rest endpoint. * append a list element instead of extending it * Add printing of args in debug mode * Add rest update endpoint. * Add verbose flag to apiserver. * Allow update to accept overrides. * Add more scheduler implementations. * sort the version items and print it * Add dryrun response for submit and update endpoints. * fix python command line errors * Fix api server activate handler. * fixed submission to local cluster * fix spelling mistake of function invocation * Remove api depenedency from apiserver build file. | 10 August 2017, 19:13:00 UTC |
| 414969c | John Hunt | 10 August 2017, 16:58:01 UTC | Force destroy Marathon group on topology kill (#2168) * Move uploader init above PackingPlan creation to fix NPE in case of bad PackingPlan * Alwayse use force=true on marathon group deletes * Fix style issues | 10 August 2017, 16:58:01 UTC |
| e62daed | Sanjeev Kulkarni | 10 August 2017, 14:56:59 UTC | Heron Python Code Cleanup (#2173) * First cut for packaging changes * Made all instance changes adhere to the new way of referring things * Fixed errors * Added dsl and spouts in instance * Undid unneeded changes * Added changes to heronpy generation * Removed unneeded files * Fixed build * Fixed generation * Fix integration tests * Fix unittest * Fix unittest | 10 August 2017, 14:56:59 UTC |
| f9299d7 | Ali Ahmed | 10 August 2017, 07:26:31 UTC | Fix JavaDoc for heron api Config (#2172) | 10 August 2017, 07:26:31 UTC |
| 5bcd357 | cckellogg | 10 August 2017, 06:19:21 UTC | Update pulsar to apache client. (#2171) | 10 August 2017, 06:19:21 UTC |
| 6b90739 | Sanjeev Kulkarni | 09 August 2017, 07:49:55 UTC | Let Python instance die if it is not able to handle stmgr messages (#2167) | 09 August 2017, 07:49:55 UTC |
| 70212a4 | Sanjeev Kulkarni | 09 August 2017, 06:43:01 UTC | Added docstrings to python dsl (#2166) | 09 August 2017, 06:43:01 UTC |
| d7a68dc | Sanjeev Kulkarni | 09 August 2017, 01:23:05 UTC | Refactor DSL by trimming streamlet class and pushing more code into individual operators (#2165) | 09 August 2017, 01:23:05 UTC |
| 07a5b01 | cckellogg | 08 August 2017, 23:41:19 UTC | Add kubernetes stateful config. (#2164) * Add kubernetes stateful config. * Add stateful key to heron internals. * Indent stateful config. | 08 August 2017, 23:41:19 UTC |
| 80b55e6 | Karthik Ramasamy | 08 August 2017, 20:45:20 UTC | added update certificates for java (#2163) | 08 August 2017, 20:45:20 UTC |
| 80275f3 | John Hunt | 07 August 2017, 23:55:45 UTC | Fix NPE when logging exceptions that have no message using SLF4J (#2161) * Move uploader init above PackingPlan creation to fix NPE in case of bad PackingPlan * Untested (but probably working) fix for NPE crash * Set to empty string | 07 August 2017, 23:55:45 UTC |
| fc73aa4 | Ashvin | 07 August 2017, 22:53:37 UTC | Dhalion: Add implementation for resolvers and health policy (#2162) * First Heron-Dhalion commit to enable topology auto-health-management * Add dhalion dependencies * Build and deploy health manager library * Add utility class to pull metrics from tracker * Connect PackingPlan and Topology providers to the StateMgr * Minor refactor for readability * Refactor code to use latest dhalion api * Add health policy config yaml * Add Heron main class for HealthManager * Fix any issues running HealthManager as a process * Assume all health policy configs to be strings * Isolate policy config specific guice modules * Add event handlers and invoke resolver actions * Fix dhalion package name change related errros * Use JsonPath to parse tracker response * Add bazel dependencies for json path * Replace tracker's metrics call with timeline call * Fix checkstyle errors * Use the Dhalion project's repo as binary source * Update dependencies as per update heron-common * Add sensors for BackPressure and ExecuteCount * Add BufferSizeSensor and refactor sensors * Minor refactor for readability * Refactor sensor code to use latest dhalion api * Make BackPressureSensor configurable, add high-pass-filter * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Added metric name to sensors * Fixed checkstyle errors * Mark HealthManager evolving, remove dead code, improve javadoc * Add sample config file for the HealthManager * Address review comment, use ConfigReader for yaml files * Fix checkstyle errors * Add detector for backpressure and basic diagnoser logic * Improve diagnoser accuracy using instance buffer sizes * Refactor code to use updated diagnoser api improve readability * Make BackPressure detector configurable and add tests * Fix names of symptoms and diagnosis instances * Add load disparity detector and refactor diagnosers * Add pending buffer size disparity anomaly detector * Add large pending buffers anomaly detector * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Add GrowingWaitQDetector * Fixed checkstyle errors * Refactored skew detectors, changed naming, added appropriate stats * Updated diagnosers to take into account more metrics and added new tests * Fixed checkstyle errors * Add DynamicResourceAllocation Policy * Isolate policy config specific guice modules * Add ScaleUpResolver * Connect DynamicResourceAllocationPolicy to resolvers * Add event handlers and invoke resolver actions * Remove blocking sleep call after any resolver action * Reuse Dhalions HealthPolicy to reduce code duplication * Fix dhalion package name change related errros * Add large pending buffers anomaly detector to policy * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Fixed checkstyle errors * Add metrics duration configuration for all sensors * Compute and provide buffer growth rate for all instances * Decouple HealthManager constructor and tracker Resolves a review comment * Remove interface for constants * Rename healthm so that it matches other components * Address review comments * Add dependency on full proto package instead of sub package * Refactor method consuming command line arguments * Avoid building health manager package Wait for the dhalion jar to be available on maven central before enabling health manager. Also fix healthmgr path in build scripts * Address review comments * Refactor code based on review comments in PR-1980 * Enable health manager build since dhalion is in maven now * Address review comments PR 2101 * Refactor after merging reviewed code * Fix checkstyle errors * Re-enable a detector test * Fix errors introduced by merging detector branch * Fix errors and refactor after merging master branch | 07 August 2017, 22:53:37 UTC |
| 4165cdf | Sanjeev Kulkarni | 06 August 2017, 16:32:45 UTC | Added Pulsar Spout and Pulsar Streamlet (#2160) * Addded PulsarStreamlet for composing pulsar sourced python dsl * More changes to BUILD * Removed pulsar dep for now | 06 August 2017, 16:32:45 UTC |
| 5a3a8d7 | Sanjeev Kulkarni | 05 August 2017, 19:27:58 UTC | Added exactly once semantics for python dsl (#2159) * Added exactly once semantics for python dsl * Fixed stateful stuff in window bolt | 05 August 2017, 19:27:58 UTC |
| f001b7d | Sanjeev Kulkarni | 05 August 2017, 06:21:26 UTC | Don't print topology context since it just prints a class pointer info (#2157) * Don't print topology context since it just prints a class pointer info * Fixed build | 05 August 2017, 06:21:26 UTC |
| a6023c9 | Sanjeev Kulkarni | 05 August 2017, 06:21:07 UTC | Misc Python fixes (#2158) * Misc Python fixes * Fix unittest | 05 August 2017, 06:21:07 UTC |
| b015bc9 | Sanjeev Kulkarni | 05 August 2017, 03:57:12 UTC | If an instance is not connected, stmgr server should return false while sending restore message (#2156) | 05 August 2017, 03:57:12 UTC |
| 7b6228c | Sanjeev Kulkarni | 04 August 2017, 22:29:26 UTC | Sort the task ids to ensure that identical fields grouping tuples (#2155) end up in same task ids even accross runs | 04 August 2017, 22:29:26 UTC |
| 9b0e408 | Sanjeev Kulkarni | 04 August 2017, 19:12:45 UTC | Make sure that metric registration and adding tasks are done once. (#2152) * Refactor spout/bolt code and make sure that metric registration and adding tasks are done once * Changed inited to initialized | 04 August 2017, 19:12:45 UTC |
| e804c7e | Sanjeev Kulkarni | 04 August 2017, 09:53:03 UTC | GetInstances will return only active instances. Instead we want to (#2148) get all local instances | 04 August 2017, 09:53:03 UTC |
| 511c5d7 | Sanjeev Kulkarni | 04 August 2017, 09:49:34 UTC | Refactored common code by moving it to base instance (#2151) | 04 August 2017, 09:49:34 UTC |
| 51b01ee | Sanjeev Kulkarni | 04 August 2017, 03:59:45 UTC | Correct the way we refer to the class member (#2150) * Correct the way we refer to the class member * Fix logic while handling restore state | 04 August 2017, 03:59:45 UTC |
| 8417fad | bed debug | 04 August 2017, 00:39:00 UTC | Add MetricsCacheMetricsProvider (#2113) * add MetricsCache provider * update tracker url: add metrics cache url param * add metrics http reqeust/response * convert protobuf to dhalion * add test * fix error * fix comments * fix comment and compile | 04 August 2017, 00:39:00 UTC |
| 1389a84 | Ashvin | 04 August 2017, 00:38:08 UTC | Add Dhalion detectors and diagnoser implementation for heron (#2132) * First Heron-Dhalion commit to enable topology auto-health-management * Add dhalion dependencies * Build and deploy health manager library * Add utility class to pull metrics from tracker * Connect PackingPlan and Topology providers to the StateMgr * Minor refactor for readability * Refactor code to use latest dhalion api * Add health policy config yaml * Add Heron main class for HealthManager * Fix any issues running HealthManager as a process * Assume all health policy configs to be strings * Isolate policy config specific guice modules * Add event handlers and invoke resolver actions * Fix dhalion package name change related errros * Use JsonPath to parse tracker response * Add bazel dependencies for json path * Replace tracker's metrics call with timeline call * Fix checkstyle errors * Use the Dhalion project's repo as binary source * Update dependencies as per update heron-common * Add sensors for BackPressure and ExecuteCount * Add BufferSizeSensor and refactor sensors * Minor refactor for readability * Refactor sensor code to use latest dhalion api * Make BackPressureSensor configurable, add high-pass-filter * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Added metric name to sensors * Fixed checkstyle errors * Mark HealthManager evolving, remove dead code, improve javadoc * Add sample config file for the HealthManager * Address review comment, use ConfigReader for yaml files * Fix checkstyle errors * Add detector for backpressure and basic diagnoser logic * Improve diagnoser accuracy using instance buffer sizes * Refactor code to use updated diagnoser api improve readability * Make BackPressure detector configurable and add tests * Fix names of symptoms and diagnosis instances * Add load disparity detector and refactor diagnosers * Add pending buffer size disparity anomaly detector * Add large pending buffers anomaly detector * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Add GrowingWaitQDetector * Fixed checkstyle errors * Refactored skew detectors, changed naming, added appropriate stats * Updated diagnosers to take into account more metrics and added new tests * Fixed checkstyle errors * Add metrics duration configuration for all sensors * Compute and provide buffer growth rate for all instances * Decouple HealthManager constructor and tracker Resolves a review comment * Remove interface for constants * Rename healthm so that it matches other components * Address review comments * Add dependency on full proto package instead of sub package * Refactor method consuming command line arguments * Avoid building health manager package Wait for the dhalion jar to be available on maven central before enabling health manager. Also fix healthmgr path in build scripts * Address review comments * Refactor code based on review comments in PR-1980 * Enable health manager build since dhalion is in maven now * Address review comments PR 2101 * Refactor after merging reviewed code * Fix checkstyle errors * Re-enable a detector test | 04 August 2017, 00:38:08 UTC |
| 2428fe3 | Sanjeev Kulkarni | 03 August 2017, 20:35:44 UTC | Use a default value for checkpoint interval if user does not specify it (#2147) | 03 August 2017, 20:35:44 UTC |
| cf53f64 | Sanjeev Kulkarni | 03 August 2017, 19:15:58 UTC | Fix the paths for local stateful storage (#2145) * Fix the paths for local stateful storage * Fix unittest | 03 August 2017, 19:15:58 UTC |
| 6d793f4 | Sanjeev Kulkarni | 03 August 2017, 11:26:39 UTC | For debugging purporses count all words as 1 (#2144) | 03 August 2017, 11:26:39 UTC |
| b431814 | Sanjeev Kulkarni | 03 August 2017, 11:26:16 UTC | Corrected stateful checkpoint location (#2143) | 03 August 2017, 11:26:16 UTC |
| 6664154 | Sanjeev Kulkarni | 03 August 2017, 01:25:17 UTC | Add a string method to print out the state (#2142) | 03 August 2017, 01:25:17 UTC |
| c7f74dc | Sanjeev Kulkarni | 02 August 2017, 23:55:43 UTC | Use appropriate method while manipulating state (#2141) | 02 August 2017, 23:55:43 UTC |
| ef9233d | Sanjeev Kulkarni | 02 August 2017, 23:39:01 UTC | Spout should read input tuples even in non acking mode (#2140) | 02 August 2017, 23:39:01 UTC |
| d6b5f52 | Neng Lu | 02 August 2017, 22:07:02 UTC | initialize instance state if it's null (#2138) | 02 August 2017, 22:07:02 UTC |
| f4f3fd2 | Sanjeev Kulkarni | 02 August 2017, 22:04:28 UTC | Register for stateful messages. Also make sure that state is not empty before parsing it (#2139) | 02 August 2017, 22:04:28 UTC |
| c3172c9 | Sanjeev Kulkarni | 02 August 2017, 21:29:47 UTC | Fix typo for reliability mode (#2137) | 02 August 2017, 21:29:47 UTC |
| 1c74b8a | Neng Lu | 02 August 2017, 20:19:56 UTC | Initialize the instance state before open/prepare instance (#2134) | 02 August 2017, 20:19:56 UTC |
| 77d4f71 | Ali Ahmed | 02 August 2017, 19:08:24 UTC | Add java doc gen for heron api, spi and storm (#2123) Signed-off-by: Ali Ahmed <a.ahmed@streaml.io> | 02 August 2017, 19:08:24 UTC |
| 8539aaa | Sanjeev Kulkarni | 02 August 2017, 17:36:00 UTC | Added exactly once semantics for python (#2135) * Added StatefulComponent interface and exactly once semantics for python topologies * Handle the initiate checkpoint message * Start instance only after start stateful processing is received * Added support to handle restore message * Fix build * Added a stateful example * Added init file * Fixed bugs | 02 August 2017, 17:36:00 UTC |
| 8a1b7fe | Karthik Ramasamy | 02 August 2017, 09:00:10 UTC | Cleanup of params (#2136) * topology submitting user is captured in the cli rather than in submitter main * fix trailing space * fix unit tests | 02 August 2017, 09:00:10 UTC |
| e055ae4 | Neng Lu | 01 August 2017, 01:47:46 UTC | update sendOutState (#2131) | 01 August 2017, 01:47:46 UTC |
| d764d79 | Sanjeev Kulkarni | 31 July 2017, 23:00:02 UTC | While unzipping pex files, don't overwrite existing files. (#2129) * While unzipping pex files, don't overwrite existing files. This is useful while running multi container topologies in local mode where multiple executors are unzipping the same file * Clean the working dir * Fixed unittest | 31 July 2017, 23:00:02 UTC |
| 22cd815 | Ali Ahmed | 31 July 2017, 22:37:32 UTC | Use Java ver 8 as source and target version (#2130) * Use Java ver 8 as source and target version Signed-off-by: Ali Ahmed <a.ahmed@streaml.io> * Use Java ver 8 as source and target version Signed-off-by: Ali Ahmed <a.ahmed@streaml.io> * Use Java ver 8 as source and target version Signed-off-by: Ali Ahmed <a.ahmed@streaml.io> | 31 July 2017, 22:37:32 UTC |
| 18d6cab | Ashvin | 31 July 2017, 22:19:11 UTC | Add Dhalion-sensor implementation for heron (#2101) * First Heron-Dhalion commit to enable topology auto-health-management * Add dhalion dependencies * Build and deploy health manager library * Add utility class to pull metrics from tracker * Connect PackingPlan and Topology providers to the StateMgr * Minor refactor for readability * Refactor code to use latest dhalion api * Add health policy config yaml * Add Heron main class for HealthManager * Fix any issues running HealthManager as a process * Assume all health policy configs to be strings * Isolate policy config specific guice modules * Add event handlers and invoke resolver actions * Fix dhalion package name change related errros * Use JsonPath to parse tracker response * Add bazel dependencies for json path * Replace tracker's metrics call with timeline call * Fix checkstyle errors * Use the Dhalion project's repo as binary source * Update dependencies as per update heron-common * Add sensors for BackPressure and ExecuteCount * Add BufferSizeSensor and refactor sensors * Minor refactor for readability * Refactor sensor code to use latest dhalion api * Make BackPressureSensor configurable, add high-pass-filter * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Added metric name to sensors * Fixed checkstyle errors * Mark HealthManager evolving, remove dead code, improve javadoc * Add sample config file for the HealthManager * Address review comment, use ConfigReader for yaml files * Fix checkstyle errors * Add metrics duration configuration for all sensors * Decouple HealthManager constructor and tracker Resolves a review comment * Remove interface for constants * Rename healthm so that it matches other components * Address review comments * Add dependency on full proto package instead of sub package * Refactor method consuming command line arguments * Avoid building health manager package Wait for the dhalion jar to be available on maven central before enabling health manager. Also fix healthmgr path in build scripts * Address review comments * Refactor code based on review comments in PR-1980 * Enable health manager build since dhalion is in maven now * Address review comments PR 2101 | 31 July 2017, 22:19:11 UTC |
| 94556d7 | Neng Lu | 31 July 2017, 18:31:42 UTC | limit stmgr client reconnect attempts (#2125) | 31 July 2017, 18:31:42 UTC |
| f8eff84 | Sanjeev Kulkarni | 31 July 2017, 14:45:29 UTC | Remove duplicate variable (#2127) | 31 July 2017, 14:45:29 UTC |
| c94b0bf | Sanjeev Kulkarni | 30 July 2017, 05:45:03 UTC | Print Command details only in verbose mode (#2126) * Print Command details only in verbose mode * Added more log statements under debug | 30 July 2017, 05:45:03 UTC |
| eeb6285 | Neng Lu | 28 July 2017, 23:02:25 UTC | Make instance send out state (#2120) | 28 July 2017, 23:02:25 UTC |
| 1c860dd | Neng Lu | 28 July 2017, 23:02:07 UTC | register stateful processing messages with StreamManagerClient (#2119) | 28 July 2017, 23:02:07 UTC |
| df0dd74 | Karthik Ramasamy | 28 July 2017, 18:02:11 UTC | organize the docker directory (#2122) | 28 July 2017, 18:02:11 UTC |
| d0de5d0 | Sanjeev Kulkarni | 28 July 2017, 05:57:40 UTC | Added a new socket option to take the maximum packet size accepted (#2118) * Added a new socket option to take the maximum packet size accepted * Fixed unittest * Fixed var name | 28 July 2017, 05:57:40 UTC |
| 1fd6d7f | Neng Lu | 28 July 2017, 00:53:53 UTC | add stateful support into Slave (#2106) | 28 July 2017, 00:53:53 UTC |
| 9724d44 | Sanjeev Kulkarni | 27 July 2017, 18:53:00 UTC | Rename TupleStreamMessage2 to TupleStreamMessage for better comprehension (#2117) | 27 July 2017, 18:53:00 UTC |
| f85b7a1 | Sanjeev Kulkarni | 27 July 2017, 17:37:23 UTC | Remove TupleMessage2 since no one is using it (#2116) | 27 July 2017, 17:37:23 UTC |
| b39b0fb | Sanjeev Kulkarni | 27 July 2017, 16:21:44 UTC | Removed TupleStream proto structure since no one uses it (#2115) | 27 July 2017, 16:21:44 UTC |
| e49c796 | Sanjeev Kulkarni | 27 July 2017, 07:10:09 UTC | Removed TupleMessage since its obsolete (#2114) * Removed TupleMessage since its obsolete * Fix unit test | 27 July 2017, 07:10:09 UTC |
| caf163f | Sanjeev Kulkarni | 27 July 2017, 00:21:43 UTC | StreamManager never deals with TupleMessage (#2110) | 27 July 2017, 00:21:43 UTC |
| 6e16ce6 | Sanjeev Kulkarni | 27 July 2017, 00:21:27 UTC | Removed TupleMessage usage in python instance because stmgr does not supports it (#2111) | 27 July 2017, 00:21:27 UTC |
| 412827b | Bill Graham | 26 July 2017, 19:14:29 UTC | Fix previous AbstractTupleRoutingTest refactor (#2112) | 26 July 2017, 19:14:29 UTC |
| 7e389ed | Sanjeev Kulkarni | 26 July 2017, 11:39:59 UTC | Removed dummy since no one uses it (#2108) | 26 July 2017, 11:39:59 UTC |
| 990b481 | Sanjeev Kulkarni | 26 July 2017, 06:41:29 UTC | Renamed controller to tmaster_controller (#2107) * Renamed controller to tmaster_controller to avoid confusion with stateful_controller * Changed NULL to nullptr | 26 July 2017, 06:41:29 UTC |
| f8f6a77 | Sanjeev Kulkarni | 26 July 2017, 05:35:25 UTC | Introduce StatefulController in TMaster and handle all stateful messages (#2105) * Introduce StatefulController in TMaster and handle all stateful related messages * Address pr feedback | 26 July 2017, 05:35:25 UTC |
| f558fae | Neng Lu | 25 July 2017, 22:37:14 UTC | update queue with type Message (#2103) | 25 July 2017, 22:37:14 UTC |
| 94aebd8 | Sanjeev Kulkarni | 25 July 2017, 19:42:06 UTC | Added ability in tmaster to accept stateful processing messages (#2102) from stmgr. | 25 July 2017, 19:42:06 UTC |
| 555d346 | Sanjeev Kulkarni | 25 July 2017, 18:15:04 UTC | For stateful topologies, TMaster should connect with checkpoint manager (#2100) * For stateful topologies, TMaster should connect with checkpoint manager * Fixed executor unittest | 25 July 2017, 18:15:04 UTC |
| 936cebf | bed debug | 25 July 2017, 02:49:08 UTC | packet size check (#2098) * add packet size check * add comment * re-use function | 25 July 2017, 02:49:08 UTC |
| a9f68ea | Ashvin | 25 July 2017, 02:45:44 UTC | Dhalion health manager (#1980) * First Heron-Dhalion commit to enable topology auto-health-management * Add dhalion dependencies * Build and deploy health manager library * Add utility class to pull metrics from tracker * Connect PackingPlan and Topology providers to the StateMgr * Minor refactor for readability * Refactor code to use latest dhalion api * Add health policy config yaml * Add Heron main class for HealthManager * Fix any issues running HealthManager as a process * Assume all health policy configs to be strings * Isolate policy config specific guice modules * Add event handlers and invoke resolver actions * Fix dhalion package name change related errros * Use JsonPath to parse tracker response * Add bazel dependencies for json path * Replace tracker's metrics call with timeline call * Fix checkstyle errors * Use the Dhalion project's repo as binary source * Update dependencies as per update heron-common * Mark HealthManager evolving, remove dead code, improve javadoc * Add sample config file for the HealthManager * Address review comment, use ConfigReader for yaml files * Fix checkstyle errors * Decouple HealthManager constructor and tracker Resolves a review comment * Remove interface for constants * Rename healthm so that it matches other components * Address review comments * Add dependency on full proto package instead of sub package * Refactor method consuming command line arguments * Avoid building health manager package Wait for the dhalion jar to be available on maven central before enabling health manager. Also fix healthmgr path in build scripts * Address review comments | 25 July 2017, 02:45:44 UTC |
| 8a4336e | Neng Lu | 25 July 2017, 01:26:08 UTC | add stateful controller into tmaster dir (#1973) * add stateful helper into tmaster * add unit test for stateful restorer * update * update * address comments * update metric name | 25 July 2017, 01:26:08 UTC |
| 223e4fa | Neng Lu | 24 July 2017, 23:42:51 UTC | add clean stateful checkpoint handler into tcontroller (#2096) * add clean stateful checkpoint handler into tcontroller * address comments | 24 July 2017, 23:42:51 UTC |
| f9bddff | Sanjeev Kulkarni | 24 July 2017, 20:43:48 UTC | Introduce stateful restorer in stmgr. (#2091) * Introduce stateful restorer in stmgr. This allows stmgr to handle all checkpoint save/restore as well as exactly once messages * Added metrics to keep track of bytes/tuples discarded during restore | 24 July 2017, 20:43:48 UTC |
| eefcd08 | Sanjeev Kulkarni | 21 July 2017, 01:51:48 UTC | New API for topology reliability modes (#2089) * Added topology.reliability.mode to specify what reliability the user wants to run the topology in. This will deprecate the topology.acking, topology.stateful.enabled and topology.stateful.exactonce settings, thereby providing user with a single switch to control the topology behaviour * Fixed build * Made the value of topology.reliability.mode to be mirroring the names * Fixed integration build * Fixed integration test * Brought back setEnableAcking interface back to keep compat with Heron native topologies inside Twitter * Fixed old values of reliability mode * Marked deprecated fields/methods with annotations * Removed STATEFUL mode since there is still lack of clarity on what that means * Added comments that the suppresswarnings will go away once TOPOLOGY_ENABLE_ACKING goes away | 21 July 2017, 01:51:48 UTC |
| e394660 | Runhang Li | 20 July 2017, 17:43:31 UTC | Correct heap memory usage of stream manager (#2086) | 20 July 2017, 17:43:31 UTC |
| a2ab64f | Luc Perkins | 20 July 2017, 00:43:21 UTC | Remove website build from Travis CI build (#2088) | 20 July 2017, 00:43:21 UTC |
| c1facd5 | Sanjeev Kulkarni | 19 July 2017, 22:43:55 UTC | Remove unused function (#2081) * Remove unused function * Deleted the whole file because no one uses it | 19 July 2017, 22:43:55 UTC |
