| 0b805d3 | Runhang Li | 29 August 2017, 23:05:17 UTC | Merge branch 'objmagic/limit-msg-size' into 0.15.1.1-rc | 29 August 2017, 23:05:17 UTC |
| c7ec49c | Runhang Li | 29 August 2017, 23:02:26 UTC | Check every 1024 times. | 29 August 2017, 23:02:26 UTC |
| 4558b1d | Runhang Li | 29 August 2017, 19:05:08 UTC | Call SpaceUsed less often. | 29 August 2017, 19:05:08 UTC |
| fdbf088 | Runhang Li | 29 August 2017, 17:32:10 UTC | Support components name generated by SummingBird. (#2256) | 29 August 2017, 17:33:02 UTC |
| 459f7f5 | Runhang Li | 28 August 2017, 22:49:54 UTC | Use SpaceUsed. | 28 August 2017, 22:49:54 UTC |
| 0ce41d5 | Runhang Li | 28 August 2017, 21:28:12 UTC | Really assign. | 28 August 2017, 21:28:12 UTC |
| 9105695 | Runhang Li | 28 August 2017, 18:58:51 UTC | Limit size of HeronTupleSet. | 28 August 2017, 18:58:51 UTC |
| 15a4621 | Sanjeev Kulkarni | 27 August 2017, 22:47:55 UTC | Move system_config to from common to instance since only instance uses it (#2251) * Move system_config to from common to instance since only instance uses it * Added system config to the init file | 27 August 2017, 22:47:55 UTC |
| 57daad4 | Sanjeev Kulkarni | 27 August 2017, 21:15:39 UTC | Move EventLooper and GatewayLooper to instance since no one else uses them (#2250) * Move EventLooper and GatewayLooper to instance since no one else uses them * Fix path * Fix path. Attempt 2 | 27 August 2017, 21:15:39 UTC |
| af2a0c6 | Sanjeev Kulkarni | 27 August 2017, 18:54:38 UTC | Moved system_constants from common to instance since only instance uses it (#2249) | 27 August 2017, 18:54:38 UTC |
| 4e4bbb1 | Sanjeev Kulkarni | 27 August 2017, 16:41:36 UTC | Deleted unused file (#2248) | 27 August 2017, 16:41:36 UTC |
| fed3aff | Sanjeev Kulkarni | 26 August 2017, 23:52:00 UTC | Include only Topology proto in heron java api jar (#2247) | 26 August 2017, 23:52:00 UTC |
| 987975d | Sanjeev Kulkarni | 26 August 2017, 17:57:51 UTC | Remove unused proto (#2246) | 26 August 2017, 17:57:51 UTC |
| d816f44 | Sanjeev Kulkarni | 26 August 2017, 16:04:18 UTC | Upgraded zookeeper to the latest stable version (#2245) | 26 August 2017, 16:04:18 UTC |
| 6610ca9 | Ashvin | 26 August 2017, 01:05:25 UTC | Make metrics cache client in healthMgr fetch location from statemgr (#2232) * Make metrics cache client in healthMgr fetch location from statemgr The metrics cache port is selected at runtime. So a user cannot provide it as a configuration. The cache client needs to fetch it. * Fix checkstyle errors | 26 August 2017, 01:05:25 UTC |
| 60f9fff | Ali Ahmed | 26 August 2017, 01:02:56 UTC | Fix heronpy packaging (#2244) | 26 August 2017, 01:02:56 UTC |
| 0ad8e87 | Sanjeev Kulkarni | 26 August 2017, 00:01:31 UTC | Remove unnecessary sub module BUILD files (#2240) * Remove unnecessary sub module BUILD files * More rejiggering of BUILD * More regiggering * Fixed unittest * Fixed the build | 26 August 2017, 00:01:31 UTC |
| 41aef74 | Ali Ahmed | 25 August 2017, 23:50:13 UTC | Removing legacy kakfa connector (#2242) This is dead code that no longer compiles and is being deprecated | 25 August 2017, 23:50:13 UTC |
| fd40efb | Ali Ahmed | 25 August 2017, 21:54:08 UTC | Move api, dsl, tools, proto and connectors (#2229) * Move api, dsl, connectors and proto to heronpy * Separate heronpy/proto dependency | 25 August 2017, 21:54:08 UTC |
| 81c6957 | Sanjeev Kulkarni | 25 August 2017, 06:28:00 UTC | Moved common/python/network to instance/python/network since no one else uses them (#2237) * Moved common/python/network to instance/python/network since no one else uses them * Fixed module path | 25 August 2017, 06:28:00 UTC |
| 5cd67de | Ali Ahmed | 25 August 2017, 05:24:19 UTC | Fix bazel warning (#2239) | 25 August 2017, 05:24:19 UTC |
| 57ee7ec | Ali Ahmed | 24 August 2017, 20:30:19 UTC | Move utils to heron instance (#2233) * Move utils to heron instance This change to remove heron-api dependency for heron-common * Move Pex loader back to common | 24 August 2017, 20:30:19 UTC |
| 1a97d45 | Karthik Ramasamy | 24 August 2017, 17:21:13 UTC | Added an option to bazel build/test without doing checkstyle. (#2236) If you invoke bazel build heron/... or bazel test heron/..., it will skip checkstyle Also ensured that bazel options are in alphatetical order | 24 August 2017, 17:21:13 UTC |
| 8888b59 | cckellogg | 23 August 2017, 01:33:29 UTC | Convert kubernetes scheduler to use heron downloader. (#2223) * Convert kubernetes scheduler to use heron downloader. * Add comment for heron-conf directory configuration setting. | 23 August 2017, 01:33:29 UTC |
| be1cb38 | Sanjeev Kulkarni | 22 August 2017, 19:35:50 UTC | Make bazel configure python3 friendly (#2228) | 22 August 2017, 19:35:50 UTC |
| 716470b | Runhang Li | 22 August 2017, 04:43:15 UTC | Limit size of a single data tuple. (#2224) * Limit size of a single data tuple. * Break line. | 22 August 2017, 04:43:15 UTC |
| 1d4e016 | Ashvin | 21 August 2017, 22:56:52 UTC | Fix yaml health manager config parsing error (#2226) Fixes Issue #2225 | 21 August 2017, 22:56:52 UTC |
| 2604bc6 | Luc Perkins | 21 August 2017, 22:55:36 UTC | 0.15.0 documentation release (#2221) * update versions in the website's config.yaml * begin adding brew install instructions to quick start guide * fix python doc issue * finish homebrew instructions * get heronpy version from website YAML config | 21 August 2017, 22:55:36 UTC |
| 5deeede | Sanjeev Kulkarni | 21 August 2017, 20:55:52 UTC | Fix Join Bolt implementation (#2215) * Fix Join Bolt implementation * Added some comments to clarify the logic | 21 August 2017, 20:55:52 UTC |
| 723ef86 | Ashvin | 20 August 2017, 03:52:55 UTC | Ability to launch health manager on container-0 (#2203) * Fix long type parsing errors in yaml * Add health manager mode config * Fix checkstyle errors * Add Health Mgr changes to Aurora scheduler * Fix unit test failures | 20 August 2017, 03:52:55 UTC |
| 1f2003a | cckellogg | 20 August 2017, 00:19:39 UTC | Add a heron downloader to download and extract topology packages. (#2216) * Add a heron downloader to download and extract topology packages. * Return instead of calling exit. | 20 August 2017, 00:19:39 UTC |
| 96465b3 | Karthik Ramasamy | 19 August 2017, 19:27:55 UTC | upgrade gflags and glog to newer versions (#2211) * upgrade gflags and glog * remove old gflags | 19 August 2017, 19:27:55 UTC |
| d4a5cf5 | Sanjeev Kulkarni | 18 August 2017, 22:17:37 UTC | remove inputs from streamlet since the core streamlet class does not use it (#2214) | 18 August 2017, 22:17:37 UTC |
| 8b8de79 | Sanjeev Kulkarni | 18 August 2017, 20:49:44 UTC | Removed operation since it is unused (#2213) | 18 August 2017, 20:49:44 UTC |
| 02f979e | Sanjeev Kulkarni | 18 August 2017, 19:30:29 UTC | All of dsl methods need to output the same stream. This pr (#2212) makes DslBoltBase as the refactored place where the output is defined and the others make use of it by deriving from it | 18 August 2017, 19:30:29 UTC |
| fe1bbf9 | Sanjeev Kulkarni | 18 August 2017, 05:03:51 UTC | Make the exception style compatible with both python2 and python3 (#2210) | 18 August 2017, 05:03:51 UTC |
| f946fe1 | Thomas Cooper | 18 August 2017, 04:52:42 UTC | Fixed libtool install command in ubuntu 16.04 (#2208) * Fixed libtool install command in ubuntu 16.04 * Fixed path in docker readme | 18 August 2017, 04:52:42 UTC |
| 21d65d0 | Sanjeev Kulkarni | 17 August 2017, 21:46:51 UTC | Upgrade libevent to a more recent stable version (#2209) | 17 August 2017, 21:46:51 UTC |
| f24444e | Sanjeev Kulkarni | 17 August 2017, 00:29:11 UTC | Replace all localhost by 127.0.0.1 (#2204) * Replace all localhost by 127.0.0.1 * removed unneeded change * Fix unittest | 17 August 2017, 00:29:11 UTC |
| e85b232 | Luc Perkins | 16 August 2017, 00:14:04 UTC | Documentation changes for 0.15.0 release (#2201) * update versions in the website's config.yaml * begin adding brew install instructions to quick start guide * fix python doc issue | 16 August 2017, 00:14:04 UTC |
| 00f81db | bed debug | 15 August 2017, 23:12:34 UTC | replace hard coded stmgr port in stmgr_unittest (#1852) * add target to CountDownLatch wait() * check intermediate result * update countDown() * add timeout to CountDownLatch wait() * add test for CountDownLatch * fix mark's comment * change to bind 0 * rephrase comment and refactor d->duration * add debug log * add tuple debug print * remove duplicate common.stmgr_ports_.reserve(common.num_stmgrs_); * add debug print * register new port to tmaster * sync port for tmaster client in dummy stmgr * fix code style * remove print to save test time * fix looper location in the vector * recover dummy instance cpp * clean dummy stmgr * clean debug print in stmgr unit test * clean debug print in stmgr unit test again * fix mtmgr checking * add publisher port setter for metrics mgr client * update checking * update comment * fix bug after merge master * move setPort() to constructor * update comment and style * fix test * move FetchTMasterLocation() after StartStmgrServer() so that the tmaster_client_ will be set actual stmgr_port * print stmgr_port * add log print * update and try again friday * fix tmaster restart on new location test * remove redundant debug log * clean unnecessary change * turn on all tests * address sanjeev comment | 15 August 2017, 23:12:34 UTC |
| fd966ed | Runhang Li | 15 August 2017, 23:11:24 UTC | Fix requests version, fix default env. (#2202) | 15 August 2017, 23:11:24 UTC |
| 7a54db0 | Karthik Ramasamy | 15 August 2017, 21:49:24 UTC | cleanup the dependencies for generating heron storm jar (#2191) * cleanup the dependencies for generating heron storm jar * added basics-java dependency to heron-storm jar | 15 August 2017, 21:49:24 UTC |
| aa04322 | Sanjeev Kulkarni | 15 August 2017, 05:00:24 UTC | Fix the stateful component overloaded functions in window bolt (#2199) | 15 August 2017, 05:00:24 UTC |
| 33d61fe | Sanjeev Kulkarni | 15 August 2017, 04:34:37 UTC | Remove unused third party packages (#2198) | 15 August 2017, 04:34:37 UTC |
| 62b8214 | Sanjeev Kulkarni | 15 August 2017, 01:28:00 UTC | Expose all API related classes in Python Packaging (#2197) * Move python packaging to be based on connectors instead of spouts * Removed debug messages * Fix the right version for HERON_VERSION | 15 August 2017, 01:28:00 UTC |
| 4f05db6 | Sanjeev Kulkarni | 14 August 2017, 23:32:41 UTC | Update cpplint to the latest release. Minor fixes in the code along the way (#2196) * Update cpplint to the latest release. Minor fixes in the code along the way * Removed excessive printing | 14 August 2017, 23:32:41 UTC |
| c77d3b4 | Ashvin | 14 August 2017, 21:15:49 UTC | Add health manager operation mode (#2181) * Add health manager operation mode * Add healthMgr to heron core package | 14 August 2017, 21:15:49 UTC |
| ba816dd | Ashvin | 14 August 2017, 21:09:24 UTC | Fix log level and parameters (#2195) | 14 August 2017, 21:09:24 UTC |
| b9cfd6e | Sanjeev Kulkarni | 14 August 2017, 20:30:07 UTC | Move over from using iteritems to items since its more python3 friendly (#2194) * Move over from using iteritems to items since its more python3 friendly * One missed iteritems in cpplint | 14 August 2017, 20:30:07 UTC |
| d8c9a3a | Sanjeev Kulkarni | 14 August 2017, 19:48:50 UTC | Fix python examples now that spouts have moved to connectors (#2193) | 14 August 2017, 19:48:50 UTC |
| 0782fa0 | Karthik Ramasamy | 14 August 2017, 15:08:30 UTC | Upgrade to gtest 1.8 (#2192) * Upgrade to gtest 1.8 and it includes gmock 1.8 Remove the old gmock 1.7 directory in third_party * include the googletest 1.8 zip | 14 August 2017, 15:08:30 UTC |
| c7fa60b | Sanjeev Kulkarni | 13 August 2017, 01:58:14 UTC | Follow pythonic idiom of _ instead of camelCase in DSL (#2190) * Follow pythonic idiom of _ instead of camelCase in DSL * Fix build | 13 August 2017, 01:58:14 UTC |
| ff36602 | Sanjeev Kulkarni | 12 August 2017, 16:58:40 UTC | Follow Python idiom of using _ instead of camelCase (#2189) * Follow Python idiom of using _ instead of camelCase * Fixed dsl to follow stateful changes | 12 August 2017, 16:58:40 UTC |
| b5d3291 | Sanjeev Kulkarni | 12 August 2017, 04:07:03 UTC | HeronTupleSet needs src task id (#2187) | 12 August 2017, 04:07:03 UTC |
| 9714095 | Sanjeev Kulkarni | 12 August 2017, 03:00:52 UTC | Certain information should be printed only in debug mode (#2186) | 12 August 2017, 03:00:52 UTC |
| bc3d6d2 | Sanjeev Kulkarni | 12 August 2017, 03:00:06 UTC | Fix import name in python examples (#2185) | 12 August 2017, 03:00:06 UTC |
| afde0ac | cckellogg | 12 August 2017, 02:25:56 UTC | Create a connectors directory for spouts and bolts (sources/sinks) (#2176) * Create a connectors directory for spouts and bolts (sources/sinks) * Add subdirectories for connectors. * Moved from spouts to connectors | 12 August 2017, 02:25:56 UTC |
| 3af8305 | cckellogg | 12 August 2017, 01:47:26 UTC | Verify cluster name matches when submitting through apiserver. (#2184) | 12 August 2017, 01:47:26 UTC |
| bfcf50d | cckellogg | 11 August 2017, 22:00:24 UTC | Add topology resource unit tests. (#2179) | 11 August 2017, 22:00:24 UTC |
| 0c10b1f | Sanjeev Kulkarni | 11 August 2017, 21:00:51 UTC | Remove spi dependency from simulator since TopologyUtils moved from spi (#2182) | 11 August 2017, 21:00:51 UTC |
| 7c585ad | Sanjeev Kulkarni | 11 August 2017, 17:20:30 UTC | Moved TopologyUtils from spi to common (#2180) * Moved TopologyUtils from spi to common * Fixed unittest | 11 August 2017, 17:20:30 UTC |
| e1ed629 | cckellogg | 10 August 2017, 19:13:00 UTC | Add base framework for api server. (#2094) * Add base framework for api server. * Fix build issues. * Remove extra newlines. * add config files as resources into api server jar * package heron api server into tools * Implement submit/kill/activate/deactivate for the rest api server. * Remove excess logging and print statements from SubmitterMain. * Add help flag and remove println and hardcoded directory. * Add apiserver tests for the ConfigUtils. * Add user and verion params for submit topology. * Add release file flag for apiserver. The api server will read the, build version, build user and build tag from the release file and use those values for submitting topologies. * Set the submit_user when submitting a topology. * adding URL based handling in heron submit * Fix activate/deactivate/kill api paths in cli. * support multiple deployment modes * Return status 200 for a successful kill topology. * Catch exceptions as opposed to runtime exceptions in topology resources. * Update topology actions to check for status code 200. kill/activate/deactivate endpoints will return a http status code of 200 when successful. * fix printing debug information * Add script to start the api server. * package heron api server * get the actual binary since heron-apiserver is a symbolic link * Add base-template flag and method to find where the jar is installed. * Print error message if there is a parsing exception. * Add error message when server fails to start. * Update bind exception message. * Add port flag for api server. * added the service-url parameter * - Remove HERON_VERSION from docker files - Add error message reporting for service mode deployment * remove debug print out * Fix how yaml files are written to files. * Pass extra parameters to update and restart extra parameters Added exception handling for requests call * Apply submit overrides and add version endpoint. * Add restart rest endpoint. * append a list element instead of extending it * Add printing of args in debug mode * Add rest update endpoint. * Add verbose flag to apiserver. * Allow update to accept overrides. * Add more scheduler implementations. * sort the version items and print it * Add dryrun response for submit and update endpoints. * fix python command line errors * Fix api server activate handler. * fixed submission to local cluster * fix spelling mistake of function invocation * Remove api depenedency from apiserver build file. | 10 August 2017, 19:13:00 UTC |
| 414969c | John Hunt | 10 August 2017, 16:58:01 UTC | Force destroy Marathon group on topology kill (#2168) * Move uploader init above PackingPlan creation to fix NPE in case of bad PackingPlan * Alwayse use force=true on marathon group deletes * Fix style issues | 10 August 2017, 16:58:01 UTC |
| e62daed | Sanjeev Kulkarni | 10 August 2017, 14:56:59 UTC | Heron Python Code Cleanup (#2173) * First cut for packaging changes * Made all instance changes adhere to the new way of referring things * Fixed errors * Added dsl and spouts in instance * Undid unneeded changes * Added changes to heronpy generation * Removed unneeded files * Fixed build * Fixed generation * Fix integration tests * Fix unittest * Fix unittest | 10 August 2017, 14:56:59 UTC |
| f9299d7 | Ali Ahmed | 10 August 2017, 07:26:31 UTC | Fix JavaDoc for heron api Config (#2172) | 10 August 2017, 07:26:31 UTC |
| 5bcd357 | cckellogg | 10 August 2017, 06:19:21 UTC | Update pulsar to apache client. (#2171) | 10 August 2017, 06:19:21 UTC |
| 6b90739 | Sanjeev Kulkarni | 09 August 2017, 07:49:55 UTC | Let Python instance die if it is not able to handle stmgr messages (#2167) | 09 August 2017, 07:49:55 UTC |
| 70212a4 | Sanjeev Kulkarni | 09 August 2017, 06:43:01 UTC | Added docstrings to python dsl (#2166) | 09 August 2017, 06:43:01 UTC |
| d7a68dc | Sanjeev Kulkarni | 09 August 2017, 01:23:05 UTC | Refactor DSL by trimming streamlet class and pushing more code into individual operators (#2165) | 09 August 2017, 01:23:05 UTC |
| 07a5b01 | cckellogg | 08 August 2017, 23:41:19 UTC | Add kubernetes stateful config. (#2164) * Add kubernetes stateful config. * Add stateful key to heron internals. * Indent stateful config. | 08 August 2017, 23:41:19 UTC |
| 80b55e6 | Karthik Ramasamy | 08 August 2017, 20:45:20 UTC | added update certificates for java (#2163) | 08 August 2017, 20:45:20 UTC |
| 80275f3 | John Hunt | 07 August 2017, 23:55:45 UTC | Fix NPE when logging exceptions that have no message using SLF4J (#2161) * Move uploader init above PackingPlan creation to fix NPE in case of bad PackingPlan * Untested (but probably working) fix for NPE crash * Set to empty string | 07 August 2017, 23:55:45 UTC |
| fc73aa4 | Ashvin | 07 August 2017, 22:53:37 UTC | Dhalion: Add implementation for resolvers and health policy (#2162) * First Heron-Dhalion commit to enable topology auto-health-management * Add dhalion dependencies * Build and deploy health manager library * Add utility class to pull metrics from tracker * Connect PackingPlan and Topology providers to the StateMgr * Minor refactor for readability * Refactor code to use latest dhalion api * Add health policy config yaml * Add Heron main class for HealthManager * Fix any issues running HealthManager as a process * Assume all health policy configs to be strings * Isolate policy config specific guice modules * Add event handlers and invoke resolver actions * Fix dhalion package name change related errros * Use JsonPath to parse tracker response * Add bazel dependencies for json path * Replace tracker's metrics call with timeline call * Fix checkstyle errors * Use the Dhalion project's repo as binary source * Update dependencies as per update heron-common * Add sensors for BackPressure and ExecuteCount * Add BufferSizeSensor and refactor sensors * Minor refactor for readability * Refactor sensor code to use latest dhalion api * Make BackPressureSensor configurable, add high-pass-filter * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Added metric name to sensors * Fixed checkstyle errors * Mark HealthManager evolving, remove dead code, improve javadoc * Add sample config file for the HealthManager * Address review comment, use ConfigReader for yaml files * Fix checkstyle errors * Add detector for backpressure and basic diagnoser logic * Improve diagnoser accuracy using instance buffer sizes * Refactor code to use updated diagnoser api improve readability * Make BackPressure detector configurable and add tests * Fix names of symptoms and diagnosis instances * Add load disparity detector and refactor diagnosers * Add pending buffer size disparity anomaly detector * Add large pending buffers anomaly detector * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Add GrowingWaitQDetector * Fixed checkstyle errors * Refactored skew detectors, changed naming, added appropriate stats * Updated diagnosers to take into account more metrics and added new tests * Fixed checkstyle errors * Add DynamicResourceAllocation Policy * Isolate policy config specific guice modules * Add ScaleUpResolver * Connect DynamicResourceAllocationPolicy to resolvers * Add event handlers and invoke resolver actions * Remove blocking sleep call after any resolver action * Reuse Dhalions HealthPolicy to reduce code duplication * Fix dhalion package name change related errros * Add large pending buffers anomaly detector to policy * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Fixed checkstyle errors * Add metrics duration configuration for all sensors * Compute and provide buffer growth rate for all instances * Decouple HealthManager constructor and tracker Resolves a review comment * Remove interface for constants * Rename healthm so that it matches other components * Address review comments * Add dependency on full proto package instead of sub package * Refactor method consuming command line arguments * Avoid building health manager package Wait for the dhalion jar to be available on maven central before enabling health manager. Also fix healthmgr path in build scripts * Address review comments * Refactor code based on review comments in PR-1980 * Enable health manager build since dhalion is in maven now * Address review comments PR 2101 * Refactor after merging reviewed code * Fix checkstyle errors * Re-enable a detector test * Fix errors introduced by merging detector branch * Fix errors and refactor after merging master branch | 07 August 2017, 22:53:37 UTC |
| 4165cdf | Sanjeev Kulkarni | 06 August 2017, 16:32:45 UTC | Added Pulsar Spout and Pulsar Streamlet (#2160) * Addded PulsarStreamlet for composing pulsar sourced python dsl * More changes to BUILD * Removed pulsar dep for now | 06 August 2017, 16:32:45 UTC |
| 5a3a8d7 | Sanjeev Kulkarni | 05 August 2017, 19:27:58 UTC | Added exactly once semantics for python dsl (#2159) * Added exactly once semantics for python dsl * Fixed stateful stuff in window bolt | 05 August 2017, 19:27:58 UTC |
| f001b7d | Sanjeev Kulkarni | 05 August 2017, 06:21:26 UTC | Don't print topology context since it just prints a class pointer info (#2157) * Don't print topology context since it just prints a class pointer info * Fixed build | 05 August 2017, 06:21:26 UTC |
| a6023c9 | Sanjeev Kulkarni | 05 August 2017, 06:21:07 UTC | Misc Python fixes (#2158) * Misc Python fixes * Fix unittest | 05 August 2017, 06:21:07 UTC |
| b015bc9 | Sanjeev Kulkarni | 05 August 2017, 03:57:12 UTC | If an instance is not connected, stmgr server should return false while sending restore message (#2156) | 05 August 2017, 03:57:12 UTC |
| 7b6228c | Sanjeev Kulkarni | 04 August 2017, 22:29:26 UTC | Sort the task ids to ensure that identical fields grouping tuples (#2155) end up in same task ids even accross runs | 04 August 2017, 22:29:26 UTC |
| 9b0e408 | Sanjeev Kulkarni | 04 August 2017, 19:12:45 UTC | Make sure that metric registration and adding tasks are done once. (#2152) * Refactor spout/bolt code and make sure that metric registration and adding tasks are done once * Changed inited to initialized | 04 August 2017, 19:12:45 UTC |
| e804c7e | Sanjeev Kulkarni | 04 August 2017, 09:53:03 UTC | GetInstances will return only active instances. Instead we want to (#2148) get all local instances | 04 August 2017, 09:53:03 UTC |
| 511c5d7 | Sanjeev Kulkarni | 04 August 2017, 09:49:34 UTC | Refactored common code by moving it to base instance (#2151) | 04 August 2017, 09:49:34 UTC |
| 51b01ee | Sanjeev Kulkarni | 04 August 2017, 03:59:45 UTC | Correct the way we refer to the class member (#2150) * Correct the way we refer to the class member * Fix logic while handling restore state | 04 August 2017, 03:59:45 UTC |
| 8417fad | bed debug | 04 August 2017, 00:39:00 UTC | Add MetricsCacheMetricsProvider (#2113) * add MetricsCache provider * update tracker url: add metrics cache url param * add metrics http reqeust/response * convert protobuf to dhalion * add test * fix error * fix comments * fix comment and compile | 04 August 2017, 00:39:00 UTC |
| 1389a84 | Ashvin | 04 August 2017, 00:38:08 UTC | Add Dhalion detectors and diagnoser implementation for heron (#2132) * First Heron-Dhalion commit to enable topology auto-health-management * Add dhalion dependencies * Build and deploy health manager library * Add utility class to pull metrics from tracker * Connect PackingPlan and Topology providers to the StateMgr * Minor refactor for readability * Refactor code to use latest dhalion api * Add health policy config yaml * Add Heron main class for HealthManager * Fix any issues running HealthManager as a process * Assume all health policy configs to be strings * Isolate policy config specific guice modules * Add event handlers and invoke resolver actions * Fix dhalion package name change related errros * Use JsonPath to parse tracker response * Add bazel dependencies for json path * Replace tracker's metrics call with timeline call * Fix checkstyle errors * Use the Dhalion project's repo as binary source * Update dependencies as per update heron-common * Add sensors for BackPressure and ExecuteCount * Add BufferSizeSensor and refactor sensors * Minor refactor for readability * Refactor sensor code to use latest dhalion api * Make BackPressureSensor configurable, add high-pass-filter * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Added metric name to sensors * Fixed checkstyle errors * Mark HealthManager evolving, remove dead code, improve javadoc * Add sample config file for the HealthManager * Address review comment, use ConfigReader for yaml files * Fix checkstyle errors * Add detector for backpressure and basic diagnoser logic * Improve diagnoser accuracy using instance buffer sizes * Refactor code to use updated diagnoser api improve readability * Make BackPressure detector configurable and add tests * Fix names of symptoms and diagnosis instances * Add load disparity detector and refactor diagnosers * Add pending buffer size disparity anomaly detector * Add large pending buffers anomaly detector * Fix checkstyle errors * Replace tracker's metrics call with timeline call * Add GrowingWaitQDetector * Fixed checkstyle errors * Refactored skew detectors, changed naming, added appropriate stats * Updated diagnosers to take into account more metrics and added new tests * Fixed checkstyle errors * Add metrics duration configuration for all sensors * Compute and provide buffer growth rate for all instances * Decouple HealthManager constructor and tracker Resolves a review comment * Remove interface for constants * Rename healthm so that it matches other components * Address review comments * Add dependency on full proto package instead of sub package * Refactor method consuming command line arguments * Avoid building health manager package Wait for the dhalion jar to be available on maven central before enabling health manager. Also fix healthmgr path in build scripts * Address review comments * Refactor code based on review comments in PR-1980 * Enable health manager build since dhalion is in maven now * Address review comments PR 2101 * Refactor after merging reviewed code * Fix checkstyle errors * Re-enable a detector test | 04 August 2017, 00:38:08 UTC |
| 2428fe3 | Sanjeev Kulkarni | 03 August 2017, 20:35:44 UTC | Use a default value for checkpoint interval if user does not specify it (#2147) | 03 August 2017, 20:35:44 UTC |
| cf53f64 | Sanjeev Kulkarni | 03 August 2017, 19:15:58 UTC | Fix the paths for local stateful storage (#2145) * Fix the paths for local stateful storage * Fix unittest | 03 August 2017, 19:15:58 UTC |
| 6d793f4 | Sanjeev Kulkarni | 03 August 2017, 11:26:39 UTC | For debugging purporses count all words as 1 (#2144) | 03 August 2017, 11:26:39 UTC |
| b431814 | Sanjeev Kulkarni | 03 August 2017, 11:26:16 UTC | Corrected stateful checkpoint location (#2143) | 03 August 2017, 11:26:16 UTC |
| 6664154 | Sanjeev Kulkarni | 03 August 2017, 01:25:17 UTC | Add a string method to print out the state (#2142) | 03 August 2017, 01:25:17 UTC |
| c7f74dc | Sanjeev Kulkarni | 02 August 2017, 23:55:43 UTC | Use appropriate method while manipulating state (#2141) | 02 August 2017, 23:55:43 UTC |
| ef9233d | Sanjeev Kulkarni | 02 August 2017, 23:39:01 UTC | Spout should read input tuples even in non acking mode (#2140) | 02 August 2017, 23:39:01 UTC |
| d6b5f52 | Neng Lu | 02 August 2017, 22:07:02 UTC | initialize instance state if it's null (#2138) | 02 August 2017, 22:07:02 UTC |
| f4f3fd2 | Sanjeev Kulkarni | 02 August 2017, 22:04:28 UTC | Register for stateful messages. Also make sure that state is not empty before parsing it (#2139) | 02 August 2017, 22:04:28 UTC |
| c3172c9 | Sanjeev Kulkarni | 02 August 2017, 21:29:47 UTC | Fix typo for reliability mode (#2137) | 02 August 2017, 21:29:47 UTC |
| 1c74b8a | Neng Lu | 02 August 2017, 20:19:56 UTC | Initialize the instance state before open/prepare instance (#2134) | 02 August 2017, 20:19:56 UTC |
| 77d4f71 | Ali Ahmed | 02 August 2017, 19:08:24 UTC | Add java doc gen for heron api, spi and storm (#2123) Signed-off-by: Ali Ahmed <a.ahmed@streaml.io> | 02 August 2017, 19:08:24 UTC |
| 8539aaa | Sanjeev Kulkarni | 02 August 2017, 17:36:00 UTC | Added exactly once semantics for python (#2135) * Added StatefulComponent interface and exactly once semantics for python topologies * Handle the initiate checkpoint message * Start instance only after start stateful processing is received * Added support to handle restore message * Fix build * Added a stateful example * Added init file * Fixed bugs | 02 August 2017, 17:36:00 UTC |
| 8a1b7fe | Karthik Ramasamy | 02 August 2017, 09:00:10 UTC | Cleanup of params (#2136) * topology submitting user is captured in the cli rather than in submitter main * fix trailing space * fix unit tests | 02 August 2017, 09:00:10 UTC |
