https://github.com/twitter/heron

sort by:
Revision Author Date Message Commit Date
a0a5fc2 clean python state manager 19 September 2017, 22:57:16 UTC
9a4d39e upgrade to protobuf3.4 (#2316) 19 September 2017, 20:40:44 UTC
a507947 take into account feedback from Neng (#2322) 19 September 2017, 18:06:46 UTC
3d8aed1 clean tmater client (#2321) * clean tmater client 19 September 2017, 17:15:11 UTC
a0d80a3 Issue 2219: Provide a bookkeeper based uploader and downloader (#2220) * BK Uploader * Add a BK downloader * remove local repo * Add all dependencies * Fix * Fix errors after bumping guava to 20 * Add more tests * Address checkstyle problems * fix typo * Move heron/dlog to `heron/io/dlog` * Use `shaded` distributedlog jar * Include dlog uploader in apiserver and tools * Allow configuring num-replicas for topologies stored in bookkeeper * Remove redundant dependency * Revert "Use `shaded` distributedlog jar" This reverts commit c63ffbb9034d50211a649cbdca4859b6e079de95. * Revert "Revert "Use `shaded` distributedlog jar"" This reverts commit 9595aca4e62dcc129def11309b06947e5bda0301. * use the new shaded jar * update * Provide a dlog tool for verifying downloader and uploader * Add a README instruction for how to use the dlog tool for verifying downloader and uploader * Disable write lock * Use latest 0.5.0 release * Fix the guava dependency in tests * Fix checkstyle problems * private constructor * Revert the Extractor from singleton to static methods * Make extractor final * Fix checkstyle 19 September 2017, 05:22:02 UTC
dd5f2d7 fix python state manager (#2319) * heron executor exits when statemanager raises exception 19 September 2017, 05:12:38 UTC
481064e Added a Stateful example topology. (#2318) * Added a Stateful example topology. Also fixed a bug while running this * Added the example topology 19 September 2017, 04:39:37 UTC
f00a9f1 Add prometheus metrics web sink. (#2243) * Add prometheus metrics web sink. Provides a simple web server that exposes and endpoint for prometheus to scrape metrics. * revert local metrics_sinks config and remove commented out code. * Remove instance id from stmgr metrices when exporting to prometheus. * Revert local metrics_sink.yaml config. * Rename Metrics to MetricsUtil. 19 September 2017, 03:07:40 UTC
71676ab Seperate Stmgr and Instance Serving in Stmgr (#2313) * Refactored stmgr and instance related communication to seperate classes * First compiling version * Tests compile * More compile time fixes * Pass local data port to stmgr * ensure that we preserve backwards compat with metrics 19 September 2017, 00:58:16 UTC
9ff9889 Upgrade pex (#2314) * upgrade pex in place 18 September 2017, 20:21:07 UTC
f3ea101 Add image pull policy param for kubernetes scheduler. (#2315) 18 September 2017, 05:17:22 UTC
f87d05e Always show links button (logs, job, exceptions, etc..) for instances. (#2312) 15 September 2017, 20:12:00 UTC
2f65be5 Use bufferevent to do Network I/O (#2297) 14 September 2017, 19:12:38 UTC
2d96ddc Fixed the path of the python examples (#2305) 14 September 2017, 06:07:40 UTC
1a4dd55 Bug fixes and integration test for Python DSL (#2304) * Bug fixes and integration tests for python dsl * cleaning up * addressing comments 14 September 2017, 06:07:23 UTC
b12c7e6 fix bugs in stmgr unit test (#2306) * fix stmgr unit test * fix reconnect timer 14 September 2017, 03:57:31 UTC
b06fd91 Split executor args in aurora file so easy to read diff. (#2303) 13 September 2017, 21:18:06 UTC
3843924 Refactoring storm api (#2300) * refactoring storm compatability code and api - Moved all the Storm API to storm-compatibility/ - Modified heron/examples to use storm api only and move to storm-compatibility-examples/. Also removed all dependencies of the twitter API from these examples - Modified heron/examples to use the heron api only and moved to examples/ - Made sure the correct headers are on the storm api related files * fixing storm compatibility api paths * adding back logic to use simulator * fixing examples paths 12 September 2017, 21:48:34 UTC
4dae714 fix tmaster client sends incomplete register request to tmaster (#2291) 12 September 2017, 19:14:56 UTC
150c4a4 Add verbose logging to apiserver. (#2288) 12 September 2017, 17:59:45 UTC
9799dba Add error logging for topology actions on the apiserver. (#2296) * Add error logging for topologoy actions on the apiserver. * Fix spelling. 12 September 2017, 17:54:16 UTC
eb52b81 Fix Python documentation generation issues (#2302) 11 September 2017, 22:17:19 UTC
9f4db0e remove startup scripts (#2298) * remove startup scripts * remove the copying of script file 11 September 2017, 02:50:02 UTC
12c80ac Register requests are sent by instance as request/response pairs (#2294) 08 September 2017, 20:57:27 UTC
19db90d Heron Storm Windowing Compatibility Layer (#2292) 08 September 2017, 17:58:41 UTC
a2acab8 Correcting integration tests structure (#2293) * correcting integration tests structure * correcting build file 08 September 2017, 13:08:57 UTC
2417058 Use Piper class instead of repeating functionality (#2289) 06 September 2017, 21:36:24 UTC
2e7bc17 adding additional unit and integration tests for heron windowing support (#2284) * adding additional unit and integration tests for heron windowing support * moving tests 06 September 2017, 18:52:06 UTC
1f5b57b Reduce example topologies resources. (#2276) * Redeuce example topologies resources. * Reduce examples resources more. 06 September 2017, 04:41:56 UTC
3d18239 healthmgr: aurora heron shell controller (#2283) * healthmgr add aurora heron-shell controller * fix style * wrapper class * address maosong comment * address maosong comment: throw excetion to external logic * update example yaml * fix style 06 September 2017, 03:18:17 UTC
c309ecc Add config mapping for gcs bucket in api server deploy. (#2281) * Add config mapping for gcs bucket in api server deploy. * User heron image. 03 September 2017, 08:22:03 UTC
44e2cd6 cleanup docker scripts (#2277) * add scripts for startup docker and include client install * start a few topologies when you start the docker * added a conf file to start essential services in docker in sandbox mode * docker changes * streamlined docker stuff * remove start services * add supported platforms 03 September 2017, 08:18:33 UTC
21c2378 Add kubernetes service for apiserver. (#2280) * Add kubernetes service for apiserver. * Add comment to service component. 03 September 2017, 05:45:48 UTC
bd77cdf Notify both producer and consumer when init the Communicator (#2279) Currently, when we init the Communicator, the changes will be picked up only when the producer/consumer are notified by other events. It can lead to the race condition. This pull request fixes the issue by notifying both producer/consumer immediately to run with new values. 03 September 2017, 03:07:58 UTC
5a5912b add error log for physical plan check in tmaster (#2267) 01 September 2017, 21:07:00 UTC
bda9ef0 Add kubernetes deploy files. (#2265) * Add kubernetes deploy files. * Make default zookeeper deployment have only 1 container. * Move apiserver yaml config to gcp subdirectory. 01 September 2017, 20:29:54 UTC
da081a7 consistent behavior about when to shade. Shading is done when the final artifacts are generated (#2273) 01 September 2017, 20:29:01 UTC
40a5447 Normalize Shading and fix simulator build (#2271) 01 September 2017, 15:36:50 UTC
110ebd0 Calculate the hostname during constructor rather than during register (#2270) 01 September 2017, 15:36:35 UTC
ca8a05f Make shading uniform accross instance and api (#2266) 31 August 2017, 19:03:39 UTC
23dcad4 Add topology name validation for kubernetes scheduler. (#2264) 31 August 2017, 00:55:56 UTC
aedeab4 [ISSUE-1124] - Windows Bolt support (#2241) https://github.com/twitter/heron/issues/1124 31 August 2017, 00:07:26 UTC
bdd66b3 Read http response for all http response codes. (#2263) * Read http response for all http response codes. * Remove unused import. 30 August 2017, 22:20:55 UTC
0020bd3 ensure empty function with unique names (#2262) 30 August 2017, 20:39:03 UTC
fadd863 Add zookeeper to the heron dist docker ubuntu14.04 (#2259) * Add zookeeper to the heron dist docker ubuntu14.04 * Remove zookeeper home env variable from container. * remove versioned zookeeper directory. 30 August 2017, 19:45:19 UTC
fb441ef changes to make heron compile with bazel 0.5.4 (#2207) * changes to make heron compile with bazel 0.5.1 * changes to compile with bazel 0.5.2 * added bazel 0.5.2 for travis * remove crosstool_top for travis with bazel 0.5.2 * remove crosstool_top for applatix with bazel 0.5.2 * added support for bazel 0.5.4 rc4 candidate * fixed warnings in pkg_tar and heron downloader * upgrade to new bazel 0.5.4 release * changed the path for heron-python-instance target * updated docs to use bazel 0.5.4 and updated heron version to be 0.15.1 30 August 2017, 18:30:46 UTC
c44c4f0 [ISSUE-2170] fix tracker crash when zk root topologies path does not … (#2260) * [ISSUE-2170] fix tracker crash when zk root topologies path does not exist. * Fix checksytle. 30 August 2017, 17:54:43 UTC
b094a62 fix the executor unit test (#2261) 30 August 2017, 07:31:46 UTC
d9176f0 healthmgr check null return value (#2258) * fix null exception * add verbose 29 August 2017, 23:36:14 UTC
9e74bf5 Support components name generated by SummingBird. (#2256) 29 August 2017, 17:32:10 UTC
9df0e59 Renamed Exactly Once to Effectively Once (#2254) * Renamed Exactly Once to Effectively Once * Substitute exactly once with effectively once * Replaced exactly once with effectively once 29 August 2017, 16:58:36 UTC
e931d49 add `restartcontainer` resolver to healthmgr (#2230) * add restartcontainer resolver * add physicalplanprovider * update healthmgr.yaml for local test * fix styple and compile * fix maosong comment * fix compile * GrowingWaitQueueDetector removed * fix ashvin comment * fix compile * change min to ms * add `final` * fix 1. `final` ,2. `empty list`, 3. `synchronized`. 4. `toString()->getName() * add `sync` * refactor PhysicalPlanProvider.get() 29 August 2017, 00:07:48 UTC
8b98ebd Add src id in exception message. (#2252) 28 August 2017, 20:07:09 UTC
15a4621 Move system_config to from common to instance since only instance uses it (#2251) * Move system_config to from common to instance since only instance uses it * Added system config to the init file 27 August 2017, 22:47:55 UTC
57daad4 Move EventLooper and GatewayLooper to instance since no one else uses them (#2250) * Move EventLooper and GatewayLooper to instance since no one else uses them * Fix path * Fix path. Attempt 2 27 August 2017, 21:15:39 UTC
af2a0c6 Moved system_constants from common to instance since only instance uses it (#2249) 27 August 2017, 18:54:38 UTC
4e4bbb1 Deleted unused file (#2248) 27 August 2017, 16:41:36 UTC
fed3aff Include only Topology proto in heron java api jar (#2247) 26 August 2017, 23:52:00 UTC
987975d Remove unused proto (#2246) 26 August 2017, 17:57:51 UTC
d816f44 Upgraded zookeeper to the latest stable version (#2245) 26 August 2017, 16:04:18 UTC
6610ca9 Make metrics cache client in healthMgr fetch location from statemgr (#2232) * Make metrics cache client in healthMgr fetch location from statemgr The metrics cache port is selected at runtime. So a user cannot provide it as a configuration. The cache client needs to fetch it. * Fix checkstyle errors 26 August 2017, 01:05:25 UTC
60f9fff Fix heronpy packaging (#2244) 26 August 2017, 01:02:56 UTC
0ad8e87 Remove unnecessary sub module BUILD files (#2240) * Remove unnecessary sub module BUILD files * More rejiggering of BUILD * More regiggering * Fixed unittest * Fixed the build 26 August 2017, 00:01:31 UTC
41aef74 Removing legacy kakfa connector (#2242) This is dead code that no longer compiles and is being deprecated 25 August 2017, 23:50:13 UTC
fd40efb Move api, dsl, tools, proto and connectors (#2229) * Move api, dsl, connectors and proto to heronpy * Separate heronpy/proto dependency 25 August 2017, 21:54:08 UTC
81c6957 Moved common/python/network to instance/python/network since no one else uses them (#2237) * Moved common/python/network to instance/python/network since no one else uses them * Fixed module path 25 August 2017, 06:28:00 UTC
5cd67de Fix bazel warning (#2239) 25 August 2017, 05:24:19 UTC
57ee7ec Move utils to heron instance (#2233) * Move utils to heron instance This change to remove heron-api dependency for heron-common * Move Pex loader back to common 24 August 2017, 20:30:19 UTC
1a97d45 Added an option to bazel build/test without doing checkstyle. (#2236) If you invoke bazel build heron/... or bazel test heron/..., it will skip checkstyle Also ensured that bazel options are in alphatetical order 24 August 2017, 17:21:13 UTC
8888b59 Convert kubernetes scheduler to use heron downloader. (#2223) * Convert kubernetes scheduler to use heron downloader. * Add comment for heron-conf directory configuration setting. 23 August 2017, 01:33:29 UTC
be1cb38 Make bazel configure python3 friendly (#2228) 22 August 2017, 19:35:50 UTC
716470b Limit size of a single data tuple. (#2224) * Limit size of a single data tuple. * Break line. 22 August 2017, 04:43:15 UTC
1d4e016 Fix yaml health manager config parsing error (#2226) Fixes Issue #2225 21 August 2017, 22:56:52 UTC
2604bc6 0.15.0 documentation release (#2221) * update versions in the website's config.yaml * begin adding brew install instructions to quick start guide * fix python doc issue * finish homebrew instructions * get heronpy version from website YAML config 21 August 2017, 22:55:36 UTC
5deeede Fix Join Bolt implementation (#2215) * Fix Join Bolt implementation * Added some comments to clarify the logic 21 August 2017, 20:55:52 UTC
723ef86 Ability to launch health manager on container-0 (#2203) * Fix long type parsing errors in yaml * Add health manager mode config * Fix checkstyle errors * Add Health Mgr changes to Aurora scheduler * Fix unit test failures 20 August 2017, 03:52:55 UTC
1f2003a Add a heron downloader to download and extract topology packages. (#2216) * Add a heron downloader to download and extract topology packages. * Return instead of calling exit. 20 August 2017, 00:19:39 UTC
96465b3 upgrade gflags and glog to newer versions (#2211) * upgrade gflags and glog * remove old gflags 19 August 2017, 19:27:55 UTC
d4a5cf5 remove inputs from streamlet since the core streamlet class does not use it (#2214) 18 August 2017, 22:17:37 UTC
8b8de79 Removed operation since it is unused (#2213) 18 August 2017, 20:49:44 UTC
02f979e All of dsl methods need to output the same stream. This pr (#2212) makes DslBoltBase as the refactored place where the output is defined and the others make use of it by deriving from it 18 August 2017, 19:30:29 UTC
fe1bbf9 Make the exception style compatible with both python2 and python3 (#2210) 18 August 2017, 05:03:51 UTC
f946fe1 Fixed libtool install command in ubuntu 16.04 (#2208) * Fixed libtool install command in ubuntu 16.04 * Fixed path in docker readme 18 August 2017, 04:52:42 UTC
21d65d0 Upgrade libevent to a more recent stable version (#2209) 17 August 2017, 21:46:51 UTC
f24444e Replace all localhost by 127.0.0.1 (#2204) * Replace all localhost by 127.0.0.1 * removed unneeded change * Fix unittest 17 August 2017, 00:29:11 UTC
e85b232 Documentation changes for 0.15.0 release (#2201) * update versions in the website's config.yaml * begin adding brew install instructions to quick start guide * fix python doc issue 16 August 2017, 00:14:04 UTC
00f81db replace hard coded stmgr port in stmgr_unittest (#1852) * add target to CountDownLatch wait() * check intermediate result * update countDown() * add timeout to CountDownLatch wait() * add test for CountDownLatch * fix mark's comment * change to bind 0 * rephrase comment and refactor d->duration * add debug log * add tuple debug print * remove duplicate common.stmgr_ports_.reserve(common.num_stmgrs_); * add debug print * register new port to tmaster * sync port for tmaster client in dummy stmgr * fix code style * remove print to save test time * fix looper location in the vector * recover dummy instance cpp * clean dummy stmgr * clean debug print in stmgr unit test * clean debug print in stmgr unit test again * fix mtmgr checking * add publisher port setter for metrics mgr client * update checking * update comment * fix bug after merge master * move setPort() to constructor * update comment and style * fix test * move FetchTMasterLocation() after StartStmgrServer() so that the tmaster_client_ will be set actual stmgr_port * print stmgr_port * add log print * update and try again friday * fix tmaster restart on new location test * remove redundant debug log * clean unnecessary change * turn on all tests * address sanjeev comment 15 August 2017, 23:12:34 UTC
fd966ed Fix requests version, fix default env. (#2202) 15 August 2017, 23:11:24 UTC
7a54db0 cleanup the dependencies for generating heron storm jar (#2191) * cleanup the dependencies for generating heron storm jar * added basics-java dependency to heron-storm jar 15 August 2017, 21:49:24 UTC
aa04322 Fix the stateful component overloaded functions in window bolt (#2199) 15 August 2017, 05:00:24 UTC
33d61fe Remove unused third party packages (#2198) 15 August 2017, 04:34:37 UTC
62b8214 Expose all API related classes in Python Packaging (#2197) * Move python packaging to be based on connectors instead of spouts * Removed debug messages * Fix the right version for HERON_VERSION 15 August 2017, 01:28:00 UTC
4f05db6 Update cpplint to the latest release. Minor fixes in the code along the way (#2196) * Update cpplint to the latest release. Minor fixes in the code along the way * Removed excessive printing 14 August 2017, 23:32:41 UTC
c77d3b4 Add health manager operation mode (#2181) * Add health manager operation mode * Add healthMgr to heron core package 14 August 2017, 21:15:49 UTC
ba816dd Fix log level and parameters (#2195) 14 August 2017, 21:09:24 UTC
b9cfd6e Move over from using iteritems to items since its more python3 friendly (#2194) * Move over from using iteritems to items since its more python3 friendly * One missed iteritems in cpplint 14 August 2017, 20:30:07 UTC
d8c9a3a Fix python examples now that spouts have moved to connectors (#2193) 14 August 2017, 19:48:50 UTC
0782fa0 Upgrade to gtest 1.8 (#2192) * Upgrade to gtest 1.8 and it includes gmock 1.8 Remove the old gmock 1.7 directory in third_party * include the googletest 1.8 zip 14 August 2017, 15:08:30 UTC
c7fa60b Follow pythonic idiom of _ instead of camelCase in DSL (#2190) * Follow pythonic idiom of _ instead of camelCase in DSL * Fix build 13 August 2017, 01:58:14 UTC
ff36602 Follow Python idiom of using _ instead of camelCase (#2189) * Follow Python idiom of using _ instead of camelCase * Fixed dsl to follow stateful changes 12 August 2017, 16:58:40 UTC
back to top