9702c8f | Neng Lu | 29 June 2017, 17:45:34 UTC | limit the mem pool size (#2011) | 05 July 2017, 23:12:22 UTC |
bf306ae | Runhang Li | 05 July 2017, 20:39:30 UTC | Dump tcmalloc heap stat. | 05 July 2017, 20:39:30 UTC |
a0ab0e2 | Runhang Li | 05 July 2017, 20:01:39 UTC | Max heap 2048MB, release rate 10 | 05 July 2017, 20:01:39 UTC |
b587fdc | Runhang Li | 05 July 2017, 17:47:47 UTC | Limit heap size to 512MB. | 05 July 2017, 17:47:47 UTC |
0ab3563 | Runhang Li | 27 June 2017, 20:45:32 UTC | Only profile when receiving signal. | 28 June 2017, 22:54:32 UTC |
a5692cf | Runhang Li | 27 June 2017, 18:16:17 UTC | Enable heap prof of stmgr in heron-shell. | 28 June 2017, 22:54:25 UTC |
e7c5f82 | Runhang Li | 19 June 2017, 21:26:10 UTC | Remove duplicate method. | 19 June 2017, 21:26:10 UTC |
b600a37 | Maosong Fu | 16 June 2017, 21:54:58 UTC | Fix inaccurate execute-latency metric (#1969) * Fix inaccurate execute-latency metric Currently in bolt instance, we would use an inaccurate start of time, causing the execute-latency higher than expected, especially when the actual execute-latency is small. This pull request fixes this issue by recording a more accurate start of time. | 19 June 2017, 17:42:21 UTC |
a19f9fe | cckellogg | 14 June 2017, 20:20:48 UTC | Allow any type of file to be downloaded from a container through the shell. (#1959) | 19 June 2017, 17:42:00 UTC |
d59b61e | cckellogg | 14 June 2017, 18:23:46 UTC | Fix ui download file handler. (#1949) Adds a constructor that accepts a baseUrl. | 19 June 2017, 17:41:39 UTC |
41e6f38 | Karthik Ramasamy | 08 June 2017, 21:23:48 UTC | add a readme file for pyheron (#1944) * add a readme file for pyheron * added the URL for streamparse | 08 June 2017, 21:23:48 UTC |
babd3f9 | Sanjeev Kulkarni | 08 June 2017, 21:01:13 UTC | Update documentation regarding topology_bin in the SubmitterMain (#1939) * Cli passes only the file name of the topology_bin. Thus it's not necessary for the schedulers to get the basename. * Removed FileUtil since it's no longer used * Fixed the unittest * Fixed comments based on feedback | 08 June 2017, 21:01:13 UTC |
16a8f25 | John Crawford | 08 June 2017, 17:31:58 UTC | Kubernetes Scheduler Support (#1928) | 08 June 2017, 17:31:58 UTC |
6d5f59b | geoffret | 08 June 2017, 17:04:13 UTC | UpdateTopologyManager using stale topology (#1937) * UpdateTopologyManager using stale topology * Update UpdateTopologyManager to pull Topology again after deactivating topology * Refactor deactivateTopology to return new Topology * deactivateTopology() now returns new Topology * Modified UpdateTopologyManagerTest to allow build | 08 June 2017, 17:04:13 UTC |
d0da9fa | Karthik Ramasamy | 08 June 2017, 05:50:39 UTC | Moved the docker builds and docker images to use open-jdk-8 (#1941) | 08 June 2017, 05:50:39 UTC |
f1dfcc9 | cckellogg | 08 June 2017, 00:00:08 UTC | Add simple script to compile heron and package it in a docker image. (#1934) * Add simple script to compile heron and package it in a docker image. The image created can be used for running heron topologies in environments that support docker containers (DCOS, Kubernetes, etc..). * Add docker image building to the build artifacts script. * Remove platform check when building docker image. * Remove check from setup_scratch_dir(). * Rename run_build_docker to build_docker_image. | 08 June 2017, 00:00:08 UTC |
c2fda3b | cckellogg | 07 June 2017, 23:58:16 UTC | Remove heron core fetching for MarathonScheduler. (#1894) * Remove heron core fetching for MarathonScheduler. The heron core will be installed within the docker image. * Fix style error in MarathonScheduler. * Remove heron core fetching for MarathonScheduler. The heron core will be installed within the docker image. * Fix style error in MarathonScheduler. * Fix ubuntu spelling mistake in website dcos docs. | 07 June 2017, 23:58:16 UTC |
24dd431 | Sanjeev Kulkarni | 07 June 2017, 21:55:16 UTC | When the python pex file is copied over to the container, only (#1926) the base name should be referred | 07 June 2017, 21:55:16 UTC |
858dd7d | Karthik Ramasamy | 07 June 2017, 19:13:04 UTC | Python packaging (#1425) * pyheron packaging * python packaging * python packaging * python packaging * Fixed BUILD and requirements * version is set to 0.0.0 for pyheron if you are building out of a branch * removed the backed up BUILD file * python packaging using wheel files * upgrade to python 2.7.10 in travis * upgrade python 2.7 to 2.7.10 * use different command to upgrade to 2.7.10 in travis * switch the order of packages sources * add sudo pip install * print python versions * python packaging * remove pyheron library creation script * setup.py is automatically generated based on the version | 07 June 2017, 19:13:04 UTC |
adbb9ee | Bill Graham | 05 June 2017, 23:36:24 UTC | UpdateTopologyMaster using stale Topology from initial submission (#1924) * UpdateTopologyManager to use Topology from PhysicalPlan * UpdateTopologyManager to use Topology from PhysicalPlan * Adding comments | 05 June 2017, 23:36:24 UTC |
6dcefbc | Bill Graham | 05 June 2017, 23:35:54 UTC | Adding sleep to TestSpout to throttle down cpu usage (#1925) | 05 June 2017, 23:35:54 UTC |
efdee1f | Bill Graham | 05 June 2017, 22:04:47 UTC | Fixing logging bug in UpdateTopologyManager (#1931) | 05 June 2017, 22:04:47 UTC |
b8616e9 | Runhang Li | 05 June 2017, 21:36:01 UTC | Fix heron-shell dependency (#1930) | 05 June 2017, 21:36:01 UTC |
53048df | Runhang Li | 02 June 2017, 21:32:45 UTC | Decode serialized value in heron-tracker. (#1927) | 02 June 2017, 21:32:45 UTC |
3a9af24 | Runhang Li | 01 June 2017, 17:36:51 UTC | Asyncly handle subprocess stdout/stderr in client. (#1923) | 01 June 2017, 17:36:51 UTC |
97c7c40 | Sanjeev Kulkarni | 31 May 2017, 20:08:06 UTC | Removed per client/server specific acquire/release and consolidated them in one place (#1914) | 31 May 2017, 20:08:06 UTC |
3c3b176 | Runhang Li | 31 May 2017, 17:57:08 UTC | Add back missing arguments. (#1921) | 31 May 2017, 17:57:08 UTC |
399cbdd | Bill Graham | 31 May 2017, 00:09:16 UTC | Remove unused heron.instance.slave.fetch.pplan.interval.sec (#1920) | 31 May 2017, 00:09:16 UTC |
88391ba | Bill Graham | 30 May 2017, 21:56:25 UTC | Clean up exception handling in common tests (#1919) | 30 May 2017, 21:56:25 UTC |
42a6bb1 | Bill Graham | 30 May 2017, 21:56:11 UTC | Remove unused heron.instance.state.check.interval.sec config (#1916) | 30 May 2017, 21:56:11 UTC |
0568bfa | Neng Lu | 30 May 2017, 21:25:44 UTC | update STATEFUL_YAML to STATEFUL_CONFIG_YAML (#1917) | 30 May 2017, 21:25:44 UTC |
db9e08a | John Crawford | 30 May 2017, 17:35:53 UTC | Add authentication for Marathon scheduler (#1871) | 30 May 2017, 17:35:53 UTC |
e242f53 | bed debug | 30 May 2017, 17:29:55 UTC | Override stmgr max packet size config (#1912) | 30 May 2017, 17:29:55 UTC |
554ccc9 | Bill Graham | 30 May 2017, 17:15:25 UTC | Update grouping tests to not use Thread.sleep() (#1909) * Update grouping tests to not use Thread.sleep() * Update grouping tests to not use Thread.sleep() * Update grouping tests to not use Thread.sleep() | 30 May 2017, 17:15:25 UTC |
8e5c6dc | Bill Graham | 30 May 2017, 17:15:06 UTC | Refactor network tests to use NIO selectors instead of sleep() (#1910) * Refactor network tests to use NIO selectors instead of sleep() * Refactor network tests to use NIO selectors instead of sleep() | 30 May 2017, 17:15:06 UTC |
b5de046 | Kanishk Karanawat | 28 May 2017, 05:36:35 UTC | Fixed render issue for max back pressure (#1913) | 28 May 2017, 05:36:35 UTC |
990ae5e | Sanjeev Kulkarni | 27 May 2017, 03:56:23 UTC | Added helper methods to physial plan helper (#1905) | 27 May 2017, 03:56:23 UTC |
9fd3da2 | Kanishk Karanawat | 27 May 2017, 00:45:05 UTC | Add API support for backpressure metric (instance level) & display backpressure (instance level) in Heron UI (#1791) | 27 May 2017, 00:45:05 UTC |
6858133 | Bill Graham | 26 May 2017, 23:14:18 UTC | Removes the last 2 instances of Thread.sleep() from the tests (#1911) * refactor metrics manager tests to not use THread.sleep * Also refactoring MetricsCacheSinkTest * Remove the last 2 instances of Thread.sleep() * fix javadocs * merge from master | 26 May 2017, 23:14:18 UTC |
6d81d8c | Bill Graham | 26 May 2017, 20:52:01 UTC | Refactor BoltInstanceTest and SpoutInstanceTest to not use Thread.sleep() (#1900) * Add SlaveTester to centralize duplicate slave, looper, communicator test logic * Decoupled CommunicatorTester from SlaveTester * consolidate duplicate initialization logic * Removing sleeps from bolt/spout tests, clean up communicator * Moving field into Constants and removing unused Constant values * Update AbstractNetworkTest to use the new CommunicatorTester constructor * Move countdown latch past the static increment logic * Make expectedTuples final | 26 May 2017, 20:52:01 UTC |
f64afa0 | Huijun Wu | 26 May 2017, 17:55:56 UTC | Merge pull request #1865 from huijunwu/order_unittest improve order_unittest | 26 May 2017, 17:55:56 UTC |
093278e | Huijun Wu | 26 May 2017, 17:50:36 UTC | Merge branch 'master' of https://github.com/twitter/heron into order_unittest | 26 May 2017, 17:50:36 UTC |
07067e6 | Neng Lu | 26 May 2017, 17:46:49 UTC | fix unit test (#1906) | 26 May 2017, 17:46:49 UTC |
cc5a5b9 | Neng Lu | 26 May 2017, 00:59:10 UTC | add ckptmgr client in tmaster (#1901) | 26 May 2017, 00:59:10 UTC |
f71ada3 | Neng Lu | 26 May 2017, 00:58:49 UTC | add ckptmgr client in stmgr (#1902) | 26 May 2017, 00:58:49 UTC |
a9cf457 | Sanjeev Kulkarni | 26 May 2017, 00:24:47 UTC | Added helper methods for stateful operations (#1898) * Added helper methods for stateful operations * Took feedback into consideration * Use common method to elminate repetive code | 26 May 2017, 00:24:47 UTC |
233b54f | Huijun Wu | 26 May 2017, 00:24:05 UTC | replace 5 seconds to const val | 26 May 2017, 00:24:05 UTC |
595e709 | Bill Graham | 26 May 2017, 00:12:28 UTC | Refactor common netwrok test code into a superclass (#1899) * Add SlaveTester to centralize duplicate slave, looper, communicator test logic * Decoupled CommunicatorTester from SlaveTester * Refactoring out duplicate code in network tests * consolidate duplicate initialization logic * fix typo * clean-up per feedback | 26 May 2017, 00:12:28 UTC |
d60c52c | Neng Lu | 25 May 2017, 23:23:57 UTC | cleanup stateful configs and statefulstorage package (#1903) | 25 May 2017, 23:23:57 UTC |
9ea9e85 | Bill Graham | 25 May 2017, 19:53:21 UTC | Add SlaveTester to centralize duplicate slave, looper, communicator test logic (#1893) * Add SlaveTester to centralize duplicate slave, looper, communicator test logic * Decoupled CommunicatorTester from SlaveTester * consolidate duplicate initialization logic | 25 May 2017, 19:53:21 UTC |
a4b9da2 | Bill Graham | 25 May 2017, 19:08:30 UTC | refactor metrics manager tests to not use Thread.sleep (#1887) * refactor metrics manager tests to not use THread.sleep * Also refactoring MetricsCacheSinkTest | 25 May 2017, 19:08:30 UTC |
f8a5cf9 | Bill Graham | 25 May 2017, 18:04:24 UTC | Another attempt to fix flakey HeronServerTest (#1897) | 25 May 2017, 18:04:24 UTC |
4bdaab3 | Sanjeev Kulkarni | 25 May 2017, 17:43:28 UTC | Added config variable/helper function that govern the amount of (#1896) data stmgr can buffer waiting for checkpoint markers before giving up | 25 May 2017, 17:43:28 UTC |
6903a6f | Bill Graham | 24 May 2017, 23:08:45 UTC | Fix flakey HeronServerTest test (#1895) | 24 May 2017, 23:08:45 UTC |
f4ffebe | Huijun Wu | 24 May 2017, 21:46:56 UTC | delete latch | 24 May 2017, 21:46:56 UTC |
5a41479 | Huijun Wu | 24 May 2017, 21:42:04 UTC | Merge branch 'master' of https://github.com/twitter/heron into order_unittest | 24 May 2017, 21:42:04 UTC |
1921c19 | Huijun Wu | 24 May 2017, 21:34:52 UTC | Merge pull request #1847 from huijunwu/bind0 use bind port 0 to solve port conflict in switch_unittest.cpp | 24 May 2017, 21:34:52 UTC |
7c369dc | Neng Lu | 24 May 2017, 20:10:31 UTC | start ckptmgr in heron_executor if topology is stateful (#1885) | 24 May 2017, 20:10:31 UTC |
085ef61 | Huijun Wu | 24 May 2017, 18:14:09 UTC | delete latch | 24 May 2017, 18:14:09 UTC |
3733547 | bed debug | 24 May 2017, 02:22:08 UTC | Check intermediate result of metricsMgrTmasterLatch in stmgr unit test (#1832) | 24 May 2017, 02:22:08 UTC |
9c962ca | Bill Graham | 23 May 2017, 23:35:50 UTC | Refactor ActivateDeactivateTest to not use Thread.sleep() (#1892) | 23 May 2017, 23:35:50 UTC |
087044e | Bill Graham | 23 May 2017, 23:29:27 UTC | Refactor CacheCoreTest to not use Thread.sleep() (#1890) | 23 May 2017, 23:29:27 UTC |
5ebe82d | Bill Graham | 23 May 2017, 22:12:14 UTC | Refactor WebSionkTest to not use Thread.sleep() (#1889) | 23 May 2017, 22:12:14 UTC |
404e4ab | Bill Graham | 23 May 2017, 16:47:49 UTC | Update HeronServerTest to use HeronServerTester (#1886) | 23 May 2017, 16:47:49 UTC |
6dbfb8b | Runhang Li | 22 May 2017, 23:09:53 UTC | Further improve heron-shell (#1882) | 22 May 2017, 23:09:53 UTC |
b81446d | bed debug | 22 May 2017, 23:06:33 UTC | addd integration-test to eclipse setup (#1883) | 22 May 2017, 23:06:33 UTC |
bc20dba | Bill Graham | 22 May 2017, 21:45:20 UTC | Update EchoTest to use HeronServerTester (#1884) | 22 May 2017, 21:45:20 UTC |
053c77c | Neng Lu | 22 May 2017, 17:57:26 UTC | update stateful related configs (#1881) update stateful related configs | 22 May 2017, 17:57:26 UTC |
514705c | Bill Graham | 22 May 2017, 16:55:53 UTC | Add support for emit direct (#1855) * Adding support for direct grouping * remove mistaken commit * Renamed variables to emitDirectTaskId to be more explicit | 22 May 2017, 16:55:53 UTC |
4e6c5ba | Bill Graham | 22 May 2017, 16:54:32 UTC | Clean up SinkExecutorTest (#1878) | 22 May 2017, 16:54:32 UTC |
1fe1d5a | Neng Lu | 19 May 2017, 18:18:59 UTC | add stateful config and util methods (#1873) * add stateful config file and methods * add local and aurora stateful config * add dummy stateful.yaml for other schedulers * add stateful.yaml and fix test * update method name * address comment | 19 May 2017, 18:18:59 UTC |
a8ffec3 | Bill Graham | 19 May 2017, 16:01:05 UTC | Update CheckpointManagerServerTest to nto use HeronServerTester (#1877) | 19 May 2017, 16:01:05 UTC |
191af53 | Bill Graham | 19 May 2017, 15:59:48 UTC | Remove Thread.sleep() from SinkExecutorTest (#1876) * Remove Thread.sleep() from SinkExecutorTest * Remove Thread.sleep() from SinkExecutorTest | 19 May 2017, 15:59:48 UTC |
cafbac3 | Bill Graham | 18 May 2017, 23:59:26 UTC | Adding new HeronServerTester to simplify testing servers (#1870) * Adding new HeronServerTester to simplify testing servers * Adding more javadocs * Adding more common functionality required for other HeronServer test classes * Moving inner classes out of HeronServerTester | 18 May 2017, 23:59:26 UTC |
9fabe0a | Sanjeev Kulkarni | 18 May 2017, 23:49:30 UTC | Label the different ports so that it is easier to see which port maps (#1875) to which functionality | 18 May 2017, 23:49:30 UTC |
eb7d472 | Sanjeev Kulkarni | 18 May 2017, 23:31:37 UTC | Marathon does not allow upper case applications (#1874) | 18 May 2017, 23:31:37 UTC |
8a27705 | Neng Lu | 18 May 2017, 22:02:38 UTC | add tmaster zk watch on tmaster location (#1872) | 18 May 2017, 22:02:38 UTC |
e3f317b | Bill Graham | 17 May 2017, 23:09:34 UTC | Fix heron/common targets to be mutually exclusive (#1867) | 17 May 2017, 23:09:34 UTC |
d66f453 | Neng Lu | 17 May 2017, 22:18:20 UTC | add stateful checkpoints support in cpp statemgr (#1861) | 17 May 2017, 22:18:20 UTC |
6f5ee97 | Neng Lu | 17 May 2017, 21:53:13 UTC | package ckptmgr and statefulstorages into heron-core (#1866) | 17 May 2017, 21:53:13 UTC |
27971da | Huijun Wu | 17 May 2017, 20:34:51 UTC | add trace for potential timeout checking | 17 May 2017, 20:34:51 UTC |
96ef8e7 | Huijun Wu | 17 May 2017, 20:18:16 UTC | bind port 0; replace join with async | 17 May 2017, 20:18:16 UTC |
a905add | Bill Graham | 17 May 2017, 18:43:46 UTC | Use Duration to represent durations of time instead of primatives (#1863) * Change SystemConfig and HeronSocketOptions to use ByteAmount * Remove unused imports * Update ckptmgr code * remove import * Use Duration to represent durations of time instead of longs * Changing CheckpointManagerConfigs to also use Duration | 17 May 2017, 18:43:46 UTC |
7b90604 | Neng Lu | 17 May 2017, 17:57:30 UTC | add stateful checkpoints support for java statemgrs (#1862) * add stateful checkpoints support for java statemgrs * refactor code * update method names | 17 May 2017, 17:57:30 UTC |
e9c1488 | Runhang Li | 17 May 2017, 16:39:17 UTC | heron-shell refactor (#1864) | 17 May 2017, 16:39:17 UTC |
53311d5 | Bill Graham | 16 May 2017, 19:05:50 UTC | Change SystemConfig and HeronSocketOptions to use ByteAmount (#1860) * Change SystemConfig and HeronSocketOptions to use ByteAmount * Remove unused imports * Update ckptmgr code * remove import | 16 May 2017, 19:05:50 UTC |
52e3ec6 | Neng Lu | 15 May 2017, 21:59:09 UTC | fix the flaky ckptmgr server test (#1858) | 15 May 2017, 21:59:09 UTC |
b1ff278 | Sanjeev Kulkarni | 14 May 2017, 17:09:00 UTC | Added Checkpoint Manager for stateful topologies (#1831) * Added Checkpoint Manager for stateful topologies | 14 May 2017, 17:09:00 UTC |
3fb4350 | John Crawford | 11 May 2017, 18:29:25 UTC | Added docs for marathon / dcos deployments (#1851) | 11 May 2017, 18:29:25 UTC |
988be93 | Huijun Wu | 10 May 2017, 22:22:19 UTC | add port==0 in if checking | 10 May 2017, 22:22:19 UTC |
9e4067f | Neng Lu | 10 May 2017, 18:02:42 UTC | fix aurora to use maximum resources to start containers (#1850) * use scheduled resource to start aurora job | 10 May 2017, 18:02:42 UTC |
050d3e8 | Huijun Wu | 09 May 2017, 21:44:53 UTC | add comments; replace global var | 09 May 2017, 21:44:53 UTC |
52855f6 | Neng Lu | 08 May 2017, 23:39:39 UTC | Make storm.Config don't extend heron.api.Config (#1842) * make storm.Config don't extend heron.api.Config | 08 May 2017, 23:39:39 UTC |
98568c4 | Huijun Wu | 08 May 2017, 22:58:33 UTC | add 1 more check | 08 May 2017, 22:58:33 UTC |
5367fc0 | Huijun Wu | 08 May 2017, 22:49:03 UTC | add header | 08 May 2017, 22:49:03 UTC |
f124e44 | Huijun Wu | 08 May 2017, 22:45:14 UTC | sync for port transfer between threads | 08 May 2017, 22:45:14 UTC |
aeebc81 | Huijun Wu | 08 May 2017, 22:34:59 UTC | replace hard coded port to bind0 | 08 May 2017, 22:34:59 UTC |
de06fac | Huijun Wu | 08 May 2017, 22:30:01 UTC | update port after bind/listen | 08 May 2017, 22:30:01 UTC |
9f4a914 | Andrew Jorgensen | 08 May 2017, 17:29:54 UTC | Stream subprocess stdout and stderr in heron-executor (#1840) | 08 May 2017, 17:29:54 UTC |
a037526 | Maosong Fu | 05 May 2017, 21:15:13 UTC | Fail Heron-instance fast for errors (#1839) | 05 May 2017, 21:15:13 UTC |