https://github.com/twitter/heron

sort by:
Revision Author Date Message Commit Date
9702c8f limit the mem pool size (#2011) 05 July 2017, 23:12:22 UTC
bf306ae Dump tcmalloc heap stat. 05 July 2017, 20:39:30 UTC
a0ab0e2 Max heap 2048MB, release rate 10 05 July 2017, 20:01:39 UTC
b587fdc Limit heap size to 512MB. 05 July 2017, 17:47:47 UTC
0ab3563 Only profile when receiving signal. 28 June 2017, 22:54:32 UTC
a5692cf Enable heap prof of stmgr in heron-shell. 28 June 2017, 22:54:25 UTC
e7c5f82 Remove duplicate method. 19 June 2017, 21:26:10 UTC
b600a37 Fix inaccurate execute-latency metric (#1969) * Fix inaccurate execute-latency metric Currently in bolt instance, we would use an inaccurate start of time, causing the execute-latency higher than expected, especially when the actual execute-latency is small. This pull request fixes this issue by recording a more accurate start of time. 19 June 2017, 17:42:21 UTC
a19f9fe Allow any type of file to be downloaded from a container through the shell. (#1959) 19 June 2017, 17:42:00 UTC
d59b61e Fix ui download file handler. (#1949) Adds a constructor that accepts a baseUrl. 19 June 2017, 17:41:39 UTC
41e6f38 add a readme file for pyheron (#1944) * add a readme file for pyheron * added the URL for streamparse 08 June 2017, 21:23:48 UTC
babd3f9 Update documentation regarding topology_bin in the SubmitterMain (#1939) * Cli passes only the file name of the topology_bin. Thus it's not necessary for the schedulers to get the basename. * Removed FileUtil since it's no longer used * Fixed the unittest * Fixed comments based on feedback 08 June 2017, 21:01:13 UTC
16a8f25 Kubernetes Scheduler Support (#1928) 08 June 2017, 17:31:58 UTC
6d5f59b UpdateTopologyManager using stale topology (#1937) * UpdateTopologyManager using stale topology * Update UpdateTopologyManager to pull Topology again after deactivating topology * Refactor deactivateTopology to return new Topology * deactivateTopology() now returns new Topology * Modified UpdateTopologyManagerTest to allow build 08 June 2017, 17:04:13 UTC
d0da9fa Moved the docker builds and docker images to use open-jdk-8 (#1941) 08 June 2017, 05:50:39 UTC
f1dfcc9 Add simple script to compile heron and package it in a docker image. (#1934) * Add simple script to compile heron and package it in a docker image. The image created can be used for running heron topologies in environments that support docker containers (DCOS, Kubernetes, etc..). * Add docker image building to the build artifacts script. * Remove platform check when building docker image. * Remove check from setup_scratch_dir(). * Rename run_build_docker to build_docker_image. 08 June 2017, 00:00:08 UTC
c2fda3b Remove heron core fetching for MarathonScheduler. (#1894) * Remove heron core fetching for MarathonScheduler. The heron core will be installed within the docker image. * Fix style error in MarathonScheduler. * Remove heron core fetching for MarathonScheduler. The heron core will be installed within the docker image. * Fix style error in MarathonScheduler. * Fix ubuntu spelling mistake in website dcos docs. 07 June 2017, 23:58:16 UTC
24dd431 When the python pex file is copied over to the container, only (#1926) the base name should be referred 07 June 2017, 21:55:16 UTC
858dd7d Python packaging (#1425) * pyheron packaging * python packaging * python packaging * python packaging * Fixed BUILD and requirements * version is set to 0.0.0 for pyheron if you are building out of a branch * removed the backed up BUILD file * python packaging using wheel files * upgrade to python 2.7.10 in travis * upgrade python 2.7 to 2.7.10 * use different command to upgrade to 2.7.10 in travis * switch the order of packages sources * add sudo pip install * print python versions * python packaging * remove pyheron library creation script * setup.py is automatically generated based on the version 07 June 2017, 19:13:04 UTC
adbb9ee UpdateTopologyMaster using stale Topology from initial submission (#1924) * UpdateTopologyManager to use Topology from PhysicalPlan * UpdateTopologyManager to use Topology from PhysicalPlan * Adding comments 05 June 2017, 23:36:24 UTC
6dcefbc Adding sleep to TestSpout to throttle down cpu usage (#1925) 05 June 2017, 23:35:54 UTC
efdee1f Fixing logging bug in UpdateTopologyManager (#1931) 05 June 2017, 22:04:47 UTC
b8616e9 Fix heron-shell dependency (#1930) 05 June 2017, 21:36:01 UTC
53048df Decode serialized value in heron-tracker. (#1927) 02 June 2017, 21:32:45 UTC
3a9af24 Asyncly handle subprocess stdout/stderr in client. (#1923) 01 June 2017, 17:36:51 UTC
97c7c40 Removed per client/server specific acquire/release and consolidated them in one place (#1914) 31 May 2017, 20:08:06 UTC
3c3b176 Add back missing arguments. (#1921) 31 May 2017, 17:57:08 UTC
399cbdd Remove unused heron.instance.slave.fetch.pplan.interval.sec (#1920) 31 May 2017, 00:09:16 UTC
88391ba Clean up exception handling in common tests (#1919) 30 May 2017, 21:56:25 UTC
42a6bb1 Remove unused heron.instance.state.check.interval.sec config (#1916) 30 May 2017, 21:56:11 UTC
0568bfa update STATEFUL_YAML to STATEFUL_CONFIG_YAML (#1917) 30 May 2017, 21:25:44 UTC
db9e08a Add authentication for Marathon scheduler (#1871) 30 May 2017, 17:35:53 UTC
e242f53 Override stmgr max packet size config (#1912) 30 May 2017, 17:29:55 UTC
554ccc9 Update grouping tests to not use Thread.sleep() (#1909) * Update grouping tests to not use Thread.sleep() * Update grouping tests to not use Thread.sleep() * Update grouping tests to not use Thread.sleep() 30 May 2017, 17:15:25 UTC
8e5c6dc Refactor network tests to use NIO selectors instead of sleep() (#1910) * Refactor network tests to use NIO selectors instead of sleep() * Refactor network tests to use NIO selectors instead of sleep() 30 May 2017, 17:15:06 UTC
b5de046 Fixed render issue for max back pressure (#1913) 28 May 2017, 05:36:35 UTC
990ae5e Added helper methods to physial plan helper (#1905) 27 May 2017, 03:56:23 UTC
9fd3da2 Add API support for backpressure metric (instance level) & display backpressure (instance level) in Heron UI (#1791) 27 May 2017, 00:45:05 UTC
6858133 Removes the last 2 instances of Thread.sleep() from the tests (#1911) * refactor metrics manager tests to not use THread.sleep * Also refactoring MetricsCacheSinkTest * Remove the last 2 instances of Thread.sleep() * fix javadocs * merge from master 26 May 2017, 23:14:18 UTC
6d81d8c Refactor BoltInstanceTest and SpoutInstanceTest to not use Thread.sleep() (#1900) * Add SlaveTester to centralize duplicate slave, looper, communicator test logic * Decoupled CommunicatorTester from SlaveTester * consolidate duplicate initialization logic * Removing sleeps from bolt/spout tests, clean up communicator * Moving field into Constants and removing unused Constant values * Update AbstractNetworkTest to use the new CommunicatorTester constructor * Move countdown latch past the static increment logic * Make expectedTuples final 26 May 2017, 20:52:01 UTC
f64afa0 Merge pull request #1865 from huijunwu/order_unittest improve order_unittest 26 May 2017, 17:55:56 UTC
093278e Merge branch 'master' of https://github.com/twitter/heron into order_unittest 26 May 2017, 17:50:36 UTC
07067e6 fix unit test (#1906) 26 May 2017, 17:46:49 UTC
cc5a5b9 add ckptmgr client in tmaster (#1901) 26 May 2017, 00:59:10 UTC
f71ada3 add ckptmgr client in stmgr (#1902) 26 May 2017, 00:58:49 UTC
a9cf457 Added helper methods for stateful operations (#1898) * Added helper methods for stateful operations * Took feedback into consideration * Use common method to elminate repetive code 26 May 2017, 00:24:47 UTC
233b54f replace 5 seconds to const val 26 May 2017, 00:24:05 UTC
595e709 Refactor common netwrok test code into a superclass (#1899) * Add SlaveTester to centralize duplicate slave, looper, communicator test logic * Decoupled CommunicatorTester from SlaveTester * Refactoring out duplicate code in network tests * consolidate duplicate initialization logic * fix typo * clean-up per feedback 26 May 2017, 00:12:28 UTC
d60c52c cleanup stateful configs and statefulstorage package (#1903) 25 May 2017, 23:23:57 UTC
9ea9e85 Add SlaveTester to centralize duplicate slave, looper, communicator test logic (#1893) * Add SlaveTester to centralize duplicate slave, looper, communicator test logic * Decoupled CommunicatorTester from SlaveTester * consolidate duplicate initialization logic 25 May 2017, 19:53:21 UTC
a4b9da2 refactor metrics manager tests to not use Thread.sleep (#1887) * refactor metrics manager tests to not use THread.sleep * Also refactoring MetricsCacheSinkTest 25 May 2017, 19:08:30 UTC
f8a5cf9 Another attempt to fix flakey HeronServerTest (#1897) 25 May 2017, 18:04:24 UTC
4bdaab3 Added config variable/helper function that govern the amount of (#1896) data stmgr can buffer waiting for checkpoint markers before giving up 25 May 2017, 17:43:28 UTC
6903a6f Fix flakey HeronServerTest test (#1895) 24 May 2017, 23:08:45 UTC
f4ffebe delete latch 24 May 2017, 21:46:56 UTC
5a41479 Merge branch 'master' of https://github.com/twitter/heron into order_unittest 24 May 2017, 21:42:04 UTC
1921c19 Merge pull request #1847 from huijunwu/bind0 use bind port 0 to solve port conflict in switch_unittest.cpp 24 May 2017, 21:34:52 UTC
7c369dc start ckptmgr in heron_executor if topology is stateful (#1885) 24 May 2017, 20:10:31 UTC
085ef61 delete latch 24 May 2017, 18:14:09 UTC
3733547 Check intermediate result of metricsMgrTmasterLatch in stmgr unit test (#1832) 24 May 2017, 02:22:08 UTC
9c962ca Refactor ActivateDeactivateTest to not use Thread.sleep() (#1892) 23 May 2017, 23:35:50 UTC
087044e Refactor CacheCoreTest to not use Thread.sleep() (#1890) 23 May 2017, 23:29:27 UTC
5ebe82d Refactor WebSionkTest to not use Thread.sleep() (#1889) 23 May 2017, 22:12:14 UTC
404e4ab Update HeronServerTest to use HeronServerTester (#1886) 23 May 2017, 16:47:49 UTC
6dbfb8b Further improve heron-shell (#1882) 22 May 2017, 23:09:53 UTC
b81446d addd integration-test to eclipse setup (#1883) 22 May 2017, 23:06:33 UTC
bc20dba Update EchoTest to use HeronServerTester (#1884) 22 May 2017, 21:45:20 UTC
053c77c update stateful related configs (#1881) update stateful related configs 22 May 2017, 17:57:26 UTC
514705c Add support for emit direct (#1855) * Adding support for direct grouping * remove mistaken commit * Renamed variables to emitDirectTaskId to be more explicit 22 May 2017, 16:55:53 UTC
4e6c5ba Clean up SinkExecutorTest (#1878) 22 May 2017, 16:54:32 UTC
1fe1d5a add stateful config and util methods (#1873) * add stateful config file and methods * add local and aurora stateful config * add dummy stateful.yaml for other schedulers * add stateful.yaml and fix test * update method name * address comment 19 May 2017, 18:18:59 UTC
a8ffec3 Update CheckpointManagerServerTest to nto use HeronServerTester (#1877) 19 May 2017, 16:01:05 UTC
191af53 Remove Thread.sleep() from SinkExecutorTest (#1876) * Remove Thread.sleep() from SinkExecutorTest * Remove Thread.sleep() from SinkExecutorTest 19 May 2017, 15:59:48 UTC
cafbac3 Adding new HeronServerTester to simplify testing servers (#1870) * Adding new HeronServerTester to simplify testing servers * Adding more javadocs * Adding more common functionality required for other HeronServer test classes * Moving inner classes out of HeronServerTester 18 May 2017, 23:59:26 UTC
9fabe0a Label the different ports so that it is easier to see which port maps (#1875) to which functionality 18 May 2017, 23:49:30 UTC
eb7d472 Marathon does not allow upper case applications (#1874) 18 May 2017, 23:31:37 UTC
8a27705 add tmaster zk watch on tmaster location (#1872) 18 May 2017, 22:02:38 UTC
e3f317b Fix heron/common targets to be mutually exclusive (#1867) 17 May 2017, 23:09:34 UTC
d66f453 add stateful checkpoints support in cpp statemgr (#1861) 17 May 2017, 22:18:20 UTC
6f5ee97 package ckptmgr and statefulstorages into heron-core (#1866) 17 May 2017, 21:53:13 UTC
27971da add trace for potential timeout checking 17 May 2017, 20:34:51 UTC
96ef8e7 bind port 0; replace join with async 17 May 2017, 20:18:16 UTC
a905add Use Duration to represent durations of time instead of primatives (#1863) * Change SystemConfig and HeronSocketOptions to use ByteAmount * Remove unused imports * Update ckptmgr code * remove import * Use Duration to represent durations of time instead of longs * Changing CheckpointManagerConfigs to also use Duration 17 May 2017, 18:43:46 UTC
7b90604 add stateful checkpoints support for java statemgrs (#1862) * add stateful checkpoints support for java statemgrs * refactor code * update method names 17 May 2017, 17:57:30 UTC
e9c1488 heron-shell refactor (#1864) 17 May 2017, 16:39:17 UTC
53311d5 Change SystemConfig and HeronSocketOptions to use ByteAmount (#1860) * Change SystemConfig and HeronSocketOptions to use ByteAmount * Remove unused imports * Update ckptmgr code * remove import 16 May 2017, 19:05:50 UTC
52e3ec6 fix the flaky ckptmgr server test (#1858) 15 May 2017, 21:59:09 UTC
b1ff278 Added Checkpoint Manager for stateful topologies (#1831) * Added Checkpoint Manager for stateful topologies 14 May 2017, 17:09:00 UTC
3fb4350 Added docs for marathon / dcos deployments (#1851) 11 May 2017, 18:29:25 UTC
988be93 add port==0 in if checking 10 May 2017, 22:22:19 UTC
9e4067f fix aurora to use maximum resources to start containers (#1850) * use scheduled resource to start aurora job 10 May 2017, 18:02:42 UTC
050d3e8 add comments; replace global var 09 May 2017, 21:44:53 UTC
52855f6 Make storm.Config don't extend heron.api.Config (#1842) * make storm.Config don't extend heron.api.Config 08 May 2017, 23:39:39 UTC
98568c4 add 1 more check 08 May 2017, 22:58:33 UTC
5367fc0 add header 08 May 2017, 22:49:03 UTC
f124e44 sync for port transfer between threads 08 May 2017, 22:45:14 UTC
aeebc81 replace hard coded port to bind0 08 May 2017, 22:34:59 UTC
de06fac update port after bind/listen 08 May 2017, 22:30:01 UTC
9f4a914 Stream subprocess stdout and stderr in heron-executor (#1840) 08 May 2017, 17:29:54 UTC
a037526 Fail Heron-instance fast for errors (#1839) 05 May 2017, 21:15:13 UTC
back to top