https://github.com/twitter/heron

sort by:
Revision Author Date Message Commit Date
2e71b82 Nwang/clean trailing white space (#2989) * Clean up trailing spaces * update 20 August 2018, 22:30:21 UTC
e9351b0 Yaoli/test (#2987) * just test * only test the second one * add log in heron_executor.py * reset test.json * fix test.json 20 August 2018, 20:29:53 UTC
d135746 use cereal lib configured in WORKSPACE (#2986) 20 August 2018, 17:27:21 UTC
516eca3 Extending update command to allow number of containers to be modified at runtime (#2980) * added num containers to heron cli * bug fix * updated apiserver to accept container num * removed bug that did allow correct parallelism to be supplied when new containers were supplied * corrected variable in update.py * bug fix * removed unused comment * added cumulative outgoing queue size * added num containers to heron cli * bug fix * updated apiserver to accept container num * removed bug that did allow correct parallelism to be supplied when new containers were supplied * corrected variable in update.py * bug fix * removed unused comment * added cumulative outgoing queue size * bug fix * remove extra code * removed extra code 17 August 2018, 15:38:24 UTC
d669d06 Metrics added to measure the rate at which tuples are added to the queue at spout gateway (#2981) * added metrics to measure tuples added to outgoing queue per min * added metric to full metrics instance * added cumulative outgoing queue size * measuring number of tuples per tupleset * added comment justifying use of metrics * removed extra comment 17 August 2018, 15:37:51 UTC
19375a5 Nwang/add missing licenses (#2984) * Add missing license headers * revert non-heron files * more files 17 August 2018, 15:33:33 UTC
d2946ce Docker Ubuntu tweaks (#2975) * Added .vagrant to gitignore * Updated ubuntu docker images to use headless jdk + reduced update calls - Altered the ubuntu dockerfiles to use the headless jdk, which prevents the containers downloading a lot of pointless GUI libraries. - Changed the command order of the 14.04 compile file to reduce the overall number of `apt-get update` commands. - Removed ubutnu 15.10 option as this version of ubuntu is no longer supported with security updates etc. - Updated docker/scripts help text to reflect the above * Updated dockerfile and scripts for debian to v9 and remove apt-get clean - Updated all references from debian 8 to 9 (as the Java slim images uses debian 9). - Updated all help text to refer to debian9. - Removed apt-get clean commands from ubuntu docker files as they are not required. 14 August 2018, 18:46:32 UTC
7bf83ac update license information (#2977) * update license information * update JQuery License 14 August 2018, 18:01:46 UTC
091d831 [healthmgr] fix style (#2983) * fixsimportimport * fixstyle 14 August 2018, 01:53:54 UTC
bddb7ae fixsimportimport (#2982) 13 August 2018, 23:25:41 UTC
104869d [healthmgr] refactor physicalplanprovider and topologyprovider (#2979) * verbose log for debug * refactor healthmgr * refactor 2 * refactor ppprovider * fix compile * fix pplan exception * update print * fixcomments * change log to fine, when the verbose is enabled * add verbose * use list 13 August 2018, 22:45:00 UTC
2b5ab99 Adding average Serialization/Deserialization time per tuple (#2976) * adding metric to measure average serialization and deserialization times * adding a metric that measures average serialization and deserialization time per tuple 09 August 2018, 20:29:39 UTC
9818de3 Update error message in RuntimeManagerMain when an exception is catched (#2974) 08 August 2018, 17:15:03 UTC
3498979 Fixed Spelling. (#2971) 30 July 2018, 16:18:54 UTC
6be630a package c++ .h and .a files (#2961) * package c++ .h and cpp files * remove unuwanted files 28 July 2018, 06:48:53 UTC
5c32f4d spill state to local disk when configured (#2967) * spill state to local disk when configured * start ckptmgr-client after receiving pplan * separate instances and ckptmgr spilled location * clean states by owner * bail out if spill state failed * typo 27 July 2018, 21:31:53 UTC
4689693 fix metrics name (#2970) 22 July 2018, 08:32:41 UTC
c3968d5 fixing download issue in Nomad scheduler (#2969) * fixing download issue in Nomad scheduler * fix formatting 20 July 2018, 19:05:59 UTC
3ea9082 Upgrade to the latest Dhalion (#2968) * Upgrade to the latest Dhalion Fixes #2927 * Remove unused import to fix checkstyle error 20 July 2018, 13:36:24 UTC
29d93e5 (Ok To Merge) updating docker scripts (#2963) * updating ubuntu14.04 docker scripts * clean up * updating other distros * adding whitespace 17 July 2018, 21:20:50 UTC
c53b043 Fix supervisor installation in Centos 7 Dockerfile (#2966) 17 July 2018, 21:18:51 UTC
279fdec add integration test for instance state in stateful processing (#2956) * add integration test for instance state in stateful processing * merge http servers * remove the I prefix 14 July 2018, 00:09:56 UTC
aca05de joshfischer/update k8s docs (#2960) * change api status url * further clean up on updated kuberntes versioned urls * updating missed urls * further clean up and addig disclaimers * updating tool template with correct proxy url * updating notes txt 12 July 2018, 16:48:09 UTC
3e600a8 Counting pending tuples (#2951) * only using tuple num in tuplestream message to count number of data tuples * adding a field to tuplestreammessage to hold number of tuples in message * removing redundant code line 12 July 2018, 00:32:31 UTC
c68c7be Make checkpoint manager's ram configurable (#2958) * calculate container padding ram and make ckptmgr configurable * add ckptmgr ram to aurora conf * fix unit tests 11 July 2018, 06:28:32 UTC
3fea43b Added endpoint to tracker to fetch packing plan. (#2959) * Added endpoint to tracker to fetch packing plan. * checked scheduled resources as part of test 10 July 2018, 22:24:14 UTC
43ffd00 [aurora] add metadata support for aurora (#2934) * add metadata field * update aurora_metadata * use 3 params * fix unit * fix comment * update to Ning comment * remove _x * fix unit * fix style * split aurora config * update filename * fix idx 07 July 2018, 23:13:34 UTC
581344e Refactor StatefulStorage API (#2891) * Refactor StatefulStorage * fix test * fix CheckpointManagerServerTest * component metadata is optional * Update names to be more consistent * remove data_version and partition_id from protobuf for now * Remove metadata field from save/get checkpoint requests * More name and comment changes * revert refactor changes in CheckpointManagerServer * Rename InstanceStateCheckpointPartition to InstanceStateCheckpoint 07 July 2018, 18:23:16 UTC
e161575 Add log in Bolt/Spout instances after persisting state (#2954) 07 July 2018, 05:49:17 UTC
ae50ff3 Nwang/fix negative index caused by hash mod (#2953) * Fix out of boundary issue caused by .hashCode() % taskIds.size() * update RemapCustomGrouping * Refactor and add unit test 06 July 2018, 21:42:00 UTC
571a90b Counting pending tuples (#2945) * added metric for counting num packets -- needs fixing * added a map to hold task id -> task name mapping for help in mapping metrics * fixing formatting and simplifying code * ensuring metric exists before updatingit 03 July 2018, 20:19:28 UTC
b6b775f Revert the latest version number change of scala rules (#2943) * Revert the latest change about scala rules * Revert the latest version number change of scala rules 03 July 2018, 18:47:38 UTC
93b2b3f [healthmgr] Enable runtime toggle for AutoRestartBackpressureContainerPolicy (#2923) * enable runtime config for autobackpressure policy * update comment * clean comment * fix neng comment * fix compile * staging * toggle each policy * toggle per policy * fix neng comment * update condition check in toggle policy * update log fine * fix ning comment 03 July 2018, 18:43:53 UTC
fb18dca Universal heronpy (#2948) * Use six to make heronpy tests pass * Build universal heronpy wheel * make `bazel.whl` in the //scripts/packages:generate-heronpy-package 03 July 2018, 16:29:05 UTC
ef50533 added S3 uploader configuration in Helm chart (#2939) * added S3 uploader configuration in Helm chart * fixed package path * added 'packing' configuration variable (RoundRobin by default) 01 July 2018, 14:56:41 UTC
5b79124 modify travis ci to enable integration topology test (#2940) * modify travis ci to enable integration topology test * fix java test data dir 29 June 2018, 17:50:01 UTC
50a8484 add tmaster physical plan endpoint (#2941) * add tmaster pplan endpoint * fix http_server->InstallCallBack * fix request deletion 29 June 2018, 17:48:11 UTC
76be949 add integration topology test (#2938) * add integration topology test * add integration test for topology structure * clean up txt files * move encode(decode) to strutil * add const variables in strutils.cpp * fix hexEncode/Decode * simplify decodeHexChar * Remove pplan endpoint * remove pplan endpoint again 27 June 2018, 17:19:47 UTC
84737b0 Add component config in heron UI and Tracker (#2860) 27 June 2018, 00:07:43 UTC
5ee2490 Make TopologyBuilder less permissive (#2929) * Raise issues in TopologyBuilder when introduced * Do not allow malformed HERON_OPTION parts * Convert TopologyBuilder._specs to dict 26 June 2018, 14:37:58 UTC
f9d6552 Clean up website gen + website python docs (#2928) * Clean up website gen + website python docs * don't use sudo during `make site` to install pip packages * update website/config.yaml to reflect latest release - included newer bazel version as it seems to work for me * fix python topologies docs - fixed imports - tried to make code style more consistent - changed PEXes to PEXs * Fix heronpy example links * Use latest scala rules to fix tests 25 June 2018, 14:06:28 UTC
805a401 make EvitionContext extend Serializable (#2935) * make EvitionContext extend Serializable * fix typo 23 June 2018, 18:00:30 UTC
1a929da Clean up remaining dead references to Twitter (#2930) * update repository URL in release script * update remaining Java import paths in docs from com.twitter to org.apache 23 June 2018, 00:39:33 UTC
d7c8c62 Upgrade to Bazel 0.14.1 (#2932) 23 June 2018, 00:33:47 UTC
c984bcf Fix code when submitting a toplogy file without an known extension (#2933) 22 June 2018, 22:41:56 UTC
d8c10f6 Update governance.md and clean up Twitter related content (#2926) * Update governance.md and clean up Twitter related content * Update community.md 21 June 2018, 00:29:14 UTC
b3522d2 Add JDK/JAVA_HOME to bazel_configure.py (#2921) 18 June 2018, 13:10:01 UTC
81bb28d Fix integer types to avoid warnings (#2922) 18 June 2018, 13:07:09 UTC
58078e7 Correct case of acronyms (#2920) * Correct dag to DAG * Correct hdfs to HDFS * Correct s3 to S3 * Correct ram to RAM * Add vagrant/.vagrant/ to .gitignore * Correct jvm to JVM * Correct apiserver to API server * Correct 'api server' to 'API server' * Correct api to API * Correct cpu to CPU * Fix error made while correcting documentation * Correct acronyms * ram, Ram → RAM * Cpu → CPU 18 June 2018, 13:04:39 UTC
13f6626 Add permissive licence to libunwind (#2914) 08 June 2018, 14:25:11 UTC
e4fbfe5 Add DISCLAIMER file required by Apache policy (#2916) 08 June 2018, 14:24:42 UTC
c13198b make LocalFSStorage clean checkpoints before store (#2910) * make LocalFSStorage clean checkpoints before store * update and add unit tests 04 June 2018, 20:23:41 UTC
3aea542 refactor healthmgr build (#2912) * refactor healthmgr build * fix compile 31 May 2018, 04:00:13 UTC
7e011f7 refactor downlaoder build (#2911) 31 May 2018, 01:04:06 UTC
f095cdb reorder (#2908) 29 May 2018, 18:44:57 UTC
069100f log the object when it cannot be serialized when emitting tuples (#2905) * log the object when it cannot be serialized when emitting tuples * fix ning comment 22 May 2018, 23:56:36 UTC
498140c Making emit, ack, and fail thread safe (#2692) * Making emit, ack, and fail thread safe * fixing checkstyle * refactoring and adding synchronization to state save 22 May 2018, 22:21:56 UTC
1202902 add .htaccess and index.html [https://github.com/apache/incubator-heron/issues/2758] (#2872) 18 May 2018, 18:01:21 UTC
2b10cd0 Make MetricsManager.java a target so that it can be customized (#2902) 18 May 2018, 18:00:52 UTC
feea4af cleaning removed directory (#2903) 17 May 2018, 21:12:44 UTC
6ef20ad Refactor CheckpointManager to move initialization code out of constructor (#2901) 17 May 2018, 20:53:39 UTC
c54f804 Add extra info when failed to create new instance of class (#2870) 17 May 2018, 18:17:00 UTC
38f6a57 add documentation about nomad consul integration (#2898) * add documentation about nomad consul integration * add newline 17 May 2018, 14:45:56 UTC
6430c51 add src export (#2899) 15 May 2018, 03:52:27 UTC
9150216 submit topology file by uri (#2886) * move downloader registry map to yaml * fix neng comment * staging * fix path * fix type * refactor #2274 * revert comment * fix downloader command 11 May 2018, 18:28:29 UTC
70d17d0 move downloader registry map to yaml (#2884) * move downloader registry map to yaml * fix neng comment * fix path * fix type * make it compatible with old params * add comment, fix reqiured() 10 May 2018, 04:09:51 UTC
5754033 Nwang/update license in other files (#2895) * Update license text in other files * whitespace * more files 08 May 2018, 07:02:43 UTC
056ba11 fixing test (#2894) 08 May 2018, 06:09:18 UTC
075e06e Refactoring Nomad documentation and add documentation on running heron via docker on Nomad (#2876) 08 May 2018, 04:28:54 UTC
2a48237 Update license text in py files (#2889) 08 May 2018, 00:02:43 UTC
831edc2 pull yaml cpp for official release page (#2893) 07 May 2018, 03:07:01 UTC
2008084 check checkpoint file exists before deleting it (#2883) 04 May 2018, 20:24:51 UTC
6c6b774 remove thrift and scribe to prepare for apache release (#2879) * remove thrift and scribe to prepare for apache release * remove scribe dependency in tests 04 May 2018, 15:22:31 UTC
fed30ee Update license text in yaml files (#2887) 03 May 2018, 23:16:51 UTC
dd7da90 Update license text in scala files (#2888) 03 May 2018, 23:16:15 UTC
1e7e35a Update license text in H files (#2885) 03 May 2018, 05:55:33 UTC
0138b8d Update license text in java files (#2881) * Update license text in java files * more files * Update java header check template 02 May 2018, 19:52:34 UTC
9957ef3 Update license text in cpp files (#2882) 02 May 2018, 18:23:58 UTC
9d621b2 Update NOTICE file (#2878) 02 May 2018, 18:23:46 UTC
4d417d5 Scala Streamlet API Documentation is being added (#2871) 22 April 2018, 21:34:04 UTC
2bc3a18 add .htaccess and index.html [https://github.com/apache/incubator-heron/issues/2758] (#2869) 22 April 2018, 21:33:34 UTC
f5a3193 Fix kryo factor config (#2868) * Fix runtime config patching in stmgr. The old logic store and restore all the configs. However it doesn't work for non-string configs because they have empty value field and the real data is in the serialized_value field which is not covered. * fix unit tests 20 April 2018, 22:47:49 UTC
b325f85 Add extra info when failed to create new instance of class (#2867) 20 April 2018, 04:26:00 UTC
45b953b improving nomad launch script (#2862) 18 April 2018, 06:22:50 UTC
df58705 k8s ensure response body is closed after reading an error. (#2863) * k8s ensure response body is closed after reading an error. * Add another closing case. 18 April 2018, 06:21:36 UTC
f444372 [Streamlet Scala API] Add Scala Streamlet Integration Tests Part II (#2861) * Scala Streamlet Integration Tests Part II * Merge conflicts have been fixed 13 April 2018, 23:37:28 UTC
130df3c fix healthmgr metrics (#2839) * fix healthmgr metrics * fix exception null * fix metrics flush * fill metricsmgr client * add debug print * add next timer * fix metrics * fix style * fix unit * remove unnecessary comment * fix typo * update style * update style 2 * update style3 * make systemconfigfile optional * staging * fix compile * replace singleton with guice singleton * update sensor with guice singleton * fixcompile * rename metricsPublisher 13 April 2018, 03:50:18 UTC
1fe99ed Integrate runtime config and rate limit (#2846) * Integrate runtime config and rate limit * more clean up * Fix integration test by avoiding changing hydrated topology in stmgr 12 April 2018, 21:57:12 UTC
6029c28 package rename and related fixes (#2853) * rename com.twitter to org.apache and related. breaking change. [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * long line > 100, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * order of imports, checkstyle error [https://github.com/apache/incubator-heron/issues/2828] * package rename from com.twitter to org.apache [https://github.com/apache/incubator-heron/issues/2828] * add missed imports [https://github.com/apache/incubator-heron/issues/2828] * package rename from com.twitter to org.apache; fix merge issues [https://github.com/apache/incubator-heron/issues/2828] * incorporate review changes, fix merges, on package rename * fix merge conflicts, from another PR and package rename * Resolve merge conflict errors * removed three inconsistent integration tests to pass the build 11 April 2018, 18:08:38 UTC
a667fcd Align MetricsCacheMgr location discovery in Stmgr (#2797) * toggle metricscache connection according to metricscache switch config in stmgr * update str * update .h * fix compile * added one line comment * fix unit 09 April 2018, 18:44:28 UTC
cc4b2d7 Update Dhalion dependency version (#2821) * Refactor healthmgr for dhalion-v2 compatibility * Update health manager's metrics collection for v2 * Added detectors, diagnosers * Make health resolvers dhalion-v2 compatible * Make health diagnosers dhalion-v2 compatible * Make health policy dhalion-v2 api compatible * Update MetricsCache provider as per dhalion-v2 api * Modified skew detector and tests * Tag facts with execution timestamp * Update Dhalion dependency version * Address review comments in PR #2821 * Fix checkstyle and unittest errors in HealthMgr 09 April 2018, 18:09:41 UTC
ad29cc3 [Streamlet Scala API] Add Scala Streamlet Integration Tests Part I (#2826) * Scala Streamlet Integration Tests Part I * Minor change is applied to TextTransformer * Fix Scala Streamlet Integration Test Packaging Problem * Fix Scala Streamlet Integration Test Result Problem * Add Fix for Travis * Add Fix for Travis 07 April 2018, 23:07:09 UTC
c936cf1 Rate limit needs to be disabled before the bufferevent_free call (#2848) 07 April 2018, 16:06:28 UTC
56bcc6d Add sha256 checksums for all http_archives (#2856) I have taken the current sha256 checksum for all of the workspace archives so we can verify their signature on download. Since some of the artifacts are downloaded over http, we want to make sure there was no man in the middle attack done to change the resulting binary. This also gives assurance that the code we are downloading has not been tampered with in any way either over the wire or at the source. 07 April 2018, 16:03:04 UTC
2a4c1c1 expose heron metrics as a service in Nomad (#2859) 07 April 2018, 15:58:54 UTC
e51093d Add two backup urls for zookeeper (#2857) 06 April 2018, 20:33:19 UTC
ffae7af Joshfischer/eco stateful topology (#2851) * saving work. * adding examples for stateful topologies with ECO 06 April 2018, 05:04:43 UTC
98aa2a2 Eco for heron topologies (#2849) * added cereal serialization/deserialization library * initial restructuring for heron eco * support for heron eco * add the pivot * fixing storm submitter checkstyles * fixing eco checkstyles * checkstyles * added heron eco tests * fixing check styles * add submitter test * fixing ecoSubmitter test * fixing eco submitter test for storm topology * clean up * adding test to verify heron topology submitter * adding test to verify heron topology submitter * fixing checkstyles? * fixed the check style * added the check for topology type to be rigorous * added heron eco examples * modify travis and intellij scripts * fix checkstyle issues 05 April 2018, 14:35:48 UTC
9f3def0 Add json format for dry-run (#2842) This adds JSON as an optional format for the dry-run output. JSON is more easily machine readable than the other output formats and can be used to make deploy decisions based on the resources required and the resources available at deploy time. 04 April 2018, 22:39:03 UTC
860a926 add config for apiserver overrides (#2845) 03 April 2018, 18:55:01 UTC
back to top