https://github.com/apache/flink

sort by:
Revision Author Date Message Commit Date
f5216c0 Commit for release 1.3.2 28 July 2017, 14:58:35 UTC
084c59e [FLINK-7290] Add modular release scripts 28 July 2017, 14:51:13 UTC
b5c9617 [FLINK-7281] Make quickstart versions depend on project versions 28 July 2017, 14:51:13 UTC
62b6787 [FLINK-7281] Remove old and misleading release scripts/README 28 July 2017, 14:51:13 UTC
452f5d1 [FLINK-7287] [kafka, tests] Fix test instabilities in KafkaConsumerTestBase This closes #4414. 28 July 2017, 14:47:46 UTC
4382464 [FLINK-6998] [kafka] Remove unfruitful null checks on provided KafkaCommitCallbacks This closes #4187. 28 July 2017, 14:47:26 UTC
f1a173a [FLINK-6998] [kafka] Add Kafka offset commit metrics to Flink Kafka Consumer 28 July 2017, 14:04:20 UTC
09caa9f [FLINK-7268] [checkpoints] Scope SharedStateRegistry objects per (re)start 28 July 2017, 13:42:28 UTC
0225db2 [FLINK-7266] [core] Prevent attempt for parent directory deletion for object stores This closes #4397 28 July 2017, 13:21:42 UTC
854b053 [FLINK-7265] [core] Introduce FileSystemKind to differentiate between FileSystem and ObjectStore 28 July 2017, 13:15:30 UTC
3569f80 [FLINK-6842] [runtime] Uncomment and activate code in HadoopFileSystem This closes #4219 28 July 2017, 13:01:31 UTC
d0a9fe0 [FLINK-7234] [docs] Fix CombineHint documentation The CombineHint documentation applies to DataSet#reduce not DataSet#reduceGroup and should also be noted for DataSet#distinct. Also correct the usage where the CombineHint is set with setCombineHint rather than alongside the user-defined function parameter. This closes #4372 26 July 2017, 13:58:07 UTC
64d249e [FLINK-7226] [webUI] Properly include UTF-8 in content-type header 26 July 2017, 10:22:38 UTC
96ccffd [FLINK-7258] [network] Fix watermark configuration order When configuring larger memory segment sizes, configuring the low watermark before the high watermark may lead to an IllegalArgumentException, because the low watermark will temporarily be higher than the high watermark. It's necessary to configure the high watermark before the low watermark. For the queryable state server in KvStateServer I didn't add an extra test as the watermarks cannot be configured there. This closes #4391. 25 July 2017, 14:09:24 UTC
e3e7105 [FLINK-7228] [history] Use free port in HistoryServerStaticFileServerHandlerTest This closes #4366. 25 July 2017, 10:08:31 UTC
0c9bee6 [FLINK-7255] [docs] Remove default value from ListStateDescriptor constructor 25 July 2017, 09:28:36 UTC
c704adf [FLINK-6940] [docs] Clarify the effect of configuring per-job state [skip ci] 25 July 2017, 09:11:11 UTC
7180ceb [FLINK-7241] Reword description of cluster-id in HA doc Before, we were describing what happens if you manually specify a cluster-id. Now, we say explicitly that you should not do this when running Flink on a resource manager. 24 July 2017, 16:38:10 UTC
1810d20 [FLINK-7241] Remove cluster-id from YARN HA setup template in doc When running a YARN cluster the cluster-id is automatically derived. Acutally setting a cluster-id can lead to problems if you start multiple per-job YARN sessions with the same cluster-id by accident. 24 July 2017, 16:38:10 UTC
6fa4383 [FLINK-7241] Rename namespace to cluster-id in HA doc This was renamed a while ago and namespace is now deprecated. 24 July 2017, 16:38:09 UTC
8c87c44 [FLINK-7137] [table] Backport of tests for Flink 1.3 24 July 2017, 12:27:07 UTC
be8ca8a [FLINK-7137] [table] Rework nullability handling 24 July 2017, 12:14:41 UTC
45a5f87 [FLINK-6365] [kinesis] Adapt default values of the Kinesis connector The previous GET_SHARDS_MAX and GET_SHARDS_INTERVAL_MILLIS did not work well with AWS's service limitations, leading to poor Kinesis connector performace if used directly out-of-the-box. This commit adapats them to follow the default values used by the AWS SDK. This closes #4375. 24 July 2017, 10:42:12 UTC
64c1919 [hotfix] [kafka] Make notifyCheckpointComplete method final in FlinkKafkaConsumerBase This closes #4386. 24 July 2017, 10:41:29 UTC
c94f0d5 [hotfix] [kafka] Add argument checks to rescaling tests in FlinkKafkaConsumerBase 24 July 2017, 10:39:38 UTC
6abd402 [FLINK-7174] [kafka connector] Bump Kafka 0.10 dependency to 0.10.2.1 This closes #4321 24 July 2017, 10:39:38 UTC
ab28c8e [FLINK-7211] [build] Exclude Gelly javadoc jar from release 24 July 2017, 09:07:39 UTC
9416357 [hotfix] Add trace logging to state object discarding 24 July 2017, 09:05:37 UTC
618d544 [FLINK-7225] [core] Fix exception message in StateDescriptor 23 July 2017, 19:29:17 UTC
cf70255 [FLINK-7224] [kafka, docs] Fix incorrect Javadoc / docs regarding Kafka partition metadata querying Since Flink 1.3, partition metadata is no longer queried on the client side. This commit corrects the statements of this legacy behaviour in the Javadocs and documentation. This closes #4363. 22 July 2017, 11:46:34 UTC
e9d493d [FLINK-7195] [kafka] Remove partition list querying when restoring state in FlinkKafkaConsumer Previously, querying the partition list and using it to filter out restored partition states is problematic since the queried partition list may be missing partitions due to temporary downtime of Kafka brokers. Effectively, this caused the potential dropping of state on restores. This commit fixes this by completely removing partition querying if we're restoring state (as notified by FunctionInitializationContext.isRestored()). The subscribed partitions will always be exactly what the restored state contains. This closes #4357. This closes #4344. This closes #4301. 22 July 2017, 11:41:04 UTC
3369cfe [FLINK-7143] [kafka] Add test for Kafka Consumer rescaling This verifies that the consumer always correctly knows whether it is restored or not and is not affected by changes in the partitions as reported by Kafka. Previously, operator state reshuffling could lead to partitions being subscribed to multiple times. 22 July 2017, 11:37:49 UTC
ead25aa [hotfix] [kafka] Make checkpoint methods final in KafkaConsumerBase This prevents concrete Kafka Source implementations from accidentally overriding the checkpointing methods. This would be problematic when not providing tests. We test the checkpoint methods of the ConsumerBase but derived methods would not be tested. 22 July 2017, 11:37:09 UTC
b056432 [FLINK-7143] [kafka] Fix detection of restored bit in Kafka Consumer Before, the problem was that empty state was associated with the source not being restored. However, a source can have empty restored state in one of two cases: 1. The source was not restored. 2. The overall job was restored but the source simply didn't get any operator state assigned. 22 July 2017, 11:36:37 UTC
6e0d90c [FLINK-7143] [kafka] Fix indeterminate partition assignment in FlinkKafkaConsumer Apart from fixing the previous incorrect, indeterministic assignment logic, this commit also adds an explicitly defined method that properly states a strict contract for the assignment, instead of just relying on some hashCode implementation that doesn't convey this contract as well as the importance of the assignment's deterministic characteristic well. 22 July 2017, 11:35:53 UTC
6856875 [FLINK-6747] [docs] Add documentation for dynamic tables. This closes #4365 21 July 2017, 23:24:54 UTC
20ddb46 [FLINK-7176] [travis] Improve error handling This closes #4329. 20 July 2017, 17:34:00 UTC
39f5b11 [FLINK-7231] [distr. coordination] Fix slot release affecting SlotSharingGroup cleanup 20 July 2017, 13:43:14 UTC
e6348fb [FLINK-7216] [distr. coordination] Guard against concurrent global failover 20 July 2017, 13:26:43 UTC
6c0803d [FLINK-6665] [FLINK-6667] [distributed coordination] Use a callback and a ScheduledExecutor for ExecutionGraph restarts Initial work by zjureel@gmail.com , improved by sewen@apache.org. 20 July 2017, 13:10:17 UTC
129a82f [FLINK-7233] [tests] Fix instable TaskManagerHeapSizeCalculationJavaBashTest This fixes getRandomConfig() being prone to integer overflows and creating invalid configuration values. This closes #4378 20 July 2017, 13:07:47 UTC
d2a68f0 [hotfix] Backwards compatible deserialization of RocksDB backend UUIDs (cherry picked from commit 2ba5f87) 20 July 2017, 12:19:12 UTC
01265fe [FLINK-6654] [build] Let 'flink-dist' properly depend on 'flink-shaded-hadoop2-uber' This closes #3960 19 July 2017, 08:27:33 UTC
2576ea1 [hotfix] [hadoopCompat] Fix tests to verify results new Hadoop input API. This closes #4325. 18 July 2017, 09:46:20 UTC
7f110d1 Revert "[FLINK-7058] Fix scala-2.10 dependencies" This reverts commit 09a4a4bdfb03887387d47f366193d1216a66257c. 18 July 2017, 09:23:27 UTC
9643af2 [hotfix] [tests] Workaround for WaitForAllVerticesToBeRunning not working in TestingCluster (cherry picked from commit d7f9f9e) 18 July 2017, 08:45:06 UTC
3c0f383 [FLINK-7178] [metrics] Do not create separate shaded jars 17 July 2017, 19:11:53 UTC
09a4a4b [FLINK-7058] Fix scala-2.10 dependencies 17 July 2017, 19:11:13 UTC
4b003ea [FLINK-6964] [checkpoint] Fix externalized incremental checkpoints for StandaloneCompletedCheckpointStore (cherry picked from commit 8cff17f) 14 July 2017, 17:21:13 UTC
1ed2ef4 [FLINK-7154] [docs] Missing call to build CsvTableSource example The Java and Scala example code for CsvTableSource create a builder but are missing the final call to build. This closes #4313. 13 July 2017, 21:44:25 UTC
aa636bf [hotfix] [table] Fix typo in DataStreamRel ScalaDocs. This closes #4303. 13 July 2017, 21:44:10 UTC
e8887fe [hotfix] [docs] Fix broken links in 1.2 -> 1.3 API migration docs 13 July 2017, 14:28:14 UTC
bf06171 [FLINK-7034] Bump Dropwizard Metrics version to 3.2.3 13 July 2017, 09:32:19 UTC
6685273 [FLINK-7132] [java] Fix BulkIteration parallelism Copy the parallelism when translating a BulkIteration. This closes #4283 12 July 2017, 23:44:53 UTC
aaa7df5 [FLINK-6965] Include snappy-java in flink-dist 12 July 2017, 10:16:30 UTC
5ace91a [FLINK-7158] [build] Fix test dependency of flink-client 11 July 2017, 19:37:01 UTC
9a37653 [hotfix] [docs] Fix Java typo in dataset transformations doc 11 July 2017, 18:02:07 UTC
faf7974 [FLINK-7149] [connectors] Add checkpoint ID to 'sendValues()' in GenericWriteAheadSink 11 July 2017, 17:52:53 UTC
ad8766e [FLINK-7133] Exclude optional asm deps from Elasticsearch base module These ASM dependencies where shaded into the elasticsearch-base module which where then clashing with our newer (also shaded) ASM dependency. 11 July 2017, 15:05:58 UTC
8bfd120 [FLINK-7069] [metrics] Granular exception catching in MetricRegistry 11 July 2017, 10:29:32 UTC
dd3cde3 [FLINK-7039] [build] Increase forkCountTestPackage for sudo-enabled TravisCI The switch from the container-based to sudo-enabled environment in TravisCI has increased available memory from 4 GB to 7.5 GB so use a forkCount of 2 in all packages including flink-test. 11 July 2017, 10:07:40 UTC
0a9706d [FLINK-6747] [docs] Add documentation for QueryConfig. This closes #4256. 10 July 2017, 14:03:10 UTC
530a4d1 [FLINK-6422] [core] Unreachable code in FileInputFormat#createInputSplits This closes #4202. 05 July 2017, 10:10:29 UTC
6630dfd [FLINK-6996] [kafka] Fix at-least-once semantic for FlinkKafkaProducer010 This closes #4206. 05 July 2017, 10:10:18 UTC
78bbb84 [FLINK-7041] Deserialize StateBackend from JobCheckpointingSettings with user classloader This closes #4232. 05 July 2017, 10:04:57 UTC
0c9a0b9 [FLINK-7038] Correct misused terms (WindowedDataStream, JoinedDataStream) This closes #4229. 05 July 2017, 10:04:51 UTC
7ca13f2 [FLINK-7038] [docs] Correct misused term (KeyedDataStream -> KeyedStream) 05 July 2017, 10:04:44 UTC
b7fb4ca [hotfix] [docs] Added missing "more" word to programming-model docs. This closes #4244. 05 July 2017, 10:04:37 UTC
5f4296e [FLINK-7032] [build] Overwrite inherited compiler versions from parent pom Default values for compiler version are 1.6 and were causing Intellij to constantly switch language level to 1.6, which in turn was causing compilation errors. It worked fine for compiling from console using maven, because those values are separetly set in maven-compiler-plugin configuration. This closes #4213. 04 July 2017, 07:33:12 UTC
4a82e3d [FLINK-6680] [docs] Update "Upgrading Applications and Flink Versions" for 1.3 This closes #4211. 01 July 2017, 08:38:09 UTC
73876b0 [FLINK-6674] [docs] Bootstrap API Migration docs update for 1.2 -> 1.3 01 July 2017, 08:38:01 UTC
97b53fb [FLINK-6575] [tests] Disable tests on Windows that use HDFS This closes #6575. 01 July 2017, 08:37:49 UTC
e13e192 [FLINK-6376] [yarn] Improve inline code comments related to HDFS delegation token inclusion This closes #3776. 01 July 2017, 08:27:32 UTC
073852b [FLINK-6376] [yarn] Always upload HDFS delegation token for secured YARN deployments Previously, YARN log aggregation fails because it depoends on the HDFS delegation token, which we do not upload if Kerberos keytabs are used. We did not include HDFS delegation tokens when keytabs are used because the UGI would prioritize the delegation token (which expires) if both are present. To address this, changes include: 1. Change Flink YARN client to always upload delegation tokens when security is enabled. This would then allow log aggregation. 2. Filter out HDFS delegation token from the tokens fetched from HDFS when populating the UGI. This allows the UGI to always use Kerberos tickets instead of the HDFS delegation token. 01 July 2017, 08:27:15 UTC
ea48a4d [FLINK-6789] [optimizer] Remove duplicated test utility reducer in optimizer This closes #4216. 01 July 2017, 08:18:50 UTC
0d02f26 [FLINK-6867] [elasticsearch] Fix instable Elasticsearch 1.x ITCases The root cause for the instability in ES 1.x is that we're testing both embedded client mode and transport client mode against the same Elasticsearch environment. This commit removes the embedded mode testing, as that method is generally discouraged anyways. This closes #4191. 01 July 2017, 08:18:40 UTC
87ff289 [FLINK-7011] [kafka] Remove Kafka testStartFromKafkaCommitOffsets ITCases The testStartFromKafkaCommitOffsets ITCases are covering too much within one single test. The case verifies that whatever offset was committed to Kafka, Flink rreads it correctly and can uses that as the correct starting point for exactly-once. This over-engineered test was instable that we needed to first read some records and wait until some records is committed. This wait is hard to define. It is in fact sufficient to have 2 separate tests to cover the tested behaviour: - test that committed Kafka offsets are correct (there is already a ITCase for this, i.e. `runCommitOffsetsToKafka`) - test that committed offsets are correctly picked up and used correctly (there is actually also a test for this, i.e. `runStartFromGroupOffsets`) Hence, this test can be removed without harming test coverage. This closes #4190. 01 July 2017, 08:18:31 UTC
d02e688 [FLINK-6655] Add validateAndNormalizeUri method to MemoryArchivist 30 June 2017, 06:51:49 UTC
c0ad469 [FLINK-6987] Fix TextInputFormatTest for paths with spaces 30 June 2017, 06:51:49 UTC
c65317d [FLINK-6742] Add eager checks for parallelism/chain-length change 30 June 2017, 06:51:49 UTC
1d2c615 [FLINK-6898] [metrics] Limit size of operator component in metric name 30 June 2017, 06:51:49 UTC
17c5de5 [FLINK-5488] Close YarnClient on error in AbstractYarnClusterDescriptor 30 June 2017, 06:51:49 UTC
db7f0ff [FLINK-7025] [table] Port non-partitioned unbounded proctime Over window to keyed state. This closes #4212. 29 June 2017, 22:00:15 UTC
001df19 [FLINK-7004] Switch to Travis Trusty image - enable sudo for more memory - increase java heap size - replace usage of oraclejdk7 since it is no longer supporter - manually install maven 3.2.5 28 June 2017, 17:23:55 UTC
58b3b19 [FLINK-7005] [table] Optimization steps are missing for nested registered tables This closes #4186. 27 June 2017, 13:09:38 UTC
f39899d [hotfix] [docs] Fix description of "following" for Table API over windows. This closes #4161. 27 June 2017, 11:58:52 UTC
0fd3683 [FLINK-5892] Enable 1.2 keyed state test 25 June 2017, 07:00:49 UTC
b20ae53 [FLINK-6774][build] set missing build-helper-maven-plugin version This closes #4017. 25 June 2017, 06:55:10 UTC
b1f7621 [FLINK-6682] [checkpoints] Improve error message in case parallelism exceeds maxParallelism This closes #4125. 25 June 2017, 06:55:09 UTC
ff2bb71 [FLINK-6541] Improve tmp dir setup in TM/WebMonitor 25 June 2017, 06:55:09 UTC
bfba2b1 [FLINK-6782][docs] update snapshot documentation to reflect flink 1.3 This closes #4024. 25 June 2017, 06:55:09 UTC
b954eda [hotfix][docs] update Checkpoint docs with correct code example 25 June 2017, 06:55:09 UTC
c815ada [FLINK-6784][docs] update externalized checkpoints documentation This closes #4033. 25 June 2017, 06:55:09 UTC
31fd582 [FLINK-6798][docs] update old network buffer notices This closes #4080. 25 June 2017, 06:55:09 UTC
2bbfe02 [FLINK-6742] Improve savepoint migration failure error message 25 June 2017, 06:55:09 UTC
3d5cee2 [hotfix] Improve readability in SPV2#convertToOperatorStateSavepointV2 25 June 2017, 06:55:09 UTC
9139791 [FLINK-6985] [docs] Remove bugfix version from title Removes the bugfix version from title and other places where it can potentially be confusing. For snapshot release, version and version_short should be the same, e.g. 1.4-SNAPSHOT. For stable releases, version should be the full version string (e.g. 1.2.1) whereas version_short should skip the bugfix version (e.g. 1.2):. This closes #4163. 22 June 2017, 10:14:58 UTC
5fa60c7 [FLINK-6952] [docs] Add link to Javadocs 22 June 2017, 10:14:58 UTC
110eaec [FLINK-6937] [docs] Fix broken link in Production Readiness Checklist This closes #4134. 22 June 2017, 09:49:37 UTC
3389b34 [FLINK-6932] [doc] Update inaccessible Dataflow Model paper link This closes #4131. 22 June 2017, 09:49:30 UTC
back to top