https://github.com/apache/flink

sort by:
Revision Author Date Message Commit Date
89eafb4 Commit for release 1.7.1 14 December 2018, 15:48:34 UTC
d978f84 Revert "[FLINK-9555][scala-shell] Support table api in scala shell." This reverts commit efc73a872ac52e314bb1a05b9c5ed045cde6df1f. 14 December 2018, 15:45:58 UTC
bf7156a [FLINK-10566] Fix exponential planning time of large programs The traversal of the DAG is not efficient enough at some places which can lead to very long plan creation times. This introduces caching for the traversal to avoid traversing nodes multiple times. Caching is performed at two places: - when registering Kryo types - when determining the maximum parallelism 14 December 2018, 15:45:26 UTC
1797b34 [hotfix] [docs] Improve DataSet.partitionCustom() documentation. This closes #7282. 13 December 2018, 04:07:18 UTC
76bbd72 [hotfix] [docs] Fix typos in Table and SQL docs This closes #7297. 13 December 2018, 04:07:06 UTC
ff1821a [FLINK-11136] [table] Fix the merge logic of DISTINCT aggregates. This closes #7284. 13 December 2018, 04:06:47 UTC
4ab682b [FLINK-11085][build] Fix inheritance of shading filters 12 December 2018, 15:00:08 UTC
51085e7 [hotfix] [docs] Fix typo in dynamic tables documentation This closes #7275. 11 December 2018, 19:51:41 UTC
1fb8afb [FLINK-11080][ES] Rework shade-plugin filters 11 December 2018, 15:32:33 UTC
5c14b95 [FLINK-10252][metrics] Handle oversized metric messages 11 December 2018, 15:20:36 UTC
f6d93f9 [FLINK-10252][metrics] Pass akkaFrameSize to MetricQueryService 11 December 2018, 15:20:30 UTC
4f9485f [FLINK-10359] [docs] Scala example in DataSet docs is broken This closes #7266. 11 December 2018, 12:38:18 UTC
a74e856 [FLINK-11029] [docs] Fixed incorrect parameter in Working with state doc This closes #7198. 11 December 2018, 12:38:18 UTC
cfa1bf2 [hotfix] [docs] Correct the parameter in Operators Overview doc This closes #7219. 11 December 2018, 12:38:18 UTC
04d5698 [hotfix] [docs] Fix tEnv in tableApi docs This closes #7254. 11 December 2018, 12:38:18 UTC
ce99d40 [hotfix] [docs] Fix typo in Joining documentation This closes #7270. 11 December 2018, 12:38:18 UTC
8359806 [FLINK-11087] [docs] Amend compatibility table to notify issue with restoring 1.5.x braodcast state in later versions. This closes #7256. 11 December 2018, 12:38:18 UTC
388209a [FLINK-11087] [state] Incorrect broadcast state K/V serializer snapshot association when restoring from 1.5.x When restoring a broadcast state's meta information from a 1.5.x savepoint, the LegacyStateMetaInfoReaders.OperatorBackendStateMetaInfoReaderV2V3 incorrectly associates the first restored serializer as the value serializer, and the second restored serializer as the key serializer. The actual order of this should be the other way around. This bug prevents successful broadcast state restores from 1.5, both for Flink 1.6.x and 1.7.0. The commit also modifies the StatefulJobWBroadcastStateMigrationITCase to have different key / value types for its tested broadcast tests, which otherwise would not have caught this bug. 11 December 2018, 12:38:18 UTC
5cc0461 [hotfix] Cleanup unused methods / appropriate method renames in StateMetaInfoSnapshot This commit removes the `restoreTypeSerializer(...)` method. That method is no longer used after the series of changes in FLINK-11094. This also corresponds to the new principle that the restore serializer is only accessed, when the state backends attempt request it from their state meta infos. We do not create restore serializers eagerly when creating meta infos from a StateMetaInfoSnapshot. It also removes "config" from names of methods and fields related to serializer snapshotting. This corresponds to the abstraction rework of retiring TypeSerializerConfigSnapshot to be replaced by TypeSerializerSnapshot. The related fields / methods should not mention "config" anymore. 11 December 2018, 12:38:17 UTC
3f0820a [hotfix] [tests] Remove unused enum from StateBackendTestBase 11 December 2018, 12:38:17 UTC
c886007 [FLINK-11094] [state backends] State backends no longer need separate map for restored StateMetaInfoSnapshots Since now all restored state meta info snapshots are handled so that we always eagerly create the corresponding RegisteredStateMetaInfoBase for it, the information is already part of the registered state infos map. As can be seen in the changes, those maps are no longer queried and can therefore be safely removed. This closes #7264. 11 December 2018, 12:38:17 UTC
ba346ca [FLINK-11094] [state backends] Let meta infos always lazily access restore serializer This commit introduces StateSerializerProvider that wraps logic on how to obtain serializers for registered state, either with the previous schema of state in checkpoints or the current schema of state. All state meta info subclasses use StateSerializerProviders to replace direct serializer instances. This allows meta infos that were instantiated with restored serializer snapshots to not eagerly access the restore serializer when restoring state. This needs to be avoided since when restoring from 1.6, the restore serializer might not be available; for RocksDB, this should be tolerable. 11 December 2018, 12:38:17 UTC
167b4ea [FLINK-11094] [rocksdb] Eagerly create meta infos for restored state in RocksDBKeyedStateBackend This ensures that all restored state, even non-accessed ones after the restore, have a meta info available on future snapshots. 11 December 2018, 12:38:17 UTC
a3acb4e [hotfix] [state backends, tests] Make StateBackendMigrationTestBase more understandable The StateBackendMigrationTestBase previously mocked user behaviour of upgrading serializers by using a single serializer class, that can be configured with different target compatibility results when they are checked for compatibility. This is a bit hard to understand, also doesn't really reflect how a user would actually approach the feature. Instead, instead of configuring a single serializer class with different compatibility "personalities", this commit uses actual different classes, V1TestTypeSerializer, V2TestTypeSerializer, and IncompatibleTestTypeSerializer, to simulate the compatibility cases in tests. This commit also refactors the serializer migration related test serializers / types / snapshots to the testutil package, so that it can be shared by other state migration related tests in the future. 11 December 2018, 12:38:17 UTC
4a33118 [hotfix] [state backends] New namespace serializer in HeapKeyedStateBackend should always be compatible Previously, we were only checking if the new namespace serializer is incompatible, while properly we should be checking that it is strictly compatible. This doesn't affect any user expected behaviour, since the namespace serializer is never exposed to users. 11 December 2018, 12:38:17 UTC
66d18bf [hotfix] [state backend, tests] Certain StateBackendMigrationTestBase tests should fail if exception isn't thrown This commit strengthens tests in StateBackendMigrationTestBase that depend on a certain state operation (restoring state, accessing state, etc.) to be failing to assert correct behaviour. However, we previously do not really fail the test if no exception was thrown when there should be. This also caught some bugs in the test itself which had the tests verifying incorrect behaviour. 11 December 2018, 12:38:17 UTC
ae2c29e [FLINK-11041][test] ReinterpretDataStreamAsKeyedStreamITCase source should hold checkpointing lock 11 December 2018, 11:00:56 UTC
d396633 In order to maintain state compatibility revert FLINK-10543. This reverts commit 0fa9ec030d6b102f4d24f0c7f8b58c0fab97fff6. 11 December 2018, 06:43:40 UTC
f045dfd [FLINK-11123][docs] fix the import of the class is missing in ml quick start document. This closes #7269 11 December 2018, 04:06:51 UTC
63c5d5e [hotfix][docs] Add and update description of local-recovery config options This closes #7211. 10 December 2018, 14:51:37 UTC
0fa9ec0 [FLINK-10543][table] Leverage efficient timer deletion in relational operators This closes #6918 10 December 2018, 01:07:53 UTC
5f36961 [hotfix][documentation] Mention limitation of local recovery with RocksDB in multi device setups. 07 December 2018, 15:17:12 UTC
f19bc72 [FLINK-10482] Fix double counting of checkpoint stat 06 December 2018, 14:23:04 UTC
1c1de74 [FLINK-11011][E2E][JM] Log error messages about null CheckpointCoordinator only if job is running (#7224) 06 December 2018, 11:08:40 UTC
a3ae8c0 [FLINK-10987] Add LICENSE & NOTICE files for flink-avro-confluent-registry 06 December 2018, 10:54:42 UTC
5b945f7 [FLINK-10997][formats] Bundle kafka-scheme-registry-client 06 December 2018, 10:54:37 UTC
1a40a08 [hotfix][docs] Fix invalid link in schema_evolution doc 06 December 2018, 10:34:47 UTC
efc73a8 [FLINK-9555][scala-shell] Support table api in scala shell. This closes #7121 06 December 2018, 05:43:29 UTC
0215f49 [hotfix] Fixing the broken code examples The code examples for Scala and Java are both broken, and set a bad example in terms of efficiency. This closes #7232. 05 December 2018, 14:13:02 UTC
a15a298 [FLINK-10522][fs-connector] Check if RecoverableWriter supportsResume() and act accordingly. 05 December 2018, 14:12:50 UTC
6523028 [FLINK-11045][table] Set correct UserCodeClassLoader for RuntimeUDFContext in CollectionExecutor This closes #7213 05 December 2018, 09:24:14 UTC
5de5078 [FLINK-10963][fs-connector, s3] Cleanup tmp S3 objects uploaded as backups of in-progress files. 04 December 2018, 16:25:44 UTC
e32e233 [hotfix] Method renaming in the RecoverableMultiPartUploadImpl. 04 December 2018, 16:25:31 UTC
a029f33 [hotfix] Consolidated all S3 accesses under the S3AccessHelper. 04 December 2018, 16:25:22 UTC
3514c52 [hotfix][s3-connector] Renamed S3MultiPartUploader to S3AccessHelper. 04 December 2018, 16:25:12 UTC
1ef6bf8 [hotfix][fs-connector] Refactor Bucket to statically import Preconditions. 04 December 2018, 16:25:00 UTC
60f21cc [hotfix][fs-connector] Refactor PartFileWriter to take stream. 04 December 2018, 16:24:53 UTC
1034f3e [FLINK-11044] [docs] Fix registerTableSink docs This closes #7208. 04 December 2018, 09:09:26 UTC
a7f4acc [FLINK-11047] Fix CoGroupGroupSortTranslationTest by specyfing types Adding the parameter types is necessary to compile the CoGroupGroupSortTranslationTest with Scala 2.12. 04 December 2018, 07:48:52 UTC
7b23bf6 [FLINK-10874][kafka-docs] Document likely cause of UnknownTopicOrPartitionException 03 December 2018, 12:54:56 UTC
fe1f7cb [FLINK-11013] [table] Fix distinct aggregates for group window in Table API This closes #7181 03 December 2018, 10:30:31 UTC
0ff5f86 [FLINK-10149][mesos] Simplify assertions in LaunchableMesosWorkerTest Use Set equality to simplify test assertions. Change type of field LaunchableMesosWorker#TM_PORT_KEYS to Set<String>. 03 December 2018, 07:06:03 UTC
3108567 [FLINK-10149][mesos] Make returned port keys set immutable. 03 December 2018, 07:06:03 UTC
e3017db [FLINK-10149][mesos] Replace string concatenation with slf4j placeholders 03 December 2018, 07:06:03 UTC
e82df4f [FLINK-10149][mesos] Don't allocate extra mesos port for TM unless configured to do so. 03 December 2018, 07:06:03 UTC
13e0736 [hotfix] [docs] Fix typos in MATCH_RECOGNIZE docs This closes #7194. 30 November 2018, 12:45:03 UTC
a583b4a [FLINK-11017][table] Throw exception if constant with YEAR TO MONTH resolution was used for group windows This closes #7200. 30 November 2018, 12:17:37 UTC
8c51551 [hotfix][table] Check if expected exception was thrown 30 November 2018, 12:17:37 UTC
6e56a3b [hotfix] Mark release-1.7 documentation as stable 30 November 2018, 10:18:07 UTC
012ff7a [hotfix] Bump japicmp Flink reference version to 1.6.2 30 November 2018, 10:17:44 UTC
b58aaea [hotfix] Update docs/_config.yml to set correct 1.7 constants/paths 29 November 2018, 16:06:10 UTC
60aa201 [hotfix] Add release notes 1.7 link to documentation front page 29 November 2018, 16:00:56 UTC
e9276d2 [hotfix] Let CoGroupGroupSortTranslationTest extend TestLogger and fix testGroupSortTuplesDefaultCoGroup 29 November 2018, 14:42:21 UTC
64b4ef5 [FLINK-10367][network] Introduce NotificationResult for BufferListener to solve recursive stack overflow (#6829) Before this fix, during LocalBufferPool#recycle, the recycled buffer would be notified to a BufferListener. But this BufferListener may not need floating buffers any more currently, so this buffer is recycled again to the LocalBufferPool, then another BufferListener is selected to be notified of this available buffer. The above process may be repeatedly triggered in recursive way that will cause stack overflow error in extreme case. We ever encountered this error triggered by release all resources during task failover in large scale job, especially it will also result in buffer leak after stack overflow. This fix removes recursive calls and replace them with a loop and adds a `NotificationResult` as a result from BufferListener#notifyBufferAvailable to inform the caller whether the buffer was used or not. 29 November 2018, 09:42:19 UTC
d311cc4 [hotfix] Remove flink-metrics-ganglia from flink-dist/pom.xml 28 November 2018, 17:56:40 UTC
e74c5d5 [FLINK-10987] Update source LICENSE & NOTICE files The source LICENSE and NOTICE files now follow the same pattern that the LICENSE file only contains the ASL 2.0 license and the dependencies are now listed in the NOTICE file. 28 November 2018, 17:22:12 UTC
95f6531 [FLINK-10987] Add NOTICE & licenses for binary release Adds a NOTICE-binary file and a licenses-binary directory containing all bundled licenses for the binary release. When creating the binary release the NOTICE-binary file and the licenses-binary directory will be copied and renamed to NOTICE and the licenses in the binary release. 28 November 2018, 17:22:12 UTC
334b12b [FLINK-10987] Add LICENSE & NOTICE files for flink-dist 28 November 2018, 17:22:12 UTC
e80b608 [FLINK-10987] Add licenses and notice for flink-swift-fs-hadoop 28 November 2018, 17:22:12 UTC
46ff700 [FLINK-10987] Add license notices for flink-filesystems 28 November 2018, 17:22:12 UTC
d36d154 [FLINK-10987] Add LICENSE & NOTICE files for flink-metrics-prometheus 28 November 2018, 17:22:11 UTC
c6601b4 [FLINK-10987] Add LICENSE & NOTICE files for flink-metrics-graphite 28 November 2018, 17:22:11 UTC
eaae01b [FLINK-10987] Add LICENSE & NOTICE files for flink-metrics-datadog 28 November 2018, 17:22:10 UTC
78dddcc [FLINK-10987] Add LICENSE & NOTICE files for flink-connector-twitter 28 November 2018, 17:22:10 UTC
4b9c181 [FLINK-10987] Do not deploy flink-yarn-tests module to repository 28 November 2018, 17:22:10 UTC
15a6443 [FLINK-10987] Add LICENSE & NOTICE files for flink-shaded-curator 28 November 2018, 17:22:10 UTC
6c8f4d3 [FLINK-10987] Add LICENSE & NOTICE files for flink-shaded-yarn-tests 28 November 2018, 17:22:10 UTC
435c834 [FLINK-10987] Add LICENSE & NOTICE files for flink-shaded-hadoop2-uber 28 November 2018, 17:22:10 UTC
4b1b124 [FLINK-10987] Add LICENSE & NOTICE files for flink-shaded-hadoop2 28 November 2018, 17:22:09 UTC
2a85430 [FLINK-10987] Add LICENSE & NOTICE files for flink-test-utils 28 November 2018, 17:22:09 UTC
2a34e8f [FLINK-10987] Add LICENSE & NOTICE files for flink-runtime 28 November 2018, 17:22:09 UTC
4df6052 [FLINK-10987] Add LICENSE & NOTICE files for flink-runtime-web 28 November 2018, 17:22:09 UTC
2eca8d1 [FLINK-10987] Add LICENSE & NOTICE files for flink-mesos 28 November 2018, 17:22:09 UTC
cc69a93 [FLINK-10987] Add LICENSE & NOTICE files for flink-table 28 November 2018, 17:22:08 UTC
b956565 [FLINK-10987] Add LICENSE & NOTICE files for flink-sql-client 28 November 2018, 17:22:08 UTC
3d528e1 [FLINK-10987] Add LICENSE & NOTICE files for flink-streaming-python 28 November 2018, 17:22:08 UTC
3d40a41 [FLINK-10987] Exclude packaged LICENSEs from license check by the apache-rat-plugin 28 November 2018, 17:22:08 UTC
29a30b7 [FLINK-10987] Deactive ApacheLicenseResourceTransformer to add vanilla LICENSE and NOTICE file to every module 28 November 2018, 17:22:08 UTC
b272f20 [FLINK-10955] Extend release notes for Apache Flink 1.7.0 28 November 2018, 16:36:12 UTC
a7ec9cb [FLINK-11003][docs] Fix type parameter in lambda docs 28 November 2018, 09:55:13 UTC
6493ab7 [FLINK-9574] [doc] Rework docuementation for custom state serializers and state evolution This closes #7124. 28 November 2018, 06:44:14 UTC
a6dd16a [FLINK-10990][metrics] Enforce minimum timespan in MeterView 27 November 2018, 16:07:29 UTC
53f84f6 [FLINK-4173][metrics] Replace assembly-plugin usage 27 November 2018, 14:22:02 UTC
f9e2c6a [FLINK-10992][tests] Revise Hadoop configuration. Do not use /tmp directory to place log files or the HDFS data directory. Reconfigure dfs.replication to 1 because file availability is irrelevant in tests. Increase heap size of HDFS DataNodes and NameNode. Change find-files! function to not fail if directory does not exist. 27 November 2018, 14:18:48 UTC
b6900dd [FLINK-11005] Define flink-sql-client uber-jar dependencies via artifactSet Instead of including every dependency and then limiting the set of included files via a filter condition of the maven-shade-pluging, this commit defines an artifact set of included dependencies. That way we will properly include all files belonging to the listed dependencies (e.g. also the NOTICE file). This closes #7176. 27 November 2018, 13:28:17 UTC
fb8fc04 [FLINK-10998][metrics][ganglia] Remove Ganglia reporter 27 November 2018, 11:12:01 UTC
461076b [FLINK-10009][table] Fix the casting problem for built-in TIMESTAMPADD. This closes #7155 27 November 2018, 08:54:15 UTC
8cf611e [FLINK-10946] Silence checkpoint exception logging in task executor if job is not running 23 November 2018, 16:37:27 UTC
73b28a8 [FLINK-10842] [e2e] Fix broken waiting loops in common.sh This closes #7073. 23 November 2018, 10:33:36 UTC
70623d3 [FLINK-10951][tests] Set yarn.nodemanager.vmem-check-enabled to false 22 November 2018, 21:13:35 UTC
back to top