https://github.com/apache/flink

sort by:
Revision Author Date Message Commit Date
0db1570 Commit for release 1.8.0 19 March 2019, 08:03:05 UTC
f421f32 Update NOTICE-binary with latest changes The steps for this are: $ rm licenses-binary/* $ mv licenses-output/licenses/* licenses-binary/ $ mv licenses-output/NOTICE NOTICE-binary 18 March 2019, 12:38:10 UTC
6798ede [hotfix] Remove rocksdbjni from flink-dist NOTICE We currently use frocksdbjni, so rocksdbjni is not used anymore. 18 March 2019, 12:20:27 UTC
2d34db8 [FLINK-11950][dist]Add missing dependencies in NOTICE file of flink-dist. This closes #8004 18 March 2019, 11:46:18 UTC
44c2474 [FLINK-11918][table] Deprecated some Window APIs and Rename Window to GroupWindow This closes #7985 15 March 2019, 11:10:16 UTC
a3e3852 [FLINK-11902][rest] Do not wrap all exceptions in RestHandlerException 14 March 2019, 09:06:23 UTC
5423f87 [hotfix][rest] Remove "Impl. error" from log message Original intent was to never reach this code path except on programmer errors, but it has turned into an accepted code path for unhandled exceptions. 14 March 2019, 09:06:17 UTC
9776162 [FLINK-11183][metrics] Properly measure current memory usage 14 March 2019, 09:00:02 UTC
fad1661 [FLINK-11183][metrics] Move memory metrics creation into separate method 14 March 2019, 08:59:53 UTC
f7e7fbd [FLINK-11901][build] Update NOTICE files with year 2019 Uses output of update script BUT WITHOUT unrelated changes in NOTICE-binary. 13 March 2019, 14:07:26 UTC
cc7aaab [FLINK-11901][build] Add script for updating NOTICE year 13 March 2019, 14:01:23 UTC
446eab5 [FLINK-11892] [docs] Refine README of end-to-end tests to make it more clear This closes #7972 13 March 2019, 11:39:01 UTC
42f47db [FLINK-11866][py][docs] Fix method name 13 March 2019, 09:19:12 UTC
0e288ed [FLINK-11886][docs] Update CLI output 13 March 2019, 09:10:46 UTC
8779040 [FLINK-10756][runtime][tests] Wait for TM processes to shutdown 13 March 2019, 09:02:22 UTC
3969a7a [hotfix] [core] Avoid array copying in LinkedOptionalMapSerializer 13 March 2019, 05:10:00 UTC
ce7aea0 [FLINK-11865] Cache compiled CanBuildFrom values in TraversableSerializer 12 March 2019, 14:27:31 UTC
935ea92 [FLINK-11865] Extract compileCbf from TraversableSerializer 12 March 2019, 14:24:42 UTC
db0b874 [FLINK-11420][datastream] Fix duplicate and createInstance methods of CoGroupedStreams.UnionSerializer UnionSerializer did not perform a proper duplication of inner serializers. It also violated the assumption that createInstance never produces null. 11 March 2019, 16:45:31 UTC
eb4d857 [hotfix][test] Use ScalaCaseClassSerializerTest specific case class Previously the ScalaCaseClassSerializerTest reused class defined in other test, even though it defined a separate one. Also extended the class so that it uses GenericSerializer. 11 March 2019, 16:45:31 UTC
37879f7 [FLINK-11867][datastream] Fixed preconditions for filePath's value 11 March 2019, 14:26:07 UTC
36cc34f [hotfix][table-api] Update wrong null literal hint 11 March 2019, 13:26:24 UTC
2f765e7 [FLINK-11850][zk] Tolerate concurrent child deletions when deleting owned zNode When calling ZooKeeperHaServices#closeAndCleanupAllData it can happen that a child of the owned zNode of the ZooKeeperHaServices is being concurrently deleted (e.g. a LeaderElectionService has been shut down). In order to tolerate concurrent deletions, we use now ZKPaths#deleteChildren. This closes #7929. 07 March 2019, 18:27:34 UTC
b7d85c8 [FLINK-11851] Introduce dedicated io executor for ClusterEntrypoint and MiniCluster The io executor is responsible for running io operations like discarding checkpoints. By using the io executor, we don't risk that the RpcService is blocked by blocking io operations. This closes #7925. 07 March 2019, 18:22:11 UTC
813286b [FLINK-11846] Don't delete HA job files in case of duplicate job submission This commit changes the cleanup logic of the Dispatcher to only clean up job HA files if the job is not a duplicate (meaning that it is either running or has already been executed by the same JobMaster). This closes #7919. 07 March 2019, 18:20:28 UTC
1d72ad4 [FLINK-11542][config][docs] Extend memory configuration descriptions 07 March 2019, 08:40:35 UTC
9d87fe1 [hotfix][statebackend] Reduce and simplify code for column creation in RocksDB backend This closes #7830. (cherry picked from commit 953a5ffcbdae4115f7d525f310723cf8770779df) 06 March 2019, 15:46:11 UTC
b5d1dd0 [FLINK-11821] Fix package declaration and location of internal Kafka schema wrappers 06 March 2019, 15:18:32 UTC
921ba09 [FLINK-11836] Update NOTICE-binary and licenses-binary for Flink 1.8.0 06 March 2019, 13:06:51 UTC
f670472 [FLINK-11836] Sort concatenated NOTICE files for NOTICE-binary This will make for less changes in the future because the order in the NOTICE-binary file is deterministic. 06 March 2019, 13:06:51 UTC
704f0a6 [FLINK-11781][yarn] Remove "DISABLED" as possible value for yarn.per-job-cluster.include-user-jar Remove this feature because it is broken since Flink 1.5 06 March 2019, 11:24:42 UTC
16e0a06 [hotfix][runtime] Remove unused local variable in ExecutionGraph 06 March 2019, 11:24:42 UTC
5d46437 [FLINK-11751] Extend release notes for Flink 1.8 06 March 2019, 10:53:11 UTC
b2265cd [FLINK-11833] [State Backends] Cleanup unnecessary createKeyedStateBackend methods in StateBackend This closes #7909. (cherry picked from commit f10a7d8b5da5d9836a8fb3b2f38e099152f1d75f) 06 March 2019, 09:28:17 UTC
f53594d [FLINK-11336][zk] Delete ZNodes when ZooKeeperHaServices#closeAndCleanupAllData When calling ZooKeeperHaServices#closeAndCleanupAllData we should delete the HA_CLUSTER_ID znode which is owned by the respective ZooKeeperHaServices. Moreover, the method tries to go up the chain of parent znodes and tries to delete all empty parent nodes. This should clean up otherwisely orphaned parent znodes. 05 March 2019, 15:50:44 UTC
34d634e [hotfix][tests] Speed up ZooKeeperLeaderRetrievalTest#testTimeoutOfFindConnectingAddress Decrease the timeout from 10s to 1s in testTimeoutOfFindConnectingAddress to speed up the test. 05 March 2019, 15:50:44 UTC
80efb71 [hotfix] Fix checkstyle violations in ZooKeeperLeaderRetrievalTest 05 March 2019, 15:50:44 UTC
622766f [hotfix] Fix checkstyle violations in ZooKeeperUtils 05 March 2019, 15:50:44 UTC
d7386f1 [hotfix] Fix checkstyle violations in ZooKeeperHaServices 05 March 2019, 15:50:43 UTC
ce2d65d [FLINK-11796] [State Backends] Remove Snapshotable interface (cherry picked from commit e8daa49a593edc401cd44761b25b1324b11be4a6) 05 March 2019, 15:30:50 UTC
2f62b89 [FLINK-11731] [State Backends] Make DefaultOperatorStateBackend follow the builder pattern This closes #7899. (cherry picked from commit 94f84a5c7b4876dee5b34e6a3725da7ee06a607f) 05 March 2019, 15:30:41 UTC
b027fa7 Fix version change expressions in releasing scripts The earlier version had "\1${NEW_VERSION}" in there, which would resolve to "\11.8.", i.e. the backreference would now be \11. 05 March 2019, 10:47:50 UTC
571997b Fix create_release_branch.sh to accomodate Hadoop Versions Before, this would not correctly change version tags that have a version prefix or suffix, like the shaded Hadoop modules. 05 March 2019, 10:21:11 UTC
d5364df [FLINK-11730] [State Backends] Make HeapKeyedStateBackend follow the builder pattern This closes #7866. (cherry picked from commit 237d07c76b51c171f0f41f9f82d777df26da1dd4) 04 March 2019, 19:30:38 UTC
e177ba9 [FLINK-11804] [State Backends] Make sure the CloseableRegistry used in backend builder is registered with task We need to make sure each stream constructed in restore could also be closed in case of task cancel, for example the data input stream opened for serDe during restore. Also removed close of CloseableRegistry in RocksDBKeyedStateBackendBuilder. (cherry picked from commit eada52be5194a018a41e7ea51ea86e0273df2073) 04 March 2019, 19:29:47 UTC
8a5c972 [hotfix][tests] Added matcher that performs deep comparison with taking Tuples into account This commit introduced a matcher that performs a deepEquals comparison similarly to Objects#deepEquals. The only difference is that it also performs deep equality check for some flink specific classes such as e.g. Tuples, Rows. 04 March 2019, 17:55:08 UTC
7fad886 [FLINK-11420][core] Fixed duplicate method of TraversableSerializer The duplicate method of TypeSerializer used an equality check rather than reference check of the element serializer to decide if we need a deep copy. This commit uses proper reference comparison. 04 March 2019, 17:55:08 UTC
5fe62dc [hotfix][tests] Call all methods from SerializerTestBase in SerializerTestInstance by reflection 04 March 2019, 17:55:08 UTC
061981e [hotfix][core] Comparing whole collections rather than contents in KryoGenericTypeSerializerTest 04 March 2019, 17:55:08 UTC
975a25c [hotfix][core] Added snapshot for NothingSerializerSnapshot 04 March 2019, 17:55:08 UTC
7d222a6 [hotfix][core] Added snapshot for TestListCompositeSerializer 04 March 2019, 17:55:08 UTC
4679a46 [hotfix][core] Fix Tuple0Serializer handling of null Tuple0Serializer serialized null as just a proper Tuple0 instance, which if later deserialized resulted in a regular value rather than null. This commit changes it so that it is no longer possible to serialize null with Tuple0Serializer. 04 March 2019, 17:55:08 UTC
3d6e713 Update ops/upgrading.md for Flink 1.8 04 March 2019, 15:12:39 UTC
dfac0e2 [FLINK-11791] Describe how to build Flink with Hadoop in build guide 04 March 2019, 09:39:02 UTC
704bc60 [FLINK-11617] [kinesis] Kinesis consumer getRecords() failure logging is misleading (#7706) 02 March 2019, 00:37:48 UTC
ae7861d [FLINK-9003][E2E] Add operators with input going through custom, stateful serialization. 01 March 2019, 14:22:47 UTC
4340811 [FLINK-9003][hotfix] Code cleanup. 01 March 2019, 14:22:33 UTC
f450a30 [FLINK-11533] [container] Update kubernetes/README.md [pr-review] Fix typo [pr-review] Fix grammer 01 March 2019, 13:28:53 UTC
8b3741b [FLINK-11533] [container] Find job jar on classpath [pr-review] Address comments 01 March 2019, 13:28:53 UTC
8af3250 [FLINK-11533] [container] Make jobClassName argument optional [pr-review] Address comments 01 March 2019, 13:28:53 UTC
7ce8ef5 [FLINK-11533] [container] Throw FlinkParseException in ParserResultFactory 01 March 2019, 13:28:53 UTC
41ebd00 [FLINK-11533] [container] Add JarManifestParser [pr-review] Extend TestLogger in JarManifestParserTest [pr-review] Mark TemporaryFolder field final in JarManifestParserTest [pr-review] Improve Javadocs for TestJob.getTestJobJar [pr-review] Add JarManifestParser.findOnlyEntryClass(Iterable) [pr-review] Reduce visibility of helper [pr-review] Mark helper with @VisibleForTesting [pr-review] Remove remove-external-test-classes stage [pr-review] Address comments 01 March 2019, 13:28:53 UTC
83216f8 [FLINK-11752] [dist] Move flink-python to opt * [FLINK-11752] [dist] Move flink-python to opt * [FLINK-11752] [dist] Point pyflink scripts to opt 01 March 2019, 13:28:14 UTC
819a781 [hotfix][table-api] Uncouple case classes from other API tests 01 March 2019, 12:22:20 UTC
e4f840b [hotfix][table-api] Introduce an alternative for if-then-else in prefix notation This commit uncouples prefix if-then-else expressions from the `If` case class. The offically documented way is still using the `?` tenerary operator. But this commit adds a nice alternative that is available in the Scala DSL. 01 March 2019, 12:22:20 UTC
ca4cb2b [hotfix][table-api] Uncouple case classes from math expressions 01 March 2019, 12:22:20 UTC
f8d0855 [FLINK-10585][tests] Extract method getTestResource in RestServerEndpointITCase 01 March 2019, 06:44:23 UTC
9b66985 [FLINK-10585][runtime] Use java.net.URL to build restBaseUrl In URLs, IPv6 addresses have to be put inside "[" and "]", which is handled by the URL class. 01 March 2019, 06:44:23 UTC
33e0ca7 [FLINK-10585][tests] Explicitly bind testing RestServerEndpoint on loopback address If we do not bind on a loopback address, the wildcard address will be chosen. The downside of that is it can happen that the server will be only available via either IPv4 or IPv6 (but not both). This can happen, for example, if another application chose to bind on the same (random) port but only using the IPv4 stack. In this case, the bind operation in the RestServerEndpoint will only succeed for IPv6 and silently fail for IPv4. 01 March 2019, 06:44:23 UTC
eb58bf7 [FLINK-10585][tests, ssl] Re-create testing keystore and truststore Create new key so that IPv6 loopback address is included in subject alternative names section. Used the commands below to re-create the stores: keytool -genkeypair -alias flink.test -keystore test.keystore -keyalg RSA \ -keysize 4096 -storetype PKCS12 -ext "SAN=dns:localhost,ip:127.0.0.1,ip:::1" \ -dname "CN=Unknown, OU=Unknown, O=Unknown, L=Unknown, ST=Unknown, C=Unknown" \ -storepass password keytool -exportcert -keystore test.keystore -alias flink.test -file test.cer \ -storepass password keytool -importcert -keystore test.truststore -alias ca -storepass password \ -file test.cer --noprompt 01 March 2019, 06:44:23 UTC
c2bc493 [FLINK-11379][core] Fix OutOfMemoryError caused by Files.readAllBytes() when TM loads a large size TDD This closes #7797 01 March 2019, 01:19:45 UTC
7683867 [FLINK-11785][table-api] Replace case class Null(type) by nullOf(type) expression This introduces `nullOf(type)` for representing typed nulls in Table API. It allows to uncouple API from expression case classes and enables us to have `nullOf(type)` and `null` in the future, once we introduced a NULL type and proper type inference. Furthermore, it also integrates better in existing expressions that all start with lower case characters. This closes #7864. 28 February 2019, 16:12:07 UTC
24ebc09 [FLINK-11780] Change version scheme of Hadoop-based modules to conform to SNAPSHOT guidelines This also adadpts update_branch_version.sh to correctly update versions that have a prefix. 28 February 2019, 14:05:46 UTC
645c47c [hotfix][docs] fix grammatical errors in description This closes #7863 28 February 2019, 13:47:18 UTC
dd89cc7 [hotfix][docs] Fix missing joinLateral 28 February 2019, 13:18:19 UTC
87648f3 [FLINK-10881] Use cancelWithSavepoint in SavepointITCase test. 28 February 2019, 13:00:00 UTC
4fea6b8 [FLINK-10785] [tests] Upgrade FlinkKinesisConsumerMigrationTest to test restoring from 1.7.x 28 February 2019, 11:07:31 UTC
f2c92a2 [FLINK-10777] [tests] Update TypeSerializerSnapshotMigrationITCase to cover restoring from 1.7.x 28 February 2019, 11:07:31 UTC
93c1515 [FLINK-11771] [core] Fix TypeSerializerSnapshot#readVersionedSnapshot for TypeSerializerSnapshots directly upgraded from TypeSerializerConfigSnapshot 28 February 2019, 11:07:31 UTC
f4722e5 [hotfix] [tests]Fix typo in RollingSinkSecuredITCase.java This closes #7823. 28 February 2019, 11:07:30 UTC
572a57c [FLINK-10342] [kafka] Improve Javadoc of new disableFilterRestoredPartitionsWithSubscribedTopics method in FlinkKafkaConsumerBase This closes #7726. 28 February 2019, 11:07:30 UTC
879507d [FLINK-10342] [kafka] Filter restored partitions in FlinkKafkaConsumer with topics descriptor This commit lets the FlinkKafkaConsumer filter out restoreed partition's offsets that are no longer associated with the current list of specific topics / topic pattern to subscribe to. This changes the previous default behaviour of the FlinkKafkaConsumer, which always respected the complete list of restored partitions, regardless of the specified topics to subscribe to. As a fallback, a setter configuration method is added to allow disabling the filter behavior. 28 February 2019, 11:07:29 UTC
151cd8c [FLINK-11773] [tests] Add unit tests for KryoSerializerSnapshot This closes #7852. 28 February 2019, 11:07:29 UTC
ff00541 [FLINK-11773] [core] Use LinkedOptionalMapSerializer in Kryo-/PojoSerializerSnapshotData 28 February 2019, 11:07:28 UTC
f1bbb63 [FLINK-11773] [core] Add LinkedOptionalMapSerializer This adds a simplified serializer for LinkedOptionalMaps that resiliently stores the keys and the values of the map. 28 February 2019, 11:07:28 UTC
6ac771a [FLINK-11753] [tests] Refactor SchemaCompatibilityTestingSerializer This closes #7845. 28 February 2019, 11:07:28 UTC
6a68b31 [FLINK-11753] [tests] Add hamcrest matchers for TypeSerializerSchemaCompatibility 28 February 2019, 11:07:27 UTC
7aa802a [FLINK-11406] [core] Return INCOMPATIBLE when nested serializers arity don't match in CompositeTypeSerializerSnapshot This closes #7557. 28 February 2019, 11:07:27 UTC
ae62497 [FLINK-11755] [core] Removed no longer used class TypeDeserializer 28 February 2019, 11:07:26 UTC
ecd2389 [FLINK-11755] [core] Drop no longer used class CompatibilityResult 28 February 2019, 11:07:26 UTC
07c763d [FLINK-11755] [core] Drop ensureCompatibility from TypeSerializer If users are still using the TypeSerializerConfigSnapshot when upgrading to 1.8, they have to do the following: - Change the type serializer's config snapshot to implement TypeSerializerSnapshot, rather than extending TypeSerializerConfigSnapshot (as previously). - If the above step was completed, then the upgrade is done. - Otherwise, if changing to implement TypeSerializerSnapshot directly in-place as the same class isn't possible (perhaps because the new snapshot is intended to have completely different written contents or intended to have a different class name), retain the old serializer snapshot class (extending TypeSerializerConfigSnapshot) under the same name and give the updated serializer snapshot class (the one extending TypeSerializerSnapshot) a new name. - Override the TypeSerializerConfigSnapshot#resolveSchemaCompatibility(TypeSerializer) method to perform the compatibility check based on configuration written by the old serializer snapshot class. This closes #7821. 28 February 2019, 11:07:26 UTC
9075e46 [FLINK-11755] [core] Remove no longer used CompatibilityUtil class The CompatibilityUtil class is no longer used after the series of changes for FLINK-11755 and FLINK-11741. This corresponds to the fact that ensureCompatibility is about to be removed from TypeSerializer, and therefore no serializers should still require this util to convert TypeSerializerSchemaCompatibility to CompatibilityResult. 28 February 2019, 11:07:25 UTC
6841790 [FLINK-11741] [cep] Migrate legacy NFA serializers to use new serialization compatibility abstractions Although these serializers were used for state that are no longer accessed now, they will still be snapshotted as part of the CEP state's meta info, since they still are registered. This commit updates them to use the new serialization compatibility abstractions, so that the serializers are no longer Java-serialized. 28 February 2019, 11:07:25 UTC
3369083 [FLINK-11741] [core] Remove TypeSerializerSingleton's ensureCompatibility implementation 28 February 2019, 11:07:24 UTC
b192ce5 [FLINK-11755] [tests] Remove TypeSerializerSnapshotTest#testBridgeCompatibilityCheck test This test essentially tests that when a legacy TypeSerializerConfigSnapshot is restored, the compatibility check goes through the new serializer's `ensureCompatibility` method. Since we're now removing the `ensureCompatibility` method from the TypeSerializer abstraction, this test is no longer relevant. 28 February 2019, 11:07:24 UTC
edeeda3 [FLINK-11741] [tests] Remove ensureCompatibility implementation in all test-related serializers This also fixes the snapshotConfiguration method of some test-related serializers, to return a proper snapshot of itself. 28 February 2019, 11:07:24 UTC
13cc1ca [FLINK-11741] Remove ensureCompatibility implementation from dummy serializers 28 February 2019, 11:07:23 UTC
75afa9c [FLINK-11741] [runtime] WritableSerializer's ensureCompatibility method should have been removed 28 February 2019, 11:07:23 UTC
efd9cf3 [FLINK-11741] [table] Remove table dataview serializers' ensureCompatibility method using LegacySerializerSnapshotTransformer interface For the Table dataview serializers (i.e. ListViewSerializer and MapViewSerializer) we need to use the LegacySerializerSnapshotTransformer interface because these serializers were incorrectly returning the snapshot of their nested serializer in 1.6, likewise to what the LockableTypeSerializer was incorrectly doing also in 1.6. 28 February 2019, 11:07:22 UTC
5dcc28a [FLINK-11741] [core] Remove Scala EitherSerializer's ensureCompatibility method using LegacySerializerSnapshotTransformer interface The Scala EitherSerializer requires using the LegacySerializerSnapshotTransformer in order to remove the ensureCompatibility method because in 1.6, the serializer was returning Java's EitherSerializerConfigSnapshot, which has different generic types than the expected ScalaEitherSerializerSnapshot. 28 February 2019, 11:07:22 UTC
back to top