https://github.com/apache/flink

sort by:
Revision Author Date Message Commit Date
4fde279 [FLINK-25880][docs] Add Matomo tracking code to base layout 02 February 2022, 11:44:38 UTC
cd9c418 [FLINK-25880][docs] Remove Google Analytics implementation 02 February 2022, 11:44:38 UTC
5e0b797 [FLINK-16697][metrics][jmx] Disable rebinding 06 May 2020, 07:41:07 UTC
808cc1a [FLINK-14345][release] Use unsafe MapR repo for snapshots 08 October 2019, 08:25:09 UTC
73caa7b [FLINK-13394][travis] Use fallback unsafe MapR repository 06 August 2019, 11:24:25 UTC
56c3e7c [FLINK-12741] [docs] Update Kafka producer fault tolerance guarantees 23 July 2019, 10:00:02 UTC
7758cdd [FLINK-12578][build] Use fallback unsafe MapR repository 19 July 2019, 08:46:43 UTC
f092d75 [FLINK-12578][build] Add fallback unsafe MapR repository 18 July 2019, 11:15:13 UTC
022dce5 [FLINK-12578][build] Use secure MapR repository by default 18 July 2019, 11:15:10 UTC
3bcb515 [hotfix][tests][coordination] Move idle task manager release tests into a separate suite 10 July 2019, 10:02:55 UTC
9069f4d [FLINK-12736][coordination] Release TaskExecutor in SlotManager only if there were no slot allocations after the partition check The ResourceManager looks out for TaskManagers that have not had any slots allocated on them for a while, as these could be released to safe resources. If such a TM is found, the RM checks via an RPC call whether the TM still holds any partitions. If no partition is held then the TM is released. However, in the RPC callback no check is made whether the TM is actually still idle. In the meantime a slot could have been allocated on the TM. Even if the slot has been freed, there can be newly allocated partitions not included in check result. To make sure there was no resource allocation in between, we can mark the taskManagerRegistration.getIdleSince() time before starting the async 'no partition' check. The TM can be released only if the idle time after the check matches the previously marked one. Otherwise we discard the release and start over after the next timeout. 09 July 2019, 12:41:24 UTC
5d6ff74 [FLINK-12319][Library/CEP]Change the logic of releasing node from recursive to non-recursive 05 July 2019, 11:00:31 UTC
7aad964 [FLINK-12889] Set FatalExitExceptionHandler for StreamTask#asyncOperationsThreadPool In order to avoid the swallowing of uncaught exceptions in asynchronous checkpoint operations, this commit sets the FatalExitExceptionHandler for the StreamTask#asyncOperationsThreadPool. For testing purposes the uncaught exception handler was made configurable in the StreamTask. This closes #8950. 05 July 2019, 08:41:34 UTC
5b8154c [FLINK-12957][docs] fix Thrift and Protobuf dependency examples These require newer versions nowadays. This closes #8848. 26 June 2019, 08:01:53 UTC
66e95b6 [hotfix][docs] fix typo 26 June 2019, 08:01:52 UTC
e40d79b [hotfix][docs] update latency metric name to cover for latency granularity 26 June 2019, 08:01:50 UTC
f49bc58 [hotfix][docs] "data Artisans" -> "Ververica" 26 June 2019, 08:01:45 UTC
97537ea [hotfix] Harden TaskExecutorTest#testSyncSlotsWithJobMasterByHeartbeat The problem was that we don't wait until the JobMaster has sent its response back to the TaskExecutor when it receives the offered slots and before we send the heartbeat response with the AllocatedSlotReport. This commit fixes the problem by instrumenting the TaskSlotTable to notify the test when all slots are marked as active. 21 June 2019, 06:14:20 UTC
a3a4b65 [hotfix] Refactor HeartbeatManagerTest to remove SimpleTestingHeartbeatListener 21 June 2019, 06:14:19 UTC
7333b61 [FLINK-12863][FLINK-12865] Remove concurrency from HeartbeatManager(Sender)Impl This commit makes the HeartbeatManager implementations to use the RpcEndpoint's main thread executor. Furthermore, this commit changes the HeartbeatListener interface to directly return a payload instead of returning a future when HeartbeatListener#retrievePayload is called. Since the HeartbeatManager implementations now use the RpcEndpoint's main thread, we remove the splicing into the RpcEndpoint's main thread in the implementations of the HeartbeatListeners in the TaskExecutor, JobMaster and ResourceManager components. This closes #8795. 21 June 2019, 06:14:19 UTC
e2a0342 [hotfix] Make MainThreadExecutor implement ScheduledExecutor 20 June 2019, 22:55:04 UTC
82f5226 [hotfix] Backport FutureUtils#thenAcceptAsyncIfNotDone 20 June 2019, 12:17:49 UTC
b8489c5 [hotfix][TE] Remove redundant HeartbeatManager calls 20 June 2019, 12:17:49 UTC
0abc0b6 [FLINK-12896][rest] Use JobID parameter for archiving 20 June 2019, 08:36:54 UTC
272fafe [FLINK-12871][docs] fix separate keypass not compatible with PKCS12 stores 17 June 2019, 22:41:32 UTC
63d0ae6 [hotfix] Fix checkstyle violations in SlotPoolTest 14 June 2019, 07:40:48 UTC
65b6f99 [FLINK-11059][runtime] Add slot reconciliation between JM and TE With this commit we introduce an AllocatedSlotReport which is periodically sent from the JM to the TE. This report is then used to reconcile the JM's and the TE's view on the state of allocated slots. Furthermore, with this commit we drop slots which could not be freed via TaskExecutorGateway#freeSlot and instead rely on the heartbeat reconciliation logic. This closes #7227. 14 June 2019, 07:40:48 UTC
3671388 [FLINK-12835][tests] Fix wrong conversion of ManualClock bug This closes #8733. 14 June 2019, 07:32:31 UTC
ff4c143 [FLINK-10455][Connectors/Kafka] Ensure all the KafkaProducers closed on an exception The patch fixes the bugs reported in FLINK-10445 by making sure all the KafkaProducers are closed when FlinkKafkaProducer is closed. The same fix was applied to universal FlinkKafkaProducer and FlinkKafkaProducer011. 12 June 2019, 09:26:02 UTC
dce00e1 [FLINK-12646][runtime] Change the test IP of RestClientTest to 240.0.0.0 This closes #8663. 11 June 2019, 12:59:54 UTC
d13c583 [FLINK-12688] [state] Make serializer lazy initialization thread safe in StateDescriptor This closes #8570. 01 June 2019, 07:47:13 UTC
0569fcb [FLINK-11126][YARN][security] Filter out AMRMToken in the TaskManager credentials This closes #7895. 27 May 2019, 10:01:54 UTC
69b9a39 [FLINK-12578][build] Use https URL for Maven repositories MapR repositories are excluded from this change as there appears to be some certificate issue on the MapR side. The latest documentation (https://mapr.com/docs/61/DevelopmentGuide/MavenArtifacts.html) also recommends using the http url. 22 May 2019, 10:32:39 UTC
ca85285 [FLINK-12260][tests] Speed up ResourceManagerTaskExecutorTest#testDelayedRegisterTaskExecutor Use latches instead of timeouts/sleeps to test problematic thread interleaving. This closes #8415. 14 May 2019, 07:13:22 UTC
bcd35b9 [FLINK-12260] Slot allocation failure by taskmanager registration timeout and race TaskExecutor registration has asynchronous process, which allows a next retry after timeout to be processed first ahead of earlier request. Such delayed timed-out request can accidently unregister a valid task manager, whose slots are permanently not reported to job manager. This patch introduces ongoing task executor futures to prevent such race. 14 May 2019, 07:12:03 UTC
e5211d8 [FLINK-9445][scala] Scala-shell uses JAVA_RUN 10 May 2019, 07:39:44 UTC
c5380aa [FLINK-12460][docs] Replace taskmanager.tmp.dirs with io.tmp.dirs in documentation 09 May 2019, 07:59:36 UTC
f221542 [FLINK-12342][yarn] Add config option for heartbeat interval during container requests Flink's YarnResourceManager sets a faster heartbeat interval when it is requesting containers from Yarn's ResourceManager. Since requests and responses are transported via heartbeats, this speeds up requests. However, it can also put additional load on Yarn due to excessive container requests. Therefore, this commit introduces a config option which allows to control this heartbeat. 07 May 2019, 15:27:07 UTC
cfbac8f [FLINK-12219] Log uncaught exceptions and terminate in case Dispatcher#jobReachedGloballyTerminalState fails FutureUtils#assertNoException will assert that the given future has not been completed exceptionally. If it has been completed exceptionally, then it will call the FatalExitExceptionHandler. This commit uses assertNoException to assert that the Dispatcher#jobReachedGloballyTerminalState method has not failed. This closes #8334. 07 May 2019, 09:26:49 UTC
b219890 [hotfix][tests] Prevent HistoryServerTest to print to STDOUT 02 May 2019, 09:04:28 UTC
0706791 [FLINK-12184][hs] HistoryServerArchiveFetcher incompatible with old version This closes #8313. 02 May 2019, 09:04:27 UTC
1ce2efd [FLINK-12296][StateBackend] Fix local state directory collision with state loss for chained keyed operators (#8323) - Change Will change the local data path from `.../local_state_root/allocatio_id/job_id/jobvertext_id_subtask_id/chk_id/rocksdb` to `.../local_state_root/allocatio_id/job_id/jobvertext_id_subtask_id/chk_id/backend_id` When preparing the local directory Flink deletes the local directory for each subtask if it already exists, If more than one stateful operators chained in a single task, they'll share the same local directory path, then the local directory will be deleted unexpectedly, and the we'll get data loss. 02 May 2019, 08:12:31 UTC
df89c1c [FLINK-12042][test] Refactor SnapshotDirectoryTest#exists Tests in a separate test that SnapshotDirectory#temporary creates a local snapshot directory. 26 April 2019, 16:02:05 UTC
e6e2677 [FLINK-12042] Fix RocksDBStateBackend mistaken usage of the default filesystem [FLINK-12042] Restrict only temporary snapshot directories to the local file system by changing the signature to accept files as parameter This closes #8068. 26 April 2019, 16:02:04 UTC
8140395 [FLINK-12247][rest] Fix NPE when writing the archive json file to FileSystem This closes #8250. 26 April 2019, 09:53:38 UTC
2e97865 [FLINK-11915][core] Fix miscalculation of DataInputViewStream.skip [FLINK-11915][core] Add the missed unit test case [FLINK-11915][core] Rich the test case to cover origin skipping function This closes #8195. 24 April 2019, 07:02:33 UTC
0ba7777 [FLINK-10941][RM] Release task executor after all its result partitions are released The task executor gateway can use NetworkEviroment.PartitionManager to check still registered and unreleased partitions because it is the central point to manage partitions. It would also simplify how it is queried now going through TaskSlot and lingering Tasks. Eventually, NetworkEviroment becomes ShuffleService which could decide whether producer can be released or not this way or another. We still make producer task executor depend on another consumer task executor, though, we do not see any problems with it now, I think it is still more safe to introduce an option as a feature flag. By default, task executor will wait for consumers, as this PR suggests, but users can always fallback to the previous behaviour using the option. 19 April 2019, 08:52:20 UTC
183177a [FLINK-10941][Network] Release partition after consumer end of reception confirmation 19 April 2019, 08:52:20 UTC
c1ca910 [FLINK-12169] [javadocs] improve javadoc of MessageAcknowledgingSourceBase This closes #8155. 12 April 2019, 14:26:02 UTC
410757f [hotfix][docs] Update Yarn setup documentation with Flip-6 11 April 2019, 07:20:52 UTC
b2dfec1 Set outdated flag on Flink 1.7 docs 10 April 2019, 09:16:00 UTC
5c4ed0e [FLINK-12009][runtime] Fix wrong check message about heartbeat interval for HeartbeatServices This closes #8048. 09 April 2019, 02:49:41 UTC
440f8b7 [FLINK-12075][yarn] Set RestOptions.BIND_PORT only to 0 if not specified This commit changes the YarnEntrypointUtils#loadConfiguration so that it only sets RestOptions.BIND_PORT to 0 if it has not been specified. This allows to explicitly set a port range for Yarn applications which are running behind a firewall, for example. 02 April 2019, 17:22:09 UTC
b75463a [FLINK-12075] Update flink-conf.yaml to not specify rest.port per default This commits updates the flink-conf.yaml to contain the new rest options and comments out the rest.port per default. 02 April 2019, 17:22:08 UTC
4b784b2 [FLINK-12020] [docs] Add documentation for mesos-appmaster-job.sh 1. Rename the section title from `standalone` to `Flink session cluster on Mesos`. 2. Add one new section `Flink job cluster on Mesos` which describes the usage of mesos-appmaster-job.sh. This closes #8084. 02 April 2019, 14:56:17 UTC
736ea06 [FLINK-12021] Deploy execution in topological sorted order Due to changes how the slot futures are completed and due to the fact that the ResultConjunctFuture does not maintain the order in which the futures were specified, it could happen that executions were not deployed in topological order. This commit fixes this problem by changing the ResultConjunctFuture so that it maintains the order of the specified futures in its result collection. This closes #8065. 28 March 2019, 10:47:01 UTC
459965f [hotfix] Fix checkstyle violations in ExecutionGraphDeploymentTest 28 March 2019, 10:46:59 UTC
4eb0aeb [FLINK-11855] Fix race condition in EmbeddedLeaderService#GrantLeadershipCall Fix the race condition between executing EmbeddedLeaderService#GrantLeadershipCall and a concurrent shutdown of the leader service by making GrantLeadershipCall not accessing mutable state outside of a lock. This closes #7937. 28 March 2019, 10:46:46 UTC
565c49a [hotfix] Increase startup timeout in end-to-end tests We've seen quite some flakyness in the end-to-end tests on Travis lately. On most tests it takes about 5-8 secs for the dispatcher to come up so 10 secs might be to low. 27 March 2019, 14:57:47 UTC
11c3e6a [FLINK-11984][docs] MPU timeout implications on StreamingFileSink. 25 March 2019, 16:00:35 UTC
8321f64 [hotfix][travis] Fix e2e setup issues 22 March 2019, 13:05:14 UTC
c655c3b [FLINK-11887][metrics] Fix latency drift 22 March 2019, 10:39:54 UTC
34b4da1 [hotfix][travis] Fix directory references 21 March 2019, 14:10:26 UTC
5ba2c3f [FLINK-11786][travis] Setup notifications 21 March 2019, 10:01:48 UTC
17509d8 [FLINK-11786][travis] Merge cron jobs 21 March 2019, 10:01:48 UTC
a933a7c [FLINK-11786][travis] Run main profile only on pr/push 21 March 2019, 09:52:21 UTC
5ef14a1 [FLINK-11786][travis] Simplify stage selection 21 March 2019, 09:52:15 UTC
a35bfef [FLINK-11902][rest] Do not wrap all exceptions in RestHandlerException 14 March 2019, 09:07:22 UTC
17aaca4 [hotfix][rest] Remove "Impl. error" from log message Original intent was to never reach this code path except on programmer errors, but it has turned into an accepted code path for unhandled exceptions. 14 March 2019, 09:07:16 UTC
e10a98f [FLINK-11183][metrics] Properly measure current memory usage 14 March 2019, 09:02:24 UTC
fcb4f6a [FLINK-11183][metrics] Move memory metrics creation into separate method 14 March 2019, 09:02:18 UTC
c3488dd [FLINK-11866][py][docs] Fix method name 13 March 2019, 09:14:39 UTC
ad1e9fe [FLINK-11886][docs] Update CLI output 13 March 2019, 09:11:58 UTC
f04d2cb [FLINK-11420][datastream] Fix duplicate and createInstance methods of CoGroupedStreams.UnionSerializer UnionSerializer did not perform a proper duplication of inner serializers. It also violated the assumption that createInstance never produces null. 11 March 2019, 16:45:59 UTC
a933813 [FLINK-11867][datastream] Fixed preconditions for filePath's value 11 March 2019, 14:26:58 UTC
215204c [FLINK-11851] Introduce dedicated io executor for ClusterEntrypoint and MiniCluster The io executor is responsible for running io operations like discarding checkpoints. By using the io executor, we don't risk that the RpcService is blocked by blocking io operations. This closes #7926. 07 March 2019, 18:22:49 UTC
a9ec8dd [hotfix] Repair ineffective LocalRecoveryITCase The test did not actually run since the class was refactored with JUnit's parameterized, because it was always running into a NPE and the NPE was then silently swallowed in a shutdown catch-block. 07 March 2019, 15:29:16 UTC
fa53d74 [FLINK-11542][config][docs] Extend memory configuration descriptions 07 March 2019, 08:36:12 UTC
70bc26c [FLINK-11823][core] Fixed duplicate method of TrySerializer 05 March 2019, 10:13:55 UTC
35778da [hotfix][core] Added snapshot for NothingSerializerSnapshot 05 March 2019, 08:17:09 UTC
f4c0991 [hotfix][tests] Added matcher that performs deep comparison with taking Tuples into account This commit introduced a matcher that performs a deepEquals comparison similarly to Objects#deepEquals. The only difference is that it also performs deep equality check for some flink specific classes such as e.g. Tuples, Rows. 04 March 2019, 18:02:53 UTC
54cf610 [FLINK-11420][core] Fixed duplicate method of TraversableSerializer The duplicate method of TypeSerializer used an equality check rather than reference check of the element serializer to decide if we need a deep copy. This commit uses proper reference comparison. 04 March 2019, 18:02:43 UTC
c3b49ee [hotfix][tests] Call all methods from SerializerTestBase in SerializerTestInstance by reflection 04 March 2019, 18:02:33 UTC
13b3e6b [hotfix][core] Comparing whole collections rather than contents in KryoGenericTypeSerializerTest 04 March 2019, 18:02:23 UTC
d099898 [hotfix][core] Fix Tuple0Serializer handling of null Tuple0Serializer serialized null as just a proper Tuple0 instance, which if later deserialized resulted in a regular value rather than null. This commit changes it so that it is no longer possible to serialize null with Tuple0Serializer. 04 March 2019, 17:57:06 UTC
e3c0e69 [FLINK-9003][E2E] Add operators with input type that goes through custom, stateful serialization This closes #7890. 04 March 2019, 16:26:50 UTC
837cc07 [FLINK-11787] Update Kubernetes resources: workaround to make TM reachable from JM in Kubernetes (for Flink 1.7 only) This closes #7858. 28 February 2019, 14:54:31 UTC
8b01a24 [hotfix] [docs] Bump latest stable version to 1.7.2 28 February 2019, 13:46:33 UTC
185693f [FLINK-10881] Use cancelWithSavepoint in SavepointITCase test. 28 February 2019, 13:01:10 UTC
55a3ca7 [FLINK-11185] Fix StreamSourceOperatorWatermarksTest instability. The cause of the instability seems to be that due to a not-so-rare timing, the thread that calls the `interrupt()` on the main thread, runs still after its original test finishes and calls `interrupt()` during execution of the next test. This causes the normal execution (or `sleep()` in this case) to be interrupted. 26 February 2019, 16:39:24 UTC
9185eec [FLINK-11745][State TTL][E2E] Restore from the savepoint after the job cancellation. 26 February 2019, 11:12:46 UTC
60144df [FLINK-11713][docs] Remove legacy mode from documentation 22 February 2019, 13:03:51 UTC
b0c7fe8 [FLINK-11690][runtime] Use configured RPC timeout in MiniCluster 22 February 2019, 08:34:57 UTC
b9f78bb [FLINK-11041][tests] Fix ReinterpretDataStreamAsKeyedStreamITCase 21 February 2019, 10:18:27 UTC
bf23cc4 [FLINK-10964][sql-client] SQL Client throws exception when paging through finished batch query This closes #7265. 19 February 2019, 12:51:43 UTC
b4366d4 [hotfix][travis] Remove stray slash 16 February 2019, 08:41:12 UTC
9004371 [FLINK-11424][metrics] Properly remove string/failing gauges 15 February 2019, 12:54:05 UTC
4c1907e [FLINK-11628][travis] Cache maven 15 February 2019, 12:20:32 UTC
26abcfd [FLINK-11585][docs] Fix prefix matching 13 February 2019, 09:45:49 UTC
e64d3a8 [FLINK-11584][docs][tests] Fix linebreak parsing 12 February 2019, 15:05:48 UTC
back to top