https://github.com/apache/flink

sort by:
Revision Author Date Message Commit Date
4033014 Commit for release 1.10.2 11 August 2020, 06:48:51 UTC
3317d40 [hotfix][build] Adjust the file permission for update_japicmp_configuration.sh 11 August 2020, 06:45:51 UTC
fafee5e [FLINK-18859][tests] Increase timeout of ExecutionGraphNotEnoughResourceTest#testRestartWithSlotSharingAndNotEnoughResources to make it more stable 10 August 2020, 14:54:43 UTC
5696cf2 [FLINK-17503][runtime] [logs] Refactored log output. The log output was cleaned up: - Only the key of the option is logged out instead of the whole instance's toString() method. - A new utility method was introduce that adapts the log output in a way that an adapted extension is used for maximum values instead of logging the actual max value. This closes #13086. 08 August 2020, 10:12:24 UTC
8c13486 [FLINK-16510] Allow configuring shutdown behavior to avoid JVM freeze This adds the configuration option `cluster.processes.halt-on-fatal-error` which defaults to `false`. If set to `true`, a custom SecurityManager will be installed on top of the existing SecurityManager to exit forcefully via `Runtime#halt`. Exiting that way may be necessary due to the Java 8 JVM freezing during a graceful shutdown when using the G1 garbage collector. This closes #13079. 07 August 2020, 10:29:26 UTC
b717877 [FLINK-13689] [Connectors/ElasticSearch] Fix thread leak in Elasticsearch connector when cluster is down 07 August 2020, 06:47:13 UTC
d954278 [FLINK-18677][fix] Added handling of suspended or lost connections within the ZooKeeperLeaderRetrievalService. The listener needs to be notified in case of a connection loss so that it is able to initiate necessary actions on its side. [FLINK-18677][runtime] [style] Replaced spaces by TABs to follow the Apache Flink code styles. [FLINK-18677][runtime] [fix] Synchronize notifyLeaderLoss through lock and removed redundant code. The redundant code was moved into notifyIfNewLeaderAddress(String, UUID) which is then used by notifyLeaderLoss() and within nodeChanged(). Additionally, the method call of notifyLeaderLoss() is guarded now by a lock to synchronize the state change (i.e. lastLeaderAddress and lastLeaderSessionID). [FLINK-18677][runtime] The exception was added to make it more explicit that the method is not expected to be called. [FLINK-18677][runtime] Decreased wait time the queue to be filled since we're not expecting any objects. The test does not expect any calls happening. Hence, no CompletableFuture instance will be queued. The longer wait time would just result in a longer running test. [FLINK-18677][runtime] Added infinite wait time to happy test. The previous implementation had a fixed timeout. Slower machines might need longer to process the test which might result in test failures. The new implementation removes the timeout so that the test wouldn't fail just because of a poor performance of the machine the test is running on. [FLINK-18677][runtime] Moved log messages out of synchronization blocks. This closes #13055. 05 August 2020, 09:38:28 UTC
52a77e6 [FLINK-18663][rest] Exit early if shutdown has started 03 August 2020, 20:21:30 UTC
bda1383 [FLINK-18663][rest] Improve exception handling - ensure that request finalization runs even if handleException throws an exception - catch NPE in handleException, which occurs if the client closes the connection 03 August 2020, 20:21:25 UTC
7627f54 [FLINK-16619][coordination] Log reception of slot reports only once 03 August 2020, 20:15:34 UTC
eb0a56b [FLINK-18772] Disable web submission for per-job/application mode deployments When running Flink in per-job/application mode, it will instantiate a MiniDispatcherRestEndpoint. This endpoint does not instantiate the web submission REST handlers. However, it still displayed the submit job link in the web ui. This commit changes the behaviour so that we no longer display this link when running Flink in per-job/application mode. This closes #13030. 03 August 2020, 13:50:41 UTC
47ea234 [hotfix][k8s] Correct dependencies in Kubernetes pom and notice file 29 July 2020, 12:06:04 UTC
183dfc3 [FLINK-18517][k8s] Bump fabric8 version from 4.5.2 to 4.9.2 This closes #12995. 29 July 2020, 12:05:58 UTC
e268680 [FLINK-18595][network] Fix the deadlock issue by task thread and canceler thread in RemoteInputChannel Assuming two remote channels as listeners in LocalBufferPool, the deadlock happens as follows 1. While the Canceler thread calling ch1#releaseAllResources, it will occupy the bufferQueue lock and try to call ch2#notifyBufferAvailable. 2. While task thread exiting to call CachedBufferStorage#close, it might release exclusive buffers for ch2. Then ch2 will occupy the bufferQueue lock and try to call ch1#notifyBufferAvailable. 3. ch1 and ch2 will both occupy self bufferQueue lock and wait for other side's bufferQueue lock to cause deadlock. Regarding the solution, we can check the released state outside of bufferQueue lock in RemoteInputChannel#notifyBufferAvailable to return immediately. 28 July 2020, 06:19:51 UTC
bfe6c2e [FLINK-16225] Implement user class loading exception handler This closes #12563. 22 July 2020, 12:06:28 UTC
1442300 [FLINK-15962][network] Reduce the default chunk size to 4M in netty stack 22 July 2020, 11:58:56 UTC
c1f8763 [FLINK-18644][doc][hive] Remove obsolete hive connector docs This closes #12939 21 July 2020, 06:49:28 UTC
2a3b642 [FLINK-18539][datastream] Fix StreamExecutionEnvironment#addSource(SourceFunction, TypeInformation) doesn't use the user defined type information This closes #12878 14 July 2020, 01:58:18 UTC
cf047a4 [FLINK-18478] Use AvroFactory.extractAvroSpecificSchema in AvroDeserializationSchema This makes AvroFactory and the used method public where they were package private before. This fixes the problem that AvroDeserializationSchema was not working with types generated from avrohugger. It could also just be seen as refactoring/code cleanup. 09 July 2020, 14:48:07 UTC
d64a5a0 [FLINK-18097][history] Delete all job-related files on expiration 08 July 2020, 19:10:10 UTC
494e8f8 [FLINK-18501] Use inner class name for logging scheme mapping when filesystems are instantiated 08 July 2020, 09:51:53 UTC
b9f6ab5 [hotfix][docs] Mark 1.10 as outdated 07 July 2020, 12:59:51 UTC
a519b04 [FLINK-16309][docs] ElasticSearch 7 connector is missing in SQL connector list This closes #12801 02 July 2020, 03:44:26 UTC
294d07a [hotfix][docs] Fix Python example in the documentation about event_time This closes #12789. 30 June 2020, 06:55:31 UTC
d40bd0b [FLINK-17920][python][docs] Add the Python example of the Interval Join (#12779) 29 June 2020, 12:10:08 UTC
9b45486 [FLINK-17800][rocksdb] Support customized RocksDB write/read options and use RocksDBResourceContainer to get them 26 June 2020, 16:15:35 UTC
3f8649e [hot-fix][rocksdb] Ensure RocksDBKeyedStateBackend disposed at RocksDBStateMisuseOptionTest This closes #12736. 26 June 2020, 16:15:35 UTC
de6f3aa [FLINK-17800][rocksdb] Ensure total order seek to avoid user misuse 26 June 2020, 16:15:22 UTC
23ad7e3 [FLINK-18168][table-runtime-blink] Fix array reuse for BinaryArrayData in converters This closes #12542. 25 June 2020, 07:08:27 UTC
b50704b [FLINK-17639] Document FileSystems supported by the StreamingFileSink 24 June 2020, 12:47:39 UTC
dcd7574 [FLINK-18352] Make DefaultClusterClientServiceLoader/DefaultExecutorServiceLoader thread-safe 22 June 2020, 14:05:01 UTC
fd91aff [FLINK-18242][state-backend-rocksdb] Separate RocksDBOptionsFactory from OptionsFactory This closes #12673. 20 June 2020, 09:00:04 UTC
831daaa Revert "[FLINK-17800][roksdb] Ensure total order seek to avoid user misuse" This reverts commit b8ddbef9a5cc5dc769ba61bd5019dd96843c932f. 20 June 2020, 08:59:06 UTC
f87937b Revert "[FLINK-17800][roksdb] Support customized RocksDB write/read options and use RocksDBResourceContainer to get them" This reverts commit 88c22864504d772764c5838afe0b944f1da50a3a. 20 June 2020, 08:58:59 UTC
b1fdf6d [FLINK-18329][legal] Fix typo 17 June 2020, 09:04:27 UTC
f7a4128 [FLINK-16717][k8s] Use headless service for rpc and blob port This closes #11488. 16 June 2020, 13:04:24 UTC
88c2286 [FLINK-17800][roksdb] Support customized RocksDB write/read options and use RocksDBResourceContainer to get them 16 June 2020, 11:30:04 UTC
b8ddbef [FLINK-17800][roksdb] Ensure total order seek to avoid user misuse 16 June 2020, 11:29:55 UTC
5c0f827 [FLINK-17322][network] Disallowing repeated consumer creation for BufferBuilder. This is a partial revert of FLINK-10995. 16 June 2020, 07:43:58 UTC
5fc4d1b [FLINK-17322][network] Fixes BroadcastRecordWriter overwriting memory segments on first finished BufferConsumer. BroadcastRecordWriter#randomEmit initialized buffer consumers for other non-target channels incorrectly leading to separate buffer reference counting and subsequently released buffers too early. This commit uses the new BufferConsumer#copyWithReaderPosition method to copy the buffer while updating the read index to the last committed write index of the builder. 16 June 2020, 07:43:58 UTC
2bf5ea2 [FLINK-17891][yarn] Set execution.target=yarn-session in FlinkYarnSessionCli.run() Currently when starting a yarn session cluster using the yarn-session script or the FlinkYarnSessionCli.run() the displayed execution.target is yarn-per-job, which is misleading. We fix it by explicitly setting it to yarn-session. 16 June 2020, 07:40:04 UTC
124c819 [FLINK-16432][hive] Fix dependencies in Hive Connector build. (cherry picked from commit 8c3c54821dd5907fab2adab107e7391908980206) 15 June 2020, 11:17:24 UTC
2a381c9 [FLINK-18223] Fixed AvroSerializer to initialize GenericRecords in the correct way This closes #12591 15 June 2020, 10:13:52 UTC
492eb46 [hotfix] Update release notes for 1.10 13 June 2020, 12:02:28 UTC
c2e2c6e [FLINK-18241] Use correct user class loader in OptimizerPlanEnvironment & StreamPlanEnvironment This closes #12601 12 June 2020, 06:36:27 UTC
2b45d79 [hotfix] Improve exception message for parsing kryo serializer classes from config 12 June 2020, 06:36:27 UTC
a5de333 [FLINK-17788][scala-shell] Fix yarn session support in scala shell 11 June 2020, 18:54:00 UTC
6de64ac [FLINK-16217][sql-client] Fix exception catching to avoid SQL client crashes This closes #11397. 10 June 2020, 08:26:16 UTC
e71a42c [FLINK-18045] Fix Kerberos credentials checking This closes #12462. 09 June 2020, 12:08:43 UTC
855f799 [FLINK-18048] Fix --host option for standalone job cluster This closes #12495. 05 June 2020, 12:23:27 UTC
a412840 [FLINK-17466][table-planner-blink] Fix toRetractStream doesn't work correctly with Pojo conversion class This closes #12425 04 June 2020, 05:31:03 UTC
fefc92a [FLINK-16451][table-planner-blink] Fix IndexOutOfBoundsException for DISTINCT AGG with constants This closes #12432 04 June 2020, 05:31:03 UTC
dddd0f0 [FLINK-17945][python] Improve the error message when instantiating non-existing Java class This closes #12469. 04 June 2020, 02:16:57 UTC
c70460a [FLINK-17959][python] Fix the 'call already cancelled' exception when executing Python UDF This closes #12459. 03 June 2020, 15:14:24 UTC
eafc602 [FLINK-17959][python] Port Beam GrpcStateService class to flink-python module This closes #12459. 03 June 2020, 15:14:16 UTC
bd2ca49 [FLINK-17959][checkstyle] Exclude all beam classes This closes #12459. 03 June 2020, 15:14:01 UTC
ffc3d86 [FLINK-18012] Deactivate slot timeout when calling TaskSlotTable.tryMarkSlotActive In order to avoid timing out activated slots, we also need to deactivate the slot timeout in case that TaskSlotTable.tryMarkSlotActive is being called. This can happen if the response for JobMasterGateway.offerSlots has been too late and timed out. This closes #12390. 02 June 2020, 14:49:58 UTC
d872411 [hotfix] Add TaskSlotTableImplTest.testAllocatedSlotTimeout 02 June 2020, 14:49:56 UTC
4a562d3 [hotfix] Rename TaskSlotTableTest into TaskSlotTableImplTest 02 June 2020, 14:49:56 UTC
a93edd1 [hotfix] Fix checkstyle violation in TaskSlotTableTest 02 June 2020, 14:49:56 UTC
a8b1fac [FLINK-17970] Increase default value of cluster.io-pool.size from #cores to 4 * #cores This closes #12394. 02 June 2020, 14:40:43 UTC
a43716a [FLINK-17970] Rename cluster.io-executor.pool-size config option into cluster.io-pool.size Shortens the cluster.io-pool.size config option and updates the description of it. 02 June 2020, 14:40:42 UTC
fc2d419 [FLINK-18010][runtime] Expand HistoryServer logging 02 June 2020, 12:36:44 UTC
7677674 [FLINK-18008][runtime] HistoryServer logs environment info 02 June 2020, 12:36:42 UTC
6f247b4 Revert "[FLINK-17558][runtime] Add Executors#newCachedThreadPool" This reverts commit 90b8455d08eda7a6a55f5cc952fa1adf3a48ff96. 31 May 2020, 21:43:52 UTC
d4f940f [FLINK-18035][runtime] Use fixed thread pool 31 May 2020, 21:43:46 UTC
006b8d0 [FLINK-17844][build] Update japicmp configuration for 1.10.1 29 May 2020, 08:05:23 UTC
1f9f018 [hotfix] Remove unused import 29 May 2020, 07:54:33 UTC
8730b5b [FLINK-17819][yarn] Fix error msg for yarn deployments when hadoop not in classpath This closes #12395. 29 May 2020, 07:49:19 UTC
58139c7 [FLINK-17844][build] Add tooling for updating japicmp configuration 29 May 2020, 07:37:26 UTC
01aa611 [FLINK-17744] Make (Stream)ContextEnvironment#execute call JobListener#onJobExecuted 29 May 2020, 07:17:20 UTC
c6c0839 [FLINK-17558][netty] Release partitions asynchronously 28 May 2020, 12:45:18 UTC
0efeea3 [FLINK-17558][tests] Extract ShuffleEnvironment/PartitionTracker setup 28 May 2020, 12:45:18 UTC
cce9711 [FLINK-17558][tests] Simplify partition tracker setup 28 May 2020, 12:45:17 UTC
8e8dbb8 [FLINK-17558][runtime] Add Executors#newCachedThreadPool 28 May 2020, 12:45:17 UTC
cbb8cb6 [FLINK-17558][tests] Add TestExecutorResource 28 May 2020, 12:45:13 UTC
b417353 [hotfix][tests] Shutdown TaskmanagerServices 28 May 2020, 12:00:17 UTC
15c3171 [hotfix][tests] Remove unused TestingScheduledExecutor 28 May 2020, 12:00:17 UTC
32c9731 [FLINK-16694][ci] Limit number of dumped log lines 27 May 2020, 13:56:21 UTC
492f9de [FLINK-17870] Fix ScalaShell executeAsync to ship all dependencies 25 May 2020, 19:56:02 UTC
71dbbe6 [FLINK-17822][MemMan] Use private Reference.tryHandlePending|waitForReferenceProcessing to trigger GC cleaner This closes #12270. 25 May 2020, 07:34:30 UTC
7132038 [FLINK-17801][tests] Increase timeout of TaskExecutorTest.testHeartbeatTimeoutWithResourceManager Increasing the timeout because on AZP it can happen that calling the disconnectTaskExecutor takes more than 150 ms. This commit increases the timeout to 10s. This closes #12242. 22 May 2020, 16:41:23 UTC
ed4f7da [hotfix][docs] Fix comment about RocksDB timer default 20 May 2020, 15:43:51 UTC
57704be [FLINK-17763][dist] Properly handle log properties and spaces in scala-shell.sh 19 May 2020, 14:38:13 UTC
0e43356 [FLINK-17809][dist] Quote classpath and FLINK_CONF_DIR 19 May 2020, 14:34:35 UTC
b8fcdd6 [hotfix] remove IntelliJ '//noinspection ...' directives from MemoryManager 19 May 2020, 07:46:02 UTC
2a45209 [FLINK-15758][MemManager] Release segment and its unsafe memory in GC Cleaner After #9747, managed memory is allocated from UNSAFE, not as direct nio buffers as before 1.10. The releasing of segments released also underlying unsafe memory which is dangerous in general as there can be still references to java objects giving access to the released memory. If this reference ever leaks, the illegal memory access can result in memory corruption of other code parts w/o even segmentation fault. The solution can be similar to how Java handles direct memory limit: - underlying byte buffers of segments are registered to phantom reference queue with a Java GC cleaner which releases the unsafe memory - all allocations and reservations are managed by a memory limit and an atomic available memory - if available memory is not enough while reserving, the phantom reference queue processing is triggered to run hopefully discovered by GC cleaners - memory can be released directly or in a GC cleaner The GC is also sped up by nulling out byte buffer reference in `HybridMemorySegment#free` which is inaccessible anyways after freeing. Otherwise also a lot of tests, which hold accidental references to memory segments, have to be fixed to not hold them. The `MemoryManager#verifyEmpty` checks that everything can be GC'ed at the end of the tests and after slot closing in production to detect memory leaks if any other references are held, e.g. from `HybridMemorySegment#wrap`. This closes #11109. 19 May 2020, 07:46:02 UTC
33ba6be [FLINK-15758][MemManager] Remove MemoryManager#AllocationRequest 19 May 2020, 07:46:02 UTC
e70f585 [FLINK-15758][MemManager] Remove KeyedBudgetManager and use AtomicLong 19 May 2020, 07:46:02 UTC
247ab12 [FLINK-16160][table] Fix proctime()/rowtime() doesn't work for TableEnvironment.connect().createTemporaryTable() This closes #12218 19 May 2020, 06:16:57 UTC
313051c [FLINK-17506][state-processor-api] Use proper RocksDB configurations in KeyedStateInputFormat 18 May 2020, 18:51:21 UTC
5089f03 [FLINK-17506][state-processor-api] SavepointEnvironment should honour 'io.tmp.dirs' property 18 May 2020, 17:44:07 UTC
f363c83 [hotfix][state-processor-api] Remove BoundedStreamConfig 18 May 2020, 17:43:58 UTC
79f2ca1 [hotfix] Show hostname in error message This closes #11987. 18 May 2020, 08:10:37 UTC
2bc4628 [FLINK-17700][python] The callback client of JavaGatewayServer should run in a daemon thread. This closes #12165. 18 May 2020, 03:01:14 UTC
8a2b13c [FLINK-15836][k8s] Throw fatal error in KubernetesResourceManager when the pods watcher is closed with exception By default the watcher will always reconnect in Kubernetes client internally. However, if the watchReconnectLimit is configured by users via java properties or environment, the watcher may be stopped. Then all the changes of pods will not be processed properly. The reason why the the watcher closed exceptionally is usually because of network problems or port abuse. The correct way is to fail the jobmanager pod and retry in a new one. This closes #11010. 16 May 2020, 12:53:36 UTC
e3a9502 [FLINK-17248] Introduce configuration for pool size of io-executor for ClusterEntrypoint and MiniCluster This closes #11957. 16 May 2020, 12:32:22 UTC
9d149c6 [FLINK-17643][tests] Fix LaunchCoordinatorTest instability by completing stubbing The LaunchCoordinatorTest was susceptible to test failures because a test did not fully define a mock. The test scheduled a scheduled action which, if executed long enough, would be triggered and then call into an incomplete mock causing a NPE. This closes #12114. 15 May 2020, 13:26:43 UTC
b3023cb [FLINK-17578] In StreamEdge, use output tag in hashCode and equals It fixes the behavior: when we take the union of two side outputs. Flink was repeating the data from one twice. 14 May 2020, 14:21:02 UTC
38a75ca [hotfix][docs] Fix and improve query configuration docs. * Fix: TableConfig is *not* passed back when a Table is translated. 13 May 2020, 15:38:54 UTC
back to top