https://github.com/apache/flink

sort by:
Revision Author Date Message Commit Date
c61b108 Commit for release 1.5.0 24 May 2018, 14:54:44 UTC
4446723 [FLINK-9416] Make all RestClusterClient calls retriable This commit changes the RestClusterClient calls such that they are all retriable wrt to connection errors and if the service is currently unavailable (return code 503). Moreover, it changes the retry behaviour for polling the JobResult such that it fails now if the cluster returns a NOT_FOUND code. This closes #6069. 24 May 2018, 14:44:44 UTC
2307102 [FLINK-9421] Remove job from RunningJobsRegistry when it reaches a terminal state This commit lets the Dispatcher remove the RunningJobsRegistry entry for a completed job when it is removed from the Dispatcher. This closes #6068. 24 May 2018, 14:44:44 UTC
5c35e04 [FLINK-9427] Fix registration and request slot race condition in TaskExecutor This commit fixes a race condition between the TaskExecutor and the ResourceManager. Before, it could happen that the ResourceManager sends requestSlots message before the TaskExecutor registration was completed. Due to this, the TaskExecutor did not have all information it needed to accept task submissions. The problem was that the TaskExecutor sent the SlotReport at registration time. Due to this, t he SlotManager could already assign these slots to pending slot requests. With this commit, the registration protocol changes such that the TaskExecutor first registers at the ResourceManager and only after completing this step, it will announce the available slots to the SlotManager. This closes #6067. 24 May 2018, 14:44:44 UTC
bce3d7c [FLINK-9425] Make release scripts compliant with ASF release policy Remove the generation of MD5 checksum files and create sha checksum files with a sha512 file ending. This closes #6061. 24 May 2018, 14:03:52 UTC
df0393a [FLINK-9415] [scala, test] Remove ScalaStreamingMultipleProgramsTestBase This closes #6058. 24 May 2018, 06:47:33 UTC
768a125 [FLINK-9415] Remove reference to StreamingMultipleProgramsTestBase in docs 24 May 2018, 06:47:26 UTC
e04f872 [FLINK-9426][test] Remove flaky asserts from RocksDBWriteBatchPerformanceTest.benchMark(). This closes #6063. (cherry picked from commit b485f8c) 23 May 2018, 14:37:26 UTC
221fec7 [FLINK-9064][scaladocs] Add link to scaladocs to documentation sidebar. This closes #5773. (cherry picked from commit c10e03f) 23 May 2018, 14:26:17 UTC
3f97f33 [FLINK-8845][state] Introduce RocksDBWriteBatchWrapper to improve batched write performance in RocksDB backend. This closes #5650. (cherry picked from commit 1c7341a) 23 May 2018, 10:30:03 UTC
3295ffc [hotfix][cassandra] Add no-org constructor to example POJO 23 May 2018, 07:25:50 UTC
48a05ae [hotfix] [kafka, test] Remove unnecessary Mockito usages in AbstractFetcherTest 23 May 2018, 07:11:23 UTC
bc4a402 [FLINK-9349] [kafka, test] Strengthen testConcurrentPartitionsDiscoveryAndLoopFetching test This commit improves the said test to fail consistently without fixing concurrent modifications on the partition states list. This closes #6040. 23 May 2018, 07:11:14 UTC
96ffae2 [FLINK-9349] [kafka] Fix concurrent modification on partitions states list 23 May 2018, 07:11:06 UTC
8c2a70f [FLINK-9414] Remove unnecessary jline-reader and jline-terminal entries from LICENSE The jline-reader and jline-terminal are dependencies against which we link. They don't need to be included in LICENSE, because LICENSE only contains code which is contained in the source release of Flink. 22 May 2018, 23:36:57 UTC
a62683e [FLINK-9406] Use equals in JobMaster#requestPartitionState Use equals instead of referential equality in JobMaster#requestPartitionState when comparing the producerExecution attempt id with the result partition producer id. This closes #6057. 22 May 2018, 22:59:50 UTC
37b630e [FLINK-9408] Let JM try to reconnect to RM This commit changes the behaviour of the JM to always try to reconnect to the latest known RM address. This closes #6056. 22 May 2018, 22:59:50 UTC
e0b1b46 [FLINK-9402] [kinesis] Kinesis consumer configuration requires either region or endpoint. Fix validation logic to allow either region or endpoint, but not both. This closes #6045. 22 May 2018, 22:59:35 UTC
30c224a [FLINK-6909] [types] Fix error message in CsvReader for wrong type class This closes #6037. 22 May 2018, 12:48:21 UTC
5e71bf8 [hotfix][javadocs] Fix path example in DateTimeBucketer This closes #6051. 22 May 2018, 09:52:06 UTC
9d0cd58 [FLINK-9295][kafka] Fix transactional.id collisions for FlinkKafkaProducer011 Previously if there were two completely independent FlinkKafkaProducer011 data sinks in the job graph, their transactional.id would collide with one another. Fix is to use operator's unique ID as well along task name and subtask id. This change is backward compatible for recovering from older savepoints, since transactional.ids generated by the old generator still will be used after restoring from state. This closes #5977. 22 May 2018, 08:54:40 UTC
f04dfb5 [FLINK-9316][streaming] Expose operator's unique ID in DataStream programs This allows to uniquely and stably across multiple job submissions identify operators. Previously two different operators that were executed by tasks that had the same name were indistinguishable. 22 May 2018, 08:54:34 UTC
9ef10e6 [hotfix][tests] Reduce mockito usage in tests 22 May 2018, 08:54:29 UTC
e1f64d8 [hotfix][tests] Introduce MockEnvironmentBuilder to deduplicate MockEnvironment constructors 22 May 2018, 08:54:23 UTC
7b680c9 [hotfix] [e2e] Properly use run_test utility for local recovery and quickstart tests 22 May 2018, 08:54:17 UTC
7c6d5af [FLINK-9372] [elasticsearch] Typo on Elasticsearch website link This closes #6018. 22 May 2018, 08:54:11 UTC
8224a7b [hotfix] [e2e] Properly backup Flink config in externalized checkpoint e2e test 22 May 2018, 08:54:03 UTC
6d718ff [FLINK-9008] [e2e] Reuse flink-elasticsearch5-test job code as quickstart e2e test's modified job Previously, the modified job used in the `test_quickstarts.sh` test script is maintained as a new Maven module. This is an overkill, since all we are doing is replacing the quickstart's contained job with something more complex and with additional dependencies. This commit changes this by simply reusing job code in flink-elasticsearch5-test as the modified job, which is copied to the quickstart project. This closes #5823. 22 May 2018, 08:53:38 UTC
a814a9e [FLINK-9008] [e2e] Implements quickstarts end to end test 22 May 2018, 08:52:32 UTC
3e434ee [FLINK-8989] [e2e] Cleanup / improve Elasticsearch e2e tests - Rework e2e test job modules to have correct Maven POM - Parameterize num of records to write to Elasticsearch - Parameterize Elasticsearch download URL and version in test script - Improve robustness of test - Move more Elasticsearch functionality to elasticsearch-common.sh This closes #5761. 22 May 2018, 08:51:38 UTC
a7abfcb [FLINK-8989] [e2eTests] Elasticsearch1&2&5 end to end test 22 May 2018, 08:50:26 UTC
7f9e4c0 [FLINK-8977] [e2e] Extend externalized checkpoint e2e to simulate job failures This closes #6004. 22 May 2018, 08:49:34 UTC
22e400d [FLINK-8977] [e2e] Allow configuring restart strategy for general purpose DataStream job 22 May 2018, 08:49:26 UTC
d7ec5a9 [FLINK-9320] [e2e] Update test_ha e2e to use general purpose DataStream job This closes #5990. 22 May 2018, 08:49:17 UTC
aec4496 [FLINK-9322] [e2e] Add failure simulation to the general purpose DataStream job 22 May 2018, 08:49:11 UTC
ef6e40f [FLINK-8971] [e2e-tests] Include broadcast / union state in general purpose DataStream job This closes #5941. 22 May 2018, 08:49:05 UTC
0d5d086 [hotfix] [e2e-tests] Make SequenceGeneratorSource usable for 0-size key ranges 22 May 2018, 08:49:00 UTC
2b4137c [FLINK-9403][docs] Remove obsolete documentation This closes #6048. 22 May 2018, 07:06:01 UTC
68814fc [hotfix][docs][table] Fix link to registering external catalog This closes #6052. 22 May 2018, 06:46:27 UTC
0c06852 [FLINK-8659] Add migration itcases for broadcast state. 18 May 2018, 13:10:54 UTC
5df2bc5 [FLINK-9070][state] Improve the performance of RocksDBMapState.clear() with WriteBatch. This closes #5979. (cherry picked from commit 87e54eb) 18 May 2018, 09:05:35 UTC
a93fc27 [hotfix] [docs] Add Release Notes for Flink 1.5. This closes #6039. 18 May 2018, 07:50:50 UTC
bc4da43 [hotfix] Make TaskManagerRunner shutdown asynchronously 17 May 2018, 23:03:54 UTC
ba379ec [FLINK-6160] Add reconnection attempts in case of heartbeat timeouts to JobMaster and TaskExecutor If a timeout with the RM occurs on on the JobMaster and TaskExecutor, then they will both try to reconnect to the last known RM address. Additionally, we now respect the TaskManagerOption#REGISTRATION_TIMEOUT on the TaskExecutor. This means that if the TaskExecutor could not register at a RM within the given registration timeout, it will fail with a fatal exception. This allows to fail the TaskExecutor process in case that it cannot establish a connection and ultimately frees the occupied resources. The commit also changes the default value for TaskManagerOption#REGISTRATION_TIMEOUT from "Inf" to "5 min". This closes #6035. 17 May 2018, 23:03:54 UTC
884c2e3 [FLINK-9397] [DataStream API] Correctly propagate operator buffer timeout of 0 This also improves some JavaDocs. 17 May 2018, 18:33:03 UTC
27061d3 [FLINK-9387] Several log message errors in queryable-state module. 17 May 2018, 16:33:05 UTC
416d924 [hotfix] [build] Force delete corrupt jar files from cache 17 May 2018, 13:23:19 UTC
94391d8 [FLINK-9299] [docs] Fix errors in ProcessWindowFunction documentation Java examples This closes #6001 17 May 2018, 13:23:19 UTC
c75c152 [FLINK-9373][statebackend] Introduce RocksIteratorWrapper to wrap `Seek(), Next(), SeekToFirst(), SeekToLast(), SeekForPrev(), and Prev()` to check the iterator status. This closes #6020. (cherry picked from commit 105b306) 17 May 2018, 13:16:09 UTC
a8ef875 Revert "[FLINK-9360][tests] Reduce sleep to 30 seconds" This reverts commit ee1ab02442867f1aeedddc4b36ab66434344d9ae. 17 May 2018, 09:33:25 UTC
7fded5f [FLINK-9381] Release blobs after job termination Properly remove job blobs from BlobServer after the job terminates. If the job reaches a globally terminal state, then the HA blob store files will also be cleared. In case of a suspension or that the job is not finished (e.g. another process finsihes the job concurrently), we only remove the local blob server files. Additionally, we properly release the user code class loader registered in the JobManagerRunner when it closes. This closes #6030. 17 May 2018, 09:33:25 UTC
da5b6d7 [FLINK-8910][e2e] Automated test for local recovery (including sticky allocation) This closes #5676. (cherry picked from commit 489e428) 17 May 2018, 08:10:56 UTC
fbe3cbf [hotfix] Expose AllocationID as string through TaskInfo (cherry picked from commit edece9c) 17 May 2018, 08:07:52 UTC
eba462e [hotfix] Small improvements in logging for local recovery (cherry picked from commit 8993599) 17 May 2018, 08:07:48 UTC
57887cd [hotfix] Introduce NoOpTaskLocalStateStoreImpl that is used as store if local recovery is disabled This implementation will no go through all the registration/lookup steps or a normal state store, beause they are not required if local recovery is disabled. (cherry picked from commit 2bc1eaa) 17 May 2018, 08:07:44 UTC
8a8b6c4 [hotfix] Change default for SLOT_IDLE_TIMEOUT to match HEARTBEAT_TIMEOUT That preserves sticky slot allocation for local recovery for lost JVMs that can take as long as the heartbeat timeout to be detected. (cherry picked from commit b17be26) 17 May 2018, 08:07:39 UTC
f3d7733 [hotfix] Abort restore when the procedure failed through with a closed CloseableRegistry This prevents that exceptions from cancellation through the CloseableRegistry will result in unnecessary recovery attemps with alternative state. (cherry picked from commit a7b54f1) 17 May 2018, 08:07:35 UTC
f618c7e [hotfix][docs] Update docs for simplified configuration of local recovery (cherry picked from commit 85eb104) 17 May 2018, 08:07:30 UTC
da09904 [hotfix][conf] Add missing deprecation notes 16 May 2018, 18:22:33 UTC
c7c7b55 [FLINK-9354][travis] Print execution times for nightly E2E tests This closes #6008. 16 May 2018, 18:22:33 UTC
c8d6f06 [hotfix][docs] Update docs regarding externalized checkpoint This closes #5928. 16 May 2018, 18:22:33 UTC
e5db8b5 [FLINK-9285][REST][docs] Update REST API docs This closes #5946. 16 May 2018, 18:22:33 UTC
5734930 [FLINK-9333][docs] Add IntelliJ section for setting JVM options This closes #5989. 16 May 2018, 18:22:33 UTC
242a5f3 [FLINK-9333][docs] Fix typos in quickstart docs 16 May 2018, 18:22:33 UTC
ee1ab02 [FLINK-9360][tests] Reduce sleep to 30 seconds 16 May 2018, 18:22:33 UTC
eea3a82 [FLINK-9176][tests] Remove category annotations This closes #6005. 16 May 2018, 18:22:32 UTC
32bf12c [FLINK-9359][docs] Update quickstart docs to only mention Java 8 This closes #6010. 16 May 2018, 18:22:32 UTC
c2ec5ca [FLINK-9284][docs] Update port in CLI docs This closes #6013. 16 May 2018, 18:22:32 UTC
29c3461 [FLINK-9283][docs] Update port in cluster execution docs This closes #6022. 16 May 2018, 18:22:32 UTC
3bc2ca3 [FLINK-9357][tests][yarn] Add margins to exception excerpts This closes #6009. 16 May 2018, 18:22:31 UTC
7fb94fb [hotfix][test-scripts] Properly wait for cluster to be up in common.sh 16 May 2018, 14:40:36 UTC
0181131 Revert "[FLINK-8286] Fix Kerberos integration for FLIP-6 YarnTaskExecutorRunner" This reverts commit 93d1c47a14ab500b07331b2c415c86973fbeca29. 16 May 2018, 13:53:18 UTC
4365dcb [FLINK-9174] Make type of state created in ProcessWindowFunction.process() consistent 16 May 2018, 12:50:01 UTC
6da10a1 [FLINK-9361] [sql-client] Fix refresh interval in changelog mode This closes #6012. 15 May 2018, 14:35:41 UTC
f07f36f [FLINK-9365] [rpc] Add handshake procedure to AkkaRpcService when connecting The handshake procedure sends the source version and the target rpc gateway type to the rpc endpoint. This information is used to validate whether the version is compatible and whether the rpc endpoint supports the target gateway type. This closes #6017. 15 May 2018, 12:24:37 UTC
f7bb8f5 [hotfix] Resolve compiler warnings in AkkaRpcService 15 May 2018, 10:54:57 UTC
c1aa9ad [hotfix] Add JobMasterTest#testSlotRequestTimeoutWhenNoSlotOffering The JobMasterTest#testSlotRequestTimeoutWhenNoSlotOffering verifies that the JM will retry a job scheduling if one of its TMs does not properly offer a slot. The mechanism which triggers this behaviour is the slot request timeout which fails the ongoing scheduling operation if the slot requests are not fulfilled. 15 May 2018, 10:54:57 UTC
4e937aa [FLINK-9350] Parameter baseInterval has wrong check message in CheckpointCoordinator constructor This closes #6002. 15 May 2018, 08:48:01 UTC
3b22b48 [FLINK-9074] [e2e] Add e2e test for resuming jobs from retained checkpoints This closes #5969. 15 May 2018, 08:47:54 UTC
59f9c12 [FLINK-9074] [e2e] Allow configuring externalized checkpoints for the general purpose DataStream job 15 May 2018, 08:47:48 UTC
64117e8 [hotfix] Make field JobMaster#resourceManagerLeaderRetriever final 15 May 2018, 05:51:46 UTC
ee41e95 [FLINK-9358] Avoid NPE when closing an unestablished ResourceManager connection A NPE occurred when trying to disconnect an unestablished ResourceManager connection. In order to fix this problem, we now check whether the connection has been established or not. This closes #6011. 15 May 2018, 05:51:46 UTC
f5be783 [FLINK-9304] Timer service shutdown should not stop if interrupted This closes #5962. 15 May 2018, 05:51:46 UTC
d5bcecd [FLINK-9194] Introduce HistoryServerArchivist interface The HistoryServerArchivist interface encapsulates the archiving logic of an AccessExecutionGraph to the history server. Currently this means to generate the JSON responses for all possible HTTP requests and writing them to a target directory. This closes #5902. 15 May 2018, 05:51:46 UTC
27e8901 [hotfix] Add import for linked component in ArchivedJson 15 May 2018, 05:51:46 UTC
8d8b3ec [FLINK-9194] Add support for legacy history server formats 15 May 2018, 05:51:46 UTC
7ba41bc [FLINK-9194][history] Rework and extend the HistoryServer test 15 May 2018, 05:51:46 UTC
0d56793 [FLINK-9194][history] Adjust handlers 15 May 2018, 05:51:46 UTC
4d5b00e [FLINK-9194][history] Add convenience ArchivedJson constructor 15 May 2018, 05:51:46 UTC
c2e3d23 [FLINK-9194][history] Add archiving routine to Dispatcher 15 May 2018, 05:51:46 UTC
5a181e1 [hotfix][history] Read/Write MultipleJobsDetails instead of manual JSON 15 May 2018, 05:51:46 UTC
ca51c41 [FLINK-9246][HS] Adjust HistoryServer for job overview changes 15 May 2018, 05:51:46 UTC
2d34b90 [hotfix][tests] Fix minor mocking issues in AbstractStreamOperatorTest (cherry picked from commit bcd028d) 14 May 2018, 15:52:28 UTC
b907af2 [FLINK-9355][checkpointing] Simplify configuration of local recovery to a simple on/off switch This closes #6006. (cherry picked from commit 7f42259) 14 May 2018, 15:52:23 UTC
c2c7ac9 [FLINK-9336] [state] Set the userKeyOffset in every MapEntry. Previously the userKeyOffset in RocksDB was set when serializing the key and namespace. This was prone to failure as different code paths followed by queryable state were not setting it appropriately. 14 May 2018, 12:33:09 UTC
0a26dfa [FLINK-8780] [docs] Add Broadcast State documentation. 14 May 2018, 12:10:44 UTC
552435e [FLINK-9181] [docs] [sql-client] Add documentation for the SQL Client This closes #5913. 14 May 2018, 11:06:03 UTC
865c608 [hotfix] [runtime] Remove accidental reference to Hadoop StringUtils in CheckpointStorageLocationReference 14 May 2018, 08:25:42 UTC
a809a26 [FLINK-9201] Add trigger tests for late-window merging This closes #5917 14 May 2018, 08:10:42 UTC
038eb1d [FLINK-9201] Fixed the same merge window will be fired twice if watermark already passed the merge window 14 May 2018, 08:10:42 UTC
back to top