https://github.com/apache/flink

sort by:
Revision Author Date Message Commit Date
2be5f47 blink first commit 31 January 2019, 04:03:50 UTC
72b63b5 [hotfix][tests] Fix checkstyle violations in ClassLoaderUtilsTest 26 January 2019, 15:28:45 UTC
3fdb2af [FLINK-11316][tests] Refactor ClassLoaderUtilsTests#createValidJar(File) This closes #7486. 26 January 2019, 15:28:45 UTC
6c01cf9 [FLINK-11316][tests] Drop JarFileCreator 26 January 2019, 15:28:45 UTC
bced96a [FLINK-11171] Avoid concurrent usage of StateSnapshotTransformer Test non concurrent access of StateSnapshotTransformer Refactor out testNonConcurrentSnapshotTransformerAccess to separte StateSnapshotTransformerTest use element serializer from new meta info, duplicate it in rocksdb transformer factory, test concurrent access for element serializer This closes #7320. 25 January 2019, 18:14:54 UTC
c95e9f6 [FLINK-11390][tests] Port testTaskManagerFailure to new codebase. Port YARNSessionCapacitySchedulerITCase#testTaskManagerFailure to flip6 codebase: * Remove assertions that rely on log messages only * Move part where TMs are killed to YARNHighAvailabilityITCase * Rename test to a proper name that describes what it does * Add Javadoc explaning what this test does [FLINK-11390][tests] Move comment to right position [FLINK-11390][tests] Reuse YarnClient from super class Move waitUntilCondition to YarnTestBase [FLINK-11390][tests] Extract method parse hostname Extract method getOnlyApplicationReport Extract method submitJob Extract method getNumberOfSlotsPerTaskManager Extract method getFlinkConfigFromRestApi Delete useless comment Rename: runner -> yarnSessionClusterRunner Delete useless sleep & refactor Reorder methods and add static keyword where possible This closes #7546. 25 January 2019, 16:56:42 UTC
4c4ce45 [FLINK-11008][state] Parallelize file upload for RocksDB incremental snapshots. Summary: This patch add the ability about uploading state files using multithread when snapshoting. Differential Revision: https://aone.alibaba-inc.com/code/D818724 This closes #7351. 25 January 2019, 10:14:02 UTC
c841076 [FLINK-11354][tests] Port JobManagerHARecoveryTest to new code base - Moved JobManagerHARecoveryTest#testJobRecoveryWhenLosingLeadership to DispatcherHATest#testJobRecoveryWhenChangingLeadership - Moved JobManagerHARecoveryTest#testFailingJobRecovery to DispatcherHATest#testFailingRecoveryIsAFatalError This closes #7539. 24 January 2019, 17:19:10 UTC
8ce4e0c [hotfix][tests] Add TestingHighAvailabilityServicesBuilder The builder creates a TestingHighAvailabilityServices with the standalone implementation of the individual services. 24 January 2019, 17:17:23 UTC
9d9863e [hotfix][tests] Remove BlobServer from JobManagerRunnerTest 24 January 2019, 17:15:46 UTC
35a3d79 [hotfix] Move BlobWriter into JobMangerSharedServices 24 January 2019, 17:15:46 UTC
e76512b [hotfix] Pass BlobWriter into JobMaster instead of BlobServer 24 January 2019, 17:15:45 UTC
0a8ed64 [hotfix] Remove unused JobMasterGateway#requestClassloadingProps 24 January 2019, 17:15:45 UTC
35779f2 [hotfix] Fix checkstyle violations in AkkaRpcActorTest 24 January 2019, 10:33:45 UTC
3667ea6 [FLINK-10251][rpc] Refactor handling of over sized messages This commit slightly refactors and cleans up the handling of over sized messages. This closes #6876. 24 January 2019, 10:33:45 UTC
63641cd [FLINK-10251][rpc] Handle oversized response messages in AkkaRpcActor 24 January 2019, 10:33:40 UTC
2104335 [FLINK-11353][tests] Port JobManagerHAJobGraphRecoveryITCase to new code base Removed testClientNonDetachedListeningBehaviour because the test was only relevant for the JobClientActor. Moved testJobPersistencyWhenJobManagerShutdown to DispatcherHATest#testPersistedJobGraphWhenDispatcherIsShutDown. This closes #7526. 24 January 2019, 09:34:31 UTC
bb64862 [FLINK-11356][tests] Port JobManagerStartupTest to new code base - Moved JobManagerStartupTest#testStartupWithPortInUse to BootstrapToolsTest#testActorSystemInstantiationFailureWhenPortOccupied - Moved JobManagerStartupTest#testJobManagerStartupFails to BlobServerTest#testFailureIfStorageDirectoryCannotBeCreated This closes #7541. 24 January 2019, 07:56:48 UTC
a8c1f7c [hotfix][tests] Fix checkstyle violations in AkkaRpcServiceTest 24 January 2019, 07:56:48 UTC
20fff57 [FLINK-11048] Mark new RemoteStreamEnvironment constructor PublicEvolving 23 January 2019, 18:13:43 UTC
b12d392 [FLINK-11282][network] Merge StreamRecordWriter into RecordWriter (#7438) [FLINK-11282][network] Merge StreamRecordWriter into RecordWriter 23 January 2019, 17:37:51 UTC
bd0906c fix typo in JobManagerRunner This closes #7569 23 January 2019, 14:09:18 UTC
3f0b1df [FLINK-11348][tests] Port testClientStartup to new codebase Port YARNSessionCapacitySchedulerITCase#testClientStartup to new flip6 codebase. Rename test to testStartYarnSessionClusterInQaTeamQueue. Remove -n command line parameter & argument. 23 January 2019, 14:01:07 UTC
1c4df99 [FLINK-11355][tests] Remove JobManagerProcessReapingTest The JobManagerProcessReapingTest is no longer relevant since we don't start a ProcessReaper as it used to be the case in the legacy mode. 23 January 2019, 13:25:07 UTC
960feb4 [FLINK-11351][tests] Port JobManagerCleanupITCase to new code base This commit renames JobManagerCleanupITCase into BlobsCleanupITCase and uses the MiniCluster instead of the TestingCluster to execute the tests. This closes #7524. 23 January 2019, 13:22:50 UTC
c73f2b5 [FLINK-11328] [tests] Add serializer migration tests for all parameterless serializers This closes #7553. 23 January 2019, 09:20:51 UTC
eb1241e [FLINK-11328] [e2e] Do not use deprecated ParameterlessTypeSerializerConfig in e2e tests 23 January 2019, 09:19:43 UTC
ef47848 [hotfix] [tests] Remove redundant outdated migration tests in StateBackendTestBase Those tests were implemented before we had the state schema evolution feature in Flink 1.7, and were implemented using the old legacy serialization compatibility APIs. Moreoever, the behaviours that they test are already more comprehensively covered in StateBackendMigrationTestBase. 23 January 2019, 09:19:43 UTC
ade21d1 [FLINK-11328] [cep] Snapshots of NFA-related serializers should be a CompositeTypeSerializerSnapshot 23 January 2019, 09:19:40 UTC
edf6d59 [FLINK-11328] [core] Upgrade parameterless / singleton serializers to use new serialization compatibility APIs 22 January 2019, 09:16:03 UTC
f388b65 [hotfix][docs] Fix broken links 21 January 2019, 13:52:07 UTC
a7eb845 [FLINK-11256][Streaming] Improve StreamEdge to reduce the sizes of JobGraph This closes #7403 19 January 2019, 13:51:26 UTC
ba3ffe3 [hotfix][docs] Remove reference to non-existent DataStream#mapPartitionWith 18 January 2019, 15:29:40 UTC
3cf593c [FLINK-10665][tests] Remove legacy test YARNSessionFIFOITCase#testJavaAPI This closes #6917. 18 January 2019, 12:52:13 UTC
6516659 [hotfix][tests] Fix checkstyle violation and extract NoDataSource 18 January 2019, 12:52:12 UTC
12260a2 [FLINK-8739] [table] Optimize DISTINCE aggregates to use the same distinct accumulator if possible This closes #7286 18 January 2019, 12:45:38 UTC
ff615ce [hotfix][docs] Formatted match_recognize.md to keep line length under 100 characters. 18 January 2019, 12:22:53 UTC
2790408 [FLINK-10591][docs] Added description of MATCH_ROWTIME and MATCH_PROCTIME functions 18 January 2019, 12:22:53 UTC
36639d3 [FLINK-10591][table] Introduced functions to return time attributes from MATCH_RECOGNIZE 18 January 2019, 12:22:53 UTC
0055088 [hotfix][table] Switched from PatternSelectFunction to PatternProcessFunction 18 January 2019, 12:22:53 UTC
0e27da3 [hotfix][table] Converted static generateIterativeCondition & generateOneRowPerMatchExpression methods into inner methods 18 January 2019, 12:22:53 UTC
de04658 [FLINK-11036] Fix test_streaming_classloader.sh end-to-end test Before, this was relying on .version.properties being available in the flink-dist jar. This was not the case when building from a Flink source release. This is fixed by introducing a fake lib package that we place in the lib/ folder to test the classloader resolution order. Both the lib package and the user package contain a parent-child-test.properties and we check the resolution order in the test. Also change the test to not use TaskManager anymore. This test was relying on TaskManager being present in Flink, this might not be the case in the future. We change this test to place a fake class in the "lib" package and the "user" package to make it independent of the rest of Flink. 18 January 2019, 11:19:40 UTC
b96add3 [FLINK-11383][blob] Clean up blobs of failed submissions Let the dispatcher clean up blobs of failed submissions. 18 January 2019, 10:11:42 UTC
8e7b80f [FLINK-11372] [core] Incorrect delegation of compatibility checks to new CompositeTypeSerializerSnapshots This closes #7521. 18 January 2019, 08:47:54 UTC
c086cf0 [hotfix] [tests] Fix incorrect EitherSerializerSnapshot migration test files 18 January 2019, 08:45:22 UTC
f012270 [FLINK-11360] [test] Check and remove LocalFlinkMiniClusterITCase This closes #7516. 17 January 2019, 17:37:57 UTC
f4673bc [hotfix] Remove mocking from ExecutionGraphCheckpointCoordinatorTest 17 January 2019, 16:38:33 UTC
9780265 [FLINK-11349][tests] Port CoordinatorShutdownTest to new code base The relevant tests of the CoordinatorShutdownTest have been moved to the ExecutionGraphCheckpointCoordinatorTest which executes the same test just without spawning an actual cluster. 17 January 2019, 16:38:33 UTC
857ec7d [FLINK-11350][tests] Delete JobClientActorRecoveryITCase The JobClientActorRecoveryITCase is no longer needed since it only tests the legacy code path. 17 January 2019, 16:29:30 UTC
8f5cd0d [FLINK-10558][Yarn tests] Port YARNHighAvailabilityITCase to new code base This commit ports the YARNHighAvailabilityITCase to the new code base. It now uses the YarnClusterDescriptor and the RestClusterClient to directly interact with the deployed Flink cluster. Since the test uses the pkill command to kill the application master, the test only runs on Linux, MacOS, FreeBSD and Solaris. On Windows this test won't be executed. This closes #7509. 17 January 2019, 16:27:05 UTC
8e1e12e [FLINK-10817] Upgrade presto dependency to support path-style access 17 January 2019, 15:37:44 UTC
20ede03 [hotfix][streaming-java] Add override annotation to mergeWindows method of MergingWindowsAssigner subclass 17 January 2019, 14:59:28 UTC
ef18c2a [FLINK-11341][doc] Correct javadoc of AkkaUtils#getAkkaConfig 17 January 2019, 14:54:40 UTC
9943f20 [hotfix][runtime] Fix checkstyle violation in SubmittedJobGraph 17 January 2019, 14:43:59 UTC
53d5147 [hotfix][tests] Remove redundant null check 17 January 2019, 14:43:59 UTC
3ee4a5b [FLINK-11294][tests, runtime] Add new constructor to SubmittedJobGraph The new constructor only expects a JobGraph. Deprecate the old constructor. 17 January 2019, 14:43:59 UTC
dcacf0b [FLINK-11294][tests] Remove legacy JobInfo usage in valid tests 17 January 2019, 14:43:59 UTC
0a54983 [FLINK-11371] The AvroParquetReader is not being closed 17 January 2019, 12:22:28 UTC
76dd766 [FLINK-10778] [tests] Extend all TypeSerializerSnapshotMigrationTestBase subclasses to test restoring from 1.7 This closes #7504. 17 January 2019, 11:53:16 UTC
8a49d73 [FLINK-10778] [tests] Remove serializerSnapshotRestoresCurrentSerializer test in TypeSerializerSnapshotMigrationTestBase The serializerSnapshotRestoresCurrentSerializer test asserts that the restored serializer instance from the snapshot is of the same type as the current serializer. This isn't necessary true, as is not a contract of the TypeSerializerSnapshot abstraction. Therefore, this test is removed. 17 January 2019, 11:53:03 UTC
c6124db [FLINK-10778] [tests] Make new serializer compatibility tests more flexible in TypeSerializerSnapshotMigrationTestBase Before, the TypeSerializerSnapshotMigrationTestBase test base always only asserted that a new serializer is compatible as is with the previous serializer's snapshot. This makes the test code not resusable for cases where the new serializer provided isn't compatible as is, but other compatibility types, for example Kryo serializers that requires reconfiguration on restore. This allows the test base to express those cases. 17 January 2019, 11:52:53 UTC
e21c3d4 [FLINK-10778] [tests] Make TypeSerializerSnapshotMigrationTestBase aware of snapshot version Before, the tests in TypeSerializerSnapshotMigrationTestBase always assumed that the test serializer snapshotw were written with Flink 1.6. This commit makes this flexible, so that we can allow subclasses to specify different snapshot versions for each TestSpecification. 17 January 2019, 11:52:37 UTC
fa3432a [FLINK-10778] [tests] Move MigrationVersion to flink-core test utils 17 January 2019, 11:52:26 UTC
b30adb0 [hotfix] [tests] Remove unfruitful MigrationTestUtil class That utility class had a single helper method, restoreFromSnapshot, which accepts the target snapshot's Flink version. This was useful before, because the way to restore snapshots was a bit different for Flink <= 1.1 and newer versions. Since we now no longer support compatibility for 1.1 versions and below, this helper method is simply forwarding the restore operation to the test harness. This commit refactors this have equivalent behaviour directly in the AbstractStreamOperatorTestHarness class. 17 January 2019, 11:52:14 UTC
322e479 [FLINK-11069][core] Merge FutureUtil into FutureUtils 17 January 2019, 10:47:09 UTC
3d25080 [hotfix][tests] Reduce metric fetcher interval for e2e tests 17 January 2019, 10:37:49 UTC
41c4a35 [FLINK-11359][test] LegacyAvroExternalJarProgramITCase 17 January 2019, 10:23:12 UTC
e89ae0b [hotfix][docs] Fix typos 17 January 2019, 09:35:17 UTC
09eff88 [hotfix][docs] Fix quick start project structure error in DataStream API Tutorial This closes #7502 17 January 2019, 00:40:13 UTC
7d98940 [hotfix] Remove Mockito from MetricFetcherTest 16 January 2019, 21:49:38 UTC
474fe8e [FLINK-10822] Make MetricFetcher update interval configurable Introduce WebOptions.METRIC_FETCHER_UPDATE_INTERVAL configuration option to configure the update interval of the MetricFetcher. This closes #7459. 16 January 2019, 21:49:01 UTC
992b65a [hotfix] Introduce MetricFetcher interface Rename MetricFetcher into MetricFetcherImpl and introduce MetricFetcher interface. This allows for better testing and hides the type parameter of MetricFetcherImpl. 16 January 2019, 21:49:00 UTC
86e06bc [hotfix][docs] Remove stray character 16 January 2019, 14:15:48 UTC
291373a [FLINK-11302][fs-connector] Correctly parse tmp dirs in FlinkS3FileSystem. This closes #7458. 16 January 2019, 14:10:23 UTC
f61d112 [FLINK-11295][conf] Rename configuration options of queryable-state from query.x to queryable-state.x Change-Id: Idb561da3982de07e77a05ffef9ad227094f527b0 16 January 2019, 14:04:57 UTC
94647f1 [FLINK-10945] Mark InputDependencyConstraint as PublicEvolving 16 January 2019, 13:16:27 UTC
171a3b1 [FLINK-10945] Add an InputDependencyConstraint to avoid resource deadlocks for finite stream jobs when resources are limited This commit adds a job config InputDependencyConstraint, which helps to avoid resource deadlocks in LAZY_FROM_SOURCES scheduling when resources are limited. The InputDependencyConstraint controls across multiple inputs when consumers are scheduled. Currently it supports ANY and ALL. ANY means that any input intermediate result partition must be consumable and ALL means that all input intermediate result partitions (from all inputs) need to be consumable in order to schedule the consumer task. This closes #7255. 16 January 2019, 13:13:28 UTC
c08db3f [FLINK-11012][tests] Introduce abstract superclass for filesystem IT cases. This closes #7384. 16 January 2019, 12:38:44 UTC
9a21cc0 [hotfix] Fix parameter name KeyedCoProcessOperator constructor 16 January 2019, 12:27:08 UTC
4863bc1 [hotfix][docs] Update references to deprecated SinkFunction#invoke(Object) 16 January 2019, 12:26:02 UTC
53034cd [FLINK-11174][prometheus] Add option to not filter label values 16 January 2019, 12:10:16 UTC
979ebd2 [FLINK-11289][examples] Rework examples to account for licensing 16 January 2019, 11:44:28 UTC
b56197a [hotfix][build] Append shade-plugin transformers in child modules 16 January 2019, 11:44:28 UTC
9c07822 [FLINK-11187] [s3] Use file over stream for writes This changes the S3AccessHelper API to take a file instead of an input stream. This allows s3 client to properly reset a file instead of a file over stream for writes. This fixes an issue where the underlying s3 implementation has an intermittent failure, tries to reset the stream, fails to do so, and results in hung requests with delayed errors. 16 January 2019, 10:50:08 UTC
a1c64b9 [FLINK-11023][kafka] Add NOTICE files 16 January 2019, 10:07:02 UTC
bfbf986 [hotfix][quickstart] make the note about IDE memory requirements non-specific to MacOS X users 16 January 2019, 09:29:19 UTC
bfd1302 [FLINK-9222][docs] add documentation for setting up Gradle projects 16 January 2019, 09:29:19 UTC
ecb57a9 [hotfix][docs] fix some typos 16 January 2019, 09:29:19 UTC
ea0f283 [FLINK-11331][table][docs] Fix errors in tableApi.md and functions.md This closes #7494 16 January 2019, 06:51:53 UTC
3846928 Add link to KeyedProcessFunction to side output documentation 15 January 2019, 13:31:32 UTC
eff261e [FLINK-11156][tests, runtime] Simplify ZooKeeperCompletedCheckpointStore constructor 15 January 2019, 10:15:04 UTC
02078e0 [FLINK-11156][tests, runtime] Reconcile ZooKeeperCompletedCheckpointStoreMockitoTest with JDK 9 15 January 2019, 10:15:04 UTC
e7b02b4 [hotfix] [fs] Add clock as an argument in Javadocs The clock parameter is missing in the docstring. This closes #7484. 15 January 2019, 09:02:04 UTC
baea9a3 [hotfix] [datastream] Remove irrelevant comments and fix typo in SourceStreamTask This closes #7485. 15 January 2019, 08:58:15 UTC
e5e6274 [hotfix] [docs] Fix typo in Table SQL doc This closes #7491. 15 January 2019, 08:57:23 UTC
1325599 [hotfix][docs][table] Fix more typos in time attributes doc 14 January 2019, 13:05:46 UTC
2be178c [FLINK-11304][docs][table] Fix typo in time attributes doc This closes #7477. 14 January 2019, 12:39:11 UTC
c9af982 [hotfix][docs] Fix typo in classloading doc 14 January 2019, 10:32:27 UTC
7206d20 [hotfix] Fix typo in restart strategies documenation (#7479) 14 January 2019, 10:28:36 UTC
f305b64 [hotfix] Add dependency snippet for RocksDBStateBackend to state_backends.md In order to use the RocksDBStateBackend, the user has to add the flink-statebackend-rocksdb dependency to his project. This commit adds this information to the state_backends.md. This closes #7480. 14 January 2019, 10:23:48 UTC
back to top