| 965baad | James Rodewig | 06 May 2021, 18:48:46 UTC | [DOCS] EQL: Update tiebreaker docs for implicit tiebreaker (#72808) | 06 May 2021, 18:48:46 UTC |
| 1d85cb6 | Gordon Brown | 06 May 2021, 16:15:00 UTC | Improve cleanup of Node Shutdown in tests (#72772) Makes the following changes: - The node shutdown feature flag isn't set on the test runner, only the cluster JVMs, so we can't use it to check here. Instead, the cleanup now infers whether it's enabled from the shape of the first GET `_nodes/shutdown` response. - Now uses `adminClient()` instead of `client()` - Removes the unnecessary `instanceof` check, which was *not* due to parsing, but the fact that `nodes` is indeed a map if the feature flag isn't enabled. | 06 May 2021, 16:15:00 UTC |
| 148de22 | Rene Groeschke | 06 May 2021, 13:54:43 UTC | Add tracing to nullpointer in RerunTestResultProcessor (#72796) - also catch IllegalArgumentException and provide more debug output | 06 May 2021, 13:54:43 UTC |
| 090690d | István Zoltán Szabó | 06 May 2021, 13:19:28 UTC | [DOCS] Revises required privileges info in Transforms API docs (#72803) | 06 May 2021, 13:19:28 UTC |
| 3c08d82 | Dan Hermann | 06 May 2021, 12:35:08 UTC | [DOCS] Data stream snapshot behavior with excluded backing indices (#72761) | 06 May 2021, 12:35:08 UTC |
| 43bd3f2 | Dan Hermann | 06 May 2021, 12:21:08 UTC | Javadocs for Painless processor methods (#72766) | 06 May 2021, 12:21:08 UTC |
| 28b3f97 | Armin Braun | 06 May 2021, 12:19:12 UTC | Fix SnapshotShardFailure.toXContent Serialization Issue (#72801) Obvious oversight probably from the time when index uuids weren't a guarantee. | 06 May 2021, 12:19:12 UTC |
| e609e07 | Rene Groeschke | 06 May 2021, 12:02:35 UTC | Remove internal build logic from public build tool plugins (#72470) Extract usage of internal API from TestClustersPlugin and PluginBuildPlugin and related plugins and build logic This includes a refactoring of ElasticsearchDistribution to handle types better in a way we can differentiate between supported Elasticsearch Distribution types supported in TestCkustersPlugin and types only supported in internal plugins. It also introduces a set of internal versions of public plugins. As part of this we also generate the plugin descriptors now. As a follow up on this we can actually move these public used classes into an extra project (declared as included build) We keep LoggedExec and VersionProperties effectively public And workaround for RestTestBase | 06 May 2021, 12:02:35 UTC |
| 73e0662 | markharwood | 06 May 2021, 09:45:37 UTC | New TermsEnum API for discovering terms in the index. (#66452) New api designed for use by apps like Kibana for auto-complete use cases. A search string is supplied which is used as prefix for matching terms found in a given field in the index. Supported field types are keyword, constant_keyword and flattened. A timeout can limit the amount of time spent looking for matches (default 1s) and an `index_filter` query can limit indices e.g. those in the hot or warm tier by querying the `_tier` field Closes #59137 | 06 May 2021, 09:45:37 UTC |
| c9ca64c | Tanguy Leroux | 06 May 2021, 09:26:08 UTC | Add test for persistent cache clean up after relocation (#72682) This commit adds a test to verify that the persistent cache is correctly cleaned up after a shard is relocated. I've been surprised to see we don't have integ tests for this. | 06 May 2021, 09:26:08 UTC |
| 051bbb2 | Jim Ferenczi | 06 May 2021, 07:47:47 UTC | Fix early termination of search request with sort optimization (#72683) The query phase applies an optimization when sorting by a numeric field. This optimization doesn't handle early termination correctly when `timeout` and/or `terminate_after` are used. An IAE exception is thrown at the shard level when the timeout is reached. This commit fixes the bug, early terminated exceptions are correctly caught and the result is computed from the documents that the shard was able to collect before the termination. Closes #72661 | 06 May 2021, 07:47:47 UTC |
| eb8d7e2 | Jim Ferenczi | 06 May 2021, 07:42:08 UTC | Add a test module to simulate errors and warnings in search requests (#71674) This change adds a test module called `error-query` that exposes a query builder to simulate errors and warnings on shard search request. The query accepts a list of indices and shard ids where errors or warnings should be reported: ``` POST test*/_search { "query": { "error_query": { "indices": [ { "name": "test_exception", "shard_ids": [1], "error_type": "exception", "message": "boom" }, { "name": "test_warn*", "error_type": "warning", "message": "Watch out!" } ] } } } ``` The `error_type` can be set to `exception` or `warning` and the `name` accepts simple patterns, aliases and fully qualified index name if the search targets remote shards. This module is published only within snapshots like the other test modules. Relates #70784 | 06 May 2021, 07:42:08 UTC |
| 3e0959f | David Turner | 06 May 2021, 07:28:39 UTC | Fix Watcher HTTP connection config for longevity (#72736) Watcher uses a connection pool for outgoing HTTP traffic, which means that some HTTP connections may live for a long time, possibly in an idle state. Such connections may be silently torn down by a remote device, so that when we re-use them we encounter a `Connection reset` or similar error. This commit introduces a setting allowing users to set a finite expiry time on these connections, and also enables TCP keepalives on them by default so that a remote teardown will be actively detected sooner. Closes #52997 | 06 May 2021, 07:28:39 UTC |
| 1ce2308 | István Zoltán Szabó | 06 May 2021, 06:18:19 UTC | [DOCS] Adds max_trees hyperparameter to GET TM API docs (#72298) | 06 May 2021, 06:18:19 UTC |
| 0220dfb | Armin Braun | 06 May 2021, 04:32:52 UTC | Dry up Hashing BytesReference (#72443) Dries up the efficient way to hash a bytes reference and makes use of it in a few other spots that were needlessly copying all bytes in the bytes reference for hashing. | 06 May 2021, 04:32:52 UTC |
| 6fac5a4 | Armin Braun | 06 May 2021, 03:47:47 UTC | Cleanup Some releaseOnce/RunOnce Usage (#72217) Just a few obvious spots I found debugging recent test failures where we use the wrong "once" wrapper that needlessly causes indirection/allocation/longer stack-traces. | 06 May 2021, 03:47:47 UTC |
| dbad9d0 | James Rodewig | 05 May 2021, 21:49:15 UTC | [DOCS] Update 'shared_cache' references for searchable snapshots (#72775) | 05 May 2021, 21:49:15 UTC |
| ba66669 | James Rodewig | 05 May 2021, 20:35:33 UTC | [DOCS] Rename mount types for searchable snapshots (#72699) Changes: * Renames 'full copy searchable snapshot' to 'fully mounted index.' * Renames 'shared cache searchable snapshot' to 'partially mounted index.' * Removes some unneeded cache setup instructions for the frozen tier. We added a default cache size with #71844. | 05 May 2021, 20:35:33 UTC |
| 15e42fd | James Rodewig | 05 May 2021, 19:56:28 UTC | [DOCS] Fix `<repository>` param | 05 May 2021, 19:56:28 UTC |
| 08a89c8 | Ryan Ernst | 05 May 2021, 19:47:32 UTC | Remove multiple paths from ShardPath (#72713) relates #71205 | 05 May 2021, 19:47:32 UTC |
| 2dfaf7a | Ryan Ernst | 05 May 2021, 18:51:25 UTC | Remove MDP from PersistedClusterStateService (#72278) This commit removes multiple data path support from the PersistedClusterStateService. Most notably, many error cases are no longer possible where duplicate/conflicting data could previously exist across multiple paths, there is now only one path. relates #71205 | 05 May 2021, 18:51:25 UTC |
| a4ae1a5 | Ioannis Kakavas | 05 May 2021, 18:04:00 UTC | Update gradle Java to JDK15 for packaging distro tests (#72757) | 05 May 2021, 18:04:00 UTC |
| a996539 | Rene Groeschke | 05 May 2021, 17:55:31 UTC | Fix up-to-date check for build tool IT tests (#72745) Running the test builds directly in src/testkit causes up-to-date check to constantly fail as gradle internal files change on every invocation. Furthermore did some cleanup on IT tests | 05 May 2021, 17:55:31 UTC |
| eedd2d4 | Andrei Dan | 05 May 2021, 17:54:05 UTC | Renable bwc and update version checks after merging #72754 (#72756) | 05 May 2021, 17:54:05 UTC |
| 9ce7a5a | Gordon Brown | 05 May 2021, 16:44:57 UTC | Clean up Node Shutdown metadata in test cleanup (#72726) This commit ensures that node shutdown metadata is cleaned up between tests, as it causes unrelated tests to fail if a test leaves node shutdown metadata in place. | 05 May 2021, 16:44:57 UTC |
| 47719f8 | Nik Everett | 05 May 2021, 16:20:50 UTC | Properly size empty filters (#71864) This saves a few ArrayList realocations by fixing an order of operations bug issue in the "empty" handling arm for `filters`. I've also added a test so I can debug that branch. | 05 May 2021, 16:20:50 UTC |
| 326a543 | Julie Tibshirani | 05 May 2021, 16:13:07 UTC | Small clean-ups in AbstractSearchAsyncAction (#72718) * Correct logging statements. * Make buildShardFailures and buildSearchResponse private. * Avoid closing releasable twice. | 05 May 2021, 16:13:07 UTC |
| 80a5f3a | Nhat Nguyen | 05 May 2021, 16:00:37 UTC | Remove TombstoneDocSupplier from EngineConfig (#72593) With #2251, we can create delete and noop tombstones directly. Relates #72251 | 05 May 2021, 16:00:37 UTC |
| 85ddd7b | David Turner | 05 May 2021, 15:56:54 UTC | Add id to Translog.Delete#toString() (#72752) The assertion failure message in #72735 did not indicate why it failed because `Translog.Delete#toString()` does not expose all the fields of the problematic operation. This commit adds the missing `id` field. | 05 May 2021, 15:56:54 UTC |
| f096bce | Tanguy Leroux | 05 May 2021, 15:10:04 UTC | Apply spotless formatting to :x-pack:plugin:voting-only-node (#72687) | 05 May 2021, 15:10:04 UTC |
| b85f6fe | Benjamin Trent | 05 May 2021, 14:50:15 UTC | [ML] moving inference pipeline tests to allow consistent cleanup (#72686) Yaml tests are flaky as the stats index could be just recently created when we try to cleanup after the test run. This fixes that by moving the tests into a ESRestTestCase class and waiting for the .ml-stats indices to be created before running the post test cleanup. closes: #72189 | 05 May 2021, 14:50:15 UTC |
| 71a9cfe | zhangchao | 05 May 2021, 14:33:13 UTC | Add fs iotime in Nodes Stats API (#67861) This adds io_time_in_millis to Nodes stats API | 05 May 2021, 14:33:13 UTC |
| 05baf4c | Andrei Dan | 05 May 2021, 14:31:43 UTC | Disabe bwc tests (#72750) Disable bwc in preparation for merging #67861 | 05 May 2021, 14:31:43 UTC |
| e683d71 | Armin Braun | 05 May 2021, 14:07:31 UTC | Fix Edge Case Datastream Snapshot Create Bug (#72747) We always clean up the list of datastreams depending on the indices acutally in the snapshot. Even for non-partial snapshots datastream indices could be excluded from the snapshot by index exlusions that remove all the datastream's indices from the snapshot. | 05 May 2021, 14:07:31 UTC |
| 5523976 | Luca Cavanna | 05 May 2021, 13:28:59 UTC | Extract parseDocument from MappingLookup (#72694) MappingLookup became capable of parsing documents because we needed the search execution context to expose the ability to parse a document that did not depend on a mutable document mapper (only the percolator uses this feature). In hindsight, parsing documents is quite a specific usecase that does not quite fit in MappingLookup. Also, it introduces the need for MappingLookup to hold IndexSettings, IndexAnalyzers and DocumentParser only for that purpose. Instead, we can expose the DocumentParser by making it public and make its parse method accept a MappingLookup instance. | 05 May 2021, 13:28:59 UTC |
| bd290bd | Yang Wang | 05 May 2021, 12:46:25 UTC | Service Accounts - Disallow oauth2 creation (#72553) Service accounts must be authenticate with their service tokens. We intentionally do not support other authentication schemes (other than API keys). Hence we should not allow service account to create oauth2 tokens. Note this is not an issue now because the only elastic/fleet-server service account does not have permission to create oauth2 token anyway. | 05 May 2021, 12:46:25 UTC |
| 7a06c21 | Nik Everett | 05 May 2021, 12:39:19 UTC | Ban Path.of (#72649) We use `PathUtils.get` to look up paths with our custom testing infrastructure rather than `Paths.get`. In the past few years java has grown a `Path.of` which is very similar to `Paths.get`. Just like `Paths.get`, we should always be using `PathUtils.get` so that we get our fancy testing infrastructure. This uses forbiddenapis to ban `Path.of` and fixed the build errors. Closes #72392 | 05 May 2021, 12:39:19 UTC |
| 9bac76b | David Roberts | 05 May 2021, 12:35:13 UTC | [ML] Add new ml_standard tokenizer for ML categorization (#72744) This new tokenizer, ml_standard, is very similar to the original ml_classic tokenizer. The difference is that ml_standard aims to parse URLs and filesystem paths as single tokens instead of splitting them at the slashes. | 05 May 2021, 12:35:13 UTC |
| 34f9691 | Silvia Mitter | 05 May 2021, 11:42:19 UTC | Add permissions for apm_user for datastreams (#72739) Based on recent conversations around data streams for APM, there is no final decision yet that apm data streams will be created per instrumented Service. If datastreams are not created per service, the current pattern for the apm_user permissions need to be adapted to not only support <type>-apm.* but also <type>-apm-*. fixes #72737 | 05 May 2021, 11:42:19 UTC |
| ca63643 | Hendrik Muhs | 05 May 2021, 09:58:53 UTC | [Transform] fix 2 issues with index sort in integration test (#72742) fix 2 corner cases in test setup: unsigned_long not support as index sort,do not overlay a runtime field with index sort fixes #72733 relates #72692 | 05 May 2021, 09:58:53 UTC |
| fdefd3e | Rene Groeschke | 05 May 2021, 08:13:45 UTC | Rework RerunTestResultProcessor to handle aborted tests better (#72710) This should address the latest occurrences of null pointer exceptions when test start events a propagated to test process as listed in #72169 Also introducing the option to have unit tests in build tools written in spock. | 05 May 2021, 08:13:45 UTC |
| 41241f6 | Ignacio Vera | 05 May 2021, 07:24:11 UTC | mute TransformContinuousIT#testContinousEvents (#72734) | 05 May 2021, 07:24:11 UTC |
| f05f3b4 | Julie Tibshirani | 05 May 2021, 02:34:44 UTC | Remove empty test in SearchWithRandomIOExceptionsIT | 05 May 2021, 03:47:22 UTC |
| 647ba8f | Luca Belluccini | 05 May 2021, 01:25:42 UTC | [DOCS] Clarify remote_cluster_client is required to run ML (#72569) Co-authored-by: Lisa Cawley <lcawley@elastic.co> | 05 May 2021, 01:25:42 UTC |
| bd84e8a | James Rodewig | 04 May 2021, 19:55:38 UTC | [DOCS] Refactor script processor docs (#72691) | 04 May 2021, 19:55:38 UTC |
| 291b0d8 | Luca Cavanna | 04 May 2021, 17:47:47 UTC | Empty mapping to hold null meta (#72709) With #72616 we have changed the way that empty mappings are created for an index. Accidentally such mappings have been created with an empty meta map instead of null, which causes test failures in tests that compare mappings and are now finding an unexpected empty meta object which was not there before. This commit fixes the empty mapping to not hold any meta, replacing the empty map with a null argument. | 04 May 2021, 17:47:47 UTC |
| 0224621 | James Rodewig | 04 May 2021, 16:29:14 UTC | [DOCS] Fix formatting | 04 May 2021, 16:29:14 UTC |
| 70f1e8c | Armin Braun | 04 May 2021, 16:05:31 UTC | Make GetSnapshotsAction Cancellable (#72644) If this runs needlessly for large repositories (especially in timeout/retry situations) it's a significant memory+cpu hit => made it cancellable like we recently did for many other endpoints. | 04 May 2021, 16:05:31 UTC |
| 98db349 | Hendrik Muhs | 04 May 2021, 15:55:57 UTC | [Transform] unmute continuous transform testing on sorted indexes (#72692) unmute continuous transform testing on sorted indexes. These extra test randomness has been disabled due to triggered lucene assertions. The upstream issue seems to have been fixed. | 04 May 2021, 15:55:57 UTC |
| bbfa090 | James Rodewig | 04 May 2021, 15:07:19 UTC | [DOCS] Fix bulk API xref (#72685) | 04 May 2021, 15:07:19 UTC |
| 0edb8f4 | James Rodewig | 04 May 2021, 15:03:30 UTC | [DOCS] Document missing script APIs (#72175) Documents the following APIs: * [Delete stored script][0] * [Get stored script][1] * [Get script contexts][2] * [Get script languages][3] [0]: https://github.com/elastic/elasticsearch/blob/master/rest-api-spec/src/main/resources/rest-api-spec/api/delete_script.json [1]: https://github.com/elastic/elasticsearch/blob/master/rest-api-spec/src/main/resources/rest-api-spec/api/get_script.json [2]: https://github.com/elastic/elasticsearch/blob/master/rest-api-spec/src/main/resources/rest-api-spec/api/get_script_context.json [3]: https://github.com/elastic/elasticsearch/blob/master/rest-api-spec/src/main/resources/rest-api-spec/api/get_script_languages.json | 04 May 2021, 15:03:30 UTC |
| 2bd1b33 | Nicolas Ruflin | 04 May 2021, 14:51:50 UTC | Better out-of-the-box mappings for logs, metrics and synthetics (#64978) One of the problems we have today with the default templates is that ip addresses and message fields are not mapped correct. Auto detection of ip addresses would be great: https://github.com/elastic/elasticsearch/issues/64400 But in the meantime, we could also match on the naming convention that all `*.ip` fields are of type ip address. | 04 May 2021, 14:51:50 UTC |
| 619a011 | Ryan Ernst | 04 May 2021, 14:46:07 UTC | Remove multiple paths from elasticsearch-node tool (#72351) relates #71205 | 04 May 2021, 14:46:07 UTC |
| cbb2ca2 | Armin Braun | 04 May 2021, 14:41:40 UTC | Make DatastreamMetadata Immutable (#72693) This map should not be mutable. Also, the builder is unused. | 04 May 2021, 14:41:40 UTC |
| 276601d | Tanguy Leroux | 04 May 2021, 14:28:33 UTC | Mute SourceOnlySnapshotIT.testSnapshotAndRestore & testSnapshotAndRestoreWithNested (#72697) Relates #72695 | 04 May 2021, 14:28:33 UTC |
| 62a5782 | Armin Braun | 04 May 2021, 14:18:18 UTC | Check if HTTP Connection is Open in RestActionListener (#72688) Moving up the check from `DispatchingRestToXContentListener` as it never actually makes sense to serialize a response once the channel has been closed already. | 04 May 2021, 14:18:18 UTC |
| e0799c8 | Przemyslaw Gomulka | 04 May 2021, 13:56:37 UTC | [Rest Api Compatibility] transformations for keys in match and length (#72156) | 04 May 2021, 13:56:37 UTC |
| bd21f26 | Armin Braun | 04 May 2021, 13:09:27 UTC | Log Slow Executions on Scheduler Thread (#72606) Same as we did for transport and the cached time thread but for the scheduler thread that shouldn't be blocked for any non-trivial period of time either. | 04 May 2021, 13:09:27 UTC |
| 7283107 | James Rodewig | 04 May 2021, 12:32:45 UTC | [DOCS] Clarify location of custom JVM options files (#72656) (#72679) Clarify the files to be modified are in the `jvm.options.d/` folder Co-authored-by: Leaf-Lin <39002973+Leaf-Lin@users.noreply.github.com> | 04 May 2021, 12:32:45 UTC |
| 125726a | Hendrik Muhs | 04 May 2021, 12:25:16 UTC | [Transform] Fix rolling upgrade regression introduced in #72533 (#72666) #72533 introduced a regression, causing transforms to timeout/fail. With this change transform only waits for 1 active shard(primary) as waiting for all can block during rolling upgrade fixes #72617 relates #72533 | 04 May 2021, 12:25:16 UTC |
| 0843c24 | Luca Cavanna | 04 May 2021, 12:03:31 UTC | Drop support for parsing empty mappings (#72673) We used to support parsing null mappings to support the scenario where we need to submit an empty dynamic mapping update when an empty doc is indexed in an index that has no mappings yet. This has recently changed to not go through parsing, as effectively there is nothing to parse. That allows us to enforce that the mapping source is not null when we need to parse it. | 04 May 2021, 12:03:31 UTC |
| 52b0d8e | Luca Cavanna | 04 May 2021, 09:56:50 UTC | Remove DocumentMapperForType (#72616) DocumentMapperForType is used to create a document mapper when no mappings exists for an index and we are indexing the first document in it. This is only to cover for the edge case of empty docs, without any fields to dynamically map, being indexed, as we need to ensure that any index with at least one document in it has some mappings. We can replace using DocumentMapperForType with the same logic that MapperService#documentMapperWithAutoCreate includes. This also helps clean up the only case where we create a DocumentMapper from its public constructor, which can be removed and replaced by a more targeted static method. | 04 May 2021, 09:56:50 UTC |
| aba3227 | Albert Zaharovits | 04 May 2021, 09:53:29 UTC | [TEST] Updated smoke test JDK's trusted certs (#72594) The list of trusted CAs in the latest OpenJDK builds has changed: https://bugs.java.com/bugdatabase/view_bug.do?bug_id=JDK-8243559 This PR updates the default jdk trust config smoke test. Closes #71717 | 04 May 2021, 09:53:29 UTC |
| 8c28ec2 | Alan Woodward | 04 May 2021, 09:34:36 UTC | Merge dynamic field type lookup into FieldTypeLookup (#72024) Flattened field mappers have a specialised lookup class to handle the fact that their MappedFieldTypes are dynamic and generated on-the-fly, rather than being registered up front. The way this is implemented means that this lookup class also has to be aware of field aliases, which is blocking our attempt to re-implement aliases as runtime fields. This commit merges dynamic field lookup handling into the standard FieldTypeLookup class. When the lookup class is built, it checks each MappedFieldType being registered to see if it implements a new DynamicFieldType interface, and stores these in a separate map. If a field containing dots does not have a field type directly registered against it, we check if a dynamic field type matches one of its dot- delimited prefixes, and if so we then return the result of calling `DynamicFieldType.getChildFieldType()` with the remainder of the path. | 04 May 2021, 09:34:36 UTC |
| 5c6e758 | Ignacio Vera | 04 May 2021, 05:30:00 UTC | GeoBoundingBoxQueryGeoShapeIT should take into account the index version (#72605) GeoShape legacy parameters should only be used when version is lower than 8.0. | 04 May 2021, 05:30:00 UTC |
| 3f6ad3e | Lee Hinman | 04 May 2021, 02:48:37 UTC | Move shutdown component status out into separate classes (#72653) Originally these were stored in the cluster state using a single class, however, they will need to be different objects without common parts, and they will be calculated on the fly rather than persisted into cluster state. This removes the NodeShutdownComponentStatus class, as its no longer needed. Relates to #70338 | 04 May 2021, 02:48:37 UTC |
| c1c5e67 | David Kilfoyle | 03 May 2021, 22:39:14 UTC | [DOCS] Remove frozen tier restriction for ESS (#72624) * Remove frozen tier restriction for ESS * Remove section from 'Use ES for time series data' Co-authored-by: James Rodewig <40268737+jrodewig@users.noreply.github.com> | 03 May 2021, 22:39:14 UTC |
| 95f3bee | Nik Everett | 03 May 2021, 20:37:53 UTC | Document signature for runtime fields (#72630) This documents the different signatures of the `emit` method for runtime fields. For fields like `long` the signature is fairly obvious - `emit(long)`. But for `date`, `ip`, and `geo_point` its not obvious from the name what the signature of the method will be. Co-authored-by: Adam Locke <adam.locke@elastic.co> | 03 May 2021, 20:37:53 UTC |
| 44a1973 | Adam Locke | 03 May 2021, 20:24:28 UTC | [DOCS] Add field extraction use cases to scripting docs (#71596) * [DOCS] Add field extraction use cases to scripting docs * Adding file * Remove extra space * Add dissect pattern to split and retrieve data * Fix list spacing * Incorporating review feedback | 03 May 2021, 20:24:28 UTC |
| b6436c5 | Ryan Ernst | 03 May 2021, 18:11:19 UTC | Remove multiple paths from NodeEnvironment (#72599) This commit converts the multiple paths and locks internal to NodeEnvironment into a singular data path. relates #71205 | 03 May 2021, 18:11:19 UTC |
| fad5e44 | Nik Everett | 03 May 2021, 15:30:50 UTC | update benchmark readme (#72620) Documents that version 2.0 of the async profiler doesn't seem to work with jmh. Fixes some syntax in another profiling example. | 03 May 2021, 15:30:50 UTC |
| 1ef098c | James Rodewig | 03 May 2021, 15:17:47 UTC | [DOCS] Shorten quick start response (#72622) | 03 May 2021, 15:17:47 UTC |
| d07c174 | István Zoltán Szabó | 03 May 2021, 08:20:14 UTC | [DOCS] Revises required privileges info in Anomaly Detection API docs (#72483) | 03 May 2021, 08:20:14 UTC |
| 893d4ef | Ignacio Vera | 03 May 2021, 08:18:35 UTC | Do not over-allocate when resizing in GeoHashTiler with bounds (#72539) | 03 May 2021, 08:18:35 UTC |
| a22a0a8 | Tanguy Leroux | 03 May 2021, 08:12:52 UTC | Fix SearchableSnapshotsLicenseIntegTests.testShardAllocationOnInvalidLicense (#72528) This test fails sometimes on CI (see #72329) when recreating the license. It's not clear to me why that happens but I suspect batched cluster state updates, so this pull request adds some waiting points in the test. Closes #72329 | 03 May 2021, 08:12:52 UTC |
| b92b9d1 | Luca Cavanna | 03 May 2021, 07:42:37 UTC | Replace some DocumentMapper usages with MappingLookup (#72400) We recently replaced some usages of DocumentMapper with MappingLookup in the search layer, as document mapper is mutable which can cause issues. In order to do that, MappingLookup grew and became quite similar to DocumentMapper in what it does and holds. In many cases it makes sense to use MappingLookup instead of DocumentMapper, and we may even be able to remove DocumentMapper entirely in favour of MappingLookup in the long run. This commit replaces some of its straight-forward usages. | 03 May 2021, 07:42:37 UTC |
| 9c2759d | Ignacio Vera | 03 May 2021, 05:41:21 UTC | mute GeoBoundingBoxQueryGeoShapeIT (#72603) | 03 May 2021, 05:41:21 UTC |
| 246f970 | Yang Wang | 03 May 2021, 04:43:38 UTC | Service Accounts - no roles in denial error message (#72517) Service Accounts have no roles, i.e. it is always an empty list. Hence it is better to not show it in the denial error message to reduce clutter. | 03 May 2021, 04:43:38 UTC |
| 7a05d72 | Ryan Ernst | 02 May 2021, 20:29:17 UTC | Make NodeEnvironment.resolveIndexFolder singular (#72515) relates #71205 | 02 May 2021, 20:29:17 UTC |
| 2dc796a | Ryan Ernst | 02 May 2021, 20:28:57 UTC | Make nodePaths() singular (#72514) This commit converts the nodePaths() methods in NodeEnvironment to be singular. relates #71205 | 02 May 2021, 20:28:57 UTC |
| 6b116df | Albert Zaharovits | 02 May 2021, 18:19:18 UTC | [TEST] Fix test bug in ChainingInputStreamTests (#72595) This fixes a test bug in ChainingInputStreamTests.testResetForDoubleMarkAnywhere. The component input stream does not advance, and mockito rightfully intercepts two invocations instead of a single one. | 02 May 2021, 18:19:18 UTC |
| 79fc6ce | Armin Braun | 02 May 2021, 16:39:12 UTC | Prevent Encrypted Repository from Closing IndexInput (#71636) We shouldn't allow the repo to close the original input stream ever. This is handled further up-stream and not the responsibility of this code. closes #71326 (apparently some combination of resetting can trigger a close on the original stream which this change ensure will not happen any longer) | 02 May 2021, 16:39:12 UTC |
| ac402e6 | Gordon Brown | 30 April 2021, 23:32:38 UTC | Mute NodeShutdownIT.testAllocationPreventedForRemoval (#72590) | 30 April 2021, 23:32:38 UTC |
| f0c227d | Gordon Brown | 30 April 2021, 20:42:09 UTC | Add an allocation decider to prevent allocating shards to nodes which are preparing for shutdown (#71658) This PR adds an allocation decider which uses the metadata managed by the Node Shutdown API to prevent shards from being allocated to nodes which are preparing to be removed from the cluster. Additionally, shards will not be auto-expanded to nodes which are preparing to restart, instead waiting until after the restart is complete to expand the shard replication. | 30 April 2021, 20:42:09 UTC |
| 6778020 | Armin Braun | 30 April 2021, 19:52:20 UTC | Use Leak Tracking Infrastruture in MockPageCacheRecycler (#72477) The leak tracking can be run for every test while the existing solution would only work with a very limited set of tests giving us no coverage on pages that weren't acquired through the mock transport service. | 30 April 2021, 19:52:20 UTC |
| 66c77d9 | Adam Locke | 30 April 2021, 18:03:26 UTC | [DOC] Clarify usage of elastic user for Kibana (#72499) * [DOC] Clarify usage of elastic user for Kibana * Change URL to http Co-authored-by: Yang Wang <ywangd@gmail.com> * Clarify use of the kibana_system user Co-authored-by: Yang Wang <ywangd@gmail.com> Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> | 30 April 2021, 18:03:26 UTC |
| d32e9c9 | Fabio Busatto | 30 April 2021, 16:06:26 UTC | Add documentation for new built-in roles (#72146) | 30 April 2021, 16:06:26 UTC |
| 79f8230 | Benjamin Trent | 30 April 2021, 15:48:54 UTC | [ML] re-enabling datafeed stats compat test after backport (#72568) | 30 April 2021, 15:48:54 UTC |
| 46b4a22 | Christoph Büscher | 30 April 2021, 15:44:19 UTC | Add test for correct ProfileResult node time (#72558) In #45972 we saw that in earlier versions we didn't calculate the profile node time correctly, instead the `time_in_nanos` calculation wrongly included the method "_count" values. This is fixed in 7.x by #56208 but we don't seem to have a test for this anywhere which this commit add. Relates to #45972 | 30 April 2021, 15:44:19 UTC |
| 69c8811 | Alan Woodward | 30 April 2021, 15:29:33 UTC | SizeMappingTests shouldn't use ESSingleNodeTestCase (#72564) This converts the tests to use MapperServiceTestCase, and makes them a unit test rather than a full integration test. In addition, we test enabling/disabling the mapper by examining the output of parsed documents, rather than by introspection on the metadata mapper itself. | 30 April 2021, 15:29:33 UTC |
| cdf1fc3 | Luca Cavanna | 30 April 2021, 14:58:47 UTC | Consolidate and clarify MappingLookup semantics (#72557) MappingLookup has been introduced to expose a snapshot of the mappings to the search layer. We have been using it more and more over time as it is convenient and always non null. This commit documents some of its semantics and makes it easier to trace when it is created with limited functionalities (without a document parser, index settings and index analyzers). | 30 April 2021, 14:58:47 UTC |
| e686884 | Adam Locke | 30 April 2021, 14:06:35 UTC | [DOCS] Clarify that setup passwords utility should be run once per cluster (#72507) | 30 April 2021, 14:06:35 UTC |
| 05f830e | David Roberts | 30 April 2021, 13:49:50 UTC | [ML] Use appropriate master timeouts for master actions (#72492) Master node actions have a master timeout. One thing this does is define how long the transport layer waits for a master node to be elected if no master node exists at the time the master node request is made. When a persistent task invokes a master node action it makes sense for the master node timeout to be high. We do not want persistent tasks to fail because of a master timeout while a cluster is upgraded. For a request sent by an end user a master timeout of the order of 30 seconds makes sense, and the user can make a decision of whether to try again, but for a persistent task if the task fails due to a master timeout then it will never try again until somebody restarts the task. Since the user will not be expecting persistent tasks to fail during upgrade the tasks may not get restarted for a very long time, which is unacceptable. Therefore, this change increases the master timeout for master actions invoked by persistent tasks to 1 year. This means that the tasks will tolerate much longer than normal periods without a master node during upgrades, which should stop them spuriously failing. | 30 April 2021, 13:49:50 UTC |
| a18a5dd | Luca Cavanna | 30 April 2021, 13:35:39 UTC | DocumentMapper to parse through a MappingLookup (#72554) DocumentMapper currently holds a reference to a DocumentParser, the same that it uses to create its inner MappingLookup which exposes a parseDocument method. The parse method exposed by DocumentMapper can then directly call MappingLookup#parseDocument. | 30 April 2021, 13:35:39 UTC |
| 918be1d | Hendrik Muhs | 30 April 2021, 13:28:28 UTC | [Transform] avoid transform failure during rolling upgrade (#72533) ensure shards are searchable after creation of a new internal index version fixes #72525 | 30 April 2021, 13:28:28 UTC |
| 712d63b | Luca Cavanna | 30 April 2021, 13:19:04 UTC | Remove needless variant of DocumentParser#parseDocument (#72552) The variant that takes metadata fields separately was previously used for indexing tombstone docs, which have been simplified and are now handled elsewhere. We can then have one single parseDocument method that retrieves the metadata fields from MappingLookup. | 30 April 2021, 13:19:04 UTC |
| 1c69437 | Luca Cavanna | 30 April 2021, 13:17:37 UTC | Update comment on MapperService#updateMapping (#72551) The comment became outdated when we removed local merging, since the incoming mappings have already been merged by the master node. | 30 April 2021, 13:17:37 UTC |
| edf2f7d | Dan Hermann | 30 April 2021, 12:39:55 UTC | Unmute IndexingIT and TokenBackwardsCompatibilityIT tests (#72307) | 30 April 2021, 12:39:55 UTC |
| bd0d234 | Dan Hermann | 30 April 2021, 12:39:16 UTC | Remove obsolete BWC checks (#72007) | 30 April 2021, 12:39:16 UTC |
| 67926c3 | David Turner | 30 April 2021, 12:28:14 UTC | Log elapsed time for host resolution timeouts (#72484) Today we log the following message if resolving a host times out: timed out after [5s] resolving host [node-name:9300] The `[5s]` is the timeout, not the elapsed time, and indeed there's no indication how long the resolution actually took. It could be much longer than 5 seconds if something else is very broken. This commit adds the elapsed time to this message. | 30 April 2021, 12:28:14 UTC |
