| 76cefb0 | Lukáš Vlček | 13 November 2018, 09:57:12 UTC | Correct typo in BuildPlugin exception message (#35458) | 13 November 2018, 09:57:12 UTC |
| 0a6614a | Christoph Büscher | 13 November 2018, 09:34:29 UTC | Correct implemented interface of ParsedReverseNested (#35455) The ParsedReverseNested implementation should implement the ReverseNested interface and not the Nested interface. Although this is an empty marker interface it is confusing and can lead to casting errors. Also adding a test to check that both ParsedNested and ParsedReverseNested implement the correct interface. Closes #35449 | 13 November 2018, 09:34:29 UTC |
| 09965cb | David Roberts | 13 November 2018, 08:49:24 UTC | [ML] Fix find_file_structure NPE with should_trim_fields (#35465) The NPE would occur if should_trim_field was overridden to true and any field value was completely blank. This change defends against this situation. Fixes #35462 | 13 November 2018, 08:49:24 UTC |
| a18b599 | Jason Tedor | 13 November 2018, 00:31:12 UTC | Handle OS pretty name on old OS without OS release (#35453) Some very old ancient versions of Linux do not have /etc/os-release. For example, old Red Hat-like OS. This commit adds a fallback for handling pretty name for these OS. | 13 November 2018, 00:31:12 UTC |
| 71cfb73 | Tim Brooks | 12 November 2018, 23:07:42 UTC | Register remote cluster compress setting (#35464) This is a follow up to #35357. That commit failed to register the new cluster.remote.cluster_name.transport.compress setting with `ClusterSettings`. This commit fixes that. | 12 November 2018, 23:07:42 UTC |
| 9aeacea | Lisa Cawley | 12 November 2018, 21:08:57 UTC | [DOCS] Clarify results_index_name description (#35463) | 12 November 2018, 21:08:57 UTC |
| 711d703 | Zachary Tong | 12 November 2018, 20:31:16 UTC | [TEST] add missing doc tests for HLRC GetRollupIndexCaps API | 12 November 2018, 20:31:16 UTC |
| 2da239f | Zachary Tong | 12 November 2018, 20:05:03 UTC | [HLRC] Add GetRollupIndexCaps API (#35102) Also refactors the caps response tests a bit to share the same abstract class to reduce duplication of test code | 12 November 2018, 20:05:03 UTC |
| e7896bc | Igor Motov | 12 November 2018, 19:40:04 UTC | Geo: enables coerce support in WKT polygon parser (#35414) WKT parser now automatically closes open polygons similar to GeoJSON parser if coerce flag in mapping is set to true. Closes to #35059 | 12 November 2018, 19:40:04 UTC |
| 16cbbab | Tal Levy | 12 November 2018, 19:32:59 UTC | [ILM] fix retry so it picks up latest policy and executes async action (#35406) Before, moving to a failed step would only change the step info to be that of the failed step. This means two things. 1. Async Steps would never be triggered to execute 2. If there are inherent problems with the action definition that can be fixed with a policy update, these changes were not being reflected by the new execution info. Changes now 1. Async steps are executed after the move to the failed step in cluster state 2. the lifecycle execution info's phase definition is updated from the current latest policy definition, even though the index isn't moving to a new phase. Closes #35397. | 12 November 2018, 19:32:59 UTC |
| 40ca62c | Jason Tedor | 12 November 2018, 19:27:57 UTC | Address handling of OS pretty name on some OS (#35451) Some OS (e.g., Oracle Linux Server 6.9) have a trailing space at the end of the PRETTY_NAME line in /etc/os-release. This commit addresses this by accounting for this trailing space when extracting the pretty name. | 12 November 2018, 19:27:57 UTC |
| 64e5c25 | markharwood | 12 November 2018, 17:07:18 UTC | HLRC support for getTask (#35166) Given a GetTaskRequest the API returns an Optional which is empty in the case of 404s or returns a TaskInfo object if found. Added Helper methods in RestHighLevelClient for returning empty Optionals when hitting 404s | 12 November 2018, 17:07:18 UTC |
| 2591f66 | Nick Knize | 12 November 2018, 16:48:27 UTC | upgrade to lucene-8.0.0-snapshot-6d9c714052 (#35428) | 12 November 2018, 16:48:27 UTC |
| 326b238 | Jason Tedor | 12 November 2018, 15:28:35 UTC | Add docs for CCR stats API (#35439) This commit adds API docs for the CCR stats endpoint. | 12 November 2018, 15:28:35 UTC |
| 3859d21 | Jason Tedor | 12 November 2018, 15:27:12 UTC | Fix the names of CCR stats endpoints in usage API (#35438) This commit fixes the names of the CCR stats endpoints reported in the usage API. | 12 November 2018, 15:27:12 UTC |
| ca24d9a | Alpar Torok | 12 November 2018, 12:43:42 UTC | Switch to default to no build qualifier (#35415) | 12 November 2018, 12:43:42 UTC |
| c8e685e | Peter Dyson | 12 November 2018, 12:04:33 UTC | Clarify S3 repository storage class parameter (#35400) Today it is unclear that the `storage_class` parameter to an S3 repository only affects new objects and does not rewrite any existing objects. This commit clarifies this point. | 12 November 2018, 12:04:33 UTC |
| 55ff96b | Marios Trivyzas | 12 November 2018, 09:42:27 UTC | SQL: Fix query translation for scripted queries (#35408) IsNull, IsNotNull and Not where generating wrong queries as the check to generate ScriptQuery was missing. Fixes: #35232 | 12 November 2018, 09:42:27 UTC |
| ef10461 | Martijn van Groningen | 12 November 2018, 09:08:33 UTC | [TEST] Instead of ignoring the ccr downgrade to basic license qa test avoid the assertions that check the log files, because that does not work on Windows. The rest of the test is still useful and should work on Windows CI. Currently on Windows CI this qa module fails because there is just one test and that test si ignored if OS is Windows. | 12 November 2018, 09:17:33 UTC |
| 09cac32 | Christoph Büscher | 12 November 2018, 09:02:41 UTC | Upgrade to Joda 2.10.1 (#35410) This version contains a bugfix that allows us to reenable one of our muted tests in DateTimeUnitTests. Closes #33749 | 12 November 2018, 09:02:41 UTC |
| 6050deb | Albert Zaharovits | 11 November 2018, 15:13:25 UTC | HLRest: model role and privileges (#35128) The following "user privileges" objects have been created on the client side: * ApplicationResourcePrivileges * IndicesPrivileges * GlobalOperationPrivilege * GlobalPrivileges as well as the aggregating `Role` entity. | 11 November 2018, 15:13:25 UTC |
| eb8f346 | Jason Tedor | 10 November 2018, 20:45:38 UTC | Fix beta label on CCR index page This commit fixes the location of the beta label on the CCR index page. | 10 November 2018, 20:45:38 UTC |
| d84ff37 | Jason Tedor | 10 November 2018, 19:37:14 UTC | Mark CCR as beta in the docs This commit marks CCR as beta in the docs. This beta label is applied to all CCR pages. | 10 November 2018, 19:38:22 UTC |
| 64df803 | Simon Willnauer | 10 November 2018, 11:15:31 UTC | Add a java level freeze/unfreeze API (#35353) This change adds a high level freeze API that allows to mark an index as frozen and vice versa. Indices must be closed in order to become frozen and an open but frozen index must be closed to be defrosted. This change also adds a index.frozen setting to mark frozen indices and integrates the frozen engine with the SearchOperationListener that resets and releases the directory reader after and before search phases. Relates to #34352 Depends on #34357 | 10 November 2018, 11:15:31 UTC |
| ba47882 | Tim Brooks | 09 November 2018, 17:12:49 UTC | Improve MockTcpTransport memory usage (#35402) The MockTcpTransport is not friendly in regards to memory usage. It must allocate multiple byte arrays for every message. This improves the memory situation by failing fast if the message is improperly formatted. Additionally, it uses reusable big arrays for at least half of the allocated byte arrays. | 09 November 2018, 17:12:49 UTC |
| 67f9e8f | Gordon Brown | 09 November 2018, 17:11:26 UTC | Enforce limitations on ILM policy names (#35104) Enforces restrictions on ILM policy names to ensure we don't accept policy names the system can't handle, or may reserve for future use. | 09 November 2018, 17:11:26 UTC |
| ae2af20 | Martijn van Groningen | 09 November 2018, 16:43:43 UTC | [CCR] Validate remote cluster license as part of put auto follow pattern api call (#35364) Validate remote cluster license as part of put auto follow pattern api call in addition of validation that when auto follow coordinator starts auto following indices in the leader cluster. Also added qa module that tests what happens to ccr after downgrading to basic license. Existing active follow indices should remain to follow, but the auto follow feature should not pickup new leader indices. | 09 November 2018, 16:43:43 UTC |
| f2d7c94 | Albert Zaharovits | 09 November 2018, 14:58:10 UTC | DOCS Add audit ignore settings to reference page (#35274) Adds the logfile audit ignore policy settings synopsis to the Auditing Reference page. | 09 November 2018, 14:58:10 UTC |
| 807ce10 | Martijn van Groningen | 09 November 2018, 14:40:15 UTC | [TEST] Increased timeout for verifying ccr monitoring. | 09 November 2018, 14:40:15 UTC |
| fba811f | Martijn van Groningen | 09 November 2018, 14:31:51 UTC | [TEST] increased the number of index and delete ops to make it less likely that all ops exist as soft delete docs. | 09 November 2018, 14:31:51 UTC |
| 83152b3 | Martijn van Groningen | 09 November 2018, 13:24:27 UTC | [CCR] Get all auto follow patterns and no auto follow metadata (#35381) Return empty response when querying all auto follow patterns, but there is no auto follow metadata. | 09 November 2018, 13:24:27 UTC |
| 36da6e1 | Marios Trivyzas | 09 November 2018, 10:32:38 UTC | SQL: Introduce IsNull node to simplify expressions (#35206) Add `IsNull` node in parser to simplify expressions so that `<value> IS NULL` is no longer translated internally to `NOT(<value> IS NOT NULL)` Replace `IsNotNullProcessor` with `CheckNullProcessor` to encapsulate both isNull and isNotNull functionality. Closes: #34876 Fixes: #35171 | 09 November 2018, 10:32:38 UTC |
| 529910a | Armin Braun | 09 November 2018, 09:47:30 UTC | DISCOVERY: Fix RollingUpgradeTests (#35375) * DISCOVERY: Fix RollingUpgradeTests * Don't manually manage min master nodes if not necessary * Remove some dead code * Allow for manually supplying list of seed nodes * Closes #35178 | 09 November 2018, 09:47:30 UTC |
| 617f91b | Albert Zaharovits | 09 November 2018, 09:38:45 UTC | DOCS Auditing search queries (#35301) This documents how to include the search queries in the audit log. There is a catch, that even if enabling `emit_request_body`, which should output queries included in request bodies, search queries were not output because, implicitly, no REST layer audit event type was included. This folk knowledge is herein imprinted. | 09 November 2018, 09:38:45 UTC |
| 7054e28 | Jim Ferenczi | 09 November 2018, 08:41:51 UTC | Add trace log of the request for the query and fetch phases (#34479) This change adds a logger for the query and fetch phases that prints all requests before their execution at the trace level. This will help debugging cases where an issue occurs during the execution since only completed queries are logged by the slow logs. | 09 November 2018, 08:41:51 UTC |
| a964196 | Tim Vernum | 09 November 2018, 07:13:24 UTC | Refactor realm tests to use single settings (#35362) Many realm tests were written to use separate setting objects for "global settings" and "realm settings". Since #30241 there is no distinction between these settings, so these tests can be cleaned up to use a single Settings object. | 09 November 2018, 07:13:24 UTC |
| 66e3ca9 | Alpar Torok | 09 November 2018, 06:04:56 UTC | Revert "Mute test for #35361" This reverts commit f9154758e6aecc4a8373904d3189535b15e8beb8. | 09 November 2018, 06:04:56 UTC |
| b0acd70 | Tim Vernum | 09 November 2018, 05:57:49 UTC | DOCS: Add SecurityExtension breaking change (#35358) We changed the way realm settings are defined, and this affects custom realms in SecurityExtensions. This change adds those details to the breaking changes docs. Relates: #30241 | 09 November 2018, 05:57:49 UTC |
| 02b4e28 | Armin Braun | 09 November 2018, 04:07:26 UTC | #31608 Add S3 Setting to Force Path Type Access (#34721) * SNAPSHOTS: Use Path Style Access in S3 * Use path style access pattern to fix #31608 * closes #31608 | 09 November 2018, 04:07:26 UTC |
| bccc99c | Tim Brooks | 09 November 2018, 01:04:48 UTC | Fix TcpTransport compression test (#35396) This commit fixes an assertion in the TcpTransportTests compresssion test. | 09 November 2018, 01:04:48 UTC |
| b485e69 | debadair | 08 November 2018, 23:26:27 UTC | ILM API ref edits (#35112) * [DOCS] ILM API Ref edits * [DOCS] Fixed endpoint for DELETE policy. * [DOCS] Removed comparison to setting index.lifecycle.name to null. * [DOCS] Fixed xrefs to explain API. | 08 November 2018, 23:26:27 UTC |
| c9a84fe | Marios Trivyzas | 08 November 2018, 22:32:59 UTC | SQL: Handle null literal for AND and OR in `WHERE` (#35236) Change `nullable()` logic of AND and OR to false since in the Optimizer we cannot fold to null as we might be handling and expression in the SELECT clause. Introduce folding of null for AND and OR expressions in PruneFilter() since we now know that we are in HAVING or WHERE clause and we can fold `null` to `false` Fixes: #35088 Co-authored-by: Costin Leau <costin.leau@gmail.com> | 08 November 2018, 22:32:59 UTC |
| c88b2d7 | Lisa Cawley | 08 November 2018, 21:53:09 UTC | [DOCS] Cleans up monitoring configuration steps (#35111) | 08 November 2018, 21:53:09 UTC |
| 7e144b3 | Mayya Sharipova | 08 November 2018, 19:54:20 UTC | Painless Context Doc: Add field context example (#35130) * Painless Context Doc: Add field context example relates to #34829 | 08 November 2018, 19:54:20 UTC |
| 93c2c60 | Tim Brooks | 08 November 2018, 17:37:59 UTC | Move compression config to ConnectionProfile (#35357) This is related to #34483. It introduces a namespaced setting for compression that allows users to configure compression on a per remote cluster basis. The transport.tcp.compress remains as a fallback setting. If transport.tcp.compress is set to true, then all requests and responses are compressed. If it is set to false, only requests to clusters based on the cluster.remote.cluster_name.transport.compress setting are compressed. However, after this change regardless of any local settings, responses will be compressed if the request that is received was compressed. | 08 November 2018, 17:37:59 UTC |
| 5c2a5f2 | Jason Tedor | 08 November 2018, 17:24:10 UTC | Adjust BWC version on OS pretty name This commit adjusts the BWC version the OS pretty name field on OsInfo now that this field has been backported to the 6.x development branch. | 08 November 2018, 17:24:10 UTC |
| 730ec1d | Jason Tedor | 08 November 2018, 17:16:58 UTC | Add more detailed OS name on Linux (#35352) Today our OS information returned in node stats only returns a high-level name of the OS (e.g., "Linux"). Yet, for some uses this is too high-level and knowing at a finer level of granularity the underlying OS can be useful. This commit extracts the pretty name on Linux from /etc/os-release. This pretty name usually includes the Linux vendor and the Linux vendor version number (e.g., Fedora 28). | 08 November 2018, 17:16:58 UTC |
| 85a8b51 | Albert Zaharovits | 08 November 2018, 16:42:36 UTC | HLRest: refactor put_user to utilize `User` object (#35188) This follows #33552 , when the `_authenticate` API added a new `User` object for the API's response. This changes the `put_user` API to also employ a `User` object in the request. The User object changed slightly. A bug with put_user only putting/updating enabled (but not disabled) users has been fixed. | 08 November 2018, 16:42:36 UTC |
| 113af79 | Christoph Büscher | 08 November 2018, 16:04:40 UTC | Make limit on number of expanded fields configurable (#35284) Currently we introduced a hard limit of 1024 to the number of fields a query can be expanded to in #26541. Instead of using a hard limit, we should make this configurable. This change removes the hard limit check and uses the existing `max_clause_count` setting instead. Closes #34778 | 08 November 2018, 16:04:40 UTC |
| 55c6481 | Zachary Tong | 08 November 2018, 16:02:30 UTC | [Docs] Add painless context details for bucket_selector (#35162) Adds docs for the bucket_selector context, an example and corresponding doc test | 08 November 2018, 16:02:30 UTC |
| ac1d8da | Zachary Tong | 08 November 2018, 15:31:30 UTC | [Test] Remove unused imports Checkstyle | 08 November 2018, 15:31:56 UTC |
| 433469d | Hendrik Muhs | 08 November 2018, 15:28:48 UTC | [Rollup] improve handling of failures on first search (#35269) Improve error handling in the Indexer if an exception occurs during the very 1st retrieval (query execution) | 08 November 2018, 15:28:48 UTC |
| 07a69a5 | Martijn van Groningen | 08 November 2018, 15:26:14 UTC | [CCR] Rename leaderClient variables and parameters to remoteClient (#35368) | 08 November 2018, 15:26:14 UTC |
| 54b445d | Zachary Tong | 08 November 2018, 15:23:23 UTC | [Test] Remove obsolete job/cluster cleanup code Also makes sure the awaitBusy for job stoppage is checked, so that we can fail if we timed out waiting for a job to stop. Closes #35295 | 08 November 2018, 15:23:23 UTC |
| d96202a | Jim Ferenczi | 08 November 2018, 14:40:01 UTC | [DOCS] Fix missing callouts | 08 November 2018, 14:40:01 UTC |
| 6980fed | Daniel Mitterdorfer | 08 November 2018, 14:33:24 UTC | Remove unused class MemoryCircuitBreaker The class `MemoryCircuitBreaker` is unused so we remove all its traces from the code base. Relates #35367 | 08 November 2018, 14:33:24 UTC |
| 20cf13d | Daniel Mitterdorfer | 08 November 2018, 14:32:47 UTC | Use Gradle wrapper in client benchmark README With this commit we use the Gradle wrapper in documentation examples for the client benchmarks instead of Gradle itself. Relates #35366 | 08 November 2018, 14:32:47 UTC |
| ca12de5 | Alpar Torok | 08 November 2018, 11:14:59 UTC | Mute test for #35295 | 08 November 2018, 13:49:40 UTC |
| d351422 | Dominik Stadler | 08 November 2018, 13:13:00 UTC | Add parent-aggregation to parent-join module (#34210) Add `parent` aggregation, a special single bucket aggregation that joins children documents to their parent. | 08 November 2018, 13:13:00 UTC |
| 025a0c8 | Albert Zaharovits | 08 November 2018, 12:06:47 UTC | Remove deprecated audit settings (#35205) Removes `.prefix` deprecated settings for the logfile auditing and also documents it in the migrate asciidoc. | 08 November 2018, 12:06:47 UTC |
| 848847d | Russ Cam | 08 November 2018, 11:43:08 UTC | [Docs] Section header preceded by blank line (#34340) | 08 November 2018, 11:44:13 UTC |
| 518e0de | Alpar Torok | 08 November 2018, 10:01:19 UTC | Mute test #35365 | 08 November 2018, 10:27:40 UTC |
| d00b23c | Jeff Hajewski | 08 November 2018, 10:09:03 UTC | Fixes fast vector highlighter docs per issue 24318. (#34190) The `fvh` highlighter does not support span queries. This fix updates the docs to add a warning stating the lack of span query support for `fvh`. | 08 November 2018, 10:09:03 UTC |
| 9494e04 | David Kyle | 08 November 2018, 09:57:07 UTC | [ML] Prevent notifications on deletion of a non existent job (#35337) | 08 November 2018, 09:57:07 UTC |
| 8a85251 | Martijn van Groningen | 08 November 2018, 09:48:27 UTC | [CCR] Auto follow Coordinator fetch cluster state in system context (#35120) Auto follow Coordinator should fetch the leader cluster state using system context. | 08 November 2018, 09:48:27 UTC |
| f915475 | Alpar Torok | 08 November 2018, 09:27:46 UTC | Mute test for #35361 | 08 November 2018, 09:31:51 UTC |
| 14b8114 | Christoph Büscher | 08 November 2018, 09:22:25 UTC | Preserve `date_histogram` format when aggregating on unmapped fields (#35254) Currently when aggregating on an unmapped date field (e.g. using a date_histogram) we don't preserve the aggregations `format` setting but instead use the default format. This can lead to loosing the aggregations `format` when aggregating over several indices where some of them contain unmapped date fields and are encountered first in the reduce phase. Related to #31760 | 08 November 2018, 09:22:25 UTC |
| 0b24c4f | Tim Vernum | 08 November 2018, 08:21:16 UTC | Test: Mute failing SSL test Relates: https://github.com/elastic/elasticsearch/issues/35360 | 08 November 2018, 08:37:29 UTC |
| 891fdda | Jim Ferenczi | 08 November 2018, 08:30:52 UTC | Allow unmapped fields in composite aggregations (#35331) Today the `composite` aggregation throws an error if a source targets an unmapped field and `missing_bucket` is set to false. Documents without a value for a source cannot produce any bucket if `missing_bucket` is not activated so the error is a shortcut to say that the response will be empty. However this is not consistent with the `terms` aggregation which accepts unmapped field by default even if the response is also guaranteed to be empty. This commit removes this restriction, if a source contains an unmapped field we now return an empty response (no buckets). Closes #35317 | 08 November 2018, 08:30:52 UTC |
| 1703a61 | Tanguy Leroux | 08 November 2018, 08:23:33 UTC | [RCI] Add IndexShardOperationPermits.asyncBlockOperations(ActionListener<Releasable>) (#34902) The current implementation of asyncBlockOperations() can be used to execute some code once all indexing operations permits have been acquired, then releases all permits immediately after the code execution. This immediate release is not suitable for treatments that need to keep all permits over multiple execution steps. This commit adds a new asyncBlockOperations() that exposes a Releasable, making it possible to acquire all permits and only release them all when needed by closing the Releasable. The existing blockOperations() method has been modified to delegate permit acquisition/releasing to this new method. Relates to #33888 | 08 November 2018, 08:23:33 UTC |
| a90ef6b | Przemyslaw Gomulka | 08 November 2018, 07:19:27 UTC | HLRC: reindex API with wait_for_completion false (#35202) Extend High Level Rest Client Reindex API to support requests with wait_for_completion=false. This method will return a TaskSubmissionResult with task identifier as string and results can be queried with Task API refers: #27205 | 08 November 2018, 07:19:27 UTC |
| a6073f5 | Jason Tedor | 08 November 2018, 03:25:37 UTC | Add docs on JNA temp directory not being noexec (#35355) If the underlying mount point for the JNA temporary directory is mounted noexec on Linux, then the JVM will not be able to map the native code in as executable. This will prevent JNA from executing and will prevent Elasticsearch from being able to execute some functions that rely on native code (e.g., memory locking, and installing system call filters). We do not want to get into the business of catching exceptions and parsing messages towards this because these exception messages can change on us. We also do not want to jump through a lot of hoops to check the underlying mount point for noexec. Instead, we will rely on documentation to address this problem. This commit adds to the important system configuration section of the docs that the JNA temporary directory is not on a mount point with the noexec mount option. | 08 November 2018, 03:25:37 UTC |
| 2f2090f | Martijn van Groningen | 08 November 2018, 02:59:58 UTC | [CCR] Adjust list of dynamic index settings that should be replicated (#35195) Adjust list of dynamic index settings that should be replicated and added a test that verifies whether builtin dynamic index settings are classified as replicated or non replicated (whitelisted). | 08 November 2018, 02:59:58 UTC |
| 4f4fc3b | Jason Tedor | 08 November 2018, 02:20:51 UTC | Replicate index settings to followers (#35089) This commit uses the index settings version so that a follower can replicate index settings changes as needed from the leader. Co-authored-by: Martijn van Groningen <martijn.v.groningen@gmail.com> | 08 November 2018, 02:20:51 UTC |
| 7d05257 | Tim Vernum | 08 November 2018, 01:57:42 UTC | Rename RealmConfig.globalSettings() to settings() (#35330) There is no longer a concept of non-global "realm settings". All realm settings should be loaded from the node's settings using standard Setting classes. This change renames the "globalSettings" field and method to simply be "settings". | 08 November 2018, 01:57:42 UTC |
| 566979c | Tim Vernum | 08 November 2018, 01:57:22 UTC | [TEST] Cleanup FileUserPasswdStoreTests (#35329) The file realm has not supported custom filenames/locations since at least 5.0, but this test still tried to configure them. Remove all configuration of file locations, and cleaned up a few other warnings and deprecations | 08 November 2018, 01:57:22 UTC |
| a4d979c | Ryan Ernst | 07 November 2018, 23:09:09 UTC | Scripting: Add back lookup vars in score script (#34833) The lookup vars under params (namely _fields and _source) were inadvertently removed when scoring scripts were converted to using script contexts. This commit adds them back, along with deprecation warnings for those that should not be used. | 07 November 2018, 23:09:09 UTC |
| d7a4cef | Jake Landis | 07 November 2018, 21:08:03 UTC | watcher: Fix integration tests to ensure correct start/stop of Watcher (#35271) Ensure that Watcher is correctly started and stopped between tests for SmokeTestWatcherWithSecurityIT, SmokeTestWatcherWithSecurityClientYamlTestSuiteIT, SmokeTestWatcherTestSuiteIT, WatcherRestIT, XDocsClientYamlTestSuiteIT, and XPackRestIT The change here is to throw an `AssertionError` instead of `break;` to allow the `assertBusy()` to continue to busy wait until the desired state is reached. closes #33291, closes #29877, closes #34462, closes #30705, closes #34448 | 07 November 2018, 21:08:03 UTC |
| b1655c4 | Lee Hinman | 07 November 2018, 20:40:19 UTC | Remove ALL shard check in CheckShrinkReadyStep (#35346) Since it's still possible to shrink an index when replicas are unassigned, we should not check that all copies are available when performing the shrink, since we set the allocation requirement for a single node. Resolves #35321 | 07 November 2018, 20:40:19 UTC |
| ed8732b | Nhat Nguyen | 07 November 2018, 20:26:30 UTC | Use soft-deleted docs to resolve strategy for engine operation (#35230) A CCR test failure shows that the approach in #34474 is flawed. Restoring the LocalCheckpointTracker from an index commit can cause both FollowingEngine and InternalEngine to incorrectly ignore some deletes. Here is a small scenario illustrating the problem: 1. Delete doc with seq=1 => engine will add a delete tombstone to Lucene 2. Flush a commit consisting of only the delete tombstone 3. Index doc with seq=0 => engine will add that doc to Lucene but soft-deleted 4. Restart an engine with the commit (step 2); the engine will fill its LocalCheckpointTracker with the delete tombstone in the commit 5. Replay the local translog in reverse order: index#0 then delete#1 6. When process index#0, an engine will add it into Lucene as a live doc and advance the local checkpoint to 1 (seq#1 was restored from the commit - step 4). 7. When process delete#1, an engine will skip it because seq_no=1 is less than or equal to the local checkpoint. We should have zero document after recovering from translog, but here we have one. Since all operations after the local checkpoint of the safe commit are retained, we should find them if the look-up considers also soft-deleted documents. This PR fills the disparity between the version map and the local checkpoint tracker by taking soft-deleted documents into account while resolving strategy for engine operations. Relates #34474 Relates #33656 | 07 November 2018, 20:26:30 UTC |
| c51dcb1 | Lee Hinman | 07 November 2018, 20:24:21 UTC | [ILM] Check shard and relocation status in AllocationRoutedStep (#35316) * [ILM] Check shard and relocation status in AllocationRoutedStep This is a follow-up from #35161 where we now check for started and relocating state in `AllocationRoutedStep`. Resolves #35258 | 07 November 2018, 20:24:21 UTC |
| 8de3c6e | Martijn van Groningen | 07 November 2018, 19:41:27 UTC | Ignore date ranges containing 'now' when pre-processing a percolator query (#35160) Today when a percolator query contains a date range then the query analyzer extracts that range, so that at search time the `percolate` query can exclude percolator queries efficiently that are never going to match. The problem is that if 'now' is used it is evaluated at index time. So the idea is to rewrite date ranges with 'now' to a match all query, so that the query analyzer can't extract it and the `percolate` query is then able to evaluate 'now' at query time. | 07 November 2018, 19:41:27 UTC |
| 0cc0fd2 | Simon Willnauer | 07 November 2018, 19:23:35 UTC | Add a frozen engine implementation (#34357) This change adds a `frozen` engine that allows lazily open a directory reader on a read-only shard. The engine wraps general purpose searchers in a LazyDirectoryReader that also allows to release and reset the underlying index readers after any and before secondary search phases. Relates to #34352 | 07 November 2018, 19:23:35 UTC |
| f789d49 | Vladimir Dolzhenko | 07 November 2018, 19:18:11 UTC | Put a fake allocation id on allocate stale primary command (#34140) removes fake allocation id after recovery is done Relates to #33432 | 07 November 2018, 19:18:11 UTC |
| 314b9ca | Martijn van Groningen | 07 November 2018, 19:16:26 UTC | [CCR] Enforce auto follow pattern name restrictions (#35197) An auto follow pattern: * cannot start with `_` * cannot contain a `,` * can be encoded in UTF-8 * the length of UTF-8 encoded bytes is no longer than 255 bytes | 07 November 2018, 19:16:26 UTC |
| 4167c14 | Tal Levy | 07 November 2018, 18:50:55 UTC | [ILM] rolling upgrade tests (#35328) Adds basic rolling upgrade tests to check that lifecycles are still recognizable between rolling cluster upgrades and managed indices stay managed. This is a placeholder for discussing types of checks so they are ready once we backported This is a re-boot of the previous PR against index-lifecycle that needed to be reverted due to CI bwc issues. #32828 | 07 November 2018, 18:50:55 UTC |
| 2117f4f | Benjamin Trent | 07 November 2018, 18:48:15 UTC | [ML] Add Missing data checking class (#35310) * ML: Adding missing data check class * reverting bad change * Adding bucket + missing data object for returns * reverting unnecessary change * adding license header * Make client calls synchronous, akin to DatafeedJob * Fixing line length * Renaming things, addressing PR comments | 07 November 2018, 18:48:15 UTC |
| 2131e11 | Simon Willnauer | 07 November 2018, 17:43:27 UTC | Apply `ignore_throttled` also to concrete indices (#35335) Today we only apply `ingore_throttled` to expansions from wildcards, date math expressions and aliases. Yet, this is tricky since we might have resolved certain expressions in pre-filter steps like security. It's more consistent to apply this logic to all expressions including concrete indices. Relates to #34354 | 07 November 2018, 17:43:27 UTC |
| 5ae0319 | Alpar Torok | 07 November 2018, 16:36:02 UTC | Make version field names more meaningful (#35334) * Consolidate the name of the qualified build version * Field name in response should not be redundant | 07 November 2018, 16:36:02 UTC |
| 021f805 | Martijn van Groningen | 07 November 2018, 16:08:35 UTC | [CCR] Added HLRC support for pause follow API (#35216) * Moved `AcknowledgedResponse` to core package * Made AcknowledgedResponse not abstract and provided a default parser, so that in cases when the field name is not overwritten then there is no need for a subclass. Relates to #33824 | 07 November 2018, 16:08:35 UTC |
| e572a21 | Chris Cho | 07 November 2018, 16:01:35 UTC | [Docs] Improve Convert Processor description (#35280) Sometimes users are confused about whether they can use the Convert Processor for changing an existing fields type to other types even if the existing one is already ingested. This confusion is from the first line of description. Changing this and also adding a some detail to the code snippet. | 07 November 2018, 16:01:35 UTC |
| efe9bec | Jack Conradson | 07 November 2018, 15:52:12 UTC | [Painless] Removes extraneous compile method (#35323) With the removal of SearchScript (#34730), an extraneous compile method was left behind in PainlessScriptEngine. This change removes the method and updates the tests that depend on it to use the main compile method which gives better test coverage. | 07 November 2018, 15:52:12 UTC |
| e685cfe | Martijn van Groningen | 07 November 2018, 12:23:30 UTC | [CCR] Fail with a better error if leader index is red (#35298) as part of fetching history uuids from leader index. | 07 November 2018, 12:23:30 UTC |
| 9a319ec | Alpar Torok | 07 November 2018, 12:22:00 UTC | Remove ILM specific gradle extra args (#35296) | 07 November 2018, 12:22:00 UTC |
| 8a85b2e | Alpar Torok | 07 November 2018, 12:01:05 UTC | Remove build qualifier from server's Version (#35172) With this change, `Version` no longer carries information about the qualifier, we still need a way to show the "display version" that does have both qualifier and snapshot. This is now stored by the build and red from `META-INF`. | 07 November 2018, 12:01:05 UTC |
| a467a81 | Vladimir Dolzhenko | 07 November 2018, 11:52:11 UTC | Fix DeleteRequest / GetRequest / UpdateRequest / ExplainRequest validation for null and/or empty id/type (#35314) Closes #35297 | 07 November 2018, 11:52:11 UTC |
| 42dcdd0 | Marios Trivyzas | 07 November 2018, 11:08:32 UTC | SQL: Improve CircuitBreaker logic for SqlParser (#35300) Grammar's identifiers can be completely skipped from counting depths as they just add another level to the tree and they are always children of some other expression which gets counted. Increased maximum depth from 100 to 200. After testing on production configuration with -Xss1m, depths of at least 250 can be used, so being conservative we put the limit lower. Fixes: #35299 | 07 November 2018, 11:08:32 UTC |
| 9f3effd | Alexander Reelsen | 07 November 2018, 08:03:35 UTC | Watcher: Ignore system locale/timezone in croneval CLI tool (#33215) The elasticsearch-croneval CLI tool uses local dates to display when something gets triggered the next time. This is very confusing. This commit ensures, that UTC and local timezone times will be written out. The output looks like this and contains localized dates for each trigger date as well as for `now`. Now is [Tue, 28 Aug 2018 17:23:51 +0000] in UTC, local time is [ᏔᎵᏁ, 28 ᎦᎶ 2018 12:23:51 -0500] Here are the next 10 times this cron expression will trigger: 1. Mon, 2 Jan 2040 11:00:00 +0000 ᏉᏅᎯ, 2 ᎤᏃ 2040 06:00:00 -0500 2. ... This also removes an old outstanding TODO to use the jopt parsing to cast the count to an integer instead of doing it ourselves. | 07 November 2018, 08:03:35 UTC |
| b4173c8 | Tim Vernum | 07 November 2018, 07:21:30 UTC | Remove deprecated RealmConfig constructor (#35327) This removes an obsolete constructor that was still being called from some tests. Relates: #30241 | 07 November 2018, 07:21:30 UTC |
| 2395e16 | Martijn van Groningen | 07 November 2018, 06:38:44 UTC | [CCR] Change resume follow api to be a master node action (#35249) In order to start shard follow tasks, the resume follow api already needs execute N requests to the elected master node. The pause follow API is also a master node action, which would make how both APIs execute more consistent. | 07 November 2018, 06:38:44 UTC |
