https://github.com/elastic/elasticsearch

sort by:
Revision Author Date Message Commit Date
fc0eeb6 Clarify low watermark documentation (#48112) Today the docs say that the low watermark has no effect on any shards that have never been allocated, but this is confusing. Here "shard" means "replication group" not "shard copy" but this conflicts with the "never been allocated" qualifier since one allocates shard copies and not replication groups. This commit removes the misleading words. A newly-created replication group remains newly-created until one of its copies is assigned, which might be quite some time later, but it seems better to leave this implicit. 16 October 2019, 11:22:54 UTC
7ab6ae2 Fix typo in QueryBuilders Javadoc. (#47362) This PR fixes a typo in the Javadoc for terms queries in QueryBuilders. 15 October 2019, 23:22:45 UTC
5d49bbd [DOCS] Fix typo in percentile rank aggregation docs (#47247) 15 October 2019, 19:57:02 UTC
853cddb [DOCS] Remove unneeded spaces from custom analyzer snippet (#47332) 15 October 2019, 19:53:29 UTC
68ce306 [DOCS] Fix truststores typo (#47738) 15 October 2019, 19:51:08 UTC
36b32ae [DOCS] Sort analyzers, tokenizers, and token filters alphabetically (#48068) 15 October 2019, 19:47:42 UTC
66f3455 [DOCS] Expand `updated` response parm in reindex API docs (#48008) 15 October 2019, 15:17:29 UTC
1aeb467 [DOCS] Add #46860 to 7.4 release notes (#48018) 15 October 2019, 12:47:34 UTC
7108963 [ML][Transforms] fix bwc serialization with 7.3 (#48021) (#48052) 15 October 2019, 12:46:50 UTC
30eba04 SQL: [Tests] Improve tests regarding integer arg Improve tests regarding the verification of the integer arg (non-rational number) for string functions. 15 October 2019, 11:14:20 UTC
0ce262c Fix Bug in Azure Repo Exception Handling (#47968) (#48031) We were incorrectly handling `IOExceptions` thrown by the `InputStream` side of the upload operation, resulting in a `ClassCastException` as we expected to never get `IOException` from the Azure SDK code but we do in practice. This PR also sets an assertion on `markSupported` for the streams used by the SDK as adding the test for this scenario revealed that the SDK client would retry uploads for non-mark-supporting streams on `IOException` in the `InputStream`. 15 October 2019, 10:01:29 UTC
653e0be [DOCS] Reformat docs for several snapshot lifecycle policy APIs (#47998) 14 October 2019, 16:47:47 UTC
8ba7875 [DOCS] Remove unsupported `local` and `master_timeout` parms from cat API docs (#47933) 14 October 2019, 15:39:49 UTC
e32ab43 File based role mappings vs the role mapping APIs (#47015) (#47979) Make clear in the docs that the role mapping APIs is the preferred way to manage role mappings and that the role mappings that are defined in files cannot be viewed or managed with the APIs 14 October 2019, 09:41:25 UTC
42824b3 Avoid unneeded refresh with concurrent realtime gets (#47895) This change should reduce refreshes for a use-case where we perform multiple realtime gets at the same time on an active index. Currently, we only call refresh if the index operation is still on the versionMap. However, at the time we call refresh, that operation might be already or will be included in the latest reader. Hence, we do not need to refresh. Adding another lock here is not an issue as the refresh is already sequential. 14 October 2019, 01:04:41 UTC
d507915 Force flush in translog retention policy test (#47879) If we roll translog but do not index, then a flush without force is a noop. In this case, the number of retained translog files will be higher than the value specified by the retention policy. Closes #4741 14 October 2019, 01:04:41 UTC
7f2bbc6 [ML] Fix detection of syslog-like timestamp in find_file_structure (#47970) Usually syslog timestamps have two spaces before a single digit day-of-month. However, in some non-syslog cases where syslog-like timestamps are used there is only one space. The grok pattern supports this, so the timestamp parser should too. This change makes the find_file_structure endpoint do this. Also fixes another problem that the same test case exposed in the find_file_structure endpoint, which was that the exclude_lines_pattern for delimited files was always created on the assumption the delimiter was a comma. Now it is based on the actual delimiter. 13 October 2019, 19:13:58 UTC
4b7d70f Minor typo Changed 'folowing' to 'following'. 12 October 2019, 13:54:30 UTC
096a602 Fix ADRealmTests in FIPS 140 JVMs (#47437) (#47960) The changes introduced in #47179 made it so that we could try to build an SSLContext with verification mode set to None, which is not allowed in FIPS 140 JVMs. This commit address that 12 October 2019, 12:52:42 UTC
d4f5376 GlobalBuildInfo plugin should search packed references for commit IDs (#47464) (#47938) * GlobalBuildInfo plugin searches packed references In recent versions of Git, references may be packed in a packed-refs file. If this happens, Gradle will need to look in that file to find build information. 11 October 2019, 18:47:50 UTC
1571527 [Monitoring] Add new cluster privilege now necessary for the stack monitoring ui (#47871) (#47916) * Add new cluster privilege now necessary for the stack monitoring ui * PR feedback, and add test 11 October 2019, 17:22:54 UTC
e745177 [DOCS] Reformat get snapshot lifecycle policy API docs (#47827) (#47932) 11 October 2019, 17:01:04 UTC
b1690ae Adjust Version.V_6_8_4 to refer to Lucene 7.7.2 (#47926) 6.8.4 will ship with Lucene 7.7.2, so we need to change our version settings to reflect this. Relates #47901 11 October 2019, 16:02:44 UTC
0ea5223 [DOCS] Reformat put snapshot lifecycle policy API docs (#47811) (#47927) 11 October 2019, 15:57:09 UTC
7784582 Allow truncation of clean translog (#47866) Today the `elasticsearch-shard remove-corrupted-data` tool will only truncate a translog it determines to be corrupt. However there may be other cases in which it is desirable to truncate the translog, for instance if an operation in the translog cannot be replayed for some reason other than corruption. This commit adds a `--truncate-clean-translog` option to skip the corruption check on the translog and blindly truncate it. 11 October 2019, 14:52:42 UTC
25ae050 DocValueFormat implementation for date range fields (#47472) (#47606) 11 October 2019, 13:54:21 UTC
7b1673a [DOCS] Reformat reload search analyzers API docs (#47824) (#47908) 11 October 2019, 13:40:57 UTC
a6462e7 [DOCS] Fix gcloud command typo in discovery-gce.asciidoc. (#47312) 10 October 2019, 18:22:02 UTC
d0fe074 Make sibling pipeline agg ctor's protected (#42808) SiblingPipelineAggregator is a public interfaces, but the ctor was package-private. These should be protected so that plugin authors can extend and implement their own sibling pipeline agg. 10 October 2019, 16:31:53 UTC
57b6591 [DOCS] Document `bytes` and `time` params in cat API docs (#47672) (#47855) 10 October 2019, 13:48:56 UTC
dbf1ed0 [DOCS] Adds supported fields section to the PUT DFA API description (#47842) 10 October 2019, 10:43:46 UTC
ce1c40d More bootstrap docs tweaks (#47809) Clarifies not to set `cluster.initial_master_nodes` on nodes that are joining an existing cluster. Co-Authored-By: James Rodewig <james.rodewig@elastic.co> 10 October 2019, 08:55:43 UTC
07d706a Fix tag in the search request timeout option docs (#47776) and add missing parentheses `search_timeout` param 10 October 2019, 08:36:15 UTC
4e3c492 Add a verifyVersions to the test FW (#47192) The test FW has a method to check that it's implementation of getting index and wire compatible versions as well as reasoning about which version is released or not produces the same rezults as the simillar implementation in the build. This PR adds the `verifyVersions` task to the test FW so we have one task to check everything related to versions. 10 October 2019, 08:24:00 UTC
c6253d2 Sync translog without lock before trim unreferenced readers (#47790) This commit is similar to the optimization made in #45765. With this change, we fsync most of the data of the current generation without holding writeLock when trimming unreferenced readers. Relates #45765 09 October 2019, 21:57:48 UTC
e4e396e Do not auto-follow closed indices (#47721) (#47801) Backport of (#47721) for 7.x. Similarly to #47582, Auto-follow patterns creates following indices as long as the remote index matches the pattern and the remote primary shards are all started. But since 7.2 closed indices are also replicated, and it does not play well with CCR auto-follow patterns as they create following indices for closed leader indices too. This commit changes the getLeaderIndicesToFollow() so that closed indices are excluded from auto-follow patterns. 09 October 2019, 17:16:49 UTC
b4f8d04 [DOCS] Extends the analyzed_fields description in the PUT DFA API docs (#47791) 09 October 2019, 16:15:40 UTC
e043486 [DOCS] Correct split API request format (#47774) 09 October 2019, 12:27:22 UTC
fb1643d Update node-tool.asciidoc typo error 08 October 2019, 23:30:40 UTC
02834d4 [DOCS] Cleans up links to security content (#47610) (#47704) 08 October 2019, 16:06:56 UTC
b36a9bc Remove unmerged changes from release notes (#47731) 08 October 2019, 15:14:20 UTC
d72048f Fix Ex. Handling in SnapshotsService#snapshots (#47507) (#47729) We're needlessly wrapping a `SnapshotMissingException` which itself is a `SnapshotException` when trying to load a missing snapshot. This leads to failure #47442 which expects a `SnapshotMissingException` in this case. Closes #47442 08 October 2019, 15:03:15 UTC
c54650e [DOCS] Fix errors in rollover index API docs (#47702) 08 October 2019, 12:40:27 UTC
2e26fb5 Dangling indices strip aliases (#47581) Importing dangling indices with aliases risks breaking functionalities using those aliases. For instance, writing to an alias may break if there is no is_write_index indication on the existing alias and the dangling index import adds a second index to the alias. Or an application could have an assumption about the alias only ever pointing to one index and suddenly seeing the alias also linked to an old index could break it. With this change we strip aliases of the index meta data found before importing a dangling index. 08 October 2019, 10:59:39 UTC
6099e83 Throw error retrieving non-existent SLM policy (#47679) Previously when retrieving an SLM policy it would always return a 200 with `{}` in the body, even if the policy did not exist. This changes that behavior to throw an error (similar to our other APIs) if a policy doesn't exist. This also adds a basic CRUD yml test for the behavior. Resolves #47664 08 October 2019, 02:08:38 UTC
1aff080 Switch stored script example to script_score query (#47691) The example use of a scoring script was incorrectly using a filter script query, which has no scoring, and thus no _score variable avialable. This commit converts the example doc to using the newer script_score query. 08 October 2019, 00:13:29 UTC
5a0d843 Fix Rollover error when alias has closed indices (#47148) (#47540) Rollover previously requested index stats for all indices in the provided alias, which causes an exception when there is a closed index with that alias. This commit adjusts the IndicesOptions used on the index stats request so that closed indices are ignored, rather than throwing an exception. 07 October 2019, 22:01:32 UTC
0839cc0 [DOCS] Backporting API ref reformatting for document APIs (#47631) (#47684) * [DOCS] Backporting API ref reformatting for document APIs (#47631) * [DOCS] Reformats bulk API. (#47479) * Reformats bulk API. * Update docs/reference/docs/bulk.asciidoc Co-Authored-By: James Rodewig <james.rodewig@elastic.co> * Reformats mget API (#47477) * Reformats mget API * Update docs/reference/docs/get.asciidoc Co-Authored-By: James Rodewig <james.rodewig@elastic.co> * Incorporated feedback. * Reformats reindex API (#47483) * Reformats reindex API * Incorporated review feedback. * Reformats term vectors APIs (#47484) * Reformat termvectors APIs * Reformats mtermvectors * Apply suggestions from code review Co-Authored-By: James Rodewig <james.rodewig@elastic.co> * Incorporated review feedback. * Fixed console snippets. 07 October 2019, 19:02:05 UTC
6644e51 [7.4][DOCS] Adds security content in the Elasticsearch Reference (#47677) 07 October 2019, 18:27:22 UTC
49873f0 Add execute flag to CI script 07 October 2019, 18:09:35 UTC
aaea48d SQL: Allow whitespaces in escape patterns (#47577) Previously, we supported only the format `{fn <FUNCTION_NAME>()}` but other DBs like MSSQL, DB2, MariaDB/MySQL alos allow whitespaces between `{` and `fn`. Furhermore, also some applications - like PowerBI - generate escape sequences with spaces: `select { fn name(params) } etc.` Add support for white spaces between `{` and the escape pattern definition like `fn`, `ts`, `d`, `guid` etc. Closes: #47401 (cherry picked from commit 08a22d0b393f4a76c52dabc5e7b9cafcc19c30ca) 07 October 2019, 15:08:54 UTC
e86b2da [7.4][DOCS] Copies security source files from stack-docs (#47613) 07 October 2019, 13:49:08 UTC
97b86c0 [DOCS] Correct deprecation note in mapping docs (#47656) 07 October 2019, 13:38:14 UTC
2985ae8 [DOCS] Reformat clear cache API docs (#46512) (#47663) 07 October 2019, 13:36:42 UTC
fa97d35 [DOCS] Correct callouts in search template docs (#47655) 07 October 2019, 13:25:52 UTC
1baa962 [DOCS] Reformat type exists API docs (#47601) (#47653) 07 October 2019, 13:12:14 UTC
390a220 Removing the dots from property snippet (#47643) removing unnecessary dots 07 October 2019, 12:23:07 UTC
2e89040 Fail earlier Put Follow requests for closed leader indices (#47638) Backport of #47582 Today when following a new leader index, we fetch the remote cluster state, check the remote cluster license, check the user privileges, retrieve the index shard stats before initiating a CCR restore session. But if the leader index to follow is closed, we're executing a bunch of operations that would inevitability fail at some point (on retrieving the index shard stats, because this type of request forbid closed indices when resolving indices). We could fail a Put Follow request at the first step by checking the leader index state directly from the remote cluster state. This also helps the Resume Follow API to fail a bit earlier. 07 October 2019, 11:59:33 UTC
a345640 [7.4][Transform] reuse mock client to avoid problems with thread context closed errors (#46424) reuse mock client to avoid problems with threadcontext is already closed errors 07 October 2019, 11:25:48 UTC
8f6cf66 Update deprecation logging doc with logger configuration Explicitly adds a configuration snippet to change logging level 07 October 2019, 10:13:10 UTC
18fba4b Add IT for Snapshot Issue in 47552 (#47627) (#47635) * Add IT for Snapshot Issue in 47552 (#47627) Adding a specific integration test that reproduces the problem fixed in #47552. The issue fixed only reproduces in the snapshot resiliency otherwise which are not available in 6.8 where the fix is being backported to as well. 07 October 2019, 08:38:44 UTC
b2506a8 NameID mapping and Single Logout (#47288) (#47562) Clarify in the documentation that for SAML Single Logout to be functional, the Identity Provider needs to release a NameID. 07 October 2019, 06:19:53 UTC
ad75a28 [DOCS] Comment out tag in Task Managment API Docs so it isn't rendered. (#47618) The tag for the shared content is being rendered in the output. 05 October 2019, 16:49:14 UTC
6c9687b Fix Snapshot Corruption in Edge Case (#47552) (#47621) This fixes missing to marking shard snapshots as failures when multiple data-nodes are lost during the snapshot process or shard snapshot failures have occured before a node left the cluster. The problem was that we were simply not adding any shard entries for completed shards on node-left events. This has no effect for a successful shard, but for a failed shard would lead to that shard not being marked as failed during snapshot finalization. Fixed by corectly keeping track of all previous completed shard states as well in this case. Also, added an assertion that without this fix would trip on almost every run of the resiliency tests and adjusted the serialization of SnapshotsInProgress.Entry so we have a proper assertion message. Closes #47550 05 October 2019, 13:46:17 UTC
29c1424 [DOCS] Reformat shrink index API docs (#46711) (#47587) 04 October 2019, 17:57:13 UTC
cc0502f [DOCS] Reformat refresh API docs (#46667) (#47590) 04 October 2019, 17:50:27 UTC
c5a5243 [DOCS] Correct headings for split index API docs 04 October 2019, 15:09:56 UTC
da7c439 [DOCS] Reformat split index API docs (#46713) (#47579) 04 October 2019, 14:45:17 UTC
111e4e1 SQL: fix multi full-text functions usage with aggregate functions (#47444) * Skip functions involving full-text predicates when replacing multiple aggregate functions with "stats" or "matrix_stats" aggregations. (cherry picked from commit bb14ba83128dfb7a70f825ea08b1524072fb9ad0) 04 October 2019, 13:54:06 UTC
abeca45 Update link to ls monitoring settings (#47529) (#47543) 04 October 2019, 13:20:34 UTC
d6f427f Remove fallback for controller location (#47104) This change removes the temporary controller location fallback introduced in #47013. Relates elastic/ml-cpp#593 04 October 2019, 08:50:53 UTC
14fbe8f Fix alias field resolution in match query (#47369) Synonym queries (when two tokens/paths start at the same position) use the alias field instead of the concrete field to build Lucene queries. This commit fixes this bug by resolving the alias field upfront in order to provide the concrete field to the actual query parser. 04 October 2019, 08:25:26 UTC
0c7c607 [DOCS] Fixes an attribute in the update datafeed API docs. (#47551) 04 October 2019, 06:54:02 UTC
88c6cdc Add OS scripts to keep CI happy The tests just inform that we don't support this branch 04 October 2019, 05:50:13 UTC
1b2d9b0 Fix for ApiKeyIntegTests related to Expired API keys remover (#43477) (#47547) When API key is invalidated we do two things first it tries to trigger `ExpiredApiKeysRemover` task and second, we do index the invalidation for the API key. The index invalidation may happen before the `ExpiredApiKeysRemover` task is run and in that case, the API key invalidated will also get deleted. If the `ExpiredApiKeysRemover` runs before the API key invalidation is indexed then the API key is not deleted and will be deleted in the future run. This behavior was not captured in the tests related to `ExpiredApiKeysRemover` causing intermittent failures. This commit fixes those tests by checking if the API key invalidated is reported back when we get API keys after invalidation and perform the checks based on that. Closes #41747 04 October 2019, 03:18:08 UTC
c5b39fd Limit number of retaining translog files for peer recovery (#47414) Today we control the extra translog (when soft-deletes is disabled) for peer recoveries by size and age. If users manually (force) flush many times within a short period, we can keep many small (or empty) translog files as neither the size or age condition is reached. We can protect the cluster from running out of the file descriptors in such a situation by limiting the number of retaining translog files. 04 October 2019, 00:46:11 UTC
08915b6 Fix dependency resolution conflict (#47531) 03 October 2019, 21:48:44 UTC
4975748 [DOCS] Reformat index recovery API docs (#46493) (#47528) 03 October 2019, 21:09:50 UTC
ee08db3 [DOCS] Reformat index shard stores API docs (#46504) 03 October 2019, 19:58:36 UTC
960647a [DOCS] Update painless statements with if/else example (#47485) 03 October 2019, 19:22:48 UTC
a7537a9 [DOCS] Fixes missing link title (#47481) 03 October 2019, 15:07:05 UTC
cd8bb6f [ML][Transform] Use field caps for mapping deductino (#46703) (#46743) 03 October 2019, 14:48:42 UTC
55a5a75 [ML] fix two datafeed flush lockup bugs (#46982) (#47025) * [ML] fix two flush lockup bugs * Addressing PR comments * moving debug logging line so it is only written on success 03 October 2019, 14:48:28 UTC
60b528f [DOCS] Change index name in rollover ILM example (#47492) The warning section above the example tells that index name has to end with the digits but the example itself uses index name without digits which is confusing. 03 October 2019, 13:26:42 UTC
bd6b05b [DOCS] Remove duplicated half-sentence from secure settings docs (#47498) 03 October 2019, 12:41:42 UTC
54906d5 [DOCS] Amends update datafeed API docs (#47448) 03 October 2019, 11:16:37 UTC
92ea624 Remove eclipse conditionals (#44075) * Remove eclipse conditionals We used to have some meta projects with a `-test` prefix because historically eclipse could not distinguish between test and main source-sets and could only use a single classpath. This is no longer the case for the past few Eclipse versions. This PR adds the necessary configuration to correctly categorize source folders and libraries. With this change eclipse can import projects, and the visibility rules are correct e.x. auto compete doesn't offer classes from test code or `testCompile` dependencies when editing classes in `main`. Unfortunately the cyclic dependency detection in Eclipse doesn't seem to take the difference between test and non test source sets into account, but since we are checking this in Gradle anyhow, it's safe to set to `warning` in the settings. Unfortunately there is no setting to ignore it. This might cause problems when building since Eclipse will probably not know the right order to build things in so more wirk might be necesarry. 03 October 2019, 11:08:03 UTC
26a57b4 Fix es.http.cname_in_publish_address Deprecation Logging (#47451) (#47497) Since the property defaulted to `true` this deprecation logging runs every time unless its set to `false` manually (in which case it should've also logged but didn't). I didn't add a tests and removed the tests we had in `7.x` that covered this logging. I did move the check out of the `if (InetAddresses.isInetAddress(hostString) == false) {` condition so this is sort-of covered by the REST tests. IMO, any unit-test of this would be somewhat redundant and would've forced adding a field that just indicates that the deprecated property was used to every instance which seemed pointless. Closes #47436 03 October 2019, 10:47:23 UTC
e82ccbf Remove string interning from release notes (#47489) This commit removes the string interning issue and PR from the 7.4.0 release notes. The PR https://github.com/elastic/elasticsearch/pull/41039 was closed and not merged. 03 October 2019, 09:00:33 UTC
9e974c2 Add realm uniqueness enforcement in 7.4 migration docs (#47487) Add the change to the migration docs as it was omitted in #46253 03 October 2019, 08:04:41 UTC
f7c714c Fix Active Directory tests (#47460) Fixes multiple Active Directory related tests that run against the samba fixture. Some were failing since we changed the realm settings format in 7.0 and a few were slightly broken in other ways. We can move to cleanup the tests in a follow up but this work fits better to be done with or after we move the tests from a Samba based fixture to a real(-ish) Microsoft Active Directory based fixture. Resolves: #33425, #35738 03 October 2019, 04:45:34 UTC
57d52ac Always flush in FullClusterRestartIT#testRecovery (#47465) The pattern in the latest failure is similar to the source fixed in #46956 but relates to synced-flush. If peer recovery happens after indexing, and indexing flushes some shard at the end, then a synced flush in the test will not roll or commit translog. Closes #46712 03 October 2019, 02:01:32 UTC
c164b9b Add client jar for mapper-extras (#47430) The rest high level client has a dependency on mapper-extras but the jar is not published so this commit adds a client jar for this module. Closes #47413 02 October 2019, 23:24:36 UTC
d784944 [DOCS] Change xrefs to external links in 7.4 rls highlights (#47474) 02 October 2019, 20:57:11 UTC
d702ea3 [DOCS] Deletes prematurely documented outlier detection parameters. (#47457) 02 October 2019, 15:36:00 UTC
3fb2393 Update evaluate-dfanalytics.asciidoc (#47432) 02 October 2019, 11:27:59 UTC
0d89aac Fix XPackPlugin usages in tests (#47252) XPackPlugin holds data in statics and can only be initialized once. This caused tests to fail primarily when running with a low max-workers. Replaced usages with the LocalStateCompositeXPackPlugin, which handles this properly for testing. 02 October 2019, 10:42:25 UTC
f840112 Reset Token position on reuse in scripted analysis (#47424) Most of the information in AnalysisPredicateScript.Token is pulled directly from its underlying AttributeSource, but we also keep track of the token position, and this state is held directly on the Token. This information needs to be reset when the containing ScriptFilteringTokenFilter or ScriptedConditionTokenFilter is re-used. Fixes #47197 02 October 2019, 10:34:48 UTC
8117f8a MockSearchService concurrency fix (#47139) Fixed MockSearchService concurrency, assertNoInFlightContext could have false negative result (rarely). Split out from #46060 Closes #47048 02 October 2019, 10:33:43 UTC
5a28e14 [ML] Throttle the delete-by-query of expired results (#47177) Due to #47003 many clusters will have built up a large backlog of expired results. On upgrading to a version where that bug is fixed users could find that the first ML daily maintenance task deletes a very large amount of documents. This change introduces throttling to the delete-by-query that the ML daily maintenance uses to delete expired results to limit it to deleting an average 200 documents per second. (There is no throttling for state/forecast documents as these are expected to be lower volume.) Additionally a rough time limit of 8 hours is applied to the whole delete expired data action. (This is only rough as it won't stop part way through a single operation - it only checks the timeout between operations.) Relates #47103 02 October 2019, 10:20:31 UTC
back to top