sort by:
Revision Author Date Message Commit Date
23bb761 Bump versions after 7.17.17 release 23 January 2024, 17:32:08 UTC
b41b0e8 Add release notes for 7.17.17 (#104632) 22 January 2024, 23:00:17 UTC
6e0679d [7x] upgrade aws client depdencies (#104346) This commit bumps the aws client dependencies from from 1.11.749 to 1.12.270. This aligns the versions used in 7.17.x with main. (partial) backport of https://github.com/elastic/elasticsearch/pull/88932 22 January 2024, 15:52:12 UTC
4ba1572 Create extract/tag versions gradle task for 7.17 (#104532) Create a gradle task to extract version information for the new build release tag build infrastructure. This also defines a dummy tagVersions task that is implemented on v8 but doesn't have anything to do on 7.17. 22 January 2024, 11:25:05 UTC
6481e8a Fix deleting index during snapshot finalization (#104380) * Fix deleting index during snapshot finalization Today if an index is deleted during a very specific order of snapshot finalizations then it's possible we'll miscalculate the latest shard generations for the shards in that index, causing the deletion of a shard-level `index-UUID` blob which prevents further snapshots of that shard. Backports #103817 to 7.17 Closes #101029 * Test fixup 18 January 2024, 10:38:18 UTC
aba4da4 [7.17] Upgrade bundled JDK to 21.0.2 (#104481) (#104486) * Upgrade bundled JDK to 21.0.2 (#104481) # Conflicts: # gradle/verification-metadata.xml * Update verification metadata 17 January 2024, 20:44:50 UTC
af3f8e5 [7.17] Update ExecutorScalingQueue to workaround LinkedTransferQueue JDK bug (#104347) (#104425) * Update ExecutorScalingQueue to workaround LinkedTransferQueue JDK bug (#104347) This commit adds a few overrides to ExecutorScalingQueue (subclass of LinkedTransferQueue) to workaround a JDK bug in LinkedTransferQueue. * remove usage of var * fix compilation 17 January 2024, 11:24:04 UTC
b6114f4 Fix snapshot version in `createSnapshotLegacy` (#104354) We shouldn't use `Version#CURRENT` for the snapshot version anywhere, but especially not on the legacy path. Closes #86889 15 January 2024, 09:16:41 UTC
0ad0ddd [ci] Add Amazon Linux 2 to platform support pipeline (#104229) (#104286) (cherry picked from commit a354b45613bc1b1170656e37684b62886638e191) 12 January 2024, 16:40:58 UTC
aed04c0 Backport update versions task to 7.17 (#104303) Copy update version gradle task from #103335 to 7.17 for future 7.17 releases 12 January 2024, 16:01:23 UTC
20b46d1 [7x] bump dependency in discovery azure classic plugin (#104171) This commit bumps commons-io for discover azure classic plugin from 2.4 -> 2.7 11 January 2024, 15:49:45 UTC
f83dd8e Fix cancellation order in CancellableRateLimitedFluxIterator (#104259) (#104263) Closes #103054 11 January 2024, 14:38:16 UTC
9923a87 Remove BWC testing of snapshot 6.8 versions (#104226) 10 January 2024, 22:21:56 UTC
f82944c [7x] ingest attachment dependency version bumps (#104169) This commit bumps the follow dependency version for the ingest attachment plugin: tika-core 1.27 -> 1.28.5 tika-parsers 1.27 -> 1.28.5 commons-io 2.6 -> 2.11 fontbox 2.0.24 -> 2.0.26 poi 4.1.2 -> 5.2.2 poi-ooxml 4.1.2 -> 5.2.2 and poi-/ooxml-schemas is now poi-ooxml-lite and is using 5.2.2 (see poi.apache.org/changes.html) xmlbeans 3.0.1 -> 5.0.3 These versions were chosen from one of the following POM files: repo1.maven.org/maven2/org/apache/tika/tika-parent/1.28.5/tika-parent-1.28.5.pom repo1.maven.org/maven2/org/apache/tika/tika-parsers/1.28.5/tika-parsers-1.28.5.pom repo1.maven.org/maven2/org/apache/tika/tika-core/1.28.5/tika-core-1.28.5.pom repo1.maven.org/maven2/org/apache/poi/poi-ooxml-lite/5.2.2/poi-ooxml-lite-5.2.2.pom 10 January 2024, 22:01:30 UTC
ebe2e02 Disable BWC tests from "monolithic" CI jobs (#104221) (#104225) # Conflicts: # .buildkite/pipelines/periodic.template.yml # .buildkite/pipelines/periodic.yml # .buildkite/scripts/encryption-at-rest.sh # .buildkite/scripts/release-tests.sh 10 January 2024, 18:54:02 UTC
6868f0c Remove FIPS testing for Java 17 and 18 10 January 2024, 16:36:44 UTC
fe091e8 Fix discovery-gce when run in FIPS mode (#104179) * Fix discovery-gce when run in FIPS mode * dummy commit to re-kick off build * spotless 10 January 2024, 14:51:29 UTC
d035dff Tag individual CI job name axis in build scans (#104168) (#104178) # Conflicts: # .buildkite/pipelines/periodic.template.yml 10 January 2024, 00:24:14 UTC
b5afdb7 [dra] Trigger elasticsearch-hadoop dra build whenever we build a new staging artifact (#104084) (#104096) (cherry picked from commit 6a386ba20a4611d83d67f6288f02c42ddee9f533) 09 January 2024, 21:11:52 UTC
5ef0189 Revert "Add Java 22 to testing matrix" This reverts commit e39f00facc3c392609ec56460dac6b216c200a8c. 09 January 2024, 18:01:16 UTC
8846fbe Revert "Remove additional matrix dimension in Java compatibility testing" This reverts commit 0d887b1ae2f824089dcedda4a6d3e53c229c973e. 09 January 2024, 18:01:07 UTC
93af646 [7.x] Sync discovery_gce versions with main (#104086) This commit syncs the dependencies for discovery GCE plugin with the dependency versions in use in main. Specifically, this commit upgrades the following for the discovery GCE plugin: com.google.apis:google-api-services-compute:v1-rev160-1.23.0 -> v1-rev20220322-1.32 com.google.api-client:google-api-client:1.23.0 -> 1.33.1 com.google.oauth-client:google-oauth-client:1.23.0 -> 1.34.1 com.google.code.findbugs:jsr305:1.3.9 -> 3.0.2 and introduces the following for the discovery GCE plugin: api "com.fasterxml.jackson.core:jackson-core:${versions.jackson}" api "com.google.http-client:google-http-client-gson:1.41.1" runtimeOnly 'com.google.guava:guava:32.0.1-jre' runtimeOnly 'com.google.guava:failureaccess:1.0.1' api 'io.opencensus:opencensus-api:0.30.0' api 'io.opencensus:opencensus-contrib-http-util:0.30.0' api 'io.grpc:grpc-context:1.27.2' backport of #85132 and #91722 09 January 2024, 17:28:32 UTC
a586ac7 [7.x] Bump protobuf version for repository hdfs (#104076) This commit bumps the protobuf version for in 7.x to match the version used in main. Main has been running this version since #92123 09 January 2024, 16:00:55 UTC
034b8ec [7.x] Bump commons codec version (#104106) This commit bumps common-codec from 1.11 to 1.15 09 January 2024, 15:19:44 UTC
2aeecfd [7.17] Manual backport of 103944 (#104016) * Manual backport of 103944 * copy RegisteredDomainProcessorTests#testBasic from main 08 January 2024, 16:31:01 UTC
77bf12f Upgrade Bouncy Castle jars (except for the FIPS jars) (#103818) This commit upgrades the non-FIPS jars to the lastest available versions for 7.17. Bouncy Castle slightly changed their naming as evident by bouncycastle.org/latest_releases.html They no longer maintain a jdk15on library and instead use strategy for [1.5->1.8) and [1.8 -> ). This commit adopts the jdk18on libraries with the latest version. related: #100923 05 January 2024, 22:32:05 UTC
8b62001 bump junit version (#103941) (#103989) This commit bumps the junit version from 4.12 to 4.13.2 05 January 2024, 16:04:51 UTC
a3c4b08 Upgrade Bouncy Castle FIPS jars for plugin cli (#103801) This commit upgrades bc-fips and bcpg-fips to the lastest available versions for 7.17. related: #100923 05 January 2024, 14:28:21 UTC
0d887b1 Remove additional matrix dimension in Java compatibility testing 04 January 2024, 22:13:46 UTC
8340d3b [ci] Add/update docs for .buildkite dir and PR pipeline generator (#103936) (#103940) (cherry picked from commit b8009d1b1eef2cc97c92771ebb9f930eeb7651c5) 04 January 2024, 22:05:26 UTC
e39f00f Add Java 22 to testing matrix 04 January 2024, 18:38:13 UTC
68e2508 [7.17] [Test] Use larger client ports range for tests running on Windows (#103894) (#103914) * [Test] Use larger client ports range for tests running on Windows (#103894) This PR increases client's port ranges for tests which are executed on Windows in order to avoid failures due to some port ranges being excluded from use. The larger ports range (300) is chosen based on the observation where a random consecutive range of 200 ports can be excluded on Windows test workers. Closes #102349 (cherry picked from commit bdf5c7fc383e8bfba402bc3a31829f45d9964599) # Conflicts: # modules/transport-netty4/src/internalClusterTest/java/org/elasticsearch/transport/netty4/Netty4TransportMultiPortIntegrationIT.java # x-pack/plugin/security/src/internalClusterTest/java/org/elasticsearch/xpack/security/transport/filter/IpFilteringIntegrationTests.java * Fix compilation error 04 January 2024, 15:00:23 UTC
a8d9293 Only run snyk for 7.17 and main branch (#103820) (#103842) 03 January 2024, 09:05:15 UTC
8e5de13 Support different snyk organisations (#97808) (#103825) Tweaks our snyk integration to support different snyk orgs which is required to have support for elasticsearch serverless. Also replaces hardcoded remote url property by a dynamic version that resolves that property from the git origin url. (cherry picked from commit 3e13bd4d4c60636233509286c8a3f394dfe9300f) 02 January 2024, 22:44:09 UTC
759e3f6 [7.17] Reference stored scripts in snapshot restore (#102966) (#103046) Backports the following commits to 7.17: Reference stored scripts in snapshot restore (Reference stored scripts in snapshot restore #102966) 20 December 2023, 12:34:33 UTC
d61e9dc Correct docs tcp retries timeout (#102968) (#103044) Closes #102788 20 December 2023, 11:20:47 UTC
bfe46b4 [7.17] Add full GC fallback within the current attempt (#102563) (#103505) * Add full GC fallback within the current attempt (#102563) * Add full GC fallback within the current attempt * Try re-acquire the lock if we timed out due to a full GC * Condition full GC to memory reclaimed only * Fix: transform record to private static class 18 December 2023, 14:47:40 UTC
41afa78 [ci] Add amazon-2023 to platform-support matrix (#103466) (#103479) (cherry picked from commit 2517d5c065a03d409f55806dc1c97bfb80146b66) 14 December 2023, 21:19:05 UTC
450dfc5 [7.17] Dispatch ClusterStateAction#buildResponse to executor (#103435) (#103443) If waiting for a particular cluster state (e.g. on the CCR leader) we will compute the resulting cluster state and serialize it on the cluster applier thread, which can be too expensive in a large cluster for this thread. With this commit we dispatch the final action back to the original executor. 14 December 2023, 15:48:09 UTC
c77b9e9 Prune changelogs after 7.17.16 release 13 December 2023, 15:49:18 UTC
4c7876d Bump versions after 7.17.16 release 13 December 2023, 15:48:34 UTC
c716374 [DOCS] Add canonical link to quickstart (#103392) 13 December 2023, 13:51:59 UTC
e7dabf0 Disable incremental compilation in CI environments (#103346) (#103349) 12 December 2023, 22:07:11 UTC
f48406b [DOCS] Add security update to 7.17.16 RNs (#103336) 12 December 2023, 21:23:10 UTC
ac8c591 [7.17] [Docs] Custom S3 CA must be reinstalled on upgrade (#103168) (#103248) * [Docs] Custom S3 CA must be reinstalled on upgrade (#103168) This commit updates the docs to call out that custom certificate authorities for S3 repositories will need to be reinstalled every time ES is upgraded, is the node is using the bundled JDK * Fix cross-book reference 12 December 2023, 01:23:14 UTC
1a99785 Wrap painless explain error (#103151) (#103236) In https://github.com/elastic/elasticsearch/pull/100872 Painless errors were wrapped so as to avoid throwing Errors outside scripting. However, one case was missed: PainlessExplainError which is used by Debug.explain. This commit adds the explain error to those that painless wraps. closes #103018 09 December 2023, 15:00:17 UTC
2b23fa0 Update docs for v7.17.16 release (#103086) 06 December 2023, 22:01:45 UTC
08ffe30 Update IronBank docker image base to ubi:9.3 (#102721) (#103077) # Conflicts: # distribution/docker/src/docker/Dockerfile Co-authored-by: Jon <jon@elastic.co> 06 December 2023, 19:10:42 UTC
253f1f4 [7.17] [ILM] More resilient when a policy is added to searchable snapshot (#102741) (#103070) * Backport #102741 06 December 2023, 18:08:15 UTC
522439b Fix Windows tcpretries as well (#103048) (#103051) In previous PR #102968 fixed the Linux value but not the Windows one. Relates #102788 06 December 2023, 13:47:55 UTC
b9fe907 [Transform] Ensure transform updates only modify the expected transform task (#102934) (#102941) (cherry picked from commit 67ab4b46ea380d565f7ae2bec0a3d95587613a42) # Conflicts: # x-pack/plugin/core/src/test/java/org/elasticsearch/xpack/core/transform/action/UpdateTransformActionRequestTests.java 04 December 2023, 19:06:18 UTC
dbd82ac Suppress gradle welcome messages (#102898) (#102911) There are not usefuil for us (cherry picked from commit 7e24080fb26a88d7b1a0b897ef425317251747d5) 04 December 2023, 11:08:32 UTC
6da33dc Update IronBank BASE_IMAGE with ironbank prefix (#102720) (#102838) This supports local testing. It should not be included in hardening_manifest.yml, which injects the scope at runtime. # Conflicts: # distribution/docker/src/docker/Dockerfile Co-authored-by: Jon <jon@elastic.co> 30 November 2023, 22:21:41 UTC
5661f5f [7.17] Update gradle wrapper to 8.5 (#102154) (#102816) * Update gradle wrapper to 8.5 (#102154) Update BuildLayout references * Remove non existent project 30 November 2023, 20:03:30 UTC
096e8cc [Backport] Upgrade reactor netty http to v1.0.39 and reactor core to v3.4.34 (#102629) This PR upgrades the version of reactor-netty-http library to the latest v1.0.39 version and its transitive dependencies reactor-core to v3.4.34 and reactor-netty-core to v1.0.39. Backport of #102311 --------- Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> 29 November 2023, 13:59:22 UTC
8cfadd0 Set NEEDRESTART_MODE=l 28 November 2023, 22:08:26 UTC
33cbb8e Add more logging to the real memory circuit breaker and lower minimum interval (#102396) (#102443) It lowers the minimumInterval from 5000ms to 500ms as we observed high number of CBEs when there are bursting allocations in newer JDKs. 22 November 2023, 07:44:30 UTC
5bb05c3 Remove verbose debug logger (#102318) (#102421) This commit removes a debug logger which can be overly verbose. (cherry picked from commit 19a762b8f541b0bb94bd5b160a6e6b2ce14468b9) 21 November 2023, 16:18:39 UTC
cd08b1e Improve painless error wrapping (#100872) (#102394) * Improve painless error wrapping (#100872) Painless sandboxes some errors from Java for which it can recover. These errors are wrapped within a ScriptException. However, retaining the error as a cause can be confusing when walking the error chain. This commit wraps the error so that the real error type does not appear, but maintains the same error message in xcontent serialized form. * fix compile 20 November 2023, 23:35:16 UTC
4992962 [7.17] Unwrap exception more tenaciously in testQueuedOperationsAndBrokenRepoOnMasterFailOver (#102352) (#102368) * Unwrap exception more tenaciously in testQueuedOperationsAndBrokenRepoOnMasterFailOver (#102352) There can be more than 10 layers of wrapping RTEs, see #102351. As a workaround to address the test failure, this commit just manually unwraps them all. Closes #102348 * Fixup 20 November 2023, 09:08:45 UTC
b45d4c0 [ci] Add a way to trigger the entire regular PR pipeline via comment (#102256) (#102263) 15 November 2023, 20:48:49 UTC
c4cd840 [ci] Increase memory for BWC steps by moving to n1-standard-32 (#102106) (#102253) 15 November 2023, 19:52:53 UTC
4aa5175 [7.17][doc] Add known issue to all versions affected by GC behaviour change (#102124) * Added known issue for changes to GC in JDK 20/21 * Updated reference/link 14 November 2023, 13:47:37 UTC
803e013 Prune changelogs after 7.17.15 release 14 November 2023, 07:29:41 UTC
1a67f09 Bump versions after 7.17.15 release 14 November 2023, 07:29:05 UTC
e712b31 Update docs for v7.17.15 release (#102077) 13 November 2023, 13:51:21 UTC
0b8ecfb [ci] Fix build scan annotations on Windows (#101990) (#102028) (cherry picked from commit f20ae0e363e40ace2a96f239be43825dace92c37) 10 November 2023, 17:07:48 UTC
5ab8599 Protect NodeConnectionsService from stale conns (#101988) A call to `ConnectionTarget#connect` which happens strictly after all calls that close connections should leave us connected to the target. However concurrent calls to `ConnectionTarget#connect` can overlap, and today this means that a connection returned from an earlier call may overwrite one from a later call. The trouble is that the earlier connection attempt may yield a closed connection (it was concurrent with the disconnections) so we must not let it supersede the newer one. With this commit we prevent concurrent connection attempts, which avoids earlier attempts from overwriting the connections resulting from later attempts. Backport of #92558 When combined with #101910, closes #100493 09 November 2023, 21:13:03 UTC
7d975ab Delay Connection#onRemoved while pending (#101910) Today we call `Transport.Connection#onRemoved`, notifying any removed-listeners, when the connection is closed and removed from the `connectedNodes` map. However, it's possible for the connection to be closed while we're still adding it to the map and setting up the listeners, so this now-dead connection will still be found in the `pendingConnections` and may be returned to a future call to `connectToNode` even if this call was made after all the removed-listeners have been called. With this commit we delay calling the removed-listeners until the connection is closed and removed from both the `connectedNodes` and `pendingConnections` maps. Backport of #92546 to 7.17 Relates #100493 09 November 2023, 19:53:16 UTC
e573c1d Fail listener on exception in TcpTransport#openConnection (#101907) (#101955) Today `TcpTransport#openConnection` may throw exceptions on certain kinds of failure, but other kinds of failure are passed to the listener. This is trappy and not all callers handle it correctly. This commit makes sure that all exceptions are passed to the listener. Closes #100510 09 November 2023, 13:09:11 UTC
4d7f289 Fail cancelled CS requests without redundant wait for state update (#101905) Just fail the request right away if it got cancelled. Backports #96869 to 7.17 Closes #100671 Co-authored-by: Armin Braun <me@obrown.io> 08 November 2023, 12:00:12 UTC
8206af4 AwaitsFix for #101462 03 November 2023, 17:28:11 UTC
8bb7093 Use separate buildkite annotation context for failed build scans (#101740) (#101749) 03 November 2023, 17:11:12 UTC
f904dfa [ci] Add rocky-9 to matrix in packaging and platform jobs (#101653) (#101782) (cherry picked from commit a36156e1e64a9237c390b195be447dbdcb47e0d8) 03 November 2023, 15:42:55 UTC
9b8fdfc [ci] Don't run snyk step outside of main dev branches (#101729) (#101746) (cherry picked from commit c13350cc63788f058b8dcb051b9aa6129b209399) 02 November 2023, 21:05:07 UTC
eaf0591 [ci] Don't generate CI artifact for nested builds, tweak build scan data (#101690) (#101732) (cherry picked from commit 367e850da9bfb0e25ef2e52806b9a3231beee4b2) 02 November 2023, 19:47:58 UTC
60cb462 [ci] Migrate branch consistency and protection checks to Buildkite (#101646) (#101737) (cherry picked from commit dee880a49bd51f6656ea67f8fe86628830cb684b) 02 November 2023, 19:47:44 UTC
5061954 Fix race condition in SnapshotsService (#101652) (#101688) * Fix race condition in SnapshotsService * Update docs/changelog/101652.yaml 01 November 2023, 20:30:24 UTC
38d3db5 [ci] Disable intake jobs in Jenkins (#101641) (#101645) 31 October 2023, 18:38:36 UTC
62be6f9 [ci] Migrate third-party tests fully to Buildkite (#101562) (#101565) (cherry picked from commit 0ff3ae428ddffb5b172a37b7c9f69dc107df9ee1) 30 October 2023, 19:40:23 UTC
56eed56 Clarify that duplicate _name values for queries in the same request is undefined (#101523) (#101559) relates to: #101480 30 October 2023, 19:22:15 UTC
2939c26 [7.17] [buildkite] Upload build artifact and add to build scan (#100842) (#100861) 30 October 2023, 17:13:01 UTC
8196483 Updating percolate query docs to account for custom similarity limitation (#101386) (#101442) 27 October 2023, 11:12:21 UTC
42635c5 [ci] Disable remaining periodic jobs in Jenkins, except third-party tests (#101403) (#101407) (cherry picked from commit e89d245d53787fb22f43e2fa5f66848ac4479bc9) 26 October 2023, 20:21:57 UTC
0aa8cda Update IronBank docker image base to ubi:9.2 (#101393) (#101402) # Conflicts: # distribution/docker/src/docker/Dockerfile # distribution/docker/src/docker/iron_bank/hardening_manifest.yaml 26 October 2023, 19:48:59 UTC
36e5d26 Unmute PkiAuthDelegationIntegTests (#101280) (#101351) These tests were muted both at the suite level as well as at the test level for reasons I don't fully understand, and then were unmuted at one level but not the other. They don't appear to fail after a few thousand runs, so this PR unmutes them the rest of the way. 25 October 2023, 21:51:31 UTC
5847af2 [ci] Remove unused jjbb variable (#101343) (cherry picked from commit 91e5259f7402de0783589fdc7d34c59bbcc6d77f) 25 October 2023, 18:27:01 UTC
51d907b [7.17] Include branch information in build scans for buildkite jobs (#101284) (#101290) * Include branch information in build scans for buildkite jobs (#101284) # Conflicts: # build-tools-internal/src/main/groovy/elasticsearch.build-scan.gradle * Align with other branches 24 October 2023, 22:36:28 UTC
ac783bb Update bundled JDK to 21.0.1 (#101133) (#101228) * Update docs/changelog/101133.yaml (cherry picked from commit f0ef872c2cff6219707d469718acc8c3df5a5578) 24 October 2023, 14:05:08 UTC
c1db0bf [ci] Disable periodic java-matrix, java-fips-matrix, and bwc jobs in Jenkins (#101234) (#101244) (cherry picked from commit 6e6e85d0b4566eb9b7903708c92783adb49098d7) 23 October 2023, 20:24:20 UTC
945a13d [buildkite] Do collapsing annotations for Terrazzo pipelines as well (#101241) (cherry picked from commit 24ef5173557fb456da1dcca22ebeafeae1b24d4d) 23 October 2023, 20:21:21 UTC
5e7ca59 [buildkite] Increase release-tests timeout (#101238) (cherry picked from commit 4d10ea18497062b26c06a265e499cd56dd85bf60) 23 October 2023, 20:06:36 UTC
53c09f4 Disable packaging tests in Jenkins (#101088) (#101223) (cherry picked from commit 5d14bca37de24363a78b8d9c2345d3230fb8596d) 23 October 2023, 15:36:27 UTC
cadd3d3 [7.17] Remove translog from bwc testRecovery (#101068) (#101104) * Remove translog from bwc testRecovery (#101068) When the test was trying to test recovering translog ops, since we flush on close/shutdown, it failed because it never recovered any translog ops. The code for translog recovery is irrelevant due to that and this PR proposes to remove it. Alternatively, we could simulate killing nodes forcibly before upgrading, but (a) that seems out of the ordinary for upgrades, and (b) in trying that, it did not consistently pass the test because sometimes the flush on close still happened. Fixes #52031 * Fix 19 October 2023, 09:47:09 UTC
9268227 [buildkite] Remove idp-fixture docker-compose wait and bump check task agent memory (#101059) (#101075) 18 October 2023, 16:04:18 UTC
b249462 [7.17] `WaitForSnapshotStep` verifies if the index belongs to the latest snapshot of that SLM policy (#100911) (#101030) * `WaitForSnapshotStep` verifies if the index belongs to the latest snapshot of that SLM policy (#100911) The `WaitForSnapshotStep` used to check if the SLM policy has been executed after the index has entered the delete phase, but it did not check if the SLM policy included this index. The result of this is that if the user used an SLM policy that did not include this index, when the index would enter the `WaitForSnapshotStep`, it would wait for a snapshot to be taken, a snapshot that would not include the index, and then ILM would delete the index. See the exact reproduction path: https://github.com/elastic/elasticsearch/issues/57809 **Solution** This PR, after it finds a successful SLM run, it verifies if the snapshot taken by SLM contains this index. If not it throws an error, otherwise it proceeds. ILM explain will report: ``` "step_info": { "type": "illegal_state_exception", "reason": "the last successful snapshot of policy 'hourly-snapshots' does not include index '.ds-my-other-stream-2023.10.16-000001'" } ``` **Backwards compatibility concerns** In this PR, the `WaitForSnapshotStep` changed from `ClusterStateWaitStep` to `AsyncWaitStep`. We do not think this is gonna cause an issue. This was tested manually by the following steps: - Run a master node with the old version. - When ILM is executing `wait-for-snapshot`, we shutdown the node - We start the node again with the new version os ES - ES was able to pick up the step and continue with the new code. We believe that this covers bwc concerns. Fixes: https://github.com/elastic/elasticsearch/issues/57809 (cherry picked from commit 5697fcf594433bff8cc2fe97de71e52b49f0ac63) 18 October 2023, 09:33:22 UTC
28c0147 Update task name on ARM platform support CI job 17 October 2023, 22:21:12 UTC
23db6a8 [CI] Disable jenkins platform-support jobs, and re-enable all Buildkite periodic pipelines (#100630) (#101004) (cherry picked from commit b280a63eb70a040db7006665c67404c8a1ffdfde) 17 October 2023, 17:17:00 UTC
468bef1 [7.17] Update gradle wrapper to 8.4 (#99856) (#100926) * Remove deprecated forConfigurationTime usage 17 October 2023, 11:44:48 UTC
56f8e47 Add tolerance to ExtendedStatsAggregatorTests#testSummationAccuracy (#100917) (#100939) 17 October 2023, 06:47:25 UTC
back to top