sort by:
Revision Author Date Message Commit Date
0bd82d7 Provide defaults for number_of_replicas and number_of_shards 22 April 2014, 10:29:24 UTC
cdbab3c A new ClusterStateStatus to indicate cluster state life cycles When the ClusterService applies a new cluster state, it is first assigned as the new active one and then all listeners are called. Some of ES's features sample the current state and try to take action on it (for example index a document). If that fails, they will wait for change in the cluster state and try again (for example, wait for a shard to start and try indexing again). If you're unlucky you sample the state after it has been assigned as the "active" state but before all listeners has done the work. In this cases the action take (i.e., indexing a doc) will still fail (as the shard is not yet started) but waiting for a new state may take a long time or fail. This commit adds a new ClusterStateStatus that allows to better track the stages a cluster state goes through (currently `RECEIVED`, `BEING_APPLIED` & `APPLIED`). This allows detecting that a cluster state is not yet fully applied and retry without waiting for a new state to arrive. This commit also adds a utility class , ClusterStateObserver, to make this pattern slightly simpler and avoid common pit falls. Closes #5741 22 April 2014, 08:17:56 UTC
7824506 [TEST] Ensure that iteration order of TestSection is consistent 22 April 2014, 08:07:21 UTC
cf0acc8 [TEST] Remove ambigious 4th suggestion - order differs slightly on Java 8 22 April 2014, 07:57:28 UTC
b9ab161 [TEST] Added blacklist to be able to skip specific REST tests The blacklist can be provided through -Dtests.rest.blacklist and supports a comma separated list of globs e.g. -Dtests.rest.blacklist=get/10_basic/*,index/*/* Also added some missing docs and made it clearer that the suite/test descriptions effectively contains their (relative) path (api/yaml_file/test section) 22 April 2014, 07:51:29 UTC
9ca565c Return valid empty JSON response when no recovery information This is a fix to send back to the client a valid empty JSON response in the case when we have no recovery information. Closes #5743 21 April 2014, 23:56:03 UTC
4dc01aa Bug fix for hung clients on cluster without benchmark nodes This is a fix for a bug whereby a cluster that has no nodes started with -Des.node.bench=true will cause clients to hang if they attempt to submit a benchmark. Also adds REST tests to validate fix Closes #5754 21 April 2014, 23:44:09 UTC
7ec00e4 [TEST] make fetch time in millis test more resilient beef up the fetch work, and increase teh number of iterations (since we count in nanos, but reports in rounded millis) 21 April 2014, 22:02:15 UTC
0984753 Use loopback when localhost is not resolved we use the "local host" address in sevearl places in our networking layer, if local host is not resolved for some reason, still continue and operate but using the loopback interface 21 April 2014, 18:55:49 UTC
60c1794 Searcher might not be closed if store hande can't be obtained Today we first get a reference to the IndexSearcher in #acquireSearcher and then futher down we try to run Store#incRef() which might throw an exception if the store is already closed. There is a small window that allows this to happen during InternalEngine#close() when we try to acquire the searcher at the same time and the engine is the last resource that holds a reference to the store. This commit only affects unreleased code since the Store's ref counting has not yet been released. 21 April 2014, 18:38:34 UTC
8a5c388 Update benchmark.asciidoc Tidied benchmark docs 21 April 2014, 18:36:11 UTC
a75917c [Tests] SimpleRecoveryLocalGatewayTests.testSingleNodeNoFlush could fail if shards were not started The test starts a single node, indexes into, restarts the node and checks that no data was lost. It only indexed into 2 shards and didn't wait for green meaning that the node could be restarted with non-started primary. In that case the node will not re-assign the primary as it was not started. This commit makes sure that we either wait for primaries to start or index into all shards which has the same net effect. Also extending some logging in InternalIndexShard. 21 April 2014, 09:50:55 UTC
e03927b Update function-score-query.asciidoc 20 April 2014, 11:39:47 UTC
8bcc25f [Test] Let SuggestStatsTests.testSimpleStats do more work The test verifies that stats are measure by checking timeInMillis>0. On fast machines the suggestions are done in < 1 millis time. The tests now index documents (to power suggestions) and does multiple suggestions per iterations to slow things down. 19 April 2014, 15:48:54 UTC
22639ba Update forbidden-apis to 1.5.1 and remove the relaxed missing classes error. 19 April 2014, 06:58:52 UTC
85c76e3 Upgrade to mvel 2.2.0.Final closes #5877 18 April 2014, 19:53:40 UTC
aba52cc Fail replica shards locally upon failures When a replication operation (index/delete/update) fails to be executed properly, we fail the replica and allow master to allocate a new copy of it. At the moment, the node hosting the primary shard is responsible of notifying the master of a failed replica. However, if the replica shard is initializing (`POST_RECOVERY` state), we have a racing condition between the failed shard message and moving the shard into the `STARTED` state. If the latter happen first, master will fail to resolve the fail shard message. This commit builds on #5800 and fails the engine of the replica shard if a replication operation fails. This protects us against the above as the shard will reject the `STARTED` command from master. It also makes us more resilient to other racing conditions in this area. Closes #5847 18 April 2014, 16:58:27 UTC
b18114b [TEST] Make InternalEngineMergeTests more stable 18 April 2014, 16:22:19 UTC
345e195 Removed leading spaces on commented config key lines in elasticsearch.yml Author: Sean Gallagher Date: 17 Apr 2014 16:18 EDT Removed spaces on commented lines containing config key entries to prevent users from inadvertently messing up the indents in elasticsearch.yml. Closes #5842 18 April 2014, 16:02:12 UTC
21b3f59 [TEST] _id is not indexed by default, sort on score,_uid in MultiMatchQueryTests 18 April 2014, 13:09:23 UTC
d7b0a0d Moved the updateMappingOnMaster logic into a single place. Closes #5798 18 April 2014, 12:30:09 UTC
d5489b9 [TEST] added sort by "_id" when score is the same to MultiMatchQueryTests#testEquivalence A merge (and refresh) might rarely happen in the background between the two queries whose output is compared. It might then happen that two docs with same scores get returned by the two queries in a different order due to different lucene document id (which has changed in the meantime). To fix this we need to order by id when the score is the same, so that we can safely compare the output of the two queries (multimatch and dismax). 18 April 2014, 10:18:18 UTC
8af8aa8 Add a site plugin into list Howdy, Not sure if this is kosher but I would like to add my site plugin to the list in the docs. 17 April 2014, 17:28:49 UTC
bff9357 [BUILD] Fail release if test have AwaitsFix annotations Note this commit upgrades Forbidden APIs to version 1.5 Closes #5807 17 April 2014, 14:46:51 UTC
876d868 Update allocation.asciidoc 17 April 2014, 12:43:11 UTC
2213970 [TEST] Use startNodesAsync in unicast discovery tests. 17 April 2014, 04:51:42 UTC
b4e146c [DOCS] Make snapshot repository examples consistent 16 April 2014, 21:29:26 UTC
69c835d [TEST] make testTimeoutSendExceptionWithDelayedResponse more reliable on slow systems 16 April 2014, 20:59:44 UTC
3641e03 Added version constants for 1.1.2 and 1.0.4 16 April 2014, 15:21:08 UTC
f305082 [Test] InternalEngineTests: increased gc deletes interval & turn it off randomly 16 April 2014, 14:01:51 UTC
7b7aa85 Update multi-match-query.asciidoc Typo 16 April 2014, 13:41:06 UTC
3fac516 [TEST] Ignore bogus system properties. LuceneTestCase might reset some solr properties that cause our tests to fail if the run before in the same JVM We just ignore solr properties. 16 April 2014, 13:19:09 UTC
5af4ba9 [TEST] catch exceptions if TTL already expired when indexing TTLPercolatorTests indexes docs with small TTLs which can trigger AlreadyExpiredException exception. This is expected while rare and we should just catch them. 16 April 2014, 13:08:52 UTC
7e68bc6 Ensure close is called under lock in the case of an engine failure Until today we did close the engine without aqcuireing the write lock since most calls were still holding a read lock. This commit removes the code that holds on to the readlock when failing the engine which means we can simply call #close() 16 April 2014, 12:51:28 UTC
843f28b add debug logs if failed shards can not be resolved. 16 April 2014, 12:47:17 UTC
0c43641 [TEST] Reduce the amount of docs being indexed. 16 April 2014, 08:49:59 UTC
0832fde Better deal with invalid scroll ids. Closes #5738 16 April 2014, 07:16:36 UTC
c8361dc [TEST] Fix PercolatorTests#testSimple2 This test requires a mapping since otherwise if there is no mapping added the percolator query might not be parsed as a query on a numeric field since the query might arrive on a node before the dynamic mapping reached that node. This commit also moves the `indexService.readAllowed()` call up before the number of percolation queries is check to make sure we fail if reads are not allowed - there might be a query in-flight which means we need to check another node rather than return an empty result. 15 April 2014, 20:58:08 UTC
22af569 [TEST] Wait for green, and refresh after indexing in percolator test 15 April 2014, 17:18:51 UTC
1e8f5fc Remove garbage 15 April 2014, 15:57:32 UTC
2a56e77 [TEST] Don't delete data dirs after test - only delete their content. Closes #5815 15 April 2014, 15:04:50 UTC
6d0fa2f [DOCS] Update merge docs to reflect the max_merge_at_once property 15 April 2014, 14:44:47 UTC
bacba42 Switch back to ConcurrentMergeScheduler Load tests showed that SerialMS has problems to keep up with the merges under high load. We should switch back to CMS until we have a better story to balance merge threads / efforts across shards on a single node. Closes #5817 15 April 2014, 14:44:14 UTC
7f276ac [TEST] Wait for shards to be allocated before running testUpdateMappingDynamicallyWhilePercolating. If the percolate request is executed soon enough, all shards fail and the mapping is not actually updated. 15 April 2014, 14:21:40 UTC
07a5354 Update percolate.asciidoc fix typo 15 April 2014, 14:01:48 UTC
4c10afe Update core-types.asciidoc Missing bracket 15 April 2014, 13:57:20 UTC
61b8844 Updated date_formats to new dynamic_date_formats 15 April 2014, 13:44:02 UTC
4f5cb73 Update clusterstate if mapping service has local changes If the during percolating a new field was introduced in the local mapping service, then those changes should be updated in cluster state of the master as well. Closes #5776 15 April 2014, 11:43:10 UTC
9a02ea7 Cleanup FileSystemUtils#mkdirs(File) This methods had some workarounds for bugs that seem to be fixed in Java 7 [1]. There seem to be other problems on shared file-systems which are not really supported by lucene anyway or rather not recommeded. Yet the current solution that interrupts a static thread reference is too dangrous given all the usage of NIO across elasticsearch. [1] http://bugs.java.com/bugdatabase/view_bug.do?bug_id=4742723 15 April 2014, 11:24:43 UTC
ec6787f Remove FileSystemUtils#maxOpenFiles This method basically forcefully creates as many files as possible to find out the process limit in a brute-force manner. The number of possible probles with this approach would exceed the number of lines left on this commit message. This commit uses a JMX based alternative to print the process limit. 15 April 2014, 11:24:34 UTC
a40d59d Remove jsr166y now that we on Java 7, cleanup jsr166e to classes we use 15 April 2014, 11:17:50 UTC
5048838 Use TransportBulkAction for internal request from IndicesTTLService This prevents executing bulks internal autocreate indices logic and ensures that this internal request never creates an index automaticall. This fixes a bug where the TTL purger thread ran after the actual index it was purging was already closed / deleted and that re-created that index. Closes #5766 15 April 2014, 10:43:39 UTC
296b87e Separate benchmark API endpoints Separates benchmark API endpoints into separate files according to API funtionality. This makes it easier for our tests and clients. Closes #5787 15 April 2014, 03:35:24 UTC
83a330d Fix snapshot status with empty repository The snapshot status command with empty repository should return current status of currently running snapshots in all repositories. Fixes #5790 14 April 2014, 23:27:47 UTC
5a8b4d3 Benchmark documentation Moving benchmark documentation under the search section. Closes #5786 14 April 2014, 21:23:04 UTC
c52a304 Separate persistent and global metadata serialization settings 14 April 2014, 20:25:21 UTC
82ce2d2 [BUILD] remove leftover print statement 14 April 2014, 20:22:51 UTC
bb6faab Remove unused FileSystemUtils#copyFile 14 April 2014, 19:50:15 UTC
443ab1a Prevent fsync from creating 0-byte files This is related to LUCENE-5570 where fsync creates a 0-byte file if the file does not exists. This commit adds the patched lucene version using Java 7 APIs as well as a note to replace this method with the upcomeing IOUtils#fsync in Lucene 4.8 This commit cleans up FsImmutableBlobContainer#writeBlob to make use of Java7 Auto-Closing features and ensures that the directory the blob was written to is fsynced as well if possible. 14 April 2014, 19:50:09 UTC
3e55468 Check for no open issues before build release 14 April 2014, 16:54:41 UTC
8f16733 Upgrade to Lucene 4.7.2 14 April 2014, 16:45:40 UTC
d40394f Improved SearchContext.addReleasable. For resources that have their life time effectively defined by the search context they are attached to, it is convenient to use the search context to schedule the release of such resources. This commit changes aggregations to use this mechanism and also introduces a `Lifetime` object that can be used to define how long the object should live: - COLLECTION: if the object only needs to live during collection time and is what SearchContext.addReleasable would have chosen before this change (used for p/c queries), - SEARCH_PHASE for resources that only need to live during the current search phase (DFS, QUERY or FETCH), - SEARCH_CONTEXT for resources that need to live until the context is destroyed. Aggregators are currently registed with SEARCH_CONTEXT. The reason is that when using the DFS_QUERY_THEN_FETCH search type, they are allocated during the DFS phase but only used during the QUERY phase. However we should fix it in order to only allocate them during the QUERY phase and use SEARCH_PHASE as a life time. Close #5703 14 April 2014, 15:49:34 UTC
fb04c85 Make Releasable extend AutoCloseable. Java7's AutoCloseable allows to manage resources more nicely using try-with-resources statements. Since the semantics of our Releasable interface are very close to a Closeable, let's switch to it. Close #5689 14 April 2014, 15:24:25 UTC
a67eb38 equals()/hashCode() & tests for ByteArrays to avoid materializing a full byte[]. Fixes #5435 14 April 2014, 15:24:10 UTC
84e2c4c [TEST] Use indexRandom in ShardSizeTests. 14 April 2014, 10:33:21 UTC
ea633a2 Revert "Don't lookup version for auto generated id and create" This reverts commit b55020474d588586c6f962d436b502f5204fd9f3. 14 April 2014, 10:15:42 UTC
b550204 Don't lookup version for auto generated id and create When a create document is executed, and its an auto generated id (based on UUID), we know that the document will not exists in the index, so there is no need to try and lookup the version from the index. For many cases, like logging, where ids are auto generated, this can improve the indexing performance, specifically for lightweight documents where analysis is not a big part of the execution. 14 April 2014, 08:07:26 UTC
7b94b0e [DOCS] update old status of plugins 14 April 2014, 00:17:00 UTC
b8cd9d8 [TEST] Fix ClusterStatsTests#testValuesSmokeScreen to wait for yellow to get reliable FS stats. 12 April 2014, 21:02:14 UTC
da277b3 [TEST] use a real upperbound for the check on the time spend during suggestions 12 April 2014, 19:55:07 UTC
9e7348c [Test] should be abstract 12 April 2014, 14:15:29 UTC
81ed288 [TEST] Improve performance of MockBigArray MockPageRecycler 12 April 2014, 08:10:43 UTC
462e2c1 Ensure pending merges are updated on segment flushes Due to the default of `async_merge` to `true` we never run the merge policy on a segment flush which prevented the pending merges from being updated and that caused actual pending merges not to contribute to the merge decision. This commit also removes the `index.async.merge` setting is actually misleading since we take care of merges not being excecuted on the indexing threads on a different level (the merge scheduler) since 1.1. This commit also adds an additional check when to run a refresh since soely relying on the dirty flag might leave merges un-refreshed which can cause search slowdowns and higher memory consumption. Closes #5779 12 April 2014, 08:10:43 UTC
b93c003 PR #5706 introduced a bug in the sparse array-backed field data When we load sparse single valued data, we automatically assign a missing value to represent a document who has none. We try to find a value that will increase the number of bits needed to represent the data. If that missing value happen to be 0, we do no properly intialize the value array. This commit solved this problem but also cleans up the code even more to make spotting such issues easier in the future. 11 April 2014, 19:56:51 UTC
87328f6 Added awaitFix for SimpleNestedTests.testSortNestedWithNestedFilter While investigating failures 11 April 2014, 16:13:06 UTC
36c8958 Fix typos in percolate.asciidoc Close #5762 #5763 #5764 11 April 2014, 16:07:41 UTC
69e4666 ElasticsearchIllegalStateException when invoking _cat plugins Reproducible using ES 1.1.0. `/_cat/plugins` works fine when no plugins are installed. But once a plugin is installed (eg. latest marvel), it throws an exception indicating that the resulting table constructed has 7 fields in the header row but not enough fields in the data rows to make it a valid table. ``` { "status" : 500, "error" : "ElasticsearchIllegalStateException[mismatch on number of cells 6 in a row compared to header 7]" } ``` This issue has been introduced when we removed `isolation` feature in 1.1 branch. See c34d8bd. Closes #5715 (cherry picked from commit abc453daf368225c4dde8d7d0fb0acdda8644f5f) 11 April 2014, 15:11:46 UTC
04d513c Fixed- PackedArrayIndexFieldData.chooseStorageFormat compared to Long.MAX_VALUE instead of Long.MIN_VALUE Also made the LongFieldDataTests.SINGLE_VALUED_SPARSE_RANDOM & LongFieldDataTests.MULTI_VALUED_SPARSE_RANDOM more sparse 11 April 2014, 14:41:37 UTC
0659515 Added a AppendingDeltaPackedLongBuffer-based storage format to single value field data The AppendingDeltaPackedLongBuffer uses delta compression in paged fashion. For data which is roughly monotonic this results in reduced memory signature. By default we use the storage format expected to use the least memory. You can force a choice using a new field data setting `memory_storage_hint` which can be set to `ORDINALS`, `PACKED` or `PAGED` Closes #5706 11 April 2014, 13:56:51 UTC
4c8e4c5 Strengthening pseudo random number generator and adding tests to verify its behavior. Closes #5454 and #5578 11 April 2014, 12:03:51 UTC
49bf4ad Each search request should use a new InternalSearchResponse instance even in case when all shards return no hits. The InternalSearchResponse may get modified afterwards, so a new instance required at all times. 11 April 2014, 10:46:39 UTC
967301d [TEST] Prevent TTLPurger from recreating deleted index Related to #5766 11 April 2014, 07:05:23 UTC
e4b86e0 Ignored clear scroll rest test 11 April 2014, 06:49:36 UTC
78a9781 The clear scroll apis now optionally accepts a scroll_id in it body. Closes #5726 11 April 2014, 03:52:04 UTC
cab8c70 Fixed an where a nested `nested` aggregation falls outside of its parent `nested` aggregation bounds. The nested `nested` aggs now gets the proper parent docs that define its bounds correctly. Closes #5728 11 April 2014, 03:17:13 UTC
403508f [DOCS] Added tables and fixes to upgrade.asciidoc, fixed version in README.textile Author: Sean Gallagher Date: 10 Apr 2014 15:23 EDT 10 April 2014, 19:30:03 UTC
3d5024b [Docs] Add experimental highlighter plugin 10 April 2014, 17:39:55 UTC
11dc8b6 Added test with AwaitsFix annotation that simulates a split brain. 10 April 2014, 13:14:43 UTC
6125808 Use startNodesAsync in more tests 10 April 2014, 13:03:02 UTC
c6ebdde Update Eclipse configuration to Java 1.7. 10 April 2014, 09:43:55 UTC
f8a4948 [TESTS] Add more assertSearchResponse to aggregations tests. 10 April 2014, 09:35:22 UTC
0258568 [TEST] Allow higher ClusterHealthTimeout on tests if configuration is slow 10 April 2014, 08:49:46 UTC
4cbff41 Fix _bench endpoint specs to have the body on the right level in the json object 09 April 2014, 21:17:35 UTC
8a775bf Add better error reporting to RestApiParser if assertions are tripped 09 April 2014, 21:17:28 UTC
822b1c0 Benchmark API Add an API endpoint at /_bench for submitting, listing, and aborting search benchmarks. This API can be used for timing search requests, subject to various user-defined settings. Benchmark results provide summary and detailed statistics on such values as min, max, and mean time. Values are reported per-node so that it is easy to spot outliers. Slow requests are also reported. Long running benchmarks can be viewed with a GET request, or aborted with a POST request. Benchmark results are optionally stored in an index for subsequent analysis. Closes #5407 09 April 2014, 20:41:59 UTC
1f40aaf [Docs] Allocation setting explanation Closes #5748 09 April 2014, 18:12:05 UTC
33812ee Fix format string for DiskThresholdDecider reroute explanation 09 April 2014, 15:17:24 UTC
e7b50bd [TEST] MLT Rest test needs a mapping since we randomized number of nodes/shards 09 April 2014, 09:45:40 UTC
0762ad1 [TEST] RecoveryWhileunderLoadTests sometimes need higher timeouts In some cases when we have a lot of docs with lots of shards recovery takes longer than 1m causing the tests to fail before all shards are recovered. This commit raises the timeout in this test to 5m max while it's rarely needed. This commit also adds an assertion to ElasticsearchAssertions that ensures that the cluster health requests are not hitting a timeout. 09 April 2014, 09:39:22 UTC
b4250b8 [Test] recoverWhileRelocating: Increase timeout while waiting for shards to replicate. 08 April 2014, 18:57:29 UTC
back to top