330 Commits

Author SHA1 Message Date
Jason Tedor
ad7229fe72 Merge branch 'master' into feature/seq_no
* master: (158 commits)
  Document the hack
  Refactor property placeholder use of env. vars
  Force java9 log4j hack in testing
  Fix log4j buggy java version detection
  Make java9 work again
  Don't mkdir directly in deb init script
  Fix env. var placeholder test so it's reproducible
  Remove ScriptMode class in favor of boolean true/false
  [rest api spec] fix doc urls
  Netty request/response tracer should wait for send
  Filter client/server VM options from jvm.options
  [rest api spec] fix url for reindex api docs
  Remove use of a Fields class in snapshot responses that contains x-content keys, in favor of declaring/using the keys directly.
  Limit retries of failed allocations per index (#18467)
  Proxy box method to use valueOf.
  Use the build-in valueOf method instead of the custom one.
  Fixed tests and added a comment to the box method.
  Fix boxing.
  Do not decode path when sending error
  Fix race condition in snapshot initialization
  ...
2016-05-21 21:04:43 -04:00
Clinton Gormley
dafa78ec63 Revert "Doc: /_reindex: Add a note about the source size parameter"
This reverts commit 4de284866875b987110df66229fb7c7d0b9cd4d8.
2016-05-20 14:39:18 +02:00
Julien Pivotto
4de2848668 Doc: /_reindex: Add a note about the source size parameter
Closes #18484
2016-05-20 14:26:19 +02:00
Tanguy Leroux
a01ecb20ea Port Delete By Query to Reindex infrastructure
closes #16883
2016-05-19 16:07:50 +02:00
Nik Everett
fe4823eae0 Reindex should retry on search failures
This uses the same backoff policy we use for bulk and just retries until
the request isn't rejected.

Instead of `{"retries": 12}` in the response to count retries this now
looks like `{"retries": {"bulk": 12", "search": 1}`.

Closes #18059
2016-05-17 13:58:45 -04:00
Nik Everett
f569576c5b Switch default batch size for reindex to 1000 2016-05-16 08:19:29 -04:00
Jason Tedor
f6694beca0 Fix failing index doc tests
This commit fixes some failing doc tests due to sequence numbers and
shard IDs being in the response body but not in the expected response.
2016-05-15 21:29:43 -04:00
Lee Hinman
efff3918d8 Remove support for mulitple languages per scripting engine 2016-05-13 09:24:31 -06:00
Nik Everett
94317b1d33 Add wait_for_health=yellow to reindex snippets
This should help the tests pass more consistently. Should.

This also removes from `?pretty` from the docs. It isn't a thing
with `// CONSOLE`.

Relates to
https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+master+multijob-os-compatibility/os=oraclelinux/399/console
2016-05-12 12:20:06 -04:00
Clinton Gormley
3f594089c2 Renamed all AUTOSENSE snippets to CONSOLE (#18210) 2016-05-09 15:42:23 +02:00
Nik Everett
2528934411 CONSOLE is the new AUTOSENSE
This makes the test generation support both while we move from
`// AUTOSENSE` to `// CONSOLE`.

Will bother #18160
2016-05-09 09:23:23 -04:00
Nik Everett
4b1c116461 Generate and run tests from the docs
Adds infrastructure so `gradle :docs:check` will extract tests from
snippets in the documentation and execute the tests. This is included
in `gradle check` so it should happen on CI and during a normal build.

By default each `// AUTOSENSE` snippet creates a unique REST test. These
tests are executed in a random order and the cluster is wiped between
each one. If multiple snippets chain together into a test you can annotate
all snippets after the first with `// TEST[continued]` to have the
generated tests for both snippets joined.

Snippets marked as `// TESTRESPONSE` are checked against the response
of the last action.

See docs/README.asciidoc for lots more.

Closes #12583. That issue is about catching bugs in the docs during build.
This catches *some* bugs in the docs during build which is a good start.
2016-05-05 13:58:03 -04:00
Nik Everett
230697c202 [reindex] Switch throttle to Float.POSITIVE_INFITINTY/"unlimited"
All other values are errors.

Add java test for throttling. We had a REST test but it only ran against
one node so it didn't catch serialization errors.

Add Simple round trip test for rethrottle request
2016-05-04 16:14:32 -04:00
ericamick
f081bf4e26 Update bulk.asciidoc 2016-04-22 10:51:33 -06:00
ericamick
3004c45f7b Update update.asciidoc 2016-04-22 10:50:42 -06:00
ericamick
276b89242c Update get.asciidoc 2016-04-22 10:48:58 -06:00
Martijn van Groningen
81449fc912 percolator: renamed percolator query to percolate query 2016-04-20 15:23:54 +02:00
Martijn van Groningen
ba08313417 settings: Removed action.get.realtime setting
Closes #12543
2016-04-19 17:14:23 +02:00
Clinton Gormley
88c5dfeca4 Docs: Removed references to deprecated functionality
* search_type=count
* DFS in term vectors
* Replaced string with text/keyword as appropriate
2016-04-07 13:33:35 +02:00
Nik Everett
3caa5a929a Documentation for scroll size in reindex 2016-03-31 12:21:32 -04:00
Martijn van Groningen
6bcfc730d7 reindex: fix small documentation issues 2016-03-31 12:59:12 +02:00
Igor Motov
c356b30cff Update task management docs to reflect the latest changes in the interface
Brings docs in line with new list task syntax and adds task cancellation API docs.
2016-03-29 12:26:37 -04:00
Clinton Gormley
798e4281fa Added experimental annotation to the update-by-query and reindex docs 2016-03-29 15:06:27 +02:00
Clinton Gormley
978b24327e Docs: Included Nodes Task API and tidied reindex/update-by-query 2016-03-29 13:51:11 +02:00
Nik Everett
da96b6e41d [reindex] Add thottling support
The throttle is applied when starting the next scroll request so that its
timeout can include the throttle time.
2016-03-22 12:34:14 -04:00
Adrien Grand
b42f66c8ac Document 5.0 mapping changes. 2016-03-22 16:22:58 +01:00
Clinton Gormley
4506b7ad82 Docs: Fixed bad asciidoc link 2016-03-18 13:26:01 +01:00
Alexander Reelsen
2dffad9ec3 Docs: Display reindex/update by query API and fix build doc issue
The documentation existed, but was not linked anywhere.
Also fixed the docs to make sure they build with this enabled.
2016-03-18 10:44:16 +01:00
Clinton Gormley
a8c7ae7809 Fixed bad docs link 2016-03-10 13:08:29 +01:00
Clinton Gormley
f9622f9acc Docs: Added a note about the update API not supporting external versioning
Closes #12820
2016-03-10 12:33:39 +01:00
Nik Everett
d079830f10 [docs] Fix bad link in reindex docs 2016-03-04 14:34:30 -05:00
Nik Everett
22557621fe [docs] Docs for reindex using ingest pipeline 2016-03-04 10:05:13 -05:00
Geoff Wagstaff
06e2a8262d Fix use of apostrophe 2016-03-03 11:56:56 -07:00
Nik Everett
18808b7576 Move reindex from a plugin to a module 2016-02-11 17:39:49 -05:00
Clinton Gormley
6aa1a4930e Added back deprecation notices for _ttl and _timestamp 2016-01-26 11:56:36 +01:00
Clinton Gormley
c6956a9dc9 Merge pull request #16171 from dmydlarz/patch-1
Fix missing break line before unordered item list
2016-01-22 14:01:49 +01:00
Jim Ferenczi
776e5d8096 Separates routing and parent in all documentrequest in order to be able to distinguish an explicit routing value from a parent routing.
Resolves conflicts between parent routing and alias routing with the following rule:
    * The parent routing is ignored if there is an alias routing that matches the request.
Closes #3068
2015-12-21 09:44:57 +01:00
Clinton Gormley
bb8097a655 Merge pull request #14162 from GeorgiCodes/patch-2
minor fixes to doc
2015-10-16 18:26:52 +02:00
Clinton Gormley
dc018cf622 Updated docs for 3.0.0-beta 2015-10-07 13:27:46 +02:00
Clinton Gormley
fa77cf6f6f Docs: Always quote "@file" argument to --data-binary
Closes #13500
2015-09-19 17:28:15 +02:00
Clinton Gormley
2c20658204 Docs: Added deprecation notice for _timestamp and _ttl 2015-09-07 21:16:19 +02:00
Nik Everett
9eb684da51 Default detect_noop to true
detect_noop is pretty cheap and noop updates compartively expensive so this
feels like a sensible default.

Also had to do some testing and documentation around how _ttl works with
detect_noop.

Closes #11282
2015-08-27 10:34:18 -04:00
Nik Everett
2953985659 [docs] Document noop behavior of index api
Relates to #12969
2015-08-24 12:19:07 -04:00
kakakakakku
d7bf510fe0 Fixed section name and api name in docs 2015-08-18 19:26:23 +09:00
Clinton Gormley
c6c3a40cb6 Docs: Updated annotations for 2.0.0-beta1 2015-08-14 10:51:09 +02:00
Michael McCandless
ac2e0fd6a0 Remove delete-by-query core docs
We moved delete-by-query from core to a plugin, but forgot to remove the core docs.

Closes #12585
2015-08-01 05:14:46 -04:00
Jason Tedor
b61709c716 Add support for retrieving fields in bulk updates
This commit adds support to retrieve fields when using the bulk update API. This functionality was previously available for the update API
but not for the bulk update API.

Closes #11527
2015-07-08 12:06:20 -04:00
Simon Willnauer
fcdcce3bba Consolidate shard level abstractions
This commit consolidates several abstractions on the shard level in
ordinary classes not managed by the shard level guice injector.

Several classes have been collapsed into IndexShard and IndexShardGatewayService
was cleaned up to be more lightweight and self-contained. It has also been moved into
the index.shard package and it's operation is renamed from recovery from "gateway" to recovery
from "store" or "shard_store".

Closes #11847
2015-06-24 15:18:04 +02:00
Clinton Gormley
64581d66c9 Tidied up the update docs
Closes #9459
2015-06-19 17:29:11 +02:00
Boaz Leskes
f4a143d138 Clarify refresh parameter in the _bulk API
See #11690
Closes #11691
2015-06-17 08:47:40 +02:00