Michael McCandless
7ef43a22ff
limit the max size of bulk and index thread pools to bounded number of processors
2015-12-21 19:18:19 -05:00
Robert Muir
3c07a427dc
fix exc handling
2015-12-21 19:06:56 -05:00
Ryan Ernst
26eaa16a89
Remove "additional config" from hdfs repositories
2015-12-21 15:55:13 -08:00
Robert Muir
2cbfc54a81
avoid too-long classpath so it works on windows
2015-12-21 18:25:08 -05:00
Robert Muir
7065639a26
add test for listing
2015-12-21 17:25:15 -05:00
Robert Muir
5ebcf183e5
tests
2015-12-21 17:02:50 -05:00
Robert Muir
b8524bdb11
add tests
2015-12-21 16:16:24 -05:00
Simon Willnauer
98f9749ee1
fix visibility
2015-12-21 22:12:32 +01:00
Simon Willnauer
87494dd7db
fix spelling and remove wildcard imports
2015-12-21 22:06:51 +01:00
Robert Muir
3a2464b80e
improve build logic on windows without native libraries
2015-12-21 15:37:34 -05:00
Simon Willnauer
c3f901400c
Move async translog sync logic into IndexService
...
Today the logic to async - commit the translog is in every translog instance
itself. While the setting is a per index setting we manageing it per shard. This
polluts the translog code and can more easily be managed in IndexService.
2015-12-21 21:36:02 +01:00
Robert Muir
0ed45c5bfb
remove filesystem leniency
2015-12-21 14:16:53 -05:00
Robert Muir
deaf8884e9
Fix exc handling
2015-12-21 13:04:22 -05:00
Robert Muir
3ffd1a5219
final
2015-12-21 12:54:33 -05:00
Robert Muir
f81b12e327
minimize accessiblity, remove unused threadpool
2015-12-21 12:39:40 -05:00
Simon Willnauer
445be98e4c
Merge pull request #15574 from s1monw/drop_simple_translog
...
Drop support for simple translog and hard-wire buffer to 8kb
2015-12-21 17:28:55 +01:00
Adrien Grand
a6bf860cb5
Merge pull request #15575 from jpountz/upgrade/5.5.0-snapshot-1721183
...
Upgrade to lucene-5.5.0-snapshot-1721183.
2015-12-21 17:17:42 +01:00
Adrien Grand
cf52e96c42
Upgrade to lucene-5.5.0-snapshot-1721183.
...
Some files that implement or use the Scorer API had to be changed because of
https://issues.apache.org/jira/browse/LUCENE-6919 .
2015-12-21 17:02:08 +01:00
Simon Willnauer
fcfd98e9e8
Drop support for simple translog and hard-wire buffer to 8kb
...
Today we have two variants of translogs for indexing. We only recommend the buffered
one which also has a 20% advantage in indexing speed. This commit removes the option and defaults
to the buffered case. It also hard-wires the translog buffer to 8kb instead of 64kb. We used to
adjust that buffer based on if the shard is active or not, this code has also been removed and
instead we just keep an 8kb buffer arround.
2015-12-21 16:44:35 +01:00
Jim Ferenczi
81fd2169cf
Renames "default" similarity into "classic".
...
Replaces deprecated DefaultSimilarity by ClassicSimilarity.
Fixes #15102
2015-12-21 16:22:53 +01:00
Jim Ferenczi
96e29be7c6
Merge pull request #15571 from jimferenczi/min_should_match
...
Min should match greater than the number of optional clauses should return no result
2015-12-21 16:06:51 +01:00
Jim Ferenczi
4d32cc0b9f
Queries.calculateMinShouldMatch returns the number of "min should match" clauses that the user wanted
...
even if the number of optional clauses is smaller than the provided number.
In such case the query now returns no result.
Closes #15521
2015-12-21 16:06:06 +01:00
Simon Willnauer
0cdbcdab64
added 2.3.0-SNAPSHOT as a Version constant
2015-12-21 15:48:16 +01:00
Simon Willnauer
b56e19a00c
Merge pull request #15573 from s1monw/drop_settings_01
...
Simplify translog-based flush settings
2015-12-21 15:45:56 +01:00
Simon Willnauer
7fe2eddfec
fix test
2015-12-21 15:26:56 +01:00
Simon Willnauer
613e8a9782
add note to migration guide
2015-12-21 15:20:32 +01:00
Simon Willnauer
afc1cc19af
Simplify translog-based flush settings
...
This commit removes `index.translog.flush_threshold_ops` and `index.translog.disable_flush`
in favor of `index.translog.flush_threshold_size`. The number of operations is meaningless by itself and
can easily be turned into a size value with knowledge of the data. Disabling the flush is only useful in
tests and we can set the size value to a really high value. If users really need to do this they can
also apply a very high value like `1PB`.
2015-12-21 15:15:00 +01:00
Simon Willnauer
67c2f4224c
Merge pull request #15572 from s1monw/issues/15570
...
Remove `index.merge.scheduler.notify_on_failure` and default to `true`
2015-12-21 15:13:49 +01:00
Simon Willnauer
eb64a81d05
Remove `index.merge.scheduler.notify_on_failure` and default to `true`
...
This setting was undocumented and should not be set by any user. We should
fail the shard instead.
Closes #15570
2015-12-21 14:39:58 +01:00
Adrien Grand
454f3e8679
Merge pull request #15546 from jpountz/fix/realistic_mapping_tests
...
Make mappings tests more realistic.
2015-12-21 10:47:13 +01:00
Adrien Grand
ac393b7a31
Make mappings tests more realistic.
...
DocumentMapperParser has both parse and parseCompressed methods. Except that the
parse methods are ONLY used from the unit tests. This commit removes the parse
method and moves all tests to parseCompressed so that they test more
realistically how mappings are managed.
Then I renamed parseCompressed to parse given that this is the only alternative
anyway.
2015-12-21 10:44:00 +01:00
Jim Ferenczi
1ec44dcdda
Merge pull request #15371 from jimferenczi/alias_routing
...
Resolves the conflict between alias routing and parent routing by applying the alias routing and ignoring the parent routing.
2015-12-21 09:58:45 +01:00
Jim Ferenczi
776e5d8096
Separates routing and parent in all documentrequest in order to be able to distinguish an explicit routing value from a parent routing.
...
Resolves conflicts between parent routing and alias routing with the following rule:
* The parent routing is ignored if there is an alias routing that matches the request.
Closes #3068
2015-12-21 09:44:57 +01:00
Robert Muir
f67390e0c8
in the plugin: guard against HADOOP_HOME in environment on any platform.
...
hdfs fixture: minihdfs works on windows now, if things are properly set
but our test fixture still cannot launch this on windows.
2015-12-21 02:21:53 -05:00
Robert Muir
e93c491dbe
simplify hdfs fixture
2015-12-20 23:50:27 -05:00
Robert Muir
99f2cde225
Fail fast if HDFS cluster shuts itself down
2015-12-20 22:30:41 -05:00
Robert Muir
53530f1243
remove hacks, test fixtures are clean before each execution
2015-12-20 22:23:30 -05:00
Robert Muir
935c2c75f6
Remove slf4j hack
2015-12-20 22:08:18 -05:00
Robert Muir
f4f8b6e3fe
Merge branch 'master' of github.com:elastic/elasticsearch into hdfs2-only
2015-12-20 21:59:02 -05:00
Robert Muir
04966bcc3e
contain and improve hack
2015-12-20 21:02:03 -05:00
Ryan Ernst
a518599e27
Allow plugins to upgrade slf4j-api to a compile dep
...
This was originally intended to be general purpose in #15555 , but
that still had problems. Instead, this change fixes the issue explicitly
for slf4j-api, since that is the problematic dep that is not actually
included in the distributions.
2015-12-20 17:59:00 -08:00
Robert Muir
03a2b6b01b
Disable HDFS fixture on windows, it requires native libraries.
2015-12-20 16:30:19 -08:00
Robert Muir
08d1d2f192
add simple javaexec for now until test fixtures can be debugged when they do not start
2015-12-20 19:04:28 -05:00
Robert Muir
a37417085d
blind stab at unit test issues on windows
2015-12-20 18:31:55 -05:00
Robert Muir
ee546ff655
try to get windows working
2015-12-20 17:10:01 -05:00
Robert Muir
2347e3c373
Get forbidden apis passing again, this needs to be investigated
2015-12-20 16:17:17 -05:00
Robert Muir
7ac49bb278
Merge branch 'hdfs2-only' of github.com:costin/elasticsearch into hdfs2-only
2015-12-20 16:12:23 -05:00
Robert Muir
12a8428dfb
Add MiniHDFS test fixture, started before integTest and shut down after.
...
Currently uses a hardcoded port (9999), need to apply MavenFilteringHack after it starts.
2015-12-20 16:00:37 -05:00
Simon Willnauer
a9e9dc7d88
Disable tests for example-fixture
2015-12-20 15:13:14 +01:00
Costin Leau
3204e87220
Restrict usage to HDFS only
2015-12-20 15:53:18 +02:00