Simon Willnauer
8c898048bc
Merge pull request #15584 from s1monw/move_translog_syn_to_index_service
...
Move async translog sync logic into IndexService
2015-12-22 09:28:11 +01:00
Robert Muir
010d1a89c5
Merge branch 'master' into hdfs2-only
2015-12-22 00:40:54 -05:00
Robert Muir
91dcc9e073
tidy up
2015-12-22 00:28:53 -05:00
Robert Muir
9573bb9f15
make sure BlobStore.close always triggers ACE on any access afterwards
2015-12-22 00:21:03 -05:00
Robert Muir
a04268e42e
reorder checks
2015-12-21 23:52:16 -05:00
Robert Muir
a587ba110c
add some safety around repository
2015-12-21 23:48:22 -05:00
Ryan Ernst
d104d6d652
Refactor hdfs unit tests to be simple and check every configuration
...
error condition
2015-12-21 19:38:54 -08:00
Jun Ohtani
51f6519e71
Analysis : Fix no response from Analyze API without specified index
...
fix test
2015-12-22 11:53:29 +09:00
Ryan Ernst
af7d6b629c
Change hdfs unit tests to be a single node test instead of integ test
2015-12-21 18:32:28 -08:00
Robert Muir
c54d53c8d5
streamline these classes a bit
2015-12-21 21:11:06 -05:00
Robert Muir
795869c345
remove filecontextfactory
2015-12-21 20:55:17 -05:00
Robert Muir
956281f039
remove shitton of permissions
2015-12-21 20:26:13 -05:00
Jun Ohtani
267cd65506
Analysis : Fix no response from Analyze API without specified index
...
Fix error handling in TransportSingleShardAction without shardIt
Closes #15148
2015-12-22 10:13:52 +09:00
Ryan Ernst
d0e9306413
Remove reading node settings as defaults for hdfs repository settings
2015-12-21 16:25:55 -08:00
Robert Muir
3c07a427dc
fix exc handling
2015-12-21 19:06:56 -05:00
Ryan Ernst
26eaa16a89
Remove "additional config" from hdfs repositories
2015-12-21 15:55:13 -08:00
Robert Muir
2cbfc54a81
avoid too-long classpath so it works on windows
2015-12-21 18:25:08 -05:00
Robert Muir
7065639a26
add test for listing
2015-12-21 17:25:15 -05:00
Robert Muir
5ebcf183e5
tests
2015-12-21 17:02:50 -05:00
Robert Muir
b8524bdb11
add tests
2015-12-21 16:16:24 -05:00
Simon Willnauer
98f9749ee1
fix visibility
2015-12-21 22:12:32 +01:00
Simon Willnauer
87494dd7db
fix spelling and remove wildcard imports
2015-12-21 22:06:51 +01:00
Robert Muir
3a2464b80e
improve build logic on windows without native libraries
2015-12-21 15:37:34 -05:00
Simon Willnauer
c3f901400c
Move async translog sync logic into IndexService
...
Today the logic to async - commit the translog is in every translog instance
itself. While the setting is a per index setting we manageing it per shard. This
polluts the translog code and can more easily be managed in IndexService.
2015-12-21 21:36:02 +01:00
Robert Muir
0ed45c5bfb
remove filesystem leniency
2015-12-21 14:16:53 -05:00
Robert Muir
deaf8884e9
Fix exc handling
2015-12-21 13:04:22 -05:00
Robert Muir
3ffd1a5219
final
2015-12-21 12:54:33 -05:00
Robert Muir
f81b12e327
minimize accessiblity, remove unused threadpool
2015-12-21 12:39:40 -05:00
Simon Willnauer
445be98e4c
Merge pull request #15574 from s1monw/drop_simple_translog
...
Drop support for simple translog and hard-wire buffer to 8kb
2015-12-21 17:28:55 +01:00
Adrien Grand
a6bf860cb5
Merge pull request #15575 from jpountz/upgrade/5.5.0-snapshot-1721183
...
Upgrade to lucene-5.5.0-snapshot-1721183.
2015-12-21 17:17:42 +01:00
Adrien Grand
cf52e96c42
Upgrade to lucene-5.5.0-snapshot-1721183.
...
Some files that implement or use the Scorer API had to be changed because of
https://issues.apache.org/jira/browse/LUCENE-6919 .
2015-12-21 17:02:08 +01:00
Simon Willnauer
fcfd98e9e8
Drop support for simple translog and hard-wire buffer to 8kb
...
Today we have two variants of translogs for indexing. We only recommend the buffered
one which also has a 20% advantage in indexing speed. This commit removes the option and defaults
to the buffered case. It also hard-wires the translog buffer to 8kb instead of 64kb. We used to
adjust that buffer based on if the shard is active or not, this code has also been removed and
instead we just keep an 8kb buffer arround.
2015-12-21 16:44:35 +01:00
Jim Ferenczi
81fd2169cf
Renames "default" similarity into "classic".
...
Replaces deprecated DefaultSimilarity by ClassicSimilarity.
Fixes #15102
2015-12-21 16:22:53 +01:00
Jim Ferenczi
96e29be7c6
Merge pull request #15571 from jimferenczi/min_should_match
...
Min should match greater than the number of optional clauses should return no result
2015-12-21 16:06:51 +01:00
Jim Ferenczi
4d32cc0b9f
Queries.calculateMinShouldMatch returns the number of "min should match" clauses that the user wanted
...
even if the number of optional clauses is smaller than the provided number.
In such case the query now returns no result.
Closes #15521
2015-12-21 16:06:06 +01:00
Simon Willnauer
0cdbcdab64
added 2.3.0-SNAPSHOT as a Version constant
2015-12-21 15:48:16 +01:00
Simon Willnauer
b56e19a00c
Merge pull request #15573 from s1monw/drop_settings_01
...
Simplify translog-based flush settings
2015-12-21 15:45:56 +01:00
Simon Willnauer
7fe2eddfec
fix test
2015-12-21 15:26:56 +01:00
Simon Willnauer
613e8a9782
add note to migration guide
2015-12-21 15:20:32 +01:00
Simon Willnauer
afc1cc19af
Simplify translog-based flush settings
...
This commit removes `index.translog.flush_threshold_ops` and `index.translog.disable_flush`
in favor of `index.translog.flush_threshold_size`. The number of operations is meaningless by itself and
can easily be turned into a size value with knowledge of the data. Disabling the flush is only useful in
tests and we can set the size value to a really high value. If users really need to do this they can
also apply a very high value like `1PB`.
2015-12-21 15:15:00 +01:00
Simon Willnauer
67c2f4224c
Merge pull request #15572 from s1monw/issues/15570
...
Remove `index.merge.scheduler.notify_on_failure` and default to `true`
2015-12-21 15:13:49 +01:00
Simon Willnauer
eb64a81d05
Remove `index.merge.scheduler.notify_on_failure` and default to `true`
...
This setting was undocumented and should not be set by any user. We should
fail the shard instead.
Closes #15570
2015-12-21 14:39:58 +01:00
Adrien Grand
454f3e8679
Merge pull request #15546 from jpountz/fix/realistic_mapping_tests
...
Make mappings tests more realistic.
2015-12-21 10:47:13 +01:00
Adrien Grand
ac393b7a31
Make mappings tests more realistic.
...
DocumentMapperParser has both parse and parseCompressed methods. Except that the
parse methods are ONLY used from the unit tests. This commit removes the parse
method and moves all tests to parseCompressed so that they test more
realistically how mappings are managed.
Then I renamed parseCompressed to parse given that this is the only alternative
anyway.
2015-12-21 10:44:00 +01:00
Jim Ferenczi
1ec44dcdda
Merge pull request #15371 from jimferenczi/alias_routing
...
Resolves the conflict between alias routing and parent routing by applying the alias routing and ignoring the parent routing.
2015-12-21 09:58:45 +01:00
Jim Ferenczi
776e5d8096
Separates routing and parent in all documentrequest in order to be able to distinguish an explicit routing value from a parent routing.
...
Resolves conflicts between parent routing and alias routing with the following rule:
* The parent routing is ignored if there is an alias routing that matches the request.
Closes #3068
2015-12-21 09:44:57 +01:00
Robert Muir
f67390e0c8
in the plugin: guard against HADOOP_HOME in environment on any platform.
...
hdfs fixture: minihdfs works on windows now, if things are properly set
but our test fixture still cannot launch this on windows.
2015-12-21 02:21:53 -05:00
Robert Muir
e93c491dbe
simplify hdfs fixture
2015-12-20 23:50:27 -05:00
Robert Muir
99f2cde225
Fail fast if HDFS cluster shuts itself down
2015-12-20 22:30:41 -05:00
Robert Muir
53530f1243
remove hacks, test fixtures are clean before each execution
2015-12-20 22:23:30 -05:00