Commit Graph

12157 Commits

Author SHA1 Message Date
Ryan Ernst f1e0fb6b85 Merge pull request #11027 from rjernst/pr/mapper-subfields
Mappings: Remove traverse functions from Mapper
2015-05-07 08:52:38 -07:00
Alex Ksikes 4787cf701f More Like This: remove percent_terms_to_match
Users should use minimum_should_match instead.

Closes #11030
2015-05-07 14:21:29 +02:00
Britta Weber 00f8dd60fe Merge remote-tracking branch 'origin/master' into feature/synced_flush 2015-05-07 13:40:59 +02:00
Shay Banon 8128f398ca Fix NPE in PendingDelete#toString
closes #11032
2015-05-07 12:36:55 +02:00
Colin Goodheart-Smithe 8905e7297b Merge pull request #10976 from colings86/fix/10926
Allow script language to be null when parsing
2015-05-07 09:46:37 +01:00
Simon Willnauer aa184029b1 Make modifying operations durable by default.
This commit makes create, update and delete operations on an index durable
by default. The user has the option to opt out to use async translog flushes
on a per-index basis by settings `index.translog.durability=request`.

Initial benchmarks running on SSDs have show that indexing is about 7% - 10% slower
with bulk indexing compared to async translog flushes. This change is orthogonal to
the transaction log sync interval and will only sync the transaction log if the operation
has not yet been concurrently synced. Ie. if multiple indexing requests are submitted and
one operations sync call already persists the operations of others only one sync call is executed.

Relates to #10933
2015-05-07 10:14:34 +02:00
Adrien Grand 80be0f7217 Merge pull request #11002 from jpountz/fix/numeric_resolution_string_date
Mappings: `numeric_resolution` should only apply to dates provided as numbers.
2015-05-07 09:39:58 +02:00
Martijn van Groningen f7c29457d0 parent/child: Deprecated the `top_children` in favour of the `has_child` query. 2015-05-07 09:27:54 +02:00
Ryan Ernst 0b31efb328 Mappings: Remove traverse functions from Mapper
The mapper listener abstractions for object and field mappers are used
to notify the mapper service of new fields, as well as collect
all object and field mappers through a set of traversal functions.

This change removes the traversal functions in favor of simple
iteration over subfields of a mapper.
2015-05-06 23:40:07 -07:00
Alexander Reelsen 82c21ff5b3 Documentation: Mention RPM repo does not work with older distributions
Getting this to work would be a lot of work (creating two different
repositories, having another GPG key, integrating this into our build).

Closes #6498
2015-05-07 08:20:06 +02:00
Simon Willnauer 00e9654006 Verify shard state if prepareCreate/prepareIndex fails
This is pretty much a workaround for the fact that we simply
close the downstream resources once the shard is closed. This means
the document parser will barf with NPE or something similar while
AlreadyClosedException would be approriate.
2015-05-07 07:06:54 +02:00
Simon Willnauer 4db689f05e Merge pull request #11018 from brwe/counter-test
[TEST] don't check shard counter if there are still write operations ongoing after test
2015-05-07 06:32:10 +02:00
Britta Weber 790318c65a [TEST] don't check shard counter if there are still write operations ongoing after test 2015-05-06 18:23:26 +02:00
Alex Ksikes ec4f12f9ef More Like This: removal of the MLT API
Removes the More Like This API, users should now use the More Like This query.
The MLT API tests were converted to their query equivalent. Also some clean
ups in MLT tests.

Closes #10736
Closes #11003
2015-05-06 18:11:11 +02:00
David Pilato 234716a1ef Remove Codehaus repository
Codehaus announced they are shutting down their services: https://www.codehaus.org/

We should remove their repository from our pom as it could cause some errors an useless HTTP calls.

Related to #10939
2015-05-06 17:51:17 +02:00
Colin Goodheart-Smithe c860c1b437 Merge pull request #11013 from colings86/feature/11007
Adding Sum Bucket Aggregation
2015-05-06 15:50:14 +01:00
Adrien Grand 19a6cb246e Merge pull request #10949 from jpountz/fix/wait_for_mappings_on_primary
Mappings: Wait for mappings to be available on the primary before indexing.
2015-05-06 16:22:37 +02:00
Adrien Grand 8a19bf3aed Mappings: Wait for mappings to be available on the primary before indexing.
In some cases it might happen that a mapping which is already available on the
master node is not available yet on the node that holds the primary shard.
This commit changes indexing on the primary shard so that if a dynamic update
is triggered then the index operation is re-tried until required mappings are
available locally (using cluster state observing).
2015-05-06 16:19:22 +02:00
Colin Goodheart-Smithe cf1251796f Aggregations: Adding Sum Bucket Aggregation
Closes #11007
2015-05-06 14:44:56 +01:00
Zachary Tong e70a8d4ee9 Merge pull request #10964 from polyfractal/feature/aggs_movavg_rename
Rename Moving Average models to their "common" names
2015-05-06 09:07:23 -04:00
Zachary Tong 3eb9cb913d Rename Moving Average models to their "common" names
Previously, we were using the "statistical", technically accurate name.  Instead, we
should probably use the name that people are familiar with, e.g. "Holt Winters" instead
of "triple exponential".  To that end:

- `single_exp` becomes `ewma` (exponentially weighted moving average)
- `double_exp` becomes `holt`

When the `triple_exp` is added, it will be called `holt_winters`.
2015-05-06 09:04:44 -04:00
Colin Goodheart-Smithe 72d99773dc Aggregations: Adding Average Bucket Aggregation
Also includes changes to the other bucket metric aggregations to share code

Closes #11006
2015-05-06 13:53:57 +01:00
Shay Banon 8f163ad4b0 [TEST] Randomize translog settings 2015-05-06 12:23:12 +02:00
Colin Goodheart-Smithe 644fd00714 Aggregations: x-axis units normalisation for derivative aggregation 2015-05-06 10:31:16 +01:00
Adrien Grand c355bd60a4 Mappings: `numeric_resolution` should only apply to dates provided as numbers.
Close #10995
2015-05-06 11:00:53 +02:00
Simon Willnauer 67ed182347 [TEST] Remove unexpected extraFS file check - this was wrongly added before 2015-05-06 10:48:53 +02:00
Ryan Ernst 7a7bd6086a Mappings: Remove ability to disable _source field
Current features (eg. update API) and future features (eg. reindex API)
depend on _source. This change locks down the field so that
it can no longer be disabled. It also removes legacy settings
compress/compress_threshold.

closes #8142
closes #10915
2015-05-05 22:04:18 -07:00
Robert Muir fe5af6f34d Tests: fix test bug (foo -> bar) 2015-05-06 01:03:03 -04:00
Robert Muir 5351fbd8a0 Merge pull request #10997 from rmuir/groovy_better
Load fielddata on behalf of scripts.
2015-05-05 21:26:29 -07:00
Robert Muir 020f7d7195 Load fielddata on behalf of scripts.
If we have to do the one-time loading of fieldata, it requires
more permissions than groovy scripts currently have (zero). This
is because of RamUsageEstimator reflection and so on in PagedBytes.

GroovySecurityTests only test a numeric field, so add a string field
to the test (so pagedbytes fielddata gets created etc).
2015-05-06 00:16:03 -04:00
Robert Muir f613413ce4 Merge pull request #10970 from rmuir/bad_idea
bail if ES is run as root
2015-05-05 17:09:00 -07:00
Robert Muir e4beda94f9 Merge pull request #10983 from rmuir/no_check_certificate
Let HTTPS work correctly
2015-05-05 14:47:37 -07:00
Jack Conradson 9fae152cf5 Scripting: Minor TimeZone Fix
Changed DateMethodFunctionValues to use UTC instead of GMT.  Should
not affect any existing code, but is correct and consistent.

closes #10994
2015-05-05 14:20:54 -07:00
Shay Banon b4b5603617 Merge pull request #10993 from kimchy/sync_interval_not_to_control_type
Use buffered tanslog type also when sync is set to 0
2015-05-05 23:06:11 +02:00
Clinton Gormley 603a0c193b Docs: More translog doc improvements 2015-05-05 22:01:58 +02:00
Clinton Gormley a60251068c Docs: Improved the translog docs 2015-05-05 21:32:52 +02:00
Nicholas Knize 0553001369 [GEO] Remove local lucene spatial package
LUCENE-6422 - PackedQuadTree enhancement - was committed in Lucene 5.2 which is now integrated w/ ES 2.0. This eliminates the need to carry our own local lucene.spatial package. This commit removes the now unnecessary files.
2015-05-05 14:24:31 -05:00
Simon Willnauer 0b256cc629 [TEST] also close wrapped readers 2015-05-05 20:46:07 +02:00
Robert Muir 11394983d9 Merge pull request #10969 from rmuir/grooooooovy
Run groovy scripts with no permissions
2015-05-05 11:36:12 -07:00
Shay Banon ebac29d8a2 Use buffered tanslog type also when sync is set to 0
When settings sync to 0, we benefit from using the buffered type, no need to change to simple, since we get a chance to fsync multiple operations (for that single operation) and not have to sync for the other ones before returning each one
2015-05-05 20:17:36 +02:00
Tanguy Leroux 3976724882 Add pid file to Environment
This commit adds the path of the PID file to the Environment. It also add it to the Security Manager since the PID file is deleted by a shutdown hook when the JVM is exited.
2015-05-05 18:39:19 +02:00
Zachary Tong 4f65130703 [TEST] Fix min/max accumulator in MovAvg tests
Double.MIN_VALUE does not follow the same semantics as Integer.MIN_VALUE.  Namely, it
represents the smallest positive, non-zero value a double can hold.  Since the test uses negative
doubles, this can incorrectly find the min/max metric for a set of values.

Instead, Double.NEGATIVE_INFINITY needs to be used, which represents the smallest value possible.

Not strictly necessary, but MAX_VALUE was switched to POSITIVE_INFINITY just to be 100% correct
2015-05-05 12:29:49 -04:00
Simon Willnauer d20202a963 Remove double exceptin handling that causes false replica failures
we already fail the shard in the `onFailure` method if the replica
operation barfs. This additional check has been added lately that
bypasses the clusterstate observer which causes replicas to fail
if the mappings are not yet present.
2015-05-05 18:04:27 +02:00
Robert Muir afdec4c84c Merge pull request #10989 from rmuir/jna_optional
ensure JNA is fully loaded when its avail, but don't fail its not
2015-05-05 09:03:16 -07:00
Robert Muir 15e6d3ec6c ensure JNA is fully loaded when its avail, but don't fail its not 2015-05-05 11:49:40 -04:00
Britta Weber dc2eed9681 fix after merge with master 2015-05-05 17:45:41 +02:00
Simon Willnauer 200174aa37 Remove Translog interface
We only have one implementation of this interface which makes not much
sense. This commit removes the abstraction.
2015-05-05 17:34:59 +02:00
Britta Weber e3d346d3b7 cleanup 2015-05-05 17:32:03 +02:00
Britta Weber 8349a3ee1e call sync flush when shard is marked as inactive 2015-05-05 17:19:09 +02:00
Robert Muir 9c0d379254 style cleanups (assume and suppressforbidden) 2015-05-05 10:59:39 -04:00