Commit Graph

4040 Commits

Author SHA1 Message Date
Court Ewing 3931ca0fc1 Merge pull request elastic/elasticsearch#3379 from epixa/3101-reportingunsavedstate
reporting: Require user to save changes for reporting

Original commit: elastic/x-pack-elasticsearch@cefa3a0be8
2016-09-08 10:28:00 -04:00
Tanguy Leroux 97182fefb9 Clean up XContentBuilder in X-Pack
This commit cleans most of the methods of XContentBuilder so that:
    - Jackson's convenience methods are used instead of our custom ones (ie field(String,long) now uses Jackson's writeNumberField(String, long) instead of calling writeField(String) then writeNumber(long))
    - null checks are added for all field names and values
    - methods are grouped by type in the class source
    - methods have the same parameters names
    - duplicated methods like field(String, String...) and array(String, String...) are removed
    - varargs methods now have the "array" name to reflect that it builds arrays
    - unused methods like field(String,BigDecimal) are removed
    - all methods now follow the execution path: field(String,?) -> field(String) then value(?), and value(?) -> writeSomething() method. Methods to build arrays also follow the same execution path.

Original commit: elastic/x-pack-elasticsearch@d83f3aa6e2
2016-09-08 14:17:15 +02:00
Joe Fleming 8b6bd14b18 Merge pull request elastic/elasticsearch#3284 from ycombinator/reporting/5.0/encrypt-headers
Encrypt headers in reporting job doc

Original commit: elastic/x-pack-elasticsearch@9f21f20add
2016-09-07 17:35:51 -07:00
Shaunak Kashyap 0a89f0b984 Merge branch 'master' into reporting/5.0/encrypt-headers
Original commit: elastic/x-pack-elasticsearch@38c755ce1e
2016-09-07 18:39:51 -05:00
jaymode 2257cc77f6 security: add reserved metadata to the ingest admin role
Closes elastic/elasticsearch#3376

Original commit: elastic/x-pack-elasticsearch@1909da2fb0
2016-09-07 19:19:02 -04:00
Joe Fleming f3b8182147 Merge pull request elastic/elasticsearch#3314 from w33ble/reporting-fix/use-absolute-times
Use absolute times for saved objects in reports

Original commit: elastic/x-pack-elasticsearch@2e510502ec
2016-09-07 16:11:37 -07:00
Joe Fleming 3ed10b073e Merge branch 'master' into reporting-fix/use-absolute-times
Original commit: elastic/x-pack-elasticsearch@176c3b72cc
2016-09-07 14:58:03 -07:00
Joe Fleming 0941589e53 Merge branch 'master' into reporting-fix/user-permissions
Original commit: elastic/x-pack-elasticsearch@df4e1e6ab5
2016-09-07 14:49:27 -07:00
Court Ewing 8bd16c0ee2 Merge pull request elastic/elasticsearch#3375 from epixa/3293-portselection
reporting: Improved phantom.js port selection

Original commit: elastic/x-pack-elasticsearch@2fdf3b3417
2016-09-07 17:43:18 -04:00
Joe Fleming 42833ddf55 Merge pull request elastic/elasticsearch#3377 from w33ble/reporting-fix/image-capture
Fix image capturing in Phantom

Original commit: elastic/x-pack-elasticsearch@0baf1a097d
2016-09-07 14:34:50 -07:00
Joe Fleming 4df7423ccb Merge branch 'master' into reporting-fix/use-absolute-times
Original commit: elastic/x-pack-elasticsearch@83684bb720
2016-09-07 14:10:20 -07:00
Lukas Olson 61e264b13d Merge pull request elastic/elasticsearch#3340 from lukasolson/fix/session-timeout-warning-system-api
Don't reset session timeout warning for system API calls

Original commit: elastic/x-pack-elasticsearch@6f66db1a74
2016-09-07 14:05:12 -07:00
Lukas Olson a1d8967d62 Merge branch 'master' into fix/session-timeout-warning-system-api
Original commit: elastic/x-pack-elasticsearch@13680956c4
2016-09-07 11:22:36 -07:00
Court Ewing 6d48cd5e23 Merge pull request elastic/elasticsearch#3338 from lukasolson/fix/remove-client-cookie
Don't store user information in cookie

Original commit: elastic/x-pack-elasticsearch@5a4c205e6b
2016-09-07 14:16:10 -04:00
Joe Fleming 38f87b59be Merge branch 'master' into reporting-fix/use-absolute-times
Original commit: elastic/x-pack-elasticsearch@bdc85eb9fb
2016-09-07 10:21:32 -07:00
Court Ewing aa7fc0aad3 Merge pull request elastic/elasticsearch#3343 from epixa/xsrfheader
Check new kbn-xsrf header in auth redirect

Original commit: elastic/x-pack-elasticsearch@3b74ae9e25
2016-09-07 13:01:53 -04:00
Alexander Reelsen 0f571685b9 Watcher: Fix proxy xcontent serialization (elastic/elasticsearch#3364)
Calling to xcontent in a HttpRequest, with a proxy enabled, lead to
serialization exceptions, resulting in failing to write the watch
history.

Closes elastic/elasticsearch#3334

Original commit: elastic/x-pack-elasticsearch@a04dff686c
2016-09-07 16:29:15 +02:00
Alexander Reelsen a296e31a7c Watcher: Ensure triggered watch is deleted on thread pool rejection (elastic/elasticsearch#3049)
This fixes a bug I found with a customer when he updated from 1.x to 2.x.
Due to an BWC incompatible change in the watch history mapping and a thread
pool rejection during execution a watch was not removed from the triggered
watches and tried to be executed again.

While trying to fix it it turned out that the execution of the failure
test case was still done in the transport thread and thus required some
offloading to another thread pool.

Original commit: elastic/x-pack-elasticsearch@df04ce31f2
2016-09-07 15:55:33 +02:00
Alexander Reelsen bb033f1e00 Watcher: Clear out WatchStore on watch index deletion (elastic/elasticsearch#2807)
If someone deletes the watch index (i.e. by deleting all indices), the watcher
in memory store still contains all the watches and tries to execute watches -
which results in exceptions as the watch itself cannot be updated anymore.

In order to minimize this problem (it cant be get rid of completely), we should
act accordingly if the watch index goes missing (either deleted or closed) and
clear out the memory representation of watches in the watchstore as well as trying
to finish all the current executions.

Closes elastic/elasticsearch#2794

Original commit: elastic/x-pack-elasticsearch@12d98cd566
2016-09-07 15:06:03 +02:00
Court Ewing f53fd02da0 Merge pull request elastic/elasticsearch#3305 from w33ble/reporting-fix/whitelisted-headers
Reporting fix/whitelisted headers

Original commit: elastic/x-pack-elasticsearch@2818f32098
2016-09-06 19:08:29 -04:00
Joe Fleming faf98b757c Merge pull request elastic/elasticsearch#3303 from w33ble/reporting-fix/wrap-json-parsing
Reporting fix/wrap json parsing

Original commit: elastic/x-pack-elasticsearch@2d2c3e8dbe
2016-09-06 15:43:33 -07:00
Joe Fleming 45dc0814d5 Merge pull request elastic/elasticsearch#3302 from w33ble/reporting-fix/date-pattern
Fix queue index pattern date

Original commit: elastic/x-pack-elasticsearch@9ab1f502d2
2016-09-06 15:41:58 -07:00
javanna ad5606d1f7 [TEST] don't use null script lang in WatcherUtilsTests
same as elastic/x-pack@9e1e0988c1 but for testSerializeSearchRequest this time.

Original commit: elastic/x-pack-elasticsearch@aa7e3814b6
2016-09-06 23:00:56 +02:00
Lukas Olson f48e4ecc95 Merge branch 'fix/remove-client-cookie' into fix/session-timeout-warning-system-api
Original commit: elastic/x-pack-elasticsearch@8588d10f93
2016-09-06 13:51:57 -07:00
Lukas Olson 528a61e372 Merge branch 'master' into fix/remove-client-cookie
Original commit: elastic/x-pack-elasticsearch@1768d14f1e
2016-09-06 13:51:38 -07:00
Lukas Olson 0036a7f620 Merge branch 'master' into fix/disabled-ui-select
Original commit: elastic/x-pack-elasticsearch@4d9812f2c2
2016-09-06 13:51:24 -07:00
Nik Everett edb8c12f75 Always use mustache language
Using a null language just defaults to painless which is wrong for
watcher.

Original commit: elastic/x-pack-elasticsearch@48bdc31695
2016-09-06 15:45:23 -04:00
Nik Everett 05222b0d3f Deal with ConcreteShardRequest
It exists now and the intercepters have to deal with it.

Original commit: elastic/x-pack-elasticsearch@fdef0578ed
2016-09-06 15:42:06 -04:00
Martijn van Groningen 36486a7993 Changes for PR: https://github.com/elastic/elasticsearch/pull/20310
Original commit: elastic/x-pack-elasticsearch@9db3d05274
2016-09-06 18:44:41 +02:00
jaymode 7965608add security: make control of logfile audit output consistent with index output
This change moves the logfile audit output from determining what to log based on the
logger level to a enum based configuration that is used by the index output.

A few notable changes were made:

* We alway log all the information we have except for the request body
* The request body is no longer logged by default for REST events; the user needs to
explicitly opt in as there could be sensitive data in the body
* Added a `realm_authentication_failed` event that separates overall authentication
failure from that of an individual realm

Original commit: elastic/x-pack-elasticsearch@343a2bcdd9
2016-09-06 10:50:33 -04:00
Nik Everett 89ce4ebb08 Fix remaining fractional TimeValue issues with watcher
Removes the remaining spots where watcher makes fractional TimeValues.

Closes elastic/elasticsearch#3231

Original commit: elastic/x-pack-elasticsearch@22b0d37ed3
2016-09-06 09:53:22 -04:00
jaymode cd9add5350 test: remove unnecessary verify check
Original commit: elastic/x-pack-elasticsearch@f748c0a565
2016-09-06 08:36:04 -04:00
jaymode 1e6a924e74 security: add support for disabling users
This change adds support for disabling users. Users can be disabled by setting the enabled
property to false and the AuthenticationService will check to make sure that the user is enabled.
If the user is not enabled, this will be audited as an authentication failure.

Also as part of this work, the AnonymousUser was cleaned up to remove having a static instance
that caused issues with tests.

Finally, the poller of users was removed to simplify the code in the NativeUsersStore. In our other
realms we rely on the clear cache APIs and the timeout of the user cache. We should have the
same semantics for the native realm.

Closes elastic/elasticsearch#2172

Original commit: elastic/x-pack-elasticsearch@0820e40183
2016-09-06 07:41:48 -04:00
Chris Earle ec008ec4a9 Looong lines
Original commit: elastic/x-pack-elasticsearch@8c7931c179
2016-09-05 19:05:28 -04:00
Chris Earle 5d5a9afb57 [Monitoring] Use Low Level REST Client for HTTP Exporter
This rewrites the HTTP Exporter to use the REST client underneath. Functionality is improved in resource blocking (templates and pipelines existing) and the majority of the code fundamentall simplified by removing direct HTTP calls.

This is blocked by the SSLService pull request. After that is merged, the I will update this PR to reflect those changes and it could possibly allow us to remove the security privileges required for monitoring.

Original commit: elastic/x-pack-elasticsearch@1ad25f17f8
2016-09-05 15:16:03 -04:00
Alexander Reelsen 41334abda0 Watcher: Reenabling HipChatServiceTests
The authentication token stopped working, deleted it and created a new one
on the hipchat web site. Tests are working now again.

Closes elastic/elasticsearch#3162

Original commit: elastic/x-pack-elasticsearch@a0623af799
2016-09-05 12:27:14 +02:00
Martijn van Groningen 09c7f534b3 added jdocs and rename
Original commit: elastic/x-pack-elasticsearch@8a97b420c1
2016-09-03 11:01:47 +02:00
Joe Fleming b0e4bbb553 Merge pull request elastic/elasticsearch#3304 from w33ble/reporting-fix/sidebar-width
Reporting fix/sidebar width

Original commit: elastic/x-pack-elasticsearch@b02b5bd296
2016-09-02 16:01:52 -07:00
Nik Everett 3c33879018 Mark OldWatchIndices test AwaitsFix
Is freaking out in CI.

Original commit: elastic/x-pack-elasticsearch@3ab43467ed
2016-09-02 18:31:19 -04:00
Martijn van Groningen 565f50dbe5 Remove custom parsing and toXContent logic from TextTemplate and delegate to the Script as much as possible
Original commit: elastic/x-pack-elasticsearch@6d23549dc1
2016-09-02 23:36:07 +02:00
Lukas Olson 1a99a400c6 Merge branch 'master' into fix/remove-client-cookie
Original commit: elastic/x-pack-elasticsearch@f701619f79
2016-09-02 10:11:15 -07:00
Tim Sullivan 33cdecd39e Merge pull request elastic/elasticsearch#3088 from tsullivan/monitoring-ui-phonehome-pivot-iii
Monitoring UI: Welcome Message and Phone Home Controls from Global DIRECTIVE Notification

Original commit: elastic/x-pack-elasticsearch@165d68b053
2016-09-02 09:43:39 -07:00
Nik Everett 203faaf4f4 2.x backwards compatibility support for watcher
Basic backwards compatibility support for watcher.

Closes elastic/elasticsearch#3230

Relates to elastic/elasticsearch#3231 - this actually should fix all the failures caused
by fractional time values but it does so by being able to parse them.
Being able to parse them is important for 2.x compatibility but 5.0
watches shouldn't produce fractional time values. This fixes the
particular way of making fractional time values mentioned in elastic/elasticsearch#3231
but I expect there are a half dozen more places to fix. The actual
watcher tests are fairly basic.

Original commit: elastic/x-pack-elasticsearch@328717455c
2016-09-02 09:24:46 -04:00
javanna 119bb67967 adapt to elastic/elasticsearch#20288: More info classes to implement Writeable rather than Streamable
Original commit: elastic/x-pack-elasticsearch@22cadf604d
2016-09-02 10:24:15 +02:00
Jack Conradson de4c776f0f Merge pull request elastic/elasticsearch#3272 from jdconrad/deprecate
Deprecate Groovy, Python, and Javascript

Original commit: elastic/x-pack-elasticsearch@e5c1d5a112
2016-09-01 16:30:25 -07:00
Chris Earle bb5ff7ab36 Fix test on Linux; setting name missing 'total.'
Original commit: elastic/x-pack-elasticsearch@de0183b3ef
2016-09-01 18:12:00 -04:00
Jack Conradson 670a57274a Merge branch 'master' into deprecate
Original commit: elastic/x-pack-elasticsearch@c9636bd3f1
2016-09-01 14:53:42 -07:00
Chris Earle 6d40cb63d0 [Monitoring] Collect IO Stats
This ensures that the data exists in 5.0.

Original commit: elastic/x-pack-elasticsearch@bc6e7931d1
2016-09-01 15:45:51 -04:00
Chris Earle b60e8aebd2 [Monitoring] Publish X-Pack Usage with Cluster Info
This publishes X-Pack usage data to the cluster info from the elected master node. This allows phone home to retrieve this data from the index, rather than fetching it live from the connected cluster (thereby not getting it from any n - 1 clusers that are not connceted).

Original commit: elastic/x-pack-elasticsearch@79bfaaaf0b
2016-09-01 15:38:54 -04:00
jaymode 2e010d52e9 security: do not allow built-in user/role names to be defined in the file realm
This change restricts built-in user/role names from passing validation when we are reading or modifying
the files used by this realm.

Closes elastic/elasticsearch#2078

Original commit: elastic/x-pack-elasticsearch@9f6b34f39d
2016-09-01 14:46:38 -04:00