2018-06-19 16:57:10 -04:00
|
|
|
|
[role="xpack"]
|
2017-05-05 13:40:17 -04:00
|
|
|
|
[[ml-geo-functions]]
|
2018-06-19 16:57:10 -04:00
|
|
|
|
=== Geographic functions
|
2017-05-05 13:40:17 -04:00
|
|
|
|
|
2017-05-19 14:09:39 -04:00
|
|
|
|
The geographic functions detect anomalies in the geographic location of the
|
|
|
|
|
input data.
|
2017-05-05 13:40:17 -04:00
|
|
|
|
|
2017-05-19 14:09:39 -04:00
|
|
|
|
The {xpackml} features include the following geographic function: `lat_long`.
|
2017-05-05 13:40:17 -04:00
|
|
|
|
|
2017-12-21 11:14:52 -05:00
|
|
|
|
NOTE: You cannot create forecasts for jobs that contain geographic functions.
|
2018-07-25 11:10:32 -04:00
|
|
|
|
You also cannot add rules with conditions to detectors that use geographic
|
|
|
|
|
functions.
|
2017-12-21 11:14:52 -05:00
|
|
|
|
|
2017-05-19 14:09:39 -04:00
|
|
|
|
[float]
|
|
|
|
|
[[ml-lat-long]]
|
|
|
|
|
==== Lat_long
|
|
|
|
|
|
|
|
|
|
The `lat_long` function detects anomalies in the geographic location of the
|
2017-05-05 13:40:17 -04:00
|
|
|
|
input data.
|
|
|
|
|
|
2017-05-19 14:09:39 -04:00
|
|
|
|
This function supports the following properties:
|
|
|
|
|
|
|
|
|
|
* `field_name` (required)
|
|
|
|
|
* `by_field_name` (optional)
|
|
|
|
|
* `over_field_name` (optional)
|
|
|
|
|
* `partition_field_name` (optional)
|
|
|
|
|
|
|
|
|
|
For more information about those properties,
|
2017-06-19 22:31:39 -04:00
|
|
|
|
see {ref}/ml-job-resource.html#ml-detectorconfig[Detector Configuration Objects].
|
2017-05-19 14:09:39 -04:00
|
|
|
|
|
|
|
|
|
.Example 1: Analyzing transactions with the lat_long function
|
|
|
|
|
[source,js]
|
|
|
|
|
--------------------------------------------------
|
2018-06-19 16:57:10 -04:00
|
|
|
|
PUT _xpack/ml/anomaly_detectors/example1
|
2017-05-19 14:09:39 -04:00
|
|
|
|
{
|
2018-06-19 16:57:10 -04:00
|
|
|
|
"analysis_config": {
|
|
|
|
|
"detectors": [{
|
|
|
|
|
"function" : "lat_long",
|
|
|
|
|
"field_name" : "transactionCoordinates",
|
|
|
|
|
"by_field_name" : "creditCardNumber"
|
|
|
|
|
}]
|
|
|
|
|
},
|
|
|
|
|
"data_description": {
|
|
|
|
|
"time_field":"timestamp",
|
|
|
|
|
"time_format": "epoch_ms"
|
|
|
|
|
}
|
2017-05-19 14:09:39 -04:00
|
|
|
|
}
|
|
|
|
|
--------------------------------------------------
|
2018-06-19 16:57:10 -04:00
|
|
|
|
// CONSOLE
|
2018-08-31 14:56:26 -04:00
|
|
|
|
// TEST[skip:needs-licence]
|
2017-05-19 14:09:39 -04:00
|
|
|
|
|
|
|
|
|
If you use this `lat_long` function in a detector in your job, it
|
|
|
|
|
detects anomalies where the geographic location of a credit card transaction is
|
|
|
|
|
unusual for a particular customer’s credit card. An anomaly might indicate fraud.
|
|
|
|
|
|
|
|
|
|
IMPORTANT: The `field_name` that you supply must be a single string that contains
|
|
|
|
|
two comma-separated numbers of the form `latitude,longitude`. The `latitude` and
|
|
|
|
|
`longitude` must be in the range -180 to 180 and represent a point on the
|
|
|
|
|
surface of the Earth.
|
2017-05-05 14:57:20 -04:00
|
|
|
|
|
2017-05-19 14:09:39 -04:00
|
|
|
|
For example, JSON data might contain the following transaction coordinates:
|
|
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
|
--------------------------------------------------
|
|
|
|
|
{
|
|
|
|
|
"time": 1460464275,
|
|
|
|
|
"transactionCoordinates": "40.7,-74.0",
|
|
|
|
|
"creditCardNumber": "1234123412341234"
|
|
|
|
|
}
|
|
|
|
|
--------------------------------------------------
|
2018-06-19 16:57:10 -04:00
|
|
|
|
// NOTCONSOLE
|
2017-05-05 14:57:20 -04:00
|
|
|
|
|
2017-05-19 14:09:39 -04:00
|
|
|
|
In {es}, location data is likely to be stored in `geo_point` fields. For more
|
|
|
|
|
information, see {ref}/geo-point.html[Geo-point datatype]. This data type is not
|
|
|
|
|
supported natively in {xpackml} features. You can, however, use Painless scripts
|
|
|
|
|
in `script_fields` in your {dfeed} to transform the data into an appropriate
|
|
|
|
|
format. For example, the following Painless script transforms
|
|
|
|
|
`"coords": {"lat" : 41.44, "lon":90.5}` into `"lat-lon": "41.44,90.5"`:
|
2017-05-05 14:57:20 -04:00
|
|
|
|
|
|
|
|
|
[source,js]
|
|
|
|
|
--------------------------------------------------
|
2018-06-19 16:57:10 -04:00
|
|
|
|
PUT _xpack/ml/datafeeds/datafeed-test2
|
2017-05-19 14:09:39 -04:00
|
|
|
|
{
|
2018-06-19 16:57:10 -04:00
|
|
|
|
"job_id": "farequote",
|
|
|
|
|
"indices": ["farequote"],
|
|
|
|
|
"query": {
|
|
|
|
|
"match_all": {
|
|
|
|
|
"boost": 1
|
|
|
|
|
}
|
|
|
|
|
},
|
2017-05-19 14:09:39 -04:00
|
|
|
|
"script_fields": {
|
|
|
|
|
"lat-lon": {
|
|
|
|
|
"script": {
|
2017-06-09 11:29:36 -04:00
|
|
|
|
"source": "doc['coords'].lat + ',' + doc['coords'].lon",
|
2017-05-19 14:09:39 -04:00
|
|
|
|
"lang": "painless"
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
}
|
2017-05-05 14:57:20 -04:00
|
|
|
|
--------------------------------------------------
|
2018-06-19 16:57:10 -04:00
|
|
|
|
// CONSOLE
|
2018-08-31 14:56:26 -04:00
|
|
|
|
// TEST[skip:setup:farequote_job]
|
2017-05-05 14:57:20 -04:00
|
|
|
|
|
2017-06-23 14:42:37 -04:00
|
|
|
|
For more information, see <<ml-configuring-transform>>.
|