honeymoose
/
OpenSearch
mirror of https://github.com/honeymoose/OpenSearch.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
OpenSearch/docs/plugins
History
David Pilato 87553bba16
Add ingest-attachment support for per document `indexed_chars` limit (#28977) 
We today support a global `indexed_chars` processor parameter. But in some cases, users would like to set this limit depending on the document itself.
It used to be supported in mapper-attachments plugin by extracting the limit value from a meta field in the document sent to indexation process.

We add an option which reads this limit value from the document itself
by adding a setting named `indexed_chars_field`.

Which allows running:

```
PUT _ingest/pipeline/attachment
{
  "description" : "Extract attachment information. Used to parse pdf and office files",
  "processors" : [
    {
      "attachment" : {
        "field" : "data",
        "indexed_chars_field" : "size"
      }
    }
  ]
}
```

Then index either:

```
PUT index/doc/1?pipeline=attachment
{
  "data": "BASE64"
}
```

Which will use the default value (or the one defined by `indexed_chars`)

Or

```
PUT index/doc/2?pipeline=attachment
{
  "data": "BASE64",
  "size": 1000
}
```

Closes #28942
 		2018-03-14 19:07:20 +01:00
..
alerting.asciidoc Drops any plugins that haven't been updated since 2.0. Updates 5.0 links/verbiage 2016-11-02 06:38:50 -07:00
analysis-icu.asciidoc Update experimental labels in the docs (#25727) 2017-07-18 14:06:22 +02:00
analysis-kuromoji.asciidoc Enforce that responses in docs are valid json (#26249) 2017-08-17 09:02:10 -04:00
analysis-phonetic.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
analysis-smartcn.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
analysis-stempel.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
analysis-ukrainian.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
analysis.asciidoc Drops any plugins that haven't been updated since 2.0. Updates 5.0 links/verbiage 2016-11-02 06:38:50 -07:00
api.asciidoc Drops any plugins that haven't been updated since 2.0. Updates 5.0 links/verbiage 2016-11-02 06:38:50 -07:00
authors.asciidoc Docs: Remove references to elasticsearch directory in plugins (#28647) 2018-02-13 09:15:57 -08:00
discovery-azure-classic.asciidoc [Docs] Unify spelling of Elasticsearch (#27567) 2017-11-29 09:44:25 +01:00
discovery-ec2.asciidoc [Docs] Unify spelling of Elasticsearch (#27567) 2017-11-29 09:44:25 +01:00
discovery-file.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
discovery-gce.asciidoc [discovery-gce] Align code examples and documentation (#28876) 2018-03-12 15:37:11 +01:00
discovery.asciidoc Drops any plugins that haven't been updated since 2.0. Updates 5.0 links/verbiage 2016-11-02 06:38:50 -07:00
index.asciidoc Centralised doc versions in docs/Versions.asciidoc 2017-02-04 11:16:19 +01:00
ingest-attachment.asciidoc Add ingest-attachment support for per document `indexed_chars` limit (#28977) 2018-03-14 19:07:20 +01:00
ingest-geoip.asciidoc Reduce heap-memory usage of ingest-geoip plugin (#28963) 2018-03-12 08:07:33 +01:00
ingest-user-agent.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
ingest.asciidoc [Doc] Add Ingest CSV Processor Plugin to plugin as a community plugin (#27105) 2017-10-27 16:16:02 +09:00
install_remove.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
integrations.asciidoc [Docs] Unify spelling of Elasticsearch (#27567) 2017-11-29 09:44:25 +01:00
management.asciidoc Drops any plugins that haven't been updated since 2.0. Updates 5.0 links/verbiage 2016-11-02 06:38:50 -07:00
mapper-murmur3.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
mapper-size.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
mapper.asciidoc Remove mapper attachments plugin 2016-09-19 09:01:16 +02:00
plugin-script.asciidoc Add note on plugin distributions in plugins folder 2017-11-15 13:33:59 -05:00
redirects.asciidoc [DOCS] Added note about Elastic Cloud to improve 'elastic aws' SERP results. 2017-04-12 17:57:03 -07:00
repository-azure.asciidoc [Docs] Unify spelling of Elasticsearch (#27567) 2017-11-29 09:44:25 +01:00
repository-gcs.asciidoc Use client settings in repository-gcs (#28575) 2018-02-22 15:40:20 +01:00
repository-hdfs.asciidoc [Docs] Unify spelling of Elasticsearch (#27567) 2017-11-29 09:44:25 +01:00
repository-s3.asciidoc Use client settings in repository-gcs (#28575) 2018-02-22 15:40:20 +01:00
repository.asciidoc Add Google Cloud Storage repository plugin 2016-05-19 13:26:23 +02:00
security.asciidoc [Docs] Remove Kerberos/SPNEGO Shield plugin (#28019) 2018-01-10 19:23:06 +01:00
store-smb.asciidoc Added "release-state" support to plugin docs 2017-04-20 15:04:20 +02:00
store.asciidoc
…