opensearch-docs-cn/_clients/javascript/helpers.md

202 lines
5.4 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

---
layout: default
title: Helper methods
parent: JavaScript client
nav_order: 2
---
# Helper methods
Helper methods simplify the use of complicated API tasks.
## Bulk helper
The bulk helper simplifies making complex bulk API requests.
### Usage
The following code creates a bulk helper instance:
```javascript
const { Client } = require('@opensearch-project/opensearch')
const documents = require('./docs.json')
const client = new Client({ ... })
const result = await client.helpers.bulk({
datasource: documents,
onDocument (doc) {
return {
index: { _index: 'example-index' }
}
}
})
console.log(result)
```
{% include copy.html %}
Bulk helper operations return an object with the following fields:
```json
{
total: number,
failed: number,
retry: number,
successful: number,
time: number,
bytes: number,
aborted: boolean
}
```
#### Bulk helper configuration options
When creating a new bulk helper instance, you can use the following configuration options.
| Option | Data type | Required/Default | Description
| :--- | :--- | :--- | :---
| `datasource` | An array, async generator or a readable stream of strings or objects | Required | Represents the documents you need to create, delete, index, or update.
| `onDocument` | Function | Required | A function to be invoked with each document in the given `datasource`. It returns the operation to be executed for this document. Optionally, the document can be manipulated for `create` and `index` operations by returning a new document as part of the function's result.
| `concurrency` | Integer | Optional. Default is 5. | The number of requests to be executed in parallel.
| `flushBytes` | Integer | Optional. Default is 5,000,000. | Maximum bulk body size to send in bytes.
| `flushInterval` | Integer | Optional. Default is 30,000. | Time in milliseconds to wait before flushing the body after the last document has been read.
| `onDrop` | Function | Optional. Default is `noop`. | A function to be invoked for every document that cant be indexed after reaching the maximum number of retries.
| `refreshOnCompletion` | Boolean | Optional. Default is false. | Whether or not a refresh should be run on all affected indexes at the end of the bulk operation.
| `retries` | Integer | Optional. Defaults to the client's `maxRetries` value. | The number of times an operation is retried before `onDrop` is called for that document.
| `wait` | Integer | Optional. Default is 5,000. | Time in milliseconds to wait before retrying an operation.
### Examples
The following examples illustrate the index, create, update, and delete bulk helper operations.
#### Index
The index operation creates a new document if it doesnt exist and recreates the document if it already exists.
The following bulk operation indexes documents into `example-index`:
```javascript
client.helpers.bulk({
datasource: arrayOfDocuments,
onDocument (doc) {
return {
index: { _index: 'example-index' }
}
}
})
```
{% include copy.html %}
The following bulk operation indexes documents into `example-index` with document overwrite:
```javascript
client.helpers.bulk({
datasource: arrayOfDocuments,
onDocument (doc) {
return [
{
index: { _index: 'example-index' }
},
{ ...doc, createdAt: new Date().toISOString() }
]
}
})
```
{% include copy.html %}
#### Create
The create operation creates a new document only if the document does not already exist.
The following bulk operation creates documents in the `example-index`:
```javascript
client.helpers.bulk({
datasource: arrayOfDocuments,
onDocument (doc) {
return {
create: { _index: 'example-index', _id: doc.id }
}
}
})
```
{% include copy.html %}
The following bulk operation creates documents in the `example-index` with document overwrite:
```javascript
client.helpers.bulk({
datasource: arrayOfDocuments,
onDocument (doc) {
return [
{
create: { _index: 'example-index', _id: doc.id }
},
{ ...doc, createdAt: new Date().toISOString() }
]
}
})
```
{% include copy.html %}
#### Update
The update operation updates the document with the fields being sent. The document must already exist in the index.
The following bulk operation updates documents in the `arrayOfDocuments`:
```javascript
client.helpers.bulk({
datasource: arrayOfDocuments,
onDocument (doc) {
// The update operation always requires a tuple to be returned, with the
// first element being the action and the second being the update options.
return [
{
update: { _index: 'example-index', _id: doc.id }
},
{ doc_as_upsert: true }
]
}
})
```
{% include copy.html %}
The following bulk operation updates documents in the `arrayOfDocuments` with document overwrite:
```javascript
client.helpers.bulk({
datasource: arrayOfDocuments,
onDocument (doc) {
return [
{
update: { _index: 'example-index', _id: doc.id }
},
{
doc: { ...doc, createdAt: new Date().toISOString() },
doc_as_upsert: true
}
]
}
})
```
{% include copy.html %}
#### Delete
The delete operation deletes a document.
The following bulk operation deletes documents from the `example-index`:
```javascript
client.helpers.bulk({
datasource: arrayOfDocuments,
onDocument (doc) {
return {
delete: { _index: 'example-index', _id: doc.id }
}
}
})
```
{% include copy.html %}