Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,564 Commits 146 Branches 201 Tags 404 MiB
Commit Graph

262 Commits

Author SHA1 Message Date
bob 275dcc1e50
NIFI-12891: Update ElasticSearchClientService member variables on verify 
This closes #8496

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2024-03-14 09:25:13 +00:00
EndzeitBegins 5ba20b87c5
NIFI-12648 Refactor components in elasticsearch bundle using current API methods 
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #8303.
 2024-01-29 05:03:26 -05:00
David Handermann 93788f9281
NIFI-12650 Upgraded json-path from 2.8.0 to 2.9.0 (#8282) 
- Upgraded json-smart from 2.4.11 to 2.5.0
- Added json-path to managed dependencies in root Maven configuration
- Suppressed OWASP Dependency Check finding resolved in json-path 2.9.0
 2024-01-22 13:18:28 -05:00
David Handermann 250fe90b34
NIFI-9458 Replaced SimpleDateFormat with DateTimeFormatter (#8248) 
- Added FieldConverterRegistry and Standard implementation
- Moved DateTypeUtils methods to FieldConverter implementations
 2024-01-16 16:39:40 -05:00
mr1716 886efa8160
NIFI-12580 Upgraded maven-artifact plugin from 3.8.8 to 3.9.6 
This closes #8221

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2024-01-09 09:09:06 -06:00
exceptionfactory 4dc0d44dc4
NIFI-12395 Upgraded Jackson JSON from 2.15.3 to 2.16.1 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8201.
 2024-01-04 13:46:56 +04:00
mr1716 29dda4208a
NIFI-12463 Upgraded maven-artifact from 3.8.5 to 3.8.8 
This closes #8115

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-12-04 17:03:38 -06:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation 
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-06 12:01:49 -06:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules 
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
 2023-10-27 16:18:42 -07:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925) 
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
 2023-10-25 13:22:26 -04:00
Chris Sampson 6c7d02e22e
NIFI-12254 clarify Bulk operation header documentation for PutElasticsearchRecord and PutElasticsearchJson processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7912.
 2023-10-20 12:04:16 +02:00
Chris Sampson 584b3fc165
NIFI-12214 This closes #7869. ConsumeElasticsearch Query Builder properties do not dependOn the Query Definition Style 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-11 17:37:40 -07:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852) 
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
 2023-10-10 13:55:22 -04:00
Chris Sampson c091347795
NIFI-11985: Add ConsumeElasticsearch processor 
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7671.
 2023-10-10 06:00:52 -04:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-25 09:39:53 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String) 
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-23 10:30:42 -05:00
Chris Sampson 94bb8aec97
NIFI-12063 Clarified Elasticsearch Query Documentation 
Clarify paginated Elasticsearch with SCROLL does not use query parameters from dynamic properties

This closes #7695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-14 20:01:50 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-14 13:21:17 -07:00
dan-s1 8c045268ba
NIFI-11778 refactored Groovy tests in nifi-elasticsearch-restapi-processors to Java (and JUnit 5) 
This closes #7537

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-08-29 05:56:15 +01:00
Chris Sampson fb502cdf9a NIFI-11480 add option to group PutElasticsearchRecord errors by Elasticsearch _bulk error type 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7441
 2023-08-23 16:00:28 -04:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy 
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-07-18 12:22:52 -05:00
exceptionfactory ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies 
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
 2023-06-13 15:36:23 -04:00
Ryan Van Den Bos 658f2547d8
NIFI-11430 - PaginatedJsonQueryElasticsearch processors should not output empty FlowFile if hits have been found; PaginatedJsonQueryElasticsearch processors should be able to use _source and _meta only result formats when grouping by query 
This closes #7163

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-05-13 19:35:20 +01:00
Chris Sampson 3a3b9edc71
NIFI-10067: enable use of script when updating documents in Elasticsearch via PutElasticsearchJson or PutElasticsearchRecord 
NIFI-3262: enable use of dynamic_templates in Elasticsearch _bulk operations

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6628.
 2023-05-02 07:17:17 -04:00
Pierre Villard 7fb2468f4b NIFI-11502 - Upgrade json-path to 2.8.0 
NIFI-11502 fixing unit tests
NIFI-11502 review

This closes #7208

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-04-29 16:03:16 -04:00
Chris Sampson 99b2412ad4
NIFI-11483 Correctly use DescribedValue for JsonQueryElasticsearch 
This closes #7195

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-26 11:57:14 -05:00
Chris Sampson 05418d94f0 NIFI-11111 add option to output Elasticsearch error responses as FlowFile to PutElasticsearchJson and PutElasticsearchRecord 
NIFI-11111 clarify error_responses relationships in PutElasticsearchJson/Record processors
NIFI-11111 Refactor exception handling for error response flowfile transfer
NIFI-11111 Add elasticsearch.bulk.error attributes containing the Elasticsearch _bulk response for error documents in PutElasticsearchJson

This closes #6903

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-04-25 06:41:44 -04:00
Joe Witt 58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0 
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-03-23 12:28:40 -05:00
Chris Sampson f71ba8aadb
NIFI-11274 only add @timestamp to PutElasticsearchRecord document if not null 
This closes #7036.

Signed-off-by: Kevin Doran <kdoran@apache.org>
 2023-03-13 14:11:19 -04:00
Chris Sampson 6542505a50
NIFI-10797 add customisable Elasticsearch REST Client config and Elasticsearch Cluster Sniffer 
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6658.
 2023-02-13 13:22:18 -05:00
Chris Sampson 7393ce294e
NIFI-11168 Removed deprecated Elasticsearch Processors and properties 
This closes #6942

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-02-13 10:41:53 -06:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5. 
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
 2023-02-02 12:27:42 +00:00
Mike Thomsen d38f15997d
NIFI-10870 Added debug logging for the Elasticsearch REST Requests 
This closes #6841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-01-12 16:11:21 -06:00
Chris Sampson d9420afb60
NIFI-10844 Allow _source only output for GetElasticsearch and JsonQueryElasticsearch 
This closes #6687

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-01-04 15:30:41 -06:00
Chris Sampson 43a8b858ca
NIFI-10882 Set credentials for ElasticSearchClientService based on AuthorizationScheme 
This closes #6722

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2022-11-28 17:01:40 -06:00
Joe Witt 1046b2c308
Merge branch 'NIFI-10854-RC1' 2022-11-28 08:43:56 -07:00
Ryan Van Den Bos 2ad33eea80 NIFI-10845 - JsonQueryElasticsearch processors are not outputting an empty flow file for a combined response with output_no_hits set to true 
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6701
 2022-11-23 18:27:28 +00:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
Chris Sampson d23e50168f
NIFI-10776 Added NONE and PKI AuthorizationSchemes for ElasticSearchClientService 
This closes #6662

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2022-11-21 13:52:18 -06:00
Nandor Soma Abonyi 241d619138
NIFI-10775 Improve support for DescribedValue in PropertyDescriptor.Builder 
This closes #6650.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2022-11-15 22:17:21 +01:00
Nandor Soma Abonyi d374c1f399
NIFI-10760 Add API Key authentication to ElasticSearchClientServiceImpl 
This closes #6619

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2022-11-08 16:02:49 -06:00
Chris Sampson 2acfd1e496 NIFI-9398 add verification to ElasticSearchClientService (with integration tests) and Elasticsearch REST API processors 
NIFI-9398 processor verification integration-tests for nifi-elasticsearch-restapi-processors using common nifi-elasticsearch-test-utils refactored from nifi-elasticsearch-client-service
NIFI-9398 fail index exists verification for Elasticsearch processors whose operations would not create the index if it doesn't already exist

This closes #6544

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2022-11-05 18:17:13 -04:00
Chris Sampson b6026f5709 NIFI-10303 route GetElasticsearch to failure if _id is blank after attribute evaluation 
This closes #6573

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2022-10-25 14:30:09 -04:00
Chris Sampson db49a861b3 NIFI-10687 set Elasticsearch document _id to null if ID attribute evaluated to blank String for PutElasticsearchRecord or PutElasticsearchJson; use @timestamp default value if @timestamp record path evaluates to blank String in PutElasticsearchRecord 
This closes #6575

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2022-10-25 14:23:19 -04:00
Matt Burgess f43b989c99
NIFI-10617: Add missing DynamicProperty annotation to processors that use them (#6509) 
This closes #6509
 2022-10-17 12:46:37 -04:00
exceptionfactory 0dc02e26d2 NIFI-10648 Upgraded Apache Commons Text to 1.10.0 
- Added org.apache.commons.text.version property in root Maven configuration
- Removed direct version references in favor of managed dependency version

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6531.
 2022-10-14 14:07:23 -04:00
Mike Thomsen 08a1f09905 NIFI-10437 Converted SearchResponseTest from Groovy to Java. 
NIFI-10437 Removed old Maven Elasticsearch integration testing plugin and replaced with Testcontainers.
NIFI-10437 Converted TestSchemaRegistry from Groovy to Java.
NIFI-10437 Converted TestElasticsearchClientService from Groovy to Java.
NIFI-10437 Converted a unit test from Groovy to Java.
NIFI-10437 Converted a unit test from Groovy to Java.
NIFI-10437 Converted ElasticSearchLookupService_IT from Groovy to Java.
NIFI-10437 Converted ElasticSearchClientService_IT from Groovy to Java.
NIFI-10437 Migrated to Testcontainers.
NIFI-10437 Converted all nifi-elasticsearch-restapi-processors unit tests from Groovy to Java.

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6487
 2022-10-13 12:52:20 +01:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00