Commit Graph

6329 Commits

Author SHA1 Message Date
mr1716 d754d952c2 NIFI-11522 Upgrade cassandra.sdk.version to 3.11.3
This closes #7225

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:29:35 -04:00
mkalavala aad7b40bd9
NIFI-11360 Added Client-Side Encryption for Azure Blob v12 Processors
This closes #7182

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-02 20:37:33 -05:00
dan-s1 e4cdb90a75 [NIFI-11509] Added configuration to allow for parsing comments in JSON.
This closes #7220

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:18:47 -04:00
dan-s1 71c7d38c75 [NIFI-11511] Added Provenance route events for all the relationships.
This closes #7221

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:03:49 -04:00
Pierre Villard 9f3284393a NIFI-11510 - Upgrade Box SDK to 4.1.0
This closes #7219

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 07:50:40 -04:00
Chris Sampson 3a3b9edc71
NIFI-10067: enable use of script when updating documents in Elasticsearch via PutElasticsearchJson or PutElasticsearchRecord
NIFI-3262: enable use of dynamic_templates in Elasticsearch _bulk operations

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6628.
2023-05-02 07:17:17 -04:00
Pierre Villard 01d1be3215
NIFI-11507 Upgraded Calcite from 1.32 to 1.34
This closes #7216

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:11:38 -05:00
Pierre Villard 65daa33dfa
NIFI-11506 Upgraded Curator from 5.4.0 to 5.5.0
This closes #7215

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:09:42 -05:00
Pierre Villard fb4eb38688
NIFI-11505 Upgraded gRPC from 1.54.0 to 1.54.1
This closes #7214

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:08:53 -05:00
Matthew Burgess 0e93dfae83
NIFI-11466 Added ModifyCompression Processor
- Added nifi-compress-bundle with nifi-compress-nar

This closes #7180

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-29 21:06:29 -05:00
Matthew Burgess 3d60e4a4f6 NIFI-11034: Restore image viewer to nifi-assembly
This closes #7209

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 18:20:53 -04:00
Pierre Villard 7fb2468f4b NIFI-11502 - Upgrade json-path to 2.8.0
NIFI-11502 fixing unit tests
NIFI-11502 review

This closes #7208

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 16:03:16 -04:00
Chris Sampson 9274d0c9b0 NIFI-10865 allow RecordPath's unescapeJson to convert de-serialised JSON Objects into Records
NIFI-10865 allow UpdateRecord to replace the Record root for relative paths, e.g. when a RecordPath function is used to modify selected field(s)

This closes #6708

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 12:26:07 -04:00
Pierre Villard 3de6f960fb
NIFI-11501 Upgraded Hive MQTT client from 1.3.0 to 1.3.1
This closes #7207

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:14:19 -05:00
Pierre Villard abdef65096
NIFI-11497 Upgraded snowflake-ingest-sdk from 1.1.1 to 1.1.3
This closes #7204

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:10:25 -05:00
Pierre Villard 67a4d10b3e
NIFI-11495 Upgraded Iceberg from 1.2.0 to 1.2.1
This closes #7203

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:09:36 -05:00
exceptionfactory d9f49bca14
NIFI-11491 Removed deprecated PersistentProvenanceRepository
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7200.
2023-04-28 13:42:36 +03:00
exceptionfactory 7906e3424c
NIFI-11489 Removed Deprecated Record Writer and Schema Registry methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7199.
2023-04-27 20:18:15 +03:00
exceptionfactory ee03db0e8f
NIFI-11488 Removed Deprecated Sensitive Properties Algorithms
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7198.
2023-04-27 20:16:26 +03:00
Timea Barna d54940c397
NIFI-11473 Flow version change in NiFi should not stop a component when only position is changed
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7185
2023-04-27 12:59:24 -04:00
Aakash Chauhan afdbed5749
NIFI-8971 Removed legacy FlowFile name and path attributes
This closes #6003

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 16:37:48 -05:00
Chris Sampson 99b2412ad4
NIFI-11483 Correctly use DescribedValue for JsonQueryElasticsearch
This closes #7195

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 11:57:14 -05:00
Lehel Boér ffaf81ec46
NIFI-11067 Delete Property History when changing Sensitive status
This closes #7082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 09:55:21 -05:00
Pierre Villard c819c4de94 NIFI-11224: Refactor and FF attribute support in WHERE in QuerySalesforceObject.
This closes #7019.

Co-authored-by: Lehel Boér <lehel44@hotmail.com>
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-04-26 14:27:40 +02:00
Scott Aslan 387504b66f
NIFI-11433 - use .add() for set instead of .push() (#7193)
* replace d3.nest, use add instead of push for Set, use forEach to loop over Set

* es5 function syntax

Merged #7193 into main.
2023-04-25 10:43:45 -07:00
Chris Sampson 05418d94f0 NIFI-11111 add option to output Elasticsearch error responses as FlowFile to PutElasticsearchJson and PutElasticsearchRecord
NIFI-11111 clarify error_responses relationships in PutElasticsearchJson/Record processors
NIFI-11111 Refactor exception handling for error response flowfile transfer
NIFI-11111 Add elasticsearch.bulk.error attributes containing the Elasticsearch _bulk response for error documents in PutElasticsearchJson

This closes #6903

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-25 06:41:44 -04:00
Scott Aslan 38ece1d7d9
[NIFI-11433] update angular, d3, moment, slickgrid, and jquery depen… (#7174)
* [NIFIF-11433] update angular, d3, moment, slickgrid, and jquery dependencies

* address review feedback

* .entries instead of .keys

Merged #7174 into main.
2023-04-24 10:16:20 -07:00
Daniel Aaron Salwerowicz d3f2bf1c16
NIFI-11472 Check working directory after making directory in PutFTP
- Multiple threads can attempt to create a remote directory when PutFTP has multiple concurrent tasks.

This closes #7184

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-24 11:33:09 -05:00
exceptionfactory 51956a4426
NIFI-11479 Upgraded JanusGraph from 0.5.3 to 0.6.3
- Set Guava to 31.1 overriding 29.0 from JanusGraph 0.6.3

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7192.
2023-04-23 11:52:14 +03:00
exceptionfactory 1639ecee11
NIFI-11438 Set standard OpenID Connect Scopes
- Restored previous behavior of sending openid and email scopes for OpenID Connect token requests
- Added offline_access scope as the default value in nifi.properties to support Refresh Tokens

This closes #7168
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-21 11:29:16 -04:00
Peter Turcsanyi 8586ac594e
NIFI-11475 Fixed missing jackson-dataformat-xml in nifi-azure-services-api
This closes #7186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-21 08:55:26 -05:00
Mike Thomsen f3f966ca37
NIFI-11441 Removed OpenCypherClientService
- The cypher-gremlin-neo4j-driver library is no longer supported

This closes #7171

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-21 08:50:25 -05:00
Pierre Villard bdcd4fcfda
NIFI-11402 - PutBigQuery fix for case sensitivity and error handling
This closes #7140.

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2023-04-19 21:07:23 +02:00
exceptionfactory bdff3abcd6
NIFI-11461 Improve User and Group Tenants Search (#7181)
* NIFI-11461 Improved User and Group Tenants Search

- Added searchTenants method to NiFiServiceFacade and removed unnecessary object creation
- Updated TenantsResource to use delegated NiFiServiceFacade.searchTenants method
- Changed autocomplete delay from default 300 ms to 500 ms

* NIFI-11461 Adjusted implementation to use EntityFactory.createTenantEntity

This closes #7181
2023-04-19 09:58:25 -04:00
exceptionfactory 382058e154
NIFI-11425 Removed Compression from EncryptContentPGP and SignContentPGP
- Removed Compression Algorithm property from EncryptContentPGP and SignContentPGP
- Removed Camellia values from Symmetric Key Algorithm property in EncryptContentPGP

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7156.
2023-04-19 15:27:54 +03:00
exceptionfactory d382b378a8
NIFI-11387 Added Transport Type property to Azure Event Hub Components
- Transport Type defaults to AMQP and also supports AMQP with WebSockets

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7126.
2023-04-19 15:04:56 +03:00
krisztina-zsihovszki 9a002d9a43
NIFI-11255 Allowable value for 'Use s3.region Attribute'
This closes #7051.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-04-18 17:58:49 +02:00
Tamas Palfy 88587f5c02
NIFI-11386 Added Resource and Audience support to StandardOauth2AccessTokenProvider
- Also keeping previous Refresh Token if one is not provided during a refresh request

This closes #7164

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 22:05:49 -05:00
mr1716 1466b7d7d3
NIFI-11458 Upgraded JNA from 5.12.1 to 5.13.0
This closes #7179

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:09:35 -05:00
mr1716 29bb652623
NIFI-11456 Upgraded brotli4j from 1.8.0 to 1.11.0
This closes #7178

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:08:27 -05:00
mr1716 dbb973a666
NIFI-10333 Upgraded HikariCP from 4.0.3 to 5.0.1
This closes #7177

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:06:59 -05:00
mr1716 f77659913f
NIFI-11457 Upgraded commons-configuration2 from 2.8.0 to 2.9.0
This closes #7176

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:05:09 -05:00
Mark Payne 7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Mark Bathori 44a7f7f38b
NIFI-11440 Speed up Iceberg Hive Metastore Tests
This closes #7170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 12:52:22 -05:00
Paul Grey cff7808543
NIFI-11439 Corrected GCS Transit URI for custom Storage API URL
This closes #7173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 10:09:27 -05:00
Paul Grey cd685671c8
NIFI-11439 Corrected Checkstyle violation on GCS Property
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 14:25:54 -05:00
Paul Grey ee24df2830
NIFI-11439 Added Storage API URL property to GCS Processors
- Included Host Header override with Storage API URL based on Google Private Service Connect documentation

This closes #7172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 13:56:23 -05:00
exceptionfactory bc5f00a667
NIFI-11437 Switched to StreamUtils.fillBuffer() for buffer, Improved EncryptContentPGP Content Type Detection
This closes #7166
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-13 12:11:45 -04:00
Pierre Villard 061f3a1380 NIFI-11429 - Upgrade Gremlin to 3.6.2
This closes #7160

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-13 08:22:25 -04:00
Bryan Bende ba93f60731
NIFI-11436 Fix NPE during updateFlow when called from a replace request for a PG that is not under version control (#7167) 2023-04-12 19:24:22 -04:00
Tamas Palfy 3322ad7a20
NIFI-10955 Added optional preprocessing to JASN1Reader
This close #6769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 22:16:20 -05:00
Pierre Villard 594e45cf9a
NIFI-11428 Upgraded Groovy to 3.0.17 and spock-core to 2.3
This closes #7159

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 08:01:36 -05:00
Pierre Villard cbca499070
NIFI-11427 Upgraded Atlas from 2.2.0 to 2.3.0
This closes #7158

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 08:01:36 -05:00
Pierre Villard a148b6f348
NIFI-11407 Upgraded Azure BOM from 1.2.9 to 1.2.11
- Added Woodstox Core to nifi-toolkit-encrypt-config

This closes #7136

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 14:36:48 -05:00
Joe Witt 4414793f2a
NIFI-11408 enable user to disable gzip compression with PutGCSObject
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7139.
2023-04-10 19:57:16 +03:00
Pierre Villard 21e4c665dc
NIFI-11421 Upgraded Parquet from 1.12.3 to 1.13.0
- Upgraded MockFtpServer from 2.7.1 to 3.1.0

This closes #7152

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:50:13 -05:00
Pierre Villard 81fefbafc9
NIFI-11420 Upgraded ActiveMQ from 5.15.15 to 5.18.0
This closes #7151

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:48:54 -05:00
Pierre Villard 06145d2b30
NIFI-11419 Upgraded MongoDB driver from 4.8.2 to 4.9.1
This closes #7150

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:46:45 -05:00
Pierre Villard 2b06306b07
NIFI-11418 Upgraded bcrypt from 0.9.0 to 0.10.2
This closes #7149

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:55 -05:00
Pierre Villard b0997f843d
NIFI-11416 Upgraded Caffeine from 2.8.1 to 3.1.6
This closes #7147

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:12 -05:00
Pierre Villard 0b2deb94de
NIFI-11415 Upgraded Saxon-HE from 10.6 to 12.1
This closes #7146

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:44:12 -05:00
Pierre Villard 2515c5771d
NIFI-11414 Upgraded snowflake-ingest-sdk from 1.0.3 to 1.1.1
This closes #7145

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:43:14 -05:00
Pierre Villard 83d19a6e9d
NIFI-11413 Upgraded JUnit 5.9.1 to 5.9.2
- Upgraded JUnit 4.13.1 to 4.13.2

This closes #7144

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:42:24 -05:00
Pierre Villard 0160d6d6b9
NIFI-11410 Upgraded multiple integration dependencies
- Upgraded Spring Boot from 2.7.9 to 2.7.10

This closes #7141

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:40:09 -05:00
mr1716 8992256f78
NIFI-11404 Upgraded AMQP Client from 5.16.0 to 5.17.0
This closes #7138

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 16:43:50 -05:00
mr1716 58257c8a55
NIFI-11403 Upgraded Calcite Core from 1.32.0 to 1.34.0
This closes #7137

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 16:42:45 -05:00
Pierre Villard 4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
Pierre Villard 9149bd47c4
NIFI-11406 Upgraded Google GCP from 26.4.0 to 26.12.0
- Upgraded Google Drive from Revision 20221219 to 20230306

This closes #7135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:47:15 -05:00
aglotero d80a19e230 NIFI-5642: QueryCassandra processor : output FlowFiles as soon fetch_size is reached
NIFI-5642: QueryCassandra processor : output FlowFiles as soon fetch_size is reached
Fixed checkstyle error
Delete build.sh
Delete local build file
NIFI-5642 : letting fetch_size to control the Cassandra data flow creating a new MAX_ROWS_PER_FLOW_FILE parameter
Fixed checkstyle error: no more import java.util.*
Fixed missing imports
NIFI-5642: added REL_ORIGINAL relationship in order to allow incremental commit
Addressing comments from code review
Adjustments on timestamp datatype formatting
Created the OUTPUT_BATCH_SIZE property
Code review adjustments
NIFI-5642: update after rebase
NIFI-5642: addressing PR comments
NIFI-5642: adding in integration test, fixing race condition
NIFI-5642: remove log4j2

This closes #6848

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-05 16:01:54 -04:00
Mark Bathori d15eeb445b
NIFI-11342: HDFS processors fail to get ClassloaderIsolationKey at startup
This closes #7121.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-04-05 15:37:28 +02:00
exceptionfactory dffad44a03
NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:10:02 -07:00
Nandor Soma Abonyi 32df0fa484
NIFI-11137 Add record support to Consume/PublishJMS (#6987) 2023-04-03 21:42:27 +02:00
exceptionfactory e4f0508c90
NIFI-11370 Corrected JWK Set retrieval for NIFI Trust Strategy (#7108)
- Added StandardOidcIdTokenDecoderFactory based on Spring Security OidcIdTokenDecoderFactory with custom REST Operations

Merged #7108 into main.
2023-03-31 16:26:02 -07:00
Matthew Burgess 59eebb9906
NIFI-8710: Pass details instead of source ID for Provenance per the interface doc
This closes #5224

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-31 18:43:22 +02:00
exceptionfactory 75eb449a31
NIFI-11365 Corrected OIDC Redirect URI resolution for reverse proxies (#7104)
- Added Authorization Request Resolver with support for building the base redirect URI using allowed proxy headers

This closes #7104
2023-03-30 16:26:35 -04:00
Nandor Soma Abonyi 2b9f2071ed
NIFI-11270 Refactoring of the overly Paho-specific MQTT interface
This closes #7032.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-29 23:20:06 +02:00
exceptionfactory 8952f7c0cf NIFI-11354 Removed Neo4j 3 Service and modules
This closes #7093

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-03-29 15:41:24 -04:00
exceptionfactory d66b29853e
NIFI-11359 Upgraded woodstox-core to 6.5.0 for Solr 8.11.1
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-29 08:04:35 -07:00
Mark Payne 23d6d6ede4
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:30:18 -05:00
exceptionfactory dde89c0b15
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 13:12:57 +02:00
exceptionfactory 7cb20d6f7f
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:22:12 -07:00
exceptionfactory 5214097c59
NIFI-11355 Upgraded Couchbase Client from 2.5.8 to 2.7.23
- Suppressed vulnerability findings related to Couchbase Server

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7094.
2023-03-28 22:05:55 +02:00
exceptionfactory 2dbb8f25f3
NIFI-11349 Upgraded HBase from 2.2.2 to 2.5.3 with Hadoop 3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7091.
2023-03-28 22:04:00 +02:00
exceptionfactory 158b5ffbcc
NIFI-11346 This closes #7088. Upgraded Parquet from 1.12.0 to 1.12.3
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:41:45 -07:00
exceptionfactory 5bdee9a714
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:41:11 -07:00
exceptionfactory 04cacad52a
NIFI-11348 This closes #7090. Upgraded JRuby from 9.3.9.0 to 9.4.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:40:51 -07:00
exceptionfactory 26400fcbe9
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 08:35:10 -04:00
exceptionfactory 623bcfd500
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:35:48 +02:00
Mark Payne 94ae926c42
NIFI-11333: Do not allow components to be removed while a node is disconnected
This closes #7085

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 17:43:38 -05:00
Mark Payne 969fc50778
NIFI-11341 Fixed OutputStream.close() handling for Content Claims
Fixed issue in StandardContentClaimWriteCache in which inner OutputStream class did not have an idempotent close() method; as a result, the stream could be written to while already in use for another active FlowFile; fixed bug in ContentClaimInputStream in which skip() method ignored its own BufferedInputStream - this was discovered because it was causing failures in StandardProcessSessionIT; fixed bug in StandardProcessSessionIT in which the length of StandardContentClaim was being doubled because the OutputStream was setting the claim length but that is already handled at a lower level.

This closes #7087

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:05:50 -05:00
Christian Wahl 6bd893da16
NIFI-11232 Fixed buffer handling in ContentClaimInputStream
This closes #6996

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:02:27 -05:00
krisztina-zsihovszki fe2721786c
NIFI-11266 PutGoogleDrive, ListGoogleDrive, FetchGoogleDrive can't access a SharedDrive
This closes #7058

Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-27 16:01:04 +02:00
Matt Burgess 1a9acb1f4b
NIFI-11337: Update PutDatabaseRecord's Max Batch Size property documentation to reflect actual behavior (#7081) 2023-03-24 10:22:56 -04:00
exceptionfactory 2698000a85
NIFI-11254 Upgraded SnakeYAML from 1.33 to 2.0
- Updated MiNiFi and EasyRules references to use required arguments

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7084.
2023-03-24 11:11:37 +01:00
Mark Bathori b50c8101cf
NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:41:33 +01:00
Bryan Bende 5386095083
NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService
This closes #7079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 14:29:17 -05:00
Joe Gresock 1b84927ed5
NIFI-11336 Added CapabilityDescription to PutAccumuloRecord
This closes #7080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:23 -05:00
Emilio Setiadarma cac76e339d
NIFI-9196 Corrected FetchSFTP Move File destination formatting
- Changed FetchSFTP to use String.format() instead of  File.getAbsolutePath() for defining the destination path as part of the Move File completion strategy

This closes #7072

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:23 -05:00
Joe Witt 58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
Mark Payne 016d58612c
NIFI-11290 Run Component Primary Node State changes in background thread
- Ensure that components are notified that primary node has changed in a background thread instead of the Leader Election thread and activate/deactivate the thread in the case of Processors so that they can be viewed in the UI and terminated

- Fixed system tests that would fail intermittently because they did not wait for node disconnection to complete and did not properly switch the client to look at the connected node before checking cluster status

This closes #7052

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:20:37 -05:00
Joe Gresock 9de93f19a4
NIFI-11330: Restarting service referenced by parameter only when service is active (#7078) 2023-03-23 13:13:22 -04:00
dependabot[bot] 24bbe51b54
NIFI-11328 Upgraded Jettison from 1.5.2 to 1.5.4
- Upgraded direct dependencies in Framework and Registry modules as well as Spark bundle

This closes #7073
This closes #7074
This closes #7075

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 10:48:20 -05:00
exceptionfactory 8154fcce49
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:15 +01:00
Matt Burgess 3bf1195f4b
NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL (#7068)
NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL
- Changed to allow 'unexpected' events to still be processed
2023-03-22 09:47:27 -04:00
Mark Payne 6adfb6131d
NIFI-11310: Provide appropriate classpath resources to the ReloadComponent when a processor is terminated
NIFI-11310: Fixed META-INF/services file that was mistakenly listing an extra extension point, due to rebase
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7061
2023-03-21 14:29:44 -04:00
krisztina-zsihovszki 63e9365449
NIFI-4651 Add error message and code to PutSQL FlowFile attributes
NIFI-4651 Review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2023-03-21 11:19:33 -04:00
Nandor Soma Abonyi 4e602ce40f
NIFI-11264 Added debug logs for List Processor yielding
- Corrected ListFile Processor description

This closes #7027

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-21 08:04:59 -05:00
Matt Burgess 0c7de2c748
NIFI-11305: Fix logic to correctly stop CaptureChangeMySQL (#7059) 2023-03-20 16:04:19 -04:00
Mark Bathori e370292d7f
NIFI-11204: Add configurable retry logic for table commits in PutIceberg processor
This closes #6976.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-20 19:20:43 +01:00
simonbence 7954ff355c
NIFI-11213 Showing version change in older (pre 1.18.0) contained version flows properly (#7017) 2023-03-20 11:52:07 -04:00
Dustin Rodrigues cb6e530a3c
NIFI-11301 Fixed typos in ISPEnrichIP and DistributeLoad
This closes #7056

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-20 08:54:01 -05:00
Peter Turcsanyi 4bec56ed81
NIFI-11296 Improved code reusability of GRPC modules
This closes #7053

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-17 15:25:58 -05:00
Mark Bathori 2873575fce
NIFI-11263: Add case-insensitive and order independent field mapping to PutIceberg record converter
This closes #7026.

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-17 20:03:21 +01:00
mr1716 4d8c13b8e1
NIFI-10769 Updated Accumulo from 2.0.1 to 2.1.0
- Updated exclusions with Log4j 2 dependencies
- Removed exclusions no longer required based on Accumulo 2.1.0

This closes #6964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 15:20:51 -05:00
johnAlJunior 40be70762a
NIFI-11269 Added snappy-java to nifi-avro-processors
This closes #7035

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 08:53:03 -05:00
Joe Gresock 8227c19b97
NIFI-11291: Ensuring exceptional EventIterators are closed in PartitionedEventStore
This closes #7047

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 08:26:32 -05:00
dan-s1 6c64050a29
NIFI-10792 Updated ConvertExcelToCSV to handle files over 10 MB
- Refactored to reduce the cognitive complexity in the onTrigger method
- Added log4j-to-slf4j library and adjusted formatting
- Removed unnecessary graphics2d dependency

This closes #7016

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 15:03:44 -05:00
Mark Payne 450a46bc58
NIFI-11289: Avoid obtaining read locks on queues when fetching Group Status, except in those few specific situations where it's needed.
This closes #7046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 14:18:22 -05:00
Matt Burgess 668d309c7e
NIFI-11279: Allow event stream processing to continue in CaptureChangeMySQL after sync issue (#7039) 2023-03-14 16:23:43 -04:00
exceptionfactory 1c883adca8
NIFI-11275 Removed HashContent from See Also in FuzzyHashContent
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7037.
2023-03-14 12:44:23 +01:00
exceptionfactory 5b9fabb889
NIFI-11281 Corrected Accumulo NAR dependencies
- Set accumulo-core to provided in NAR and Services NAR modules
- Removed unused dependencies

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7042.
2023-03-14 12:40:46 +01:00
Chris Sampson f71ba8aadb
NIFI-11274 only add @timestamp to PutElasticsearchRecord document if not null
This closes #7036.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-03-13 14:11:19 -04:00
Peter Turcsanyi d2f80b1645
NIFI-11260 Added STS SSL Context Service for AWS Credentials Provider
This closes #7021

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-13 09:39:30 -05:00
exceptionfactory b23b2621ac
NIFI-11267 Removed deprecated OAuth2TokenProviderImpl
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7029.
2023-03-13 09:22:20 +01:00
exceptionfactory 665b1696ef
NIFI-11268 Removed deprecated OpenPGP support from EncryptContent
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7030.
2023-03-13 09:20:33 +01:00
Emilio Setiadarma 1208e03b4c
NIFI-8497 Added SlackRecordSink
This closes #6593

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-10 16:23:02 -06:00
Matt Burgess c1890a5bb8
NIFI-5501: Fixed classloader issue leading to multiple abandoned threads (#7031) 2023-03-10 15:37:32 -05:00
Nandor Soma Abonyi ed1cee4520
NIFI-11202 Removed deprecated Kerberos properties from Kafka 2_6
This closes #6978

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-09 16:04:58 -06:00
exceptionfactory dbc627e0b0
NIFI-11261 Added Primary Node State handling to GetAzureEventHub
- Updated Qpid Proton J from 0.34.0 to 0.34.1

This closes #7023.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-09 22:31:51 +01:00
exceptionfactory ccea9760f9
NIFI-11194 Remove gzip CSS and JS from nifi-web-ui (#6968)
* NIFI-11194 Removed gzip CSS and JS from nifi-web-ui

* NIFI-11194 Updated comment for static content aggregation

This closes #6968
2023-03-08 12:06:45 -05:00
Peter Turcsanyi 5088934b79
NIFI-11256 Improved documentation for Azure Event Hubs Processors
- used the same ordering of 'Event Hub Namespace', 'Event Hub Name' and 'Service Bus Endpoint' properties
- removed "Primary" tag from 'Shared Access Policy Key' property name
- added some notes on clustering and consumer group in the documentation

This closes #7018

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-07 15:31:30 -06:00
exceptionfactory 512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
exceptionfactory d3908dede8
NIFI-11253 Removed H2 1.4 database migration modules
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7014
2023-03-07 10:35:21 -05:00
Nissim Shiman 5350b02923
NIFI-4718 Improved detection of FlowFile V3 in IdentityMimeType
This closes #7009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-07 09:22:27 -06:00
Lehel Boér 13d343d5ee
NIFI-11151: Improving code reusability of DBCP services
This closes #6935.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-07 14:41:34 +01:00
Joe Gresock 5cf909ccf6
NIFI-11247: Using parameterContextName instead of group name when fetching parameters (#7011)
Merged #7011.
2023-03-06 10:48:41 -08:00
Nandor Soma Abonyi a8cd33a243
NIFI-11248 Removed Kafka 2_0 Components
This closes #7010

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-06 09:35:31 -06:00
Robert Kalmar c7c1a245a9
NIFI-11246 Document differences in GetAzureEventHub and ConsumeAzureEventHub
This closes #7006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-06 07:54:23 -06:00
Pierre Villard 169b53feaa
NIFI-11157 - Doc update for scheduling strategy for MergeContent/Record
This closes #6999.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-06 12:01:34 +01:00
exceptionfactory f76259a6cf
NIFI-11210 Removed unused import from TestDistributedMapCacheClientService
- Missed commit from #6994

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:31:27 -06:00
Joe Gresock 5e3b93b2d6
NIFI-11238: Creating missing parameter providers when importing inherited provided contexts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7002.
2023-03-03 22:11:45 +01:00
Paul Grey 288031f5f6
NIFI-11210 Added read timeout to DistributedMapCacheClientService
This closes #6994

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:00:28 -06:00
exceptionfactory b7df6b9716
NIFI-11235 Removed ExtractCCDAAttributes and ccda-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7000.
2023-03-03 18:39:45 +01:00
exceptionfactory ba788d6e39
NIFI-11236 Removed ConsumeEWS Processor
- Removed ews-java-api dependency
- Added commons-lang3 dependency to maintain current usage in other Processors

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7001.
2023-03-03 18:38:30 +01:00
exceptionfactory 89625c78b4
NIFI-11244 Removed RocksDBFlowFileRepository and nifi-rocksdb-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7004.
2023-03-03 18:36:43 +01:00
exceptionfactory 44c70277ea
NIFI-11245 Corrected reducing Maximum Thread Count while running (#7005)
- Corrected implementation to allow reducing Maximum Thread Count below the default of 10
2023-03-03 11:35:34 -05:00
Lehel Boér 9ea0fe7b3d NIFI-11234: Fix RecordWriter NPE in QuerySalesforceObject
This closes #6997.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-03-01 16:40:49 +01:00
krisztina-zsihovszki 60c02225d5
NIFI-11158 PutSalesforceObject processor improvements
This closes #6959.

Reviewed-by: Lehel <lehel44@hotmail.com>
Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-28 19:21:50 +01:00
Mark Bean b08ae75be4
NIFI-11134 Added Label auditing to Flow Configuration History
This closes #6949

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-27 12:55:43 -06:00
Matthew Burgess 61b87e007b
NIFI-11209: Include newly-added columns in output for UpdateTable processors when Update Field Names is true
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6986.
2023-02-27 14:08:48 +01:00
exceptionfactory 84047c135b
NIFI-11219 Set Qpid Proton J 0.34.0 for Azure EventHubs
- Overrides Qpid Proton J 0.33.8 from azure-core-amqp 2.8.1 to resolve PROTON-2347

This closes #6988.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-26 18:33:41 +01:00
Lehel Boér a61f019cbf NIFI-10966: Add option to QuerySalesforceObject to run custom query
This closes #6794.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-24 14:47:46 +01:00
Lehel Boér 7295e3dc21
NIFI-11147: Query all fields in QuerySalesforceObject
Fix review comments
2023-02-23 16:59:56 -05:00
exceptionfactory 48689a2567
NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-02-23 10:33:45 -05:00
Mark Payne 87e61c50ee
NIFI-11192: Ensure that if ports moved between parent/child group in between flow versions that we can properly handle that. Added system tests to verify.
NIFI-11192: If a failure is encountered when changing the version of a flow from 1 version to another, attempt to rollback the changes instead of just failing with the flow in a bad state
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6981
2023-02-22 15:38:00 -05:00
exceptionfactory 7b12545e5a
NIFI-11211 Removed deprecated SSLContextService methods
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6983.
2023-02-22 14:54:03 -05:00
Matthew Burgess a2b98e0c9c NIFI-11094: Allow CaptureChangeMySQL to send multiple events per FlowFile
This closes #6907.

Co-authored-by: Tamas Palfy <tpalfy@apache.org>

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-22 19:27:42 +01:00
Lehel 7e97c1ce19
NIFI-11045: Sensitive dynamic property support for parameterized queries in ExecuteSQL and ExecuteSQLRecord
This closes #6853.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-22 12:37:07 +01:00
exceptionfactory 85f2162021 NIFI-11201 Added include-iotdb Maven build profile
This closes #6975

- Corrected Fetch Size property evaluation in QueryIoTDBRecord for FlowFile attributes

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:53:23 -05:00
exceptionfactory a0ef378a42 NIFI-11207 Removed HBase 1.1.2 Services
This closes #6979

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:51:02 -05:00
exceptionfactory 57a1144f34
NIFI-11187 Removed ActiveMQ from Standard Processors
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6961
2023-02-21 16:54:37 -05:00
exceptionfactory 0fa1060297
NIFI-11208 Removed Hortonworks Schema Registry
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6980
2023-02-21 16:48:45 -05:00
exceptionfactory 0255c0c4ed NIFI-11185 Removed GetTwitter Processor
This closes #6958

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 09:21:12 -05:00
Pierre Villard 21394038cd NIFI-11198 - Upgrade snowflake-ingest-sdk to 1.0.3
This closes #6972

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 09:15:29 -05:00
Pierre Villard 3115b9f28d
NIFI-10803 - Upgrade Dropbox SDK to 5.4.4
This closes #6971.

Reviewed-by: krisztina-zsihovszki <zsikrisz@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-21 11:09:29 +01:00
Lehel 1b951818e1
NIFI-11190: Added provenance events to GetHubSpot and GetShopify
This closes #6965.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-20 22:13:29 +01:00
lizhizhou 7cb86dd42d
NIFI-10784 Added QueryIoTDBRecord Processor
This closes #6844

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-18 19:58:39 -06:00
dan-s1 22a4bce1ed
NIFI-11156 Updated SchemaValidator to include error message for ValidateXml
- Restores behavior so that XML parsing failure details will be included in FlowFile error attribute from ValidateXml

This closes #6970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-18 10:28:50 -06:00
exceptionfactory 5507bfa4b2
NIFI-11191 Refactored HikariCPConnectionPoolTest with Mock Driver (#6966)
- Removed Derby dependencies from HikariCP module no longer required for testing

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-02-16 17:34:57 -05:00
exceptionfactory 284804ac42
NIFI-11188 Removed ProcessContext encrypt and decrypt methods
- Removed unnecessary references to PropertyEncryptor from multiple framework components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6962.
2023-02-16 12:16:15 -05:00
Nandor Soma Abonyi 0d4f1523fe NIFI-11144 Fix failing tests for ConsumeJMS/PublishJMS
This closes #6930.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-16 15:50:07 +01:00
Mark Payne fed175d46f NIFI-11189: When synchronizing a ProcessGroup to match a VersionedProcessGroup, do not remove the temporary funnel until the very end. This is important if the temporary funnel already exists in the flow on startup
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6963
2023-02-16 14:18:50 +01:00
exceptionfactory 4f11550e97
NIFI-11174 Removed deprecated Standard Processors
- Base64EncodeContent
- GetHTTP
- GetJMSQueue
- GetJMSTopic
- HashAttribute
- HashContent
- PostHTTP
- PutJMS

Removed deprecated Proxy properties from InvokeHTTP

- Proxy Host
- Proxy Port
- Proxy Type
- Proxy Username
- Proxy Password

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6953.
2023-02-15 13:14:56 -05:00
Matthew Burgess 9c5ae0d098
NIFI-11149 Added PutRedisHashRecord Processor
This closes #6943

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-15 11:28:24 -06:00
Pierre Villard b56b1da842
NIFI-11180 Removed Ambari Reporting Task
- Updated TestRuntimeManifest to reference Prometheus Reporting Task

This closes #6952

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-15 08:25:22 -06:00
Pierre Villard aae6bafc6c
NIFI-11183 Removed Hive 1.x components
This closes #6957

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 22:39:16 -06:00
Pierre Villard 46f89e3226
NIFI-11182 Removed Kafka 1.x components
This closes #6955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 18:38:42 -06:00
Pierre Villard 35cf9f87be
NIFI-11179 Removed Flume components
This closes #6950

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 16:25:44 -06:00
mkalavala 0d0ba1ca41
NIFI-9131 Refactor nifi-ldap-iaa-providers-bundle to use JUnit 5
This closes #6946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 16:03:31 -06:00
Nandor Soma Abonyi dd2fc4bb9d
NIFI-11173 Add default values to DeleteAzureBlobStorage_v12
This closes #6945.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-14 11:42:37 +01:00
Nissim Shiman dbef536ebd
NIFI-10950 DistributeLoad processor - this closes #6924. removed Load Distribution
Service

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 19:18:57 -05:00
Mark Payne 471cccbbda
NIFI-11176: This closes #6948. When comparing a VersionedConnection with an existing connection, we examined the source component's VersionedComponentId. But the existing component may not have a VersionedComponentId. We should only be comparing these if they are populated
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 18:52:15 -05:00
Chris Sampson 6542505a50
NIFI-10797 add customisable Elasticsearch REST Client config and Elasticsearch Cluster Sniffer
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6658.
2023-02-13 13:22:18 -05:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Chris Sampson 7393ce294e
NIFI-11168 Removed deprecated Elasticsearch Processors and properties
This closes #6942

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-13 10:41:53 -06:00
Pierre Villard 18ef2a57a5
NIFI-11164 Updated minimum Java version from 8 to 11.0.16
- Updated GitHub workflows from Java 8 to 11
- Updated Maven Compiler Source and Target version from 1.8 to 11
- Disabled JASN1 tests failing on Windows with Java 11

This closes #6940

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-10 23:31:37 -06:00
Bence Simon b0ec28a452 NIFI-11159 Fixing connections with source having reassigned id 2023-02-10 11:12:51 -05:00
exceptionfactory a66727c4d1
NIFI-11160 Upgraded Apache Tika from 2.6.0 to 2.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6938.
2023-02-10 11:38:25 +01:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
Joe Witt 3b9a518387
Merge branch 'NIFI-11103-RC1' 2023-02-09 15:13:42 -07:00
Robert Kalmar 9906f0a952
NIFI-11150 Add Service Account JSON credentials support to Google Pub/Sub Lite procesors
This closes #6933.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-09 12:53:27 +01:00
exceptionfactory 2e55498771
NIFI-11154 Removed Default Schedule from ConsumeMQTT
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6936.
2023-02-09 11:15:11 +01:00
exceptionfactory 8abfced7e1
NIFI-11152 Upgraded Splunk SDK from 1.9.1 to 1.9.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6934.
2023-02-09 11:13:25 +01:00
dan-s1 99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
krisztina-zsihovszki 3e2e081d4b
NIFI-11146 Proxy usage in BoxFile processors
This closes #6932.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-08 15:58:17 +01:00
Mark Bathori b375f4b138
NIFI-11124: Add hadoop.file.url attribute to HDFS processors
This closes #6916.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-07 23:10:16 +01:00
Joe Witt 896fdacbbd
NIFI-11103-RC1 prepare for next development iteration 2023-02-06 11:41:41 -07:00
Joe Witt 81296b5b69
NIFI-11103-RC1 prepare release nifi-1.20.0-RC1 2023-02-06 11:41:39 -07:00
Joe Witt 4f91420cc1
NIFI-11139 Updated multiple Maven Plugins
This closes #6925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 16:07:02 -06:00
exceptionfactory cd76dc0366
NIFI-11140 This closes #6922. Upgraded Tomcat from 8.5.82 to 8.5.85 for Flume
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:03:16 -07:00
Mark Payne 28b9f6fc02
NIFI-11118: This closes #6909. When changing version of a versioned flow, ensure that we properly set the Version Control Information's StorageLocation for the NiFi Registry client in order to maintain backward compatibility
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:02:38 -07:00
exceptionfactory b3319c7119
NIFI-11141 This closes #6923. Upgraded Azure SDK BOM from 1.2.6 to 1.2.9
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:01:32 -07:00
Emilio Setiadarma 0b61a6226c
NIFI-11092 Fixed ConsumeTwitter handling on Primary Node changes
This closes #6901

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 13:12:58 -06:00
Peter Turcsanyi 0c171bbb08 NIFI-10846: Added SMB Dialect and Use Encryption properties in SMB processors
This closes #6917.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-03 14:04:56 +01:00
Tamas Palfy 56d8879e91
NIFI-11107 In ConsumeIMAP and ConsumePOP3 added support for OAUTH based authorization.
This closes #6900.

Reviewed-by: Nandor Soma Abonyi <abonyisoma@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-03 13:57:43 +01:00
exceptionfactory 6877e84931
NIFI-11135 Upgraded Commons CSV from 1.9.0 to 1.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6921.
2023-02-03 12:26:47 +01:00
Joe Gresock 2609fd5f55
NIFI-11122 Corrected provided parameter context inheritance after creation
This closes #6913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-02 13:20:35 -06:00
Kalman Jantner 027e2b9bc1 NIFI-11123: fix default value and update docs
This closes #6899.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-02 18:48:47 +01:00
Mark Bathori 869e2b3d66
NIFI-11110: Create processor for triggering HMS events
Review comment fixes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6902
2023-02-02 11:31:44 -05:00
krisztina-zsihovszki 653631cc67
NIFI-11059 PutBoxFile processor
This closes #6892.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-02 15:33:37 +01:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
exceptionfactory 8bc7593d34
NIFI-11126 Delete MultiPart files in ListenHTTP after processing
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6915
2023-02-02 12:23:44 +00:00
dan-s1 d46aa89788
NIFI-8005 Added warning message for Excel sheets not found
This closes #6897

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-01 16:26:06 -06:00
Joe Gresock afdf49b3cd
NIFI-11100: Limiting scope of external controller services during version sync to services outside the versioning context (#6898) 2023-02-01 12:14:38 -05:00
Mark Bathori 3f04fae5a5
NIFI-11112 Corrected location of additionalDetails for GetZendesk
This closes #6904

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-31 16:25:11 -06:00
krisztina-zsihovszki 92ccb79670
NIFI-11117 Remove folder creation from PutGoogleDrive
This closes #6910.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-31 19:58:44 +01:00
exceptionfactory 5daf01e760
NIFI-11120 This closes #6912. Upgraded Zip4j from 2.11.2 to 2.11.3
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 11:49:12 -07:00
exceptionfactory bdede27447
NIFI-11119 This closes #6911. Excluded snakeyaml:android from javafaker
- Added direct dependency on standard snakeyaml version to nifi-standard-processors

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 10:05:23 -07:00
exceptionfactory a7206f187b
NIFI-9989 This closes #6908. Upgraded SSHJ from 0.34.0 to 0.35.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 09:18:54 -07:00
simonbence ae66ebdc22
NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes (#6870)
* NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes
2023-01-31 10:58:42 -05:00
Ferenc Erdei e4748e15f4
NIFI-11087 Added VerifyContentMAC Processor
This closes #6877

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-27 12:11:14 -06:00
Kalman Jantner cc8d108975
NIFI-10710 Added Processors for AWS Polly, Textract, Translate, Transcribe
This closes #6589

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-27 11:46:28 -06:00
exceptionfactory 0c676b9633
NIFI-11022 Added DecryptContent Compatibility Processors
- Added nifi-cipher-bundle with nifi-cipher-nar for new Processors
- Added DecryptContentCompatibilityMode Processor supporting PKCS5 and PKCS12 Password-Based Encryption Schemes
- Added DecryptContentEncoded Processor supporting NiFi Key Derivation Functions and associated formatting
- Added nifi-security-crypt-key module with Key Derivation Functions and Parameter Readers
- Added Additional Details documentation for Processors

This closes #6821
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-26 17:56:02 -05:00
Mark Payne d9f35b8974
NIFI-11105: This closes #6895. When mapping Parameter Context to VersionedParameterContext, don't bother mapping those that have already been mapped, as it is redundant
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-26 15:35:18 -07:00
Malthe Borch 41649660be
NIFI-10721 Avoid querying properties after Azure Blob upload
This closes #6730

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-26 15:45:52 -06:00
krisztina-zsihovszki 96a6594680
NIFI-11068 Introduced ConflictResolutionStrategy enum
This closes #6861

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-26 15:34:43 -06:00
exceptionfactory d913f8046a
NIFI-10581 Upgraded Apache Tika from 2.4.1 to 2.6.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6894.
2023-01-26 19:52:17 +01:00
exceptionfactory d60f541d7e
NIFI-11098 Deprecated ProcessContext encrypt and decrypt methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6891.
2023-01-26 18:18:09 +01:00
exceptionfactory 97cb3c4eaa
NIFI-11101 Deprecated ConsumeEWS Processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6893.
2023-01-26 18:00:16 +01:00
Mark Bathori c3dd2569db NIFI-10974: Incorrect warning message on memory usage from MonitorMemory 2023-01-26 13:25:07 +01:00
Priyanka Awatramani b3f2d95092
NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes
- Updated TestAttributesToCSV with LinkedHashMap for deterministic test behavior
- Updated TestHttpFlowFileServerProtocol with adjusted checksums to match expectations from LinkedHashMap changes

This closes #6748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 16:19:20 -06:00
exceptionfactory 5101db2ab7
NIFI-11096 This closes #6889. Added EncodeContent to Processor services definition
- Deprecated Base64EncodeContent in favor of EncodeContent
- Updated EncodeContent to use Commons Codec for Hexadecimal encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 15:01:38 -07:00
Joe Gresock 7d99521d4c
NIFI-11089: Resolving previously resolved parameter providers when possible on version sync (#6886) 2023-01-25 13:42:52 -05:00
Paul Grey 567e95aa28
NIFI-11047 - Issue when upgrading version of dataflow with external service
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6849
2023-01-25 12:52:52 -05:00
exceptionfactory 4fe2c318e6
NIFI-11091 This closes #6884. Upgraded Google libraries-bom from 25.4.0 to 26.4.0
- Upgraded Google Drive library to v3-rev20221219-2.0.0
- Corrected test encryption keys to match expected encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 10:00:00 -07:00
Pierre Villard 1148738c19
NIFI-11095 This closes #6888. Deprecate Hortonworks Schema Registry
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:59:00 -07:00
Mark Payne 228a3441b5
NIFI-11001: This closes #6836. When new components are added, track a mapping of its Versioned Compoenent ID to the component itself. Then, use this when creating connections. This is important because if a Process Group has multiple components with the same Versioned Component ID across multiple child groups, the Versioned Component ID may be changed upon adding the component. Maintaining this mapping allows us to still create the connection correctly.
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:55:16 -07:00
Nissim Shiman b7f7b411ef
NIFI-10853 Allow UpdateAttribute dynamic property to validate nifi
expressions

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6770
2023-01-25 11:43:12 -05:00
Peter Gyori 4d3fcb6843
NIFI-11000 Add compression example to CreateHadoopSequenceFile documentation
This closes #6801

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 10:33:29 -06:00
exceptionfactory f32a60af33
NIFI-11064 Removed unstable TestPutSFTP.testRunTransitUriDifferentHosts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6885.
2023-01-25 11:07:13 +01:00
exceptionfactory 84f48b5e8c
NIFI-11090 This closes #6883. Removed unused Jasypt test dependency
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-24 08:42:33 -07:00
krisztina-zsihovszki 4700fed249
NIFI-10965 PutGoogleDrive
This closes #6832.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 22:20:33 +01:00
Bence Simon 0ab1fbccc8
NIFI-10934 Added uniqueness check for Registry Client creation
This closes #6750

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Chris Sampson <12159006+ChrisSamo632@users.noreply.github.com>
2023-01-23 14:57:17 -06:00
Joe Gresock bf871e0b8d
NIFI-11032: Addressing NPE when retrieving registry client info with unauthorized user (#6879) 2023-01-23 15:51:25 -05:00
Paul Grey b426226207
NIFI-10993 - PublishKafkaRecord should use correct record schema
This closes #6833.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 21:40:29 +01:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Joe Gresock 8640989ad7
NIFI-11039: Fixing bug when importing parameter providers from nifi-registry (#6868)
* NIFI-11039: Fixing NPE in registry retrieval
* NIFI-11039: Fixing bug when importing parameter providers from nifi registry
2023-01-23 11:59:34 -05:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Joe Gresock 29618ae5c6
NIFI-11076: Resolving deadlock issue in StandardParameterContext (#6865)
* NIFI-11076: Resolving deadlock issue in StandardParameterContext

* NIFI-11076: Resolving deadlock issue in StandardParameterContext
2023-01-23 10:54:38 -05:00
Nandor Soma Abonyi eb5d172693
NIFI-10991 Add AWS MSK IAM support to Kafka processors
This closes #6846.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 12:33:49 +01:00
mr1716 bc02470b00
NIFI-11085 Update graphics2d to 0.42
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6876.
2023-01-23 11:54:58 +01:00
mr1716 78a2c4e14a
NIFI-11072 Updated xz from 1.8 to 1.9
This closes #6871

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-20 16:18:03 -06:00
mr1716 bdcefe4a98
NIFI-11081 Updated gRPC from 1.50.2 to 1.52.1
This closes #6875

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-20 16:17:06 -06:00
Timea Barna a9274c12c5
NIFI-11079 Extend QueryNifiReportingTask and ProcessGroup Summary Table
Correcting EmbeddedQuestDbStatusHistoryRepositoryForComponentsTest

Correcting TestQueryNiFiReportingTask

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6869
2023-01-20 15:22:20 -05:00
exceptionfactory 7db6f17350
NIFI-11064 Changed TestPutSFTP run iterations based on files queued
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6863.
2023-01-19 21:20:43 +01:00
krisztina-zsihovszki 312c6190e9
NIFI-11069 PutDropbox: remove upload cancellation, unify conflict resolution naming
This closes #6855.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 17:33:04 +01:00
Kalman Jantner 67925b171a NIFI-10953: Implement GCP Vision AI processors
This closes #6762.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-01-19 16:20:58 +01:00
Tamas Palfy 464e0a96ee
NIFI-11050 In PutEmail added OAuth authorization option. StandardOauth2AccessTokenProvider can be used with refresh_token grant type.
This closes #6845.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 16:05:28 +01:00
Matthew Burgess d7b14c0c45
NIFI-11033: Update QueryNiFiReportingTask additionalDetails page to include Flow Config History table
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6856.
2023-01-19 12:38:10 +01:00
mr1716 4518740da5
NIFI-11071 Update json-flattener to 0.16.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6860.
2023-01-19 10:56:01 +01:00
mr1716 b4f6aace53
NIFI-11070 Update json-schema-validator to 1.0.76
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6857.
2023-01-19 10:53:36 +01:00
mr1716 4b8ce44d59
NIFI-11042 Update msal4j to 1.13.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6859.
2023-01-19 10:52:17 +01:00
mr1716 4d78ebc487
NIFI-11024: Update iceberg.version to 1.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6851.
2023-01-18 14:22:15 +01:00
krisztina-zsihovszki 9ad1d8a7ae
NIFI-11028 Handle controller service 'Scheduled State' change (#6831) 2023-01-17 18:40:47 -05:00
Matthew Burgess 8986f4b33a
NIFI-6501 Refactor CaptureChangeMySQL with bounded queue of 1000
This closes #6791

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-17 16:18:55 -06:00
Matthew Burgess 6adbc1aeb0
NIFI-11036: Add Cluster Summary Metrics to Prometheus endpoint
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6834.
2023-01-17 14:44:33 +01:00
krisztina-zsihovszki b7071cbb04
NIFI-11049 Fixed flaky PutDropboxTest, attribute description corrected
This closes #6850.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-16 16:55:59 +01:00
Mike Thomsen d38f15997d
NIFI-10870 Added debug logging for the Elasticsearch REST Requests
This closes #6841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 16:11:21 -06:00
Matthew Burgess e0ec9780a5
NIFI-10449 Fixed ScriptedLookupServices reloading
- Reload script after disabled and first validation after changes made

This closes #6371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 15:09:52 -06:00
Chris Sampson 1d7ee542b1
NIFI-2161 add option to skip attribute output for unmatched JSON path expressions in EvaluateJsonPath
This closes #6817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 14:06:15 -06:00
Nissim Shiman 74e0a2002e
NIFI-11030 refactor nifi-stateless-processor-bundle to use JUnit5
This closes #6837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-11 18:43:40 -06:00
mr1716 fbb74b2c21
NIFI-11040 Update box-java-sdk to 3.8.2
This closes #6835.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-11 21:16:09 +01:00
Nissim Shiman 692e74e90d
NIFI-10241 Add comments tooltip for controller services, reporting tasks
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6768
2023-01-11 14:29:14 -05:00
Mark Payne d5c79fdcd1
NIFI-10887: Addressed performance concerned. Use String.indexOf() instead of Pattern.matcher() when using Literal Replace. Use a NonFlushableOutputStream when ProcessSession.write() is called. Implemented hashCode() on AbstractConnection. Updated default Run Schedule on ReplaceText from 0 ms to 25 ms. Added a Surround Replacement strategy that allows both prepending and appending text. Updated unit tests to account for this.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6724
2023-01-11 12:28:59 -05:00
Matthew Burgess a9baa21f87 NIFI-10996: Write out CSV header even if there are no records
This closes #6818

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-01-11 10:55:31 -05:00
lizhizhou 40ccb71f85
NIFI-10234 Added PutIoTDBRecord Processor
This closes #6416

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Xuan Ronaldo <xuanronaldo@qq.com>
Co-authored-by: Zhizhou Li <lizhizhou1983@gmail.com>
2023-01-10 20:38:33 -06:00
exceptionfactory 0c0f7e87be
NIFI-11004 Added documentation for OIDC groups claim property
This closes #6802
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-10 17:20:23 -05:00
Nissim Shiman fe25424233
NIFI-10772 Clarify logs on shutdown where controller service and/or
processor were unable to properly start

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6829
2023-01-10 13:56:00 -05:00
exceptionfactory 0d9dc6c540
NIFI-9167 Converted remaining nifi-framework tests to JUnit 5
NIFI-9167 Addressed feedback and improved tests using TempDir

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6823
2023-01-10 13:53:51 -05:00
exceptionfactory 6c517446a4
NIFI-10949 Updated MongoDB components using current driver (#6759)
- Replaced references to mongodb-driver-legacy with mongodb-driver-sync
- Updated components to use current synchronous driver classes
- Upgraded MongoDB driver from 4.7.2 to 4.8.0
2023-01-09 14:27:35 -05:00
Paul Grey e97977d61f
NIFI-10997 Ensure auditing of process group / controller service operations
This closes #6800

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 13:25:04 -06:00
nathluu ea93dec079
NIFI-10481 Support disabling ZooKeeper Ensemble Tracking
This closes #6400

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 10:42:01 -06:00
Matthew Burgess 4f77a17d19
NIFI-11031: Fix logic error in GenerateRecord for nullPercentage
This closes #6830

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-06 21:01:01 -06:00
exceptionfactory e966336e89
NIFI-11029 Added Standard XML parsing to ExtractCCDAAttributes
- Added DeprecationNotice to ExtractCCDAAttributes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6828
2023-01-06 16:10:42 -05:00
Nissim Shiman 9252dcbc76
NIFI-11019 Converted remaining nifi-scripting tests to JUnit 5
This closes #6824

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-06 11:33:18 -06:00
greyp9 b69721cac9
NIFI-10980 - correct ordering of property descriptor allowable values (#6781)
NIFI-10980 - correct ordering of property descriptor allowable values
2023-01-05 14:11:03 -05:00
exceptionfactory 53faecdcf6
NIFI-11027 Removed direct dependency on Joda Time
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6825.
2023-01-05 11:56:42 +01:00
Chris Sampson d9420afb60
NIFI-10844 Allow _source only output for GetElasticsearch and JsonQueryElasticsearch
This closes #6687

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-04 15:30:41 -06:00
Matthew Burgess c11092b2b4
NIFI-10998 Fixed SplitJson to always compile new JsonPath when property changes
This closes #6803

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-04 13:58:06 -06:00
dan-s1 06c8225bbd [NIFI-11006] Upgraded from Junit4 to Junit5
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6813
2023-01-04 16:07:20 +00:00
Nissim Shiman d229f3fd11
NIFI-10608 Process Group copies include non-processor referenced
controller services

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6685
2023-01-03 12:09:01 -05:00
dan-s1 481cdaf3db
NIFI-11018 Upgraded nifi-web-security to JUnit 5
This closes #6814

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-02 12:16:37 -06:00
dan-s1 b74c5b423f
NIFI-10979 Additional nifi-framework upgrades from JUnit 4 to 5
This closes #6806

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:18:38 -06:00
Esa Lindqvist 4716c8d715
NIFI-10456 Added Client Authentication Strategy option to OAuth2 Provider
StandardOauth2AccessTokenProvider has been updated with new property `Client Authentication Strategy` supporting Basic Authentication as recommended in RFC 6749. The changes maintain the current default implementation using Request Body parameters

This closes #6782

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:07:33 -06:00
dependabot[bot] 9915bded77
NIFI-11017 Upgraded Hazelcast from 4.2.5 to 4.2.6
This closes #6812

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:50:36 -06:00
Pierre Villard 09463b0ae5
NIFI-11012 Updated Twitter SDK from 1.1.4 to 2.0.3
This closes #6811

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:44:30 -06:00
Pierre Villard eb9f75e28f
NIFI-11009 Update Snowflake SDK to 1.0.2-beta.7
This closes #6808

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:29:58 -06:00
Pierre Villard bb886af69d NIFI-11010 - Update Kinesis client to 1.14.9
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6809
2022-12-29 11:29:48 +00:00
Mark Bathori 4b24bcd2f8
NIFI-10677: Add Choice data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6563.
2022-12-25 17:58:17 +01:00
Emilio Setiadarma bf24d575b3
NIFI-10971: improved edge case handling while fetching objects using Azure Key Vault Client and added unit tests
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6780.
2022-12-25 17:51:40 +01:00
exceptionfactory b556322749
NIFI-11005 Added Illegal and Redundant Import Modules to Checkstyle
- Updated impacted classes to remove redundant import lines
- Removed WebUtilsGroovyTest.groovy class due to use of internal sun.security classes

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6804.
2022-12-23 18:34:38 +01:00
Eric Bernard b65431564d
NIFI-10988 - Fix ConsumeGCPubSubLite processors delivering incorrect messages
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6788.
2022-12-23 18:26:13 +01:00
Matthew Burgess f38f14b363
NIFI-10585 Added GenerateRecord Processor
This closes #6480

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 19:30:05 -06:00
dan-s1 dde821cf71
NIFI-6498 Update TransformXml to send errors to Component Log
This closes #6798

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 11:15:37 -06:00
mr1716 c85a6e866f
NIFI-10921 Upgraded Apache POI from 5.2.2 to 5.2.3
This closes #6760

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-19 12:41:42 -06:00
Matthew Burgess 2a88980024 NIFI-4572: Include database and table names in CaptureChangeMySQL events even when cache is not configured
This closes #6786.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-19 17:30:33 +01:00
Nandor Soma Abonyi caee606706
NIFI-10884 log target filename
This closes #6792.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-18 22:49:52 +01:00
krisztina-zsihovszki 1d5a1bff08
NIFI-10868 PutDropbox processor
This closes #6740.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-16 18:51:31 +01:00
Bryan Bende 5c3ca9d537
NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs,… (#6785)
- NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs, and ensure the auto-loader attempts to process any NARs available before starting to watch for new files
- Add system test with NAR Provider that copies NARs from a local directory and verifies the NARs were loaded and linked correctly
- Exclude new assembly from CI test-compile
2022-12-16 11:30:37 -05:00
exceptionfactory a8974253ce
NIFI-10989 Removed SHA-1 and MD5 from TestHashContent
- Removed methods to avoid intermittent failures due to lack of Bouncy Castle Security Provider registration

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6790
2022-12-15 22:06:52 -05:00
Rajmund Takacs 1c40738997
NIFI-10618: Add Asana connector
This closes #6504.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-16 00:14:26 +01:00
Peter Turcsanyi ae5d23db47
NIFI-10987: Added default implementation of AWS SDK V2 credentials in AWSCredentialsProviderService
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6787.
2022-12-15 16:43:04 -05:00
Peter Turcsanyi 1e23e5146f NIFI-10969: Created extension point for Signer Override in AWS S3 processors
Also added Signer Override property in AWSCredentialsProviderControllerService with Custom Signer extension point.
Made Assume Role related properties dependent on Assume Role ARN property in AWSCredentialsProviderControllerService.
Fixed S3 IT tests.

This closes #6777.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-15 18:43:22 +01:00
Mark Payne 78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6725
2022-12-14 12:09:32 -05:00
Lehel Boér ed6ba53724 NIFI-10832: Create PutSalesforceRecord processor
This closes #6670.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
dan-s1 e21f622643
NIFI-10877 Converted more nifi-framework-core tests from JUnit 4 to 5
This closes #6775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-13 11:37:59 -06:00
exceptionfactory c11dff912a
NIFI-10958 Adjusted Script Engine handling to avoid exceptions
- Added empty check for list of discovered Script Engines to avoid exceptions for documentation generation on Java 17

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6774
2022-12-12 16:43:28 -05:00
Nathan Gough 2fa82179a8
NIFI-10576 Added onFinishRecordSet implementation for WriteParquetResult
This closes #6517

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-09 14:16:21 -06:00
hj28 ac8e3dae58
NIFI-10637 Deterministic TestGenerateTableFetch testMultipleColumnTypeMissing
This closes #6754

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-09 10:41:36 -06:00
exceptionfactory b0ab364f61
NIFI-10967 Corrected TestWriteJsonResult mixed arrays
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6773
2022-12-09 01:01:58 -05:00
Bryan Bende 334c9db9c3
NIFI-10915 Add additionalDetails content to runtime manifest
- Update manifests assembly to include the additionaDetails.html files
- Update C2 ExtensionDefinition to add a new field for additional details content
- Update manifest generation to read the additional details and pass through to C2 runtime manifest
- Switch to boolean to indicate presence of additional details, instead of including content

Add additionalDetails files to nifi-runtime-manifest artifact, organized by group/artifact/version/type

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6767
2022-12-08 11:02:56 -05:00
Matt Burgess b744fac479
NIFI-10956: Fix inference issues with mixed arrays (#6763) 2022-12-08 09:28:19 -05:00
exceptionfactory 45a31c7286 NIFI-10899 Added SameSite Policy to Application Cookies
- Added __Secure prefix to Application Cookie Names

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6735.
2022-12-05 14:09:39 -05:00
Paul Grey 3dc48f0894 NIFI-10916 - Controller Service allowable values dropdown list should be sorted
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6739.
2022-12-05 11:44:07 -05:00
exceptionfactory ab7ce58fb1
NIFI-10947 This closes #6758. Upgraded Apache Commons Net to 3.9.0
- Added Commons Net to managed dependencies in root Maven configuration
- Removed version references to 3.3 in MiNiFi and 3.6 in NiFi standard modules

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-05 09:01:29 -07:00
mr1716 de694ee45d
NIFI-10920 Upgraded Jettison from 1.5.1. to 1.5.2
This closes #6747

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-05 09:11:24 -06:00
exceptionfactory 87c583042e
NIFI-10941 Removed TestNG references
- Replaced TestNG assertions with JUnit 5
- Excluded testng transitive dependencies from groovy-all
- Added testng exclusion to Maven Enforcer configuration

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6753.
2022-12-05 13:11:59 +01:00
exceptionfactory 47fc3ae77d
NIFI-10898 This closes #6729. Removed unused test HTTP Servlets
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-04 21:08:14 -07:00
Mark Payne e1c8c96111 NIFI-10937, NIFI-10938, NIFI-10939: When restoring flow from XML, properly parse XML for registry clients, looking for 'id' tag instead of 'identifier' tag. Fixed typo in error message about Reporting Task for Registry Clients. Updated StandardFlowComparator so that we compare sub-process groups' contents only if the Flow Coordinates are different by more than their version
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6752.
2022-12-02 18:37:47 -05:00
Mark Payne 2473683ce5 NIFI-10918: When fetching a flow from a Flow Registry, if it references any 'internal versioned flows' instead of requiring that we have a client configured for the appropriate URL, attempt to fetch the flow from each client. We will start with the clients that do report that they can handle the URL but will try others as well. As soon as we successfully fetch the flow, we stop.
NIFI-10918: Fixed checkstyle violations

This closes #6736
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-12-02 14:24:40 +01:00
exceptionfactory c51411d360
NIFI-10925 Refactored TestPutSFTP with discrete test methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6746.
2022-12-02 10:08:18 +01:00
mr1716 beb0f920d5
NIFI-10912 This closes #6742. Upgrade JSLT To 0.1.14
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-01 12:02:35 -07:00
exceptionfactory 3399d09c46
NIFI-10923 This closes #6745. Upgraded Apache SSHD to 2.9.2
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-01 12:02:01 -07:00
exceptionfactory c3b0e1a790
NIFI-10919 Corrected SCRAM SASL Mechanism for Kafka Components
This closes #6743
Signed-off-by: Paul Grey <greyp@apache.org>
2022-12-01 11:29:29 -05:00
simonbence 570fc7f1fa
NIFI-10914 Adjusting input check for loading nested versioned flows (#6741) 2022-12-01 11:09:51 -05:00
greyp9 282c56b5ce
NIFI-10901 - PublishKafka headers not sent in ProducerRecord (#6731) 2022-11-30 13:23:23 -05:00
mr1716 c79eca94a1
NIFI-10910 Upgraded amqp-client from 5.15.0 to 5.16.0
This closes #6734

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-30 11:54:50 -06:00
Tamas Palfy f630540891
NIFI-10765 Added better error reporting in JASN1Reader
This closes #6703

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:45:18 -06:00
sopan98 ee5d557d2a
NIFI-10891 Replaced HashMap with LinkedHashMap in BinFiles
- Resolved non-deterministic behavior in TestMergeContent.testDefragmentMultipleMingledSegments

This closes #6727

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:29:08 -06:00
sopan98 ab8e9aa8df
NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader
- Updated unit test based on deterministic behavior of LinkedHashMap

This closes #6726

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:26:58 -06:00
Nandor Soma Abonyi 3a7ec5d542 NIFI-10785 Allow publishing AMQP message with null header value
NIFI-10785 addressing review comment
NIFI-10785 addressing review comments (remove unnecessary property to ignore null headers)

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6649.
2022-11-29 12:41:23 -05:00
exceptionfactory de296b5e65 NIFI-10897 Replaced Spring Security Base64 with java.util.Base64
This closes #6728

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-29 12:20:16 -05:00
exceptionfactory d55fb91b0f NIFI-10871 Skipped CSRF processing for replicated HTTP requests
- Updated Security Filter Configuration to avoid unnecessary CSRF Request Token generation for requests replicated between cluster nodes

This closes #6715.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-29 17:19:18 +01:00
priyanka-28 830a64b8e9
NIFI-10834 Updated TestPutSplunkHTTP to avoid non-deterministic tests
This closes #6672

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 21:07:18 -06:00
Yihen Liu a3c895341c
NIFI-10875 Changed TestQuerySolr to check for path elements
- Changes avoid non-deterministic expectations for query parameters

This closes #6718

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 17:12:19 -06:00
Chris Sampson 43a8b858ca
NIFI-10882 Set credentials for ElasticSearchClientService based on AuthorizationScheme
This closes #6722

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 17:01:40 -06:00
dan-s1 e8d554d9b4
NIFI-10876 Converted some nifi-framework tests from JUnit 4 to JUnit 5
This closes #6720

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 14:47:17 -06:00
Joe Gresock 31af82275e
NIFI-10791 Added AWS SDK v2 support to AWSCredentialsProviderControllerService
This closes #6661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 14:36:12 -06:00
Vasily Makarov 83feb0a02d
NIFI-7190 CaptureChangeMySQL processor remove comments from normalized query
This closes #6711

Co-authored-by: Vasily Makarov <feitgraph@gmail.com>
Co-authored-by: Matt Burgess <mattyb149@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 12:53:47 -06:00
Nandor Soma Abonyi b0a92868a9
NIFI-10872 Fix broken Java Mail links in ConsumeIMAP and ConsumePOP3 documentation
This closes #6723

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 10:47:00 -06:00
Bence Simon df21478297
NIFI-10874 Fixed issue with multiple levels of versioned flows
This closes #6719

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 10:44:12 -06:00
Joe Witt 198a27abbe
NIFI-10854 adjusting post merge for next release cycle 2022-11-28 08:49:35 -07:00
Joe Witt 1046b2c308
Merge branch 'NIFI-10854-RC1' 2022-11-28 08:43:56 -07:00
Arpad Boda a469c92f21
NIFI-10873 - GenerateFlowFile: flowfiles in a batch are not unique
This closes #6717.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-28 16:41:19 +01:00
Matthew Burgess 5f1d93f977 NIFI-5819: Support SQLServer sql_variant type
This closes #6699.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-24 16:57:50 +01:00
Ryan Van Den Bos 2ad33eea80 NIFI-10845 - JsonQueryElasticsearch processors are not outputting an empty flow file for a combined response with output_no_hits set to true
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6701
2022-11-23 18:27:28 +00:00
sssqhai 2393785765
NIFI-6428 Add 'inTransaction' value to state,fix bug
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6036
2022-11-23 09:58:06 -05:00
Peter Turcsanyi 40b46b4f5d
NIFI-10850: Fixed Query Parameters property in InvokeAWSGatewayApi should support FlowFile attributes in EL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6692.
2022-11-23 13:04:58 +01:00
exceptionfactory 9cc9692c98
NIFI-10866 Refactored Kafka 1.0 and 2.0 using nifi-kafka-shared
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6710.
2022-11-23 05:04:34 -05:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
exceptionfactory 0ca09fd52c
NIFI-10864 This closes #6707. Deprecated Hive 1.1 and 1.2 Components
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:34:26 -07:00
exceptionfactory 6062f16667
NIFI-10861 This closes #6705. Deprecated Azure Storage Processors using legacy Microsoft SDK
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:34:06 -07:00
exceptionfactory 5aa7ba9bf9
NIFI-10860 This closes #6704. Deprecated ExecuteFlumeSink and ExecuteFlumeSource
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:33:45 -07:00
sopan98 ff14ea2aab
NIFI-10862 This closes #6709. Fix Flaky tests in TestXMLReader
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:25:02 -07:00
Shane Ardell aa6f6dd61d
NIFI-10814: Display description for selected flow (#6693)
* display description for selected flow

* NIFI-10814: add border when content overflows and increase height

* NIFI-10814: add padding to description

* NIFI-10814: remove duplicate CSS property from declaration block

* NIFI-10814: a few more CSS tweaks

This closes #6693
2022-11-22 17:01:38 -05:00
exceptionfactory 8e417c890a
NIFI-10819 Restricted JndiLoginModule for Kafka JAAS Config
- Refactored property configuration and validation to nifi-kafka-shared

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6690.
2022-11-22 16:51:23 -05:00
Matthew Burgess 09bc5bcb5a
NIFI-10699: Add FLOW_CONFIG_HISTORY table to QueryNiFiReportingTask
This closes #6581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 15:35:22 -06:00
Mike Thomsen 6a9cb9c10c
NIFI-10863 Added conditional InvokeHTTP HTTP debug log
- Wrapping if statements prevent them from being called at all if debug logging is disabled

This closes #6706

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 15:31:53 -06:00
Nandor Soma Abonyi 4ea425e235
NIFI-10656 Log ignored event with info instead of warning
This closes #6540.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-22 22:13:56 +01:00
exceptionfactory 7019e182b5
NIFI-10835 Improved performance of TestControlRate
- Added LongSupplier for TimedBuffer and ControlRate classes to support overriding System.currentTimeMillis()

This closes #6671
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-22 13:14:04 -05:00
Curtis Ruck 54108689b6
NIFI-10842 Added HTTP Protocols to StandardOauth2AccessTokenProvider
This closes #6686

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:26:32 -06:00
sopan98 2d70bfb380
NIFI-10744 Changed HashSet to LinkedHashSet in SegmentContent for deterministic handling
This closes #6700

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:07:58 -06:00
exceptionfactory 6b188636ff
NIFI-10188 Added jaxws-api for ConsumeEWS on Java 11
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6697
2022-11-21 18:30:33 -05:00
dan-s1 844f311c52
NIFI-9107 Converted remaining nifi-enrich-bundle tests from JUnit 4 to 5
This closes #6698

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:54:58 -06:00
dan-s1 f3d2dfaf5c
NIFI-9165 Converted remaining nifi-standard-bundle tests from JUnit 4 to JUnit 5
This closes #6696

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:53:14 -06:00
Paul Grey 620b7365c2
NIFI-10851 Corrected removal of Controller Service references on property updates
- Convert unit test to JUnit 5

This closes #6695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:45:54 -06:00
Mark Payne 2126dbbe29
NIFI-10660: When converting Avro GenericRecord to a java Map, check GenericRecord's schema to see if field exists before calling Record.get().
NIFI-10660: Added unit tests; fixed bug to ensure that we use the desired field name when checking if it exists in schema

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6688
2022-11-21 15:09:31 -05:00
Mike Thomsen e172a3f224
NIFI-10840 Added a build profile to enable Neo4J 5 support
This closes #6684

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 14:07:27 -06:00
Chris Sampson d23e50168f
NIFI-10776 Added NONE and PKI AuthorizationSchemes for ElasticSearchClientService
This closes #6662

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 13:52:18 -06:00
aksharau a861bab34d
NIFI-9920 Fetching all bulletins of a process group on update process group (#6335) 2022-11-21 11:24:47 -05:00
Mark Bathori 594e93d97e
NIFI-10812: Remove duplicate record template creation from Iceberg record converter
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6659
2022-11-20 17:26:49 -05:00
Bence Simon 4fe65f1b81
NIFI-10828 Adding new REST API endpoint for exposing versioned flow details
NIFI-10828 Fixing documentation

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6674
2022-11-20 17:05:50 -05:00
Lehel Boér 81b36e69ae
NIFI-10389 Added mime.type to GetShopify and GetHubSpot
This closes #6682

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:42:43 -06:00
mr1716 c63a668ac5
NIFI-10808 Upgraded Guava from 31.0.1 to 31.1
This closes #6683

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:18:13 -06:00
Robert Kalmar 89426d167b
NIFI-10370 Create PutSnowflake processor using Snowpipe ingest
This closes #6584.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-18 16:19:03 +01:00
Pierre Villard 2698282615 NIFI-10804 - Update okhttp-digest to 2.7
This closes #6681

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:35:12 -05:00
Pierre Villard 87f02d26d9 NIFI-10809 - Update greenmail to 1.6.11
This closes #6679

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:33:34 -05:00
Pierre Villard 85a95550bb NIFI-10806 - update snmp4j dependencies
This closes #6677

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:32:06 -05:00
Matthew Burgess 214bd2f00c
NIFI-7862: Add UpdateDatabaseTable processor for auto table structure updates
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5523.
2022-11-17 14:38:52 -05:00
krisztina-zsihovszki dfdd86cff7 NIFI-10793 Comment is not populated when process group is created via API
This closes #6653.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-17 16:04:46 +01:00
Arpad Boda 7a449dbcee NIFI-10833 - Fix grammar error in ListenHTTP log msg 2022-11-16 19:40:20 -05:00
sedadgn 009d641576 NIFI-10787 - Cannot commit flows to nifi registry after updating our nifi release to 1.18.0
NifiRegistryFlowRegistryClient defines the PropertyDescriptor PROPERTY_URL  name as small case "url". The map bases on the name property of the PropertyDescriptor object. Here searching with uppercase value of "URL" causes the map lookup to fail and cause a NPE later on. Therefore, it is changed as "url"

NIFI-10787 - Added constant for property descriptor "url" in NiFiRegistryFlowMapper to make it more clear.

NIFI-10787 - Added change to unit test.

NIFI-10787 - Updated unit test to validate that NiFi registry url is being set and retrieved.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6655.
2022-11-16 19:07:15 -05:00
Mark Payne d7f2eb7c26
NIFI-10818: Fixed bug in which oldest bin in MergeContent was not being evicted in order to make room for a new bin when using a correlation attribute. Added additional tests for JoinEnrichment to ensure that the changes had no adverse effects on that processor. Found a bug when running that test in MockProcessSession so also addressed the bug (ConcurrentModificationException).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6668
2022-11-16 16:49:29 -05:00
greyp9 30facedc43
NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key (#6131)
* NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key
* publisher wrapper record; property naming and display order; doc updates
2022-11-16 16:07:43 -05:00
exceptionfactory bd89d66539
NIFI-7392 Corrected TestValidationJson for Windows build 2022-11-16 11:29:12 -06:00
mr1716 83ff168ac1
NIFI-10763 Upgraded mysql-binlog-connector-java from 0.26.1 to 0.27.5
This closes #6667

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:19:19 -06:00
r65535 a702a8c215
NIFI-7392 Added ValidateJson to Standard Processors
This closes #6337

Co-authored-by: dan-s1 <dsteig1@gmail.com>
Co-authored-by: r65535 <ryan77056@gchq.gov.uk>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:02:17 -06:00
Nathan Gough 1b8cd8349b
NIFI-10703 - Updated VersionedDataflow to support MaxEventDrivenThreadCount
NIFI-10703 - Also setting the maxEventDrivenThreadCount on the controller when using a versioned flow.
NIFI-10703 - Corrected to use getMaxEventDrivenThreadCount(), set a default value for event driven thread count in VersionedDataflow
NIFI-10703 - Updated log message for setMaxThreadCount in FlowController.java
NIFI-10703 - Updated default value for maxEventDrivenThreadCount
NIFI-10703 - Set private for DEFAULT_MAX_EVENT_DRIVEN_THREAD_COUNT

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6638
2022-11-15 21:08:48 -05:00
Matthew Burgess f2774c4924
NIFI-9814: Add range sampling to SampleRecord
- Incorporated review comments

This closes #5878
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-15 18:49:51 -05:00
Nandor Soma Abonyi 241d619138
NIFI-10775 Improve support for DescribedValue in PropertyDescriptor.Builder
This closes #6650.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 22:17:21 +01:00
Mark Payne bda624823b
NIFI-10817: Moved the calls in StandardProcessSession to 'resetState()' and 'acknowledgeRecords()' from the outer commit(boolean) to the inner commit(Checkpoint, boolean). By moving the call here, the logic of StandardProcessSession is unaffected. But the StatelessProcessSession that inherits from it now has the benefit of having the state cleaned up when calling super.commit(Checkpoint, boolean).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6663
2022-11-15 15:47:32 -05:00
Malthe Borch a71556f115
NIFI-10491 Added Conflict Resolution Strategy to PutAzureBlobStorage_v12
This closes #6443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:40:23 -06:00
mr1716 491f21bf90
NIFI-10727 Upgraded grpc libraries from 1.48.0 to 1.50.2
This closes #6660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:24:17 -06:00
Paul Grey 25b6e2c9cd
NIFI-10815 Fixed initial internal yield duration when processor created
This closes #6664

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:14:50 -06:00
Tamas Palfy 56af75f5bd
NIFI-10722 - Add handling of TBCD-STRING in nifi-asn1-services
This closes #6611

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:12:22 -06:00
Mark Bathori 4083e07447
NIFI-10801: Fix hive metastore based tests in Iceberg processors
This closes #6656.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 20:12:37 +01:00
Mark Bean 2bfefc3e5b NIFI-10243: allow ControlRate to throttle on combination of data rate or flowfile rate
NIFI-10243: fix typos

NIFI-10243: re-ordered property in ControlRate

NIFI-10243: minor updates to make code cleaner based on PR comments

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6506.
2022-11-14 23:04:55 -05:00
Emilio Setiadarma d06c19180a
NIFI-9697: Implemented AzureKeyVaultSecretsParameterProvider and AzureKeyVaultCredentialsService; Implemented unit tests as well as the documentation for the Parameter Provider
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6545.
2022-11-14 13:25:47 -05:00
Nathan Gough 23e8a19417
NIFI-10705 - Primary keys were not being included in ConvertJSONToSQL UPDATE queries when 'User statement.type Attribute' was used.
This closes #6652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 09:23:10 -06:00
Bryan Bende 7de74ad3f0
NIFI-10802 Apply bundle updates before properties in component synchronizer (#6654)
This closes #6654
2022-11-14 09:09:44 -05:00
mr1716 5fb8cf89f0
NIFI-10730 Upgraded Splunk from 1.6.5.0 to 1.9.1
This closes #6617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:58:27 -06:00
Mike Thomsen 78dbee8b7a
NIFI-10805 Upgraded script bundle Clojure, Groovy and JRuby
- Upgraded Clojure from 1.10.1 to 1.11.1
- Upgraded Groovy from 3.0.8 to 3.0.13
- Upgraded JRuby from 9.3.8.0 to 9.3.9.0

This closes #6657

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:54:52 -06:00
Mike Thomsen 00da6d5ead
NIFI-10562 Moved MongoDB to testcontainers for integration-tests
This closes #6642

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:35:06 -06:00
Peter Gyori 412c1f2e43
NIFI-10762: Ranger Authorizer accepts multiple Ranger Admin Identity property values (#6625) 2022-11-14 08:28:24 -05:00
Emilio Setiadarma 08bc44715e
NIFI-10789 Set FlowFile attributes for errors fetching from Azure Data Lake Storage
This closes #6644

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:27:59 -06:00
Mike Thomsen ea10b62615 NIFI-10794 Made StandardOauth2AccessTokenProvider a verifiable controller service.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6645.
2022-11-13 17:04:50 +00:00
exceptionfactory b14eedfa7f
NIFI-10796 This closes #6647. Upgraded Apache Iceberg from 0.14.0 to 1.0.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-10 15:39:23 -07:00
exceptionfactory 588e04cd07 NIFI-10780 Improved Event Server to avoid dropping messages
- Improved ByteArrayMessageChannelHandler to call BlockingQueue.offer() while the server is not shutting down
- Improved NettyEventServer to use ChannelFuture.await() for closing the channel to allow shutdown to proceed
- Added test method for EventDroppedException handling

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6634.
2022-11-10 15:38:43 -05:00
Tamas Palfy 56d0061da4
NIFI-10764 Fixed handling BIT STRING in nifi-asn1-services
Representing as a string of 1s and 0s (e.g. "010011000")

This closes #6622

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-10 10:33:17 -06:00
Seokwon Yang 0643f336e8
NIFI-10130 AzureGraphUserGroupProvider handles group with transitive members
This closes #6135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 15:47:03 -06:00
Pierre Villard 425dd6a848
NIFI-10790 Updated Snowflake JDBC driver from 3.13.21 to 3.13.24
This closes #6641

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 15:32:30 -06:00
sopan98 ad4e0b0585
NIFI-10783 Switched to LinkedHashMap for CompareFuzzyHash
This closes #6639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 14:27:39 -06:00
Gabor Kulik 1bd4169558 NIFI-10702 Clear server list on connection error in SMB processors
This closes #6620.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-09 21:07:24 +01:00
Bryan Bende 9c21e26e63
NIFI-10788 Ensure proposed service config is applied when component synchronizer adds a new service (#6640)
This closes #6640
2022-11-09 15:04:19 -05:00
Mike Thomsen ddfaf16f68
NIFI-10781 Made the MongoDB controller service implement VerifiableControllerService.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6635
2022-11-08 17:40:41 -05:00
exceptionfactory 01816da56f
NIFI-10645 Corrected Bouncy Castle dependencies for Iceberg
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6636
2022-11-08 17:36:57 -05:00
Nandor Soma Abonyi d374c1f399
NIFI-10760 Add API Key authentication to ElasticSearchClientServiceImpl
This closes #6619

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 16:02:49 -06:00
dependabot[bot] cc35e3e427
NIFI-10782 Upgraded Apache Ivy from 2.5.0 to 2.5.1
This closes #6630 and #6631

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 15:31:45 -06:00
sopan98 889254a9dc
NIFI-10744 Used LinkedHashMap in TestScanHBase methods
This closes #6633

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 14:51:10 -06:00
sopan98 ce18b63db0
NIFI-10743 Used LinkedHashMap in TestHBase_1_1_2_ClientService.testScan
This closes #6632

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 14:49:22 -06:00
SaumyaGurtu 747b5d4d9e NIFI-10317 Taking care of NullPointerException if AMQP header value is null
NIFI-10317 refactoring to remove repeated conversions to string from char
NIFI-10317 correctly handle null values: null vs "null"
NIFI-10317 adding test
NIFI-10317 - Updated ConsumeAMQPTest to test for null and empty header values.
NIFI-10317 - Updated ConsumeAMQPTest to use hard coded string values when testing. Made convertMapToString() private.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6382.
2022-11-08 12:14:05 -05:00
Mark Bathori 2a85264dd5
NIFI-10645: Add cloud profiles for Iceberg processors
This closes #6541.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-08 18:03:31 +01:00
exceptionfactory 7c1a7da116 NIFI-10737 Corrected ListenBeats buffer handling
- Added test class for ListenBeats
- Removed unnecessary dependencies
- Implemented BatchDecoder for reading Beats Protocol frames
- Refactored protocol and handler classes

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6608.
2022-11-07 17:09:45 -05:00
exceptionfactory e60cbd4bbb
NIFI-10768 Filter empty messages in ListenSyslog (#6624)
- Added FilteringStrategy argument to Server Factory for ListenSyslog
- Set quick shutdown quiet period for ListenSyslog and TestListenSyslog
- Added test method for batched messages with empty message included
2022-11-07 15:05:40 -05:00
Bryan Bende 83d4e5bd04
NIFI-10771 Add SINGLE_BATCH_PER_NODE to allowable values for flow file concurrency in ProcessGroupDTO
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6627
2022-11-07 13:58:49 -05:00
Joe Gresock c6dde491ec
NIFI-10770: Removing fetch parameters on startup
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6626
2022-11-07 13:46:01 -05:00
Shane Ardell 60a8b3bc5f
NIFI-10698: Add filtering options to summary table (#6610)
* NIFI-10698: Add filtering options to summary table

* NIFI-10698: fix checkbox spacing and alignment

* NIFI-10698: fix spacing between dropdowns

Merged #6610 into main.
2022-11-07 10:34:42 -08:00
exceptionfactory 4f80233575
NIFI-10733 Upgraded Curator from 5.3.0 to 5.4.0
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6621
2022-11-07 10:00:06 -05:00
Marco Carlino 6ce2e3799c
NIFI-10349 add maximum object age property to list s3
This closes #6293.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-07 14:44:53 +01:00
Chris Sampson 2acfd1e496 NIFI-9398 add verification to ElasticSearchClientService (with integration tests) and Elasticsearch REST API processors
NIFI-9398 processor verification integration-tests for nifi-elasticsearch-restapi-processors using common nifi-elasticsearch-test-utils refactored from nifi-elasticsearch-client-service
NIFI-9398 fail index exists verification for Elasticsearch processors whose operations would not create the index if it doesn't already exist

This closes #6544

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-05 18:17:13 -04:00
exceptionfactory d9e494f976
NIFI-10713 Added Deprecation Warning for PGP in EncryptContent
NIFI-10713 Removed OpenPGP, PGP, and GPG tags

This closes #6613
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-04 18:04:37 -04:00
Mark Payne 381e0f84e1
NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception
This closes #6623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 16:20:22 -05:00
Mark Bean 61e1a37d2e
NIFI-10228: parse json flow using instanceIdentifier as the UUID
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6217
2022-11-04 13:09:29 -04:00
Mark Bean 4e4f6437ee
NIFI-4798 allow empty value for UpdateAttribute property
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6585
2022-11-04 12:29:19 -04:00
Mike Thomsen 19658df52b
NIFI-10675 Corrected SSL support in Neo4j V4 Cypher Service
- Added Testcontainers for Neo4j integration tests

This closes #6559

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 09:23:34 -05:00
Ferenc Erdei 86acde2fe2
NIFI-10750 Move C2NiFiClientService to minifi-framework
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #6612.
2022-11-04 08:53:53 +01:00
Nathan Gough d237fd228f
NIFI-10738 Updated SNMP tests to retry BindExceptions
This closes #6606

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 17:43:57 -05:00
Nissim Shiman f4069ab77a
NIFI-10287 ExecuteScript - Allow python scripts to use external modules
Co-authored-by: Nissim Shiman <nshiman@yahoo.com>
Co-authored-by: dan-s1 <dstieg1@gmail.com>

NIFI-10287 changes for code review

NIFI-10287 modification based on reviewer comment

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6254
2022-11-02 16:18:41 -04:00
mr1716 6fed5dee17
NIFI-10732 Upgraded ASN1Bean from 1.12.0 to 1.13.0
NIFI-10731 Upgraded asn1bean-compiler from 1.12.0 to 1.13.0

This closes #6609

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 10:34:41 -05:00
Matt Gilman ec22504d6e
NIFI-10709 Showed log in link on logout complete page
- Fixing issue remove token when logging out from the canvas.

This closes #6592

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 10:28:18 -05:00
Nathan Gough c40639a51f
NIFI-10332 Selected OIDC Logout method using Discovery URLs
This closes #6594

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-01 21:33:26 -05:00
TheGreatRandall 238c356219
NIFI-10637 Simplified Locale validation in ParseCEF
This closes #6522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 18:43:19 -05:00
BoyuLi4 56d26be3ca
NIFI-10630 Updated TestWaitNotifyProtocol comparing JSON Objects
This closes #6526

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 15:56:31 -05:00
priyanka-28 6f65cd1f32
NIFI-10629 Updated TestJsonEntitySerializer with sorted properties
This closes #6515

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 15:09:04 -05:00
zhewenf2 65201ab88b
NIFI-10642 Fix flaky test groupByStringMixedNumberOfRecords
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6528
2022-10-31 15:58:27 -04:00
Mike Thomsen 2a45d4ac89
NIFI-10729 Added Cassandra testcontainers.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6604
2022-10-31 14:39:26 -04:00
Mike Thomsen b6d95faa95
NIFI-10711 Made the script runner more debuggable.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6590
2022-10-31 13:39:42 -04:00
mr1716 8d2789dbc4 NIFI-10725 Update ICU4J to 72.1
This closes #6603

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-30 08:44:48 -04:00
mr1716 60d7f437a6
NIFI-10720 Update bval-jsr to 2.0.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6600.
2022-10-29 10:29:43 +02:00
M Tien e862a02df6
NIFI-10715: improve tooltips in parameter providers (#6598)
* NIFI-10715: clean up tooltips in parameter providers

* more clean up

This closes #6598
2022-10-28 16:23:18 -04:00
UcanInfosec 557a1a7869 NIFI-10718 Update mongo.driver.version to 4.7.2
This closes #6599

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-28 15:51:53 -04:00
Paul Grey 61ccb23b47
NIFI-10704 - include API name of properties in processor documentation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6586
2022-10-28 14:13:16 -04:00
Ferenc Kis 65558accda
NIFI-10679 MiNiFi C2 Update Asset Command
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #6583.
2022-10-28 20:09:15 +02:00
mr1716 438d8ec1eb NIFI-10688 Update javax.json-api & javax.json
This closes #6572

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-28 08:02:28 -04:00
exceptionfactory c6ae69e054
NIFI-10716 Upgraded Flume from 1.10.1 to 1.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6595.
2022-10-28 10:59:29 +02:00
M Tien be64f5560c
NIFI-10603: fix showing the referencing components border in the fetch parameters dialog (#6491)
This closes #6491
2022-10-27 13:45:24 -04:00
Csaba Bejan ac7306f582
NIFI-10693 Remove proxy configuration properties from PutBigQuery
This closes #6580.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-27 16:57:11 +02:00
UcanInfosec ef0793c8fc
NIFI-10695 Update org.eclipse.paho.client.mqttv3 to 1.2.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6578.
2022-10-27 07:29:19 +02:00
Matt Gilman b05bd988b6 NIFI-10700:
- Only restart ports if their scheduledState is Running.
- Adding unit tests.
- Fixing unit test to properly verify Port isn't restarted.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6582.
2022-10-26 16:31:27 -04:00
Mark Payne d390a0becf
NIFI-10673: When a component is added to a ProcessGroup, we had a method called ensureUniqueVersionControlId but the method only took into accounts in that Process Group. Updated methods to now consider components in any Process Group that is part of the same Versioned Flow. Also added system test to verify the problem and the fix. Added Toolkit clients and additional methods as necessary in order to implement system tests
NIFI-10673: Addresed checkstyle issue

NIFI-10673: Removed TODO comment
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2022-10-26 14:38:01 -04:00
Chris Sampson b6026f5709 NIFI-10303 route GetElasticsearch to failure if _id is blank after attribute evaluation
This closes #6573

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-25 14:30:09 -04:00
Chris Sampson db49a861b3 NIFI-10687 set Elasticsearch document _id to null if ID attribute evaluated to blank String for PutElasticsearchRecord or PutElasticsearchJson; use @timestamp default value if @timestamp record path evaluates to blank String in PutElasticsearchRecord
This closes #6575

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-25 14:23:19 -04:00
Andrew Lim 2d5a8b8b0d NIFI-10503 Changed flow file references to FlowFile in GenerateTableFetch processor docs
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6577.
2022-10-25 11:13:07 -04:00
Denes Arvay 3ed87a2982
NIFI-10594 Render empty lines in Labels
This closes #6519

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:39:29 -05:00
UcanInfosec 3d1bf497a3
NIFI-10686 Upgraded questdb-core from 6.5.2 to 6.5.3
This closes #6570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:22:26 -05:00
mtien 643b6a6c1d
NIFI-10689 Fixed Parameter Provider Name encoding in context dialog
This closes #6576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:16:36 -05:00
Joe Witt c92a30734f
NIFI-10680 Corrected Bouncy Castle references in optional profiles
NIFI-10691 Removed duplicate Bouncy Castle dependencies from nifi-standard-processors

This closes #6571

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 17:46:51 -05:00
Timea Barna 7c33516aee NIFI-9437 Flowfile Expiration cannot exceed 24 days
NIFI-9437 Addressing review comments, correcting setter in StatelessFlowQueue class

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6558.
2022-10-24 14:46:56 -04:00
mr1716 753cb1b9df
NIFI-10683 Upgraded JNA to 5.12.1 for Windows Event Log
This closes #6568

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 09:53:43 -05:00
Malthe Borch 831a11d0b5
NIFI-7823 Added groups mapping from OIDC token claim
This closes #6454

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 09:12:24 -05:00
markap14 d64574b565
NIFI-10682: When determining effective property values, ensure that we always use the up-to-date version of Property Descriptors (#6567)
This closes #6567
2022-10-24 09:59:16 -04:00
mr1716 f23318a361
NIFI-10670 Update commons-csv from 1.8 to 1.9.0
This closes #6554

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 15:18:00 -05:00
Lehel Boér feb3148b68
NIFI-10628: Added Default Schedule Time and Run Duration to processors
This closes #6512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 14:57:46 -05:00
Nandor Soma Abonyi 2049268372
NIFI-10668 Persist proxy password in remote process group (#6557)
* NIFI-10668 Persist proxy password in remote process group
2022-10-21 11:44:12 -04:00
Joe Witt c155d29658
NIFI-10614 Upgraded Bouncy Castle from 1.70 to 1.71
- Blocked Bouncy Castle jdk15on dependencies
- Forced jdk18on dependencies and validated across entire build

This closes #6498

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 19:35:02 -05:00
exceptionfactory 9f2ad260bd NIFI-10667 Added Private Key Service interface and implementation
- Defined PrivateKeyService in nifi-key-service-api
- Implemented StandardPrivateKeyService using Bouncy Castle library

NIFI-10667 Improved custom validation to avoid repetitive reads

NIFI-10667 Added onPropertyModified() to clear Key Reference for validation

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6553.
2022-10-20 18:08:18 -04:00
Nathan Gough c22181e79f
NIFI-10672 - Removed intermittently failing method from DBCPServiceTest
This closes #6555

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 16:33:35 -05:00
markap14 e83e3eb849
NIFI-10663: When ProcessorNode.stop() is called, it returns a Future. That future, however, may be completed when the processor is fully stopped or whenever it becomes stopping. Fixed this behavior by only completing the future whenever the processor has fully stopped. Also addressed an issue in the synchronizer in which we did not stop a processor when it had a state of STARTING. (#6561)
This closes #6561
2022-10-20 15:42:37 -04:00
yiteng3 a5d93d96a3
NIFI-10631 Changed HashMap to LinkedHashMap in TestHBase_2_ClientService
- Adjustment avoids non-deterministic warnings related to HashMap ordering

This closes #6516

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-19 09:54:47 -05:00
dependabot[bot] 531a9de28f
NIFI-10669 Upgraded Jettison from 1.3.7 to 1.5.1
- Upgraded Jettison in nifi-framework-bundle
- Upgraded Jettison in nifi-registry-ranger
- Upgraded Jettison in nifi-spark-bundle

This closes #6548
This closes #6549
This closes #6550

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-19 09:45:49 -05:00
Peter Turcsanyi 2be5c26f28
NIFI-10659: Extracted DBCP common code to nifi-dbcp-base module for use in Snowflake NAR
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6543
2022-10-18 17:04:14 -04:00
UcanInfosec 808d3d6664
NIFI-10636 Update Jython-standalone to 2.7.3
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6521
2022-10-18 16:57:32 -04:00
exceptionfactory dd93fbeb7a
NIFI-10661 Corrected JSLT tests using parsed JSON comparison
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6551
2022-10-18 16:50:01 -04:00
exceptionfactory fcefd051d2
NIFI-10652 Corrected dependency scopes for nifi-iceberg-processors
- Marked nifi-iceberg-services-api as provided
- Marked multiple Hadoop and Hive dependencies as provided to avoid duplicate inclusion in nifi-iceberg-processors-nar

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6535
2022-10-18 13:25:11 -04:00
exceptionfactory 523dd94045
NIFI-10651 Upgraded Iceberg transitive dependencies
- Followed dependency override approach from nifi-hive-bundle based on Hive dependencies

NIFI-10651 Removed unnecessary Calcite dependency references

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6533
2022-10-18 13:23:15 -04:00
exceptionfactory b64b4fcce5
NIFI-10661 Added support for File Resources to JSLTTransformJSON
- Refactored unit test methods for reuse of shared operations
- Added link to JSLT Tutorial in property description

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6546
2022-10-18 13:16:29 -04:00
Matthew Burgess dfbc7dfc21
NIFI-8111: Add JSLTTransformJSON Processor
This closes #4797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-17 16:14:18 -05:00
Matt Burgess f43b989c99
NIFI-10617: Add missing DynamicProperty annotation to processors that use them (#6509)
This closes #6509
2022-10-17 12:46:37 -04:00
Matthew Burgess a76abef270 NIFI-10635: Fix handling of enums in PutDatabaseRecord
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6518.
2022-10-17 11:29:53 -04:00