Commit Graph

5991 Commits

Author SHA1 Message Date
mr1716 1466b7d7d3
NIFI-11458 Upgraded JNA from 5.12.1 to 5.13.0
This closes #7179

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:09:35 -05:00
mr1716 29bb652623
NIFI-11456 Upgraded brotli4j from 1.8.0 to 1.11.0
This closes #7178

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:08:27 -05:00
mr1716 dbb973a666
NIFI-10333 Upgraded HikariCP from 4.0.3 to 5.0.1
This closes #7177

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:06:59 -05:00
mr1716 f77659913f
NIFI-11457 Upgraded commons-configuration2 from 2.8.0 to 2.9.0
This closes #7176

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:05:09 -05:00
Mark Payne 7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Mark Bathori 44a7f7f38b
NIFI-11440 Speed up Iceberg Hive Metastore Tests
This closes #7170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 12:52:22 -05:00
Paul Grey cff7808543
NIFI-11439 Corrected GCS Transit URI for custom Storage API URL
This closes #7173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 10:09:27 -05:00
Paul Grey cd685671c8
NIFI-11439 Corrected Checkstyle violation on GCS Property
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 14:25:54 -05:00
Paul Grey ee24df2830
NIFI-11439 Added Storage API URL property to GCS Processors
- Included Host Header override with Storage API URL based on Google Private Service Connect documentation

This closes #7172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 13:56:23 -05:00
exceptionfactory bc5f00a667
NIFI-11437 Switched to StreamUtils.fillBuffer() for buffer, Improved EncryptContentPGP Content Type Detection
This closes #7166
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-13 12:11:45 -04:00
Pierre Villard 061f3a1380 NIFI-11429 - Upgrade Gremlin to 3.6.2
This closes #7160

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-13 08:22:25 -04:00
Bryan Bende ba93f60731
NIFI-11436 Fix NPE during updateFlow when called from a replace request for a PG that is not under version control (#7167) 2023-04-12 19:24:22 -04:00
Tamas Palfy 3322ad7a20
NIFI-10955 Added optional preprocessing to JASN1Reader
This close #6769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 22:16:20 -05:00
Pierre Villard 594e45cf9a
NIFI-11428 Upgraded Groovy to 3.0.17 and spock-core to 2.3
This closes #7159

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 08:01:36 -05:00
Pierre Villard cbca499070
NIFI-11427 Upgraded Atlas from 2.2.0 to 2.3.0
This closes #7158

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 08:01:36 -05:00
Pierre Villard a148b6f348
NIFI-11407 Upgraded Azure BOM from 1.2.9 to 1.2.11
- Added Woodstox Core to nifi-toolkit-encrypt-config

This closes #7136

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 14:36:48 -05:00
Joe Witt 4414793f2a
NIFI-11408 enable user to disable gzip compression with PutGCSObject
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7139.
2023-04-10 19:57:16 +03:00
Pierre Villard 21e4c665dc
NIFI-11421 Upgraded Parquet from 1.12.3 to 1.13.0
- Upgraded MockFtpServer from 2.7.1 to 3.1.0

This closes #7152

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:50:13 -05:00
Pierre Villard 81fefbafc9
NIFI-11420 Upgraded ActiveMQ from 5.15.15 to 5.18.0
This closes #7151

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:48:54 -05:00
Pierre Villard 06145d2b30
NIFI-11419 Upgraded MongoDB driver from 4.8.2 to 4.9.1
This closes #7150

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:46:45 -05:00
Pierre Villard 2b06306b07
NIFI-11418 Upgraded bcrypt from 0.9.0 to 0.10.2
This closes #7149

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:55 -05:00
Pierre Villard b0997f843d
NIFI-11416 Upgraded Caffeine from 2.8.1 to 3.1.6
This closes #7147

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:12 -05:00
Pierre Villard 0b2deb94de
NIFI-11415 Upgraded Saxon-HE from 10.6 to 12.1
This closes #7146

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:44:12 -05:00
Pierre Villard 2515c5771d
NIFI-11414 Upgraded snowflake-ingest-sdk from 1.0.3 to 1.1.1
This closes #7145

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:43:14 -05:00
Pierre Villard 83d19a6e9d
NIFI-11413 Upgraded JUnit 5.9.1 to 5.9.2
- Upgraded JUnit 4.13.1 to 4.13.2

This closes #7144

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:42:24 -05:00
Pierre Villard 0160d6d6b9
NIFI-11410 Upgraded multiple integration dependencies
- Upgraded Spring Boot from 2.7.9 to 2.7.10

This closes #7141

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:40:09 -05:00
mr1716 8992256f78
NIFI-11404 Upgraded AMQP Client from 5.16.0 to 5.17.0
This closes #7138

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 16:43:50 -05:00
mr1716 58257c8a55
NIFI-11403 Upgraded Calcite Core from 1.32.0 to 1.34.0
This closes #7137

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 16:42:45 -05:00
Pierre Villard 4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
Pierre Villard 9149bd47c4
NIFI-11406 Upgraded Google GCP from 26.4.0 to 26.12.0
- Upgraded Google Drive from Revision 20221219 to 20230306

This closes #7135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:47:15 -05:00
aglotero d80a19e230 NIFI-5642: QueryCassandra processor : output FlowFiles as soon fetch_size is reached
NIFI-5642: QueryCassandra processor : output FlowFiles as soon fetch_size is reached
Fixed checkstyle error
Delete build.sh
Delete local build file
NIFI-5642 : letting fetch_size to control the Cassandra data flow creating a new MAX_ROWS_PER_FLOW_FILE parameter
Fixed checkstyle error: no more import java.util.*
Fixed missing imports
NIFI-5642: added REL_ORIGINAL relationship in order to allow incremental commit
Addressing comments from code review
Adjustments on timestamp datatype formatting
Created the OUTPUT_BATCH_SIZE property
Code review adjustments
NIFI-5642: update after rebase
NIFI-5642: addressing PR comments
NIFI-5642: adding in integration test, fixing race condition
NIFI-5642: remove log4j2

This closes #6848

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-05 16:01:54 -04:00
Mark Bathori d15eeb445b
NIFI-11342: HDFS processors fail to get ClassloaderIsolationKey at startup
This closes #7121.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-04-05 15:37:28 +02:00
exceptionfactory dffad44a03
NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:10:02 -07:00
Nandor Soma Abonyi 32df0fa484
NIFI-11137 Add record support to Consume/PublishJMS (#6987) 2023-04-03 21:42:27 +02:00
exceptionfactory e4f0508c90
NIFI-11370 Corrected JWK Set retrieval for NIFI Trust Strategy (#7108)
- Added StandardOidcIdTokenDecoderFactory based on Spring Security OidcIdTokenDecoderFactory with custom REST Operations

Merged #7108 into main.
2023-03-31 16:26:02 -07:00
Matthew Burgess 59eebb9906
NIFI-8710: Pass details instead of source ID for Provenance per the interface doc
This closes #5224

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-31 18:43:22 +02:00
exceptionfactory 75eb449a31
NIFI-11365 Corrected OIDC Redirect URI resolution for reverse proxies (#7104)
- Added Authorization Request Resolver with support for building the base redirect URI using allowed proxy headers

This closes #7104
2023-03-30 16:26:35 -04:00
Nandor Soma Abonyi 2b9f2071ed
NIFI-11270 Refactoring of the overly Paho-specific MQTT interface
This closes #7032.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-29 23:20:06 +02:00
exceptionfactory 8952f7c0cf NIFI-11354 Removed Neo4j 3 Service and modules
This closes #7093

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-03-29 15:41:24 -04:00
exceptionfactory d66b29853e
NIFI-11359 Upgraded woodstox-core to 6.5.0 for Solr 8.11.1
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-29 08:04:35 -07:00
Mark Payne 23d6d6ede4
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:30:18 -05:00
exceptionfactory dde89c0b15
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 13:12:57 +02:00
exceptionfactory 7cb20d6f7f
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:22:12 -07:00
exceptionfactory 5214097c59
NIFI-11355 Upgraded Couchbase Client from 2.5.8 to 2.7.23
- Suppressed vulnerability findings related to Couchbase Server

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7094.
2023-03-28 22:05:55 +02:00
exceptionfactory 2dbb8f25f3
NIFI-11349 Upgraded HBase from 2.2.2 to 2.5.3 with Hadoop 3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7091.
2023-03-28 22:04:00 +02:00
exceptionfactory 158b5ffbcc
NIFI-11346 This closes #7088. Upgraded Parquet from 1.12.0 to 1.12.3
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:41:45 -07:00
exceptionfactory 5bdee9a714
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:41:11 -07:00
exceptionfactory 04cacad52a
NIFI-11348 This closes #7090. Upgraded JRuby from 9.3.9.0 to 9.4.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:40:51 -07:00
exceptionfactory 26400fcbe9
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 08:35:10 -04:00
exceptionfactory 623bcfd500
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:35:48 +02:00
Mark Payne 94ae926c42
NIFI-11333: Do not allow components to be removed while a node is disconnected
This closes #7085

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 17:43:38 -05:00
Mark Payne 969fc50778
NIFI-11341 Fixed OutputStream.close() handling for Content Claims
Fixed issue in StandardContentClaimWriteCache in which inner OutputStream class did not have an idempotent close() method; as a result, the stream could be written to while already in use for another active FlowFile; fixed bug in ContentClaimInputStream in which skip() method ignored its own BufferedInputStream - this was discovered because it was causing failures in StandardProcessSessionIT; fixed bug in StandardProcessSessionIT in which the length of StandardContentClaim was being doubled because the OutputStream was setting the claim length but that is already handled at a lower level.

This closes #7087

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:05:50 -05:00
Christian Wahl 6bd893da16
NIFI-11232 Fixed buffer handling in ContentClaimInputStream
This closes #6996

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:02:27 -05:00
krisztina-zsihovszki fe2721786c
NIFI-11266 PutGoogleDrive, ListGoogleDrive, FetchGoogleDrive can't access a SharedDrive
This closes #7058

Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-27 16:01:04 +02:00
Matt Burgess 1a9acb1f4b
NIFI-11337: Update PutDatabaseRecord's Max Batch Size property documentation to reflect actual behavior (#7081) 2023-03-24 10:22:56 -04:00
exceptionfactory 2698000a85
NIFI-11254 Upgraded SnakeYAML from 1.33 to 2.0
- Updated MiNiFi and EasyRules references to use required arguments

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7084.
2023-03-24 11:11:37 +01:00
Mark Bathori b50c8101cf
NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:41:33 +01:00
Bryan Bende 5386095083
NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService
This closes #7079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 14:29:17 -05:00
Joe Gresock 1b84927ed5
NIFI-11336 Added CapabilityDescription to PutAccumuloRecord
This closes #7080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:23 -05:00
Emilio Setiadarma cac76e339d
NIFI-9196 Corrected FetchSFTP Move File destination formatting
- Changed FetchSFTP to use String.format() instead of  File.getAbsolutePath() for defining the destination path as part of the Move File completion strategy

This closes #7072

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:23 -05:00
Joe Witt 58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
Mark Payne 016d58612c
NIFI-11290 Run Component Primary Node State changes in background thread
- Ensure that components are notified that primary node has changed in a background thread instead of the Leader Election thread and activate/deactivate the thread in the case of Processors so that they can be viewed in the UI and terminated

- Fixed system tests that would fail intermittently because they did not wait for node disconnection to complete and did not properly switch the client to look at the connected node before checking cluster status

This closes #7052

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:20:37 -05:00
Joe Gresock 9de93f19a4
NIFI-11330: Restarting service referenced by parameter only when service is active (#7078) 2023-03-23 13:13:22 -04:00
dependabot[bot] 24bbe51b54
NIFI-11328 Upgraded Jettison from 1.5.2 to 1.5.4
- Upgraded direct dependencies in Framework and Registry modules as well as Spark bundle

This closes #7073
This closes #7074
This closes #7075

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 10:48:20 -05:00
exceptionfactory 8154fcce49
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:15 +01:00
Matt Burgess 3bf1195f4b
NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL (#7068)
NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL
- Changed to allow 'unexpected' events to still be processed
2023-03-22 09:47:27 -04:00
Mark Payne 6adfb6131d
NIFI-11310: Provide appropriate classpath resources to the ReloadComponent when a processor is terminated
NIFI-11310: Fixed META-INF/services file that was mistakenly listing an extra extension point, due to rebase
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7061
2023-03-21 14:29:44 -04:00
krisztina-zsihovszki 63e9365449
NIFI-4651 Add error message and code to PutSQL FlowFile attributes
NIFI-4651 Review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2023-03-21 11:19:33 -04:00
Nandor Soma Abonyi 4e602ce40f
NIFI-11264 Added debug logs for List Processor yielding
- Corrected ListFile Processor description

This closes #7027

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-21 08:04:59 -05:00
Matt Burgess 0c7de2c748
NIFI-11305: Fix logic to correctly stop CaptureChangeMySQL (#7059) 2023-03-20 16:04:19 -04:00
Mark Bathori e370292d7f
NIFI-11204: Add configurable retry logic for table commits in PutIceberg processor
This closes #6976.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-20 19:20:43 +01:00
simonbence 7954ff355c
NIFI-11213 Showing version change in older (pre 1.18.0) contained version flows properly (#7017) 2023-03-20 11:52:07 -04:00
Dustin Rodrigues cb6e530a3c
NIFI-11301 Fixed typos in ISPEnrichIP and DistributeLoad
This closes #7056

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-20 08:54:01 -05:00
Peter Turcsanyi 4bec56ed81
NIFI-11296 Improved code reusability of GRPC modules
This closes #7053

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-17 15:25:58 -05:00
Mark Bathori 2873575fce
NIFI-11263: Add case-insensitive and order independent field mapping to PutIceberg record converter
This closes #7026.

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-17 20:03:21 +01:00
mr1716 4d8c13b8e1
NIFI-10769 Updated Accumulo from 2.0.1 to 2.1.0
- Updated exclusions with Log4j 2 dependencies
- Removed exclusions no longer required based on Accumulo 2.1.0

This closes #6964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 15:20:51 -05:00
johnAlJunior 40be70762a
NIFI-11269 Added snappy-java to nifi-avro-processors
This closes #7035

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 08:53:03 -05:00
Joe Gresock 8227c19b97
NIFI-11291: Ensuring exceptional EventIterators are closed in PartitionedEventStore
This closes #7047

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 08:26:32 -05:00
dan-s1 6c64050a29
NIFI-10792 Updated ConvertExcelToCSV to handle files over 10 MB
- Refactored to reduce the cognitive complexity in the onTrigger method
- Added log4j-to-slf4j library and adjusted formatting
- Removed unnecessary graphics2d dependency

This closes #7016

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 15:03:44 -05:00
Mark Payne 450a46bc58
NIFI-11289: Avoid obtaining read locks on queues when fetching Group Status, except in those few specific situations where it's needed.
This closes #7046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 14:18:22 -05:00
Matt Burgess 668d309c7e
NIFI-11279: Allow event stream processing to continue in CaptureChangeMySQL after sync issue (#7039) 2023-03-14 16:23:43 -04:00
exceptionfactory 1c883adca8
NIFI-11275 Removed HashContent from See Also in FuzzyHashContent
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7037.
2023-03-14 12:44:23 +01:00
exceptionfactory 5b9fabb889
NIFI-11281 Corrected Accumulo NAR dependencies
- Set accumulo-core to provided in NAR and Services NAR modules
- Removed unused dependencies

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7042.
2023-03-14 12:40:46 +01:00
Chris Sampson f71ba8aadb
NIFI-11274 only add @timestamp to PutElasticsearchRecord document if not null
This closes #7036.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-03-13 14:11:19 -04:00
Peter Turcsanyi d2f80b1645
NIFI-11260 Added STS SSL Context Service for AWS Credentials Provider
This closes #7021

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-13 09:39:30 -05:00
exceptionfactory b23b2621ac
NIFI-11267 Removed deprecated OAuth2TokenProviderImpl
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7029.
2023-03-13 09:22:20 +01:00
exceptionfactory 665b1696ef
NIFI-11268 Removed deprecated OpenPGP support from EncryptContent
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7030.
2023-03-13 09:20:33 +01:00
Emilio Setiadarma 1208e03b4c
NIFI-8497 Added SlackRecordSink
This closes #6593

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-10 16:23:02 -06:00
Matt Burgess c1890a5bb8
NIFI-5501: Fixed classloader issue leading to multiple abandoned threads (#7031) 2023-03-10 15:37:32 -05:00
Nandor Soma Abonyi ed1cee4520
NIFI-11202 Removed deprecated Kerberos properties from Kafka 2_6
This closes #6978

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-09 16:04:58 -06:00
exceptionfactory dbc627e0b0
NIFI-11261 Added Primary Node State handling to GetAzureEventHub
- Updated Qpid Proton J from 0.34.0 to 0.34.1

This closes #7023.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-09 22:31:51 +01:00
exceptionfactory ccea9760f9
NIFI-11194 Remove gzip CSS and JS from nifi-web-ui (#6968)
* NIFI-11194 Removed gzip CSS and JS from nifi-web-ui

* NIFI-11194 Updated comment for static content aggregation

This closes #6968
2023-03-08 12:06:45 -05:00
Peter Turcsanyi 5088934b79
NIFI-11256 Improved documentation for Azure Event Hubs Processors
- used the same ordering of 'Event Hub Namespace', 'Event Hub Name' and 'Service Bus Endpoint' properties
- removed "Primary" tag from 'Shared Access Policy Key' property name
- added some notes on clustering and consumer group in the documentation

This closes #7018

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-07 15:31:30 -06:00
exceptionfactory 512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
exceptionfactory d3908dede8
NIFI-11253 Removed H2 1.4 database migration modules
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7014
2023-03-07 10:35:21 -05:00
Nissim Shiman 5350b02923
NIFI-4718 Improved detection of FlowFile V3 in IdentityMimeType
This closes #7009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-07 09:22:27 -06:00
Lehel Boér 13d343d5ee
NIFI-11151: Improving code reusability of DBCP services
This closes #6935.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-07 14:41:34 +01:00
Joe Gresock 5cf909ccf6
NIFI-11247: Using parameterContextName instead of group name when fetching parameters (#7011)
Merged #7011.
2023-03-06 10:48:41 -08:00
Nandor Soma Abonyi a8cd33a243
NIFI-11248 Removed Kafka 2_0 Components
This closes #7010

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-06 09:35:31 -06:00
Robert Kalmar c7c1a245a9
NIFI-11246 Document differences in GetAzureEventHub and ConsumeAzureEventHub
This closes #7006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-06 07:54:23 -06:00
Pierre Villard 169b53feaa
NIFI-11157 - Doc update for scheduling strategy for MergeContent/Record
This closes #6999.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-06 12:01:34 +01:00
exceptionfactory f76259a6cf
NIFI-11210 Removed unused import from TestDistributedMapCacheClientService
- Missed commit from #6994

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:31:27 -06:00
Joe Gresock 5e3b93b2d6
NIFI-11238: Creating missing parameter providers when importing inherited provided contexts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7002.
2023-03-03 22:11:45 +01:00
Paul Grey 288031f5f6
NIFI-11210 Added read timeout to DistributedMapCacheClientService
This closes #6994

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:00:28 -06:00
exceptionfactory b7df6b9716
NIFI-11235 Removed ExtractCCDAAttributes and ccda-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7000.
2023-03-03 18:39:45 +01:00
exceptionfactory ba788d6e39
NIFI-11236 Removed ConsumeEWS Processor
- Removed ews-java-api dependency
- Added commons-lang3 dependency to maintain current usage in other Processors

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7001.
2023-03-03 18:38:30 +01:00
exceptionfactory 89625c78b4
NIFI-11244 Removed RocksDBFlowFileRepository and nifi-rocksdb-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7004.
2023-03-03 18:36:43 +01:00
exceptionfactory 44c70277ea
NIFI-11245 Corrected reducing Maximum Thread Count while running (#7005)
- Corrected implementation to allow reducing Maximum Thread Count below the default of 10
2023-03-03 11:35:34 -05:00
Lehel Boér 9ea0fe7b3d NIFI-11234: Fix RecordWriter NPE in QuerySalesforceObject
This closes #6997.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-03-01 16:40:49 +01:00
krisztina-zsihovszki 60c02225d5
NIFI-11158 PutSalesforceObject processor improvements
This closes #6959.

Reviewed-by: Lehel <lehel44@hotmail.com>
Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-28 19:21:50 +01:00
Mark Bean b08ae75be4
NIFI-11134 Added Label auditing to Flow Configuration History
This closes #6949

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-27 12:55:43 -06:00
Matthew Burgess 61b87e007b
NIFI-11209: Include newly-added columns in output for UpdateTable processors when Update Field Names is true
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6986.
2023-02-27 14:08:48 +01:00
exceptionfactory 84047c135b
NIFI-11219 Set Qpid Proton J 0.34.0 for Azure EventHubs
- Overrides Qpid Proton J 0.33.8 from azure-core-amqp 2.8.1 to resolve PROTON-2347

This closes #6988.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-26 18:33:41 +01:00
Lehel Boér a61f019cbf NIFI-10966: Add option to QuerySalesforceObject to run custom query
This closes #6794.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-24 14:47:46 +01:00
Lehel Boér 7295e3dc21
NIFI-11147: Query all fields in QuerySalesforceObject
Fix review comments
2023-02-23 16:59:56 -05:00
exceptionfactory 48689a2567
NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-02-23 10:33:45 -05:00
Mark Payne 87e61c50ee
NIFI-11192: Ensure that if ports moved between parent/child group in between flow versions that we can properly handle that. Added system tests to verify.
NIFI-11192: If a failure is encountered when changing the version of a flow from 1 version to another, attempt to rollback the changes instead of just failing with the flow in a bad state
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6981
2023-02-22 15:38:00 -05:00
exceptionfactory 7b12545e5a
NIFI-11211 Removed deprecated SSLContextService methods
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6983.
2023-02-22 14:54:03 -05:00
Matthew Burgess a2b98e0c9c NIFI-11094: Allow CaptureChangeMySQL to send multiple events per FlowFile
This closes #6907.

Co-authored-by: Tamas Palfy <tpalfy@apache.org>

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-22 19:27:42 +01:00
Lehel 7e97c1ce19
NIFI-11045: Sensitive dynamic property support for parameterized queries in ExecuteSQL and ExecuteSQLRecord
This closes #6853.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-22 12:37:07 +01:00
exceptionfactory 85f2162021 NIFI-11201 Added include-iotdb Maven build profile
This closes #6975

- Corrected Fetch Size property evaluation in QueryIoTDBRecord for FlowFile attributes

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:53:23 -05:00
exceptionfactory a0ef378a42 NIFI-11207 Removed HBase 1.1.2 Services
This closes #6979

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:51:02 -05:00
exceptionfactory 57a1144f34
NIFI-11187 Removed ActiveMQ from Standard Processors
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6961
2023-02-21 16:54:37 -05:00
exceptionfactory 0fa1060297
NIFI-11208 Removed Hortonworks Schema Registry
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6980
2023-02-21 16:48:45 -05:00
exceptionfactory 0255c0c4ed NIFI-11185 Removed GetTwitter Processor
This closes #6958

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 09:21:12 -05:00
Pierre Villard 21394038cd NIFI-11198 - Upgrade snowflake-ingest-sdk to 1.0.3
This closes #6972

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 09:15:29 -05:00
Pierre Villard 3115b9f28d
NIFI-10803 - Upgrade Dropbox SDK to 5.4.4
This closes #6971.

Reviewed-by: krisztina-zsihovszki <zsikrisz@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-21 11:09:29 +01:00
Lehel 1b951818e1
NIFI-11190: Added provenance events to GetHubSpot and GetShopify
This closes #6965.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-20 22:13:29 +01:00
lizhizhou 7cb86dd42d
NIFI-10784 Added QueryIoTDBRecord Processor
This closes #6844

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-18 19:58:39 -06:00
dan-s1 22a4bce1ed
NIFI-11156 Updated SchemaValidator to include error message for ValidateXml
- Restores behavior so that XML parsing failure details will be included in FlowFile error attribute from ValidateXml

This closes #6970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-18 10:28:50 -06:00
exceptionfactory 5507bfa4b2
NIFI-11191 Refactored HikariCPConnectionPoolTest with Mock Driver (#6966)
- Removed Derby dependencies from HikariCP module no longer required for testing

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-02-16 17:34:57 -05:00
exceptionfactory 284804ac42
NIFI-11188 Removed ProcessContext encrypt and decrypt methods
- Removed unnecessary references to PropertyEncryptor from multiple framework components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6962.
2023-02-16 12:16:15 -05:00
Nandor Soma Abonyi 0d4f1523fe NIFI-11144 Fix failing tests for ConsumeJMS/PublishJMS
This closes #6930.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-16 15:50:07 +01:00
Mark Payne fed175d46f NIFI-11189: When synchronizing a ProcessGroup to match a VersionedProcessGroup, do not remove the temporary funnel until the very end. This is important if the temporary funnel already exists in the flow on startup
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6963
2023-02-16 14:18:50 +01:00
exceptionfactory 4f11550e97
NIFI-11174 Removed deprecated Standard Processors
- Base64EncodeContent
- GetHTTP
- GetJMSQueue
- GetJMSTopic
- HashAttribute
- HashContent
- PostHTTP
- PutJMS

Removed deprecated Proxy properties from InvokeHTTP

- Proxy Host
- Proxy Port
- Proxy Type
- Proxy Username
- Proxy Password

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6953.
2023-02-15 13:14:56 -05:00
Matthew Burgess 9c5ae0d098
NIFI-11149 Added PutRedisHashRecord Processor
This closes #6943

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-15 11:28:24 -06:00
Pierre Villard b56b1da842
NIFI-11180 Removed Ambari Reporting Task
- Updated TestRuntimeManifest to reference Prometheus Reporting Task

This closes #6952

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-15 08:25:22 -06:00
Pierre Villard aae6bafc6c
NIFI-11183 Removed Hive 1.x components
This closes #6957

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 22:39:16 -06:00
Pierre Villard 46f89e3226
NIFI-11182 Removed Kafka 1.x components
This closes #6955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 18:38:42 -06:00
Pierre Villard 35cf9f87be
NIFI-11179 Removed Flume components
This closes #6950

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 16:25:44 -06:00
mkalavala 0d0ba1ca41
NIFI-9131 Refactor nifi-ldap-iaa-providers-bundle to use JUnit 5
This closes #6946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 16:03:31 -06:00
Nandor Soma Abonyi dd2fc4bb9d
NIFI-11173 Add default values to DeleteAzureBlobStorage_v12
This closes #6945.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-14 11:42:37 +01:00
Nissim Shiman dbef536ebd
NIFI-10950 DistributeLoad processor - this closes #6924. removed Load Distribution
Service

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 19:18:57 -05:00
Mark Payne 471cccbbda
NIFI-11176: This closes #6948. When comparing a VersionedConnection with an existing connection, we examined the source component's VersionedComponentId. But the existing component may not have a VersionedComponentId. We should only be comparing these if they are populated
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 18:52:15 -05:00
Chris Sampson 6542505a50
NIFI-10797 add customisable Elasticsearch REST Client config and Elasticsearch Cluster Sniffer
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6658.
2023-02-13 13:22:18 -05:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Chris Sampson 7393ce294e
NIFI-11168 Removed deprecated Elasticsearch Processors and properties
This closes #6942

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-13 10:41:53 -06:00
Pierre Villard 18ef2a57a5
NIFI-11164 Updated minimum Java version from 8 to 11.0.16
- Updated GitHub workflows from Java 8 to 11
- Updated Maven Compiler Source and Target version from 1.8 to 11
- Disabled JASN1 tests failing on Windows with Java 11

This closes #6940

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-10 23:31:37 -06:00
Bence Simon b0ec28a452 NIFI-11159 Fixing connections with source having reassigned id 2023-02-10 11:12:51 -05:00
exceptionfactory a66727c4d1
NIFI-11160 Upgraded Apache Tika from 2.6.0 to 2.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6938.
2023-02-10 11:38:25 +01:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
Joe Witt 3b9a518387
Merge branch 'NIFI-11103-RC1' 2023-02-09 15:13:42 -07:00
Robert Kalmar 9906f0a952
NIFI-11150 Add Service Account JSON credentials support to Google Pub/Sub Lite procesors
This closes #6933.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-09 12:53:27 +01:00
exceptionfactory 2e55498771
NIFI-11154 Removed Default Schedule from ConsumeMQTT
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6936.
2023-02-09 11:15:11 +01:00
exceptionfactory 8abfced7e1
NIFI-11152 Upgraded Splunk SDK from 1.9.1 to 1.9.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6934.
2023-02-09 11:13:25 +01:00
dan-s1 99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
krisztina-zsihovszki 3e2e081d4b
NIFI-11146 Proxy usage in BoxFile processors
This closes #6932.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-08 15:58:17 +01:00
Mark Bathori b375f4b138
NIFI-11124: Add hadoop.file.url attribute to HDFS processors
This closes #6916.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-07 23:10:16 +01:00
Joe Witt 896fdacbbd
NIFI-11103-RC1 prepare for next development iteration 2023-02-06 11:41:41 -07:00
Joe Witt 81296b5b69
NIFI-11103-RC1 prepare release nifi-1.20.0-RC1 2023-02-06 11:41:39 -07:00
Joe Witt 4f91420cc1
NIFI-11139 Updated multiple Maven Plugins
This closes #6925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 16:07:02 -06:00
exceptionfactory cd76dc0366
NIFI-11140 This closes #6922. Upgraded Tomcat from 8.5.82 to 8.5.85 for Flume
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:03:16 -07:00
Mark Payne 28b9f6fc02
NIFI-11118: This closes #6909. When changing version of a versioned flow, ensure that we properly set the Version Control Information's StorageLocation for the NiFi Registry client in order to maintain backward compatibility
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:02:38 -07:00
exceptionfactory b3319c7119
NIFI-11141 This closes #6923. Upgraded Azure SDK BOM from 1.2.6 to 1.2.9
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:01:32 -07:00
Emilio Setiadarma 0b61a6226c
NIFI-11092 Fixed ConsumeTwitter handling on Primary Node changes
This closes #6901

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 13:12:58 -06:00
Peter Turcsanyi 0c171bbb08 NIFI-10846: Added SMB Dialect and Use Encryption properties in SMB processors
This closes #6917.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-03 14:04:56 +01:00
Tamas Palfy 56d8879e91
NIFI-11107 In ConsumeIMAP and ConsumePOP3 added support for OAUTH based authorization.
This closes #6900.

Reviewed-by: Nandor Soma Abonyi <abonyisoma@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-03 13:57:43 +01:00
exceptionfactory 6877e84931
NIFI-11135 Upgraded Commons CSV from 1.9.0 to 1.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6921.
2023-02-03 12:26:47 +01:00
Joe Gresock 2609fd5f55
NIFI-11122 Corrected provided parameter context inheritance after creation
This closes #6913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-02 13:20:35 -06:00
Kalman Jantner 027e2b9bc1 NIFI-11123: fix default value and update docs
This closes #6899.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-02 18:48:47 +01:00
Mark Bathori 869e2b3d66
NIFI-11110: Create processor for triggering HMS events
Review comment fixes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6902
2023-02-02 11:31:44 -05:00
krisztina-zsihovszki 653631cc67
NIFI-11059 PutBoxFile processor
This closes #6892.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-02 15:33:37 +01:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
exceptionfactory 8bc7593d34
NIFI-11126 Delete MultiPart files in ListenHTTP after processing
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6915
2023-02-02 12:23:44 +00:00
dan-s1 d46aa89788
NIFI-8005 Added warning message for Excel sheets not found
This closes #6897

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-01 16:26:06 -06:00
Joe Gresock afdf49b3cd
NIFI-11100: Limiting scope of external controller services during version sync to services outside the versioning context (#6898) 2023-02-01 12:14:38 -05:00
Mark Bathori 3f04fae5a5
NIFI-11112 Corrected location of additionalDetails for GetZendesk
This closes #6904

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-31 16:25:11 -06:00
krisztina-zsihovszki 92ccb79670
NIFI-11117 Remove folder creation from PutGoogleDrive
This closes #6910.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-31 19:58:44 +01:00
exceptionfactory 5daf01e760
NIFI-11120 This closes #6912. Upgraded Zip4j from 2.11.2 to 2.11.3
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 11:49:12 -07:00
exceptionfactory bdede27447
NIFI-11119 This closes #6911. Excluded snakeyaml:android from javafaker
- Added direct dependency on standard snakeyaml version to nifi-standard-processors

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 10:05:23 -07:00
exceptionfactory a7206f187b
NIFI-9989 This closes #6908. Upgraded SSHJ from 0.34.0 to 0.35.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 09:18:54 -07:00
simonbence ae66ebdc22
NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes (#6870)
* NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes
2023-01-31 10:58:42 -05:00
Ferenc Erdei e4748e15f4
NIFI-11087 Added VerifyContentMAC Processor
This closes #6877

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-27 12:11:14 -06:00
Kalman Jantner cc8d108975
NIFI-10710 Added Processors for AWS Polly, Textract, Translate, Transcribe
This closes #6589

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-27 11:46:28 -06:00
exceptionfactory 0c676b9633
NIFI-11022 Added DecryptContent Compatibility Processors
- Added nifi-cipher-bundle with nifi-cipher-nar for new Processors
- Added DecryptContentCompatibilityMode Processor supporting PKCS5 and PKCS12 Password-Based Encryption Schemes
- Added DecryptContentEncoded Processor supporting NiFi Key Derivation Functions and associated formatting
- Added nifi-security-crypt-key module with Key Derivation Functions and Parameter Readers
- Added Additional Details documentation for Processors

This closes #6821
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-26 17:56:02 -05:00
Mark Payne d9f35b8974
NIFI-11105: This closes #6895. When mapping Parameter Context to VersionedParameterContext, don't bother mapping those that have already been mapped, as it is redundant
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-26 15:35:18 -07:00
Malthe Borch 41649660be
NIFI-10721 Avoid querying properties after Azure Blob upload
This closes #6730

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-26 15:45:52 -06:00
krisztina-zsihovszki 96a6594680
NIFI-11068 Introduced ConflictResolutionStrategy enum
This closes #6861

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-26 15:34:43 -06:00
exceptionfactory d913f8046a
NIFI-10581 Upgraded Apache Tika from 2.4.1 to 2.6.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6894.
2023-01-26 19:52:17 +01:00
exceptionfactory d60f541d7e
NIFI-11098 Deprecated ProcessContext encrypt and decrypt methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6891.
2023-01-26 18:18:09 +01:00
exceptionfactory 97cb3c4eaa
NIFI-11101 Deprecated ConsumeEWS Processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6893.
2023-01-26 18:00:16 +01:00
Mark Bathori c3dd2569db NIFI-10974: Incorrect warning message on memory usage from MonitorMemory 2023-01-26 13:25:07 +01:00
Priyanka Awatramani b3f2d95092
NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes
- Updated TestAttributesToCSV with LinkedHashMap for deterministic test behavior
- Updated TestHttpFlowFileServerProtocol with adjusted checksums to match expectations from LinkedHashMap changes

This closes #6748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 16:19:20 -06:00
exceptionfactory 5101db2ab7
NIFI-11096 This closes #6889. Added EncodeContent to Processor services definition
- Deprecated Base64EncodeContent in favor of EncodeContent
- Updated EncodeContent to use Commons Codec for Hexadecimal encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 15:01:38 -07:00
Joe Gresock 7d99521d4c
NIFI-11089: Resolving previously resolved parameter providers when possible on version sync (#6886) 2023-01-25 13:42:52 -05:00
Paul Grey 567e95aa28
NIFI-11047 - Issue when upgrading version of dataflow with external service
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6849
2023-01-25 12:52:52 -05:00
exceptionfactory 4fe2c318e6
NIFI-11091 This closes #6884. Upgraded Google libraries-bom from 25.4.0 to 26.4.0
- Upgraded Google Drive library to v3-rev20221219-2.0.0
- Corrected test encryption keys to match expected encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 10:00:00 -07:00
Pierre Villard 1148738c19
NIFI-11095 This closes #6888. Deprecate Hortonworks Schema Registry
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:59:00 -07:00
Mark Payne 228a3441b5
NIFI-11001: This closes #6836. When new components are added, track a mapping of its Versioned Compoenent ID to the component itself. Then, use this when creating connections. This is important because if a Process Group has multiple components with the same Versioned Component ID across multiple child groups, the Versioned Component ID may be changed upon adding the component. Maintaining this mapping allows us to still create the connection correctly.
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:55:16 -07:00
Nissim Shiman b7f7b411ef
NIFI-10853 Allow UpdateAttribute dynamic property to validate nifi
expressions

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6770
2023-01-25 11:43:12 -05:00