8273 Commits

Author SHA1 Message Date
Joe Witt
eef5ca1afe
NIFI-11357-RC1 prepare release nifi-1.21.0-RC1 nifi-1.21.0-RC1 2023-03-29 12:35:12 -07:00
exceptionfactory
6b6d779069
NIFI-11349 Excluded reload4j from HBase 2 jigsaw profile 2023-03-29 11:14:48 -05:00
exceptionfactory
10022567fd
NIFI-11359 This closes #7099. Upgraded woodstox-core to 6.5.0 for Solr 8.11.1
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-29 08:03:56 -07:00
Mark Payne
451941aad9
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:35:32 -05:00
exceptionfactory
3c2cb36c05
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 08:15:17 -05:00
exceptionfactory
6a5b8c39ef
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:23:07 -07:00
exceptionfactory
2468bb5963
NIFI-11355 Upgraded Couchbase Client from 2.5.8 to 2.7.23
- Suppressed vulnerability findings related to Couchbase Server

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7094.
2023-03-28 22:06:15 +02:00
exceptionfactory
c8c38bb8c6
NIFI-11349 Upgraded HBase from 2.2.2 to 2.5.3 with Hadoop 3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7091.
2023-03-28 22:04:21 +02:00
exceptionfactory
e5843cde6f
NIFI-11346 This closes #7088. Upgraded Parquet from 1.12.0 to 1.12.3 2023-03-28 08:26:07 -07:00
exceptionfactory
87768708ab
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:21:51 -07:00
exceptionfactory
d23ca26f7a
NIFI-11348 This closes #7090. Upgraded JRuby from 9.3.9.0 to 9.4.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:21:23 -07:00
exceptionfactory
ff5a783943
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 09:38:58 -05:00
exceptionfactory
588e0d74ab
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:50:14 +02:00
Mark Payne
d2fdff7b93
NIFI-11333: Do not allow components to be removed while a node is disconnected
This closes #7085

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 17:44:31 -05:00
Mark Payne
474e124667
NIFI-11341 Fixed OutputStream.close() handling for Content Claims
Fixed issue in StandardContentClaimWriteCache in which inner OutputStream class did not have an idempotent close() method; as a result, the stream could be written to while already in use for another active FlowFile; fixed bug in ContentClaimInputStream in which skip() method ignored its own BufferedInputStream - this was discovered because it was causing failures in StandardProcessSessionIT; fixed bug in StandardProcessSessionIT in which the length of StandardContentClaim was being doubled because the OutputStream was setting the claim length but that is already handled at a lower level.

This closes #7087

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:13:11 -05:00
Christian Wahl
06b0093130
NIFI-11232 Fixed buffer handling in ContentClaimInputStream
This closes #6996

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:13:10 -05:00
krisztina-zsihovszki
0b33ad8053
NIFI-11266 PutGoogleDrive, ListGoogleDrive, FetchGoogleDrive can't access a SharedDrive
This closes #7058

Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-27 19:46:42 +02:00
Matt Burgess
e7be544989 NIFI-11337: Update PutDatabaseRecord's Max Batch Size property documentation to reflect actual behavior (#7081) 2023-03-24 10:24:42 -04:00
exceptionfactory
7ee16dda49
NIFI-11254 Upgraded SnakeYAML from 1.33 to 2.0
- Updated MiNiFi and EasyRules references to use required arguments

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7084.
2023-03-24 11:11:58 +01:00
Mark Bathori
986a1f0891 NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:44:51 +01:00
dependabot[bot]
153089af39
NIFI-11338 Upgraded Spring Vault Core from 2.3.2 to 2.3.3
This closes #7083

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 19:50:12 -05:00
Bryan Bende
093935e1cd
NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService
This closes #7079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 14:30:26 -05:00
Joe Gresock
c6aa166e32
NIFI-11336 Added CapabilityDescription to PutAccumuloRecord
This closes #7080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:57 -05:00
Emilio Setiadarma
82886d6514
NIFI-9196 Corrected FetchSFTP Move File destination formatting
- Changed FetchSFTP to use String.format() instead of  File.getAbsolutePath() for defining the destination path as part of the Move File completion strategy

This closes #7072

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:56 -05:00
Joe Witt
fb31fcca54
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:32:43 -05:00
Mark Payne
8eeebdb614
NIFI-11290 Run Component Primary Node State changes in background thread
- Ensure that components are notified that primary node has changed in a background thread instead of the Leader Election thread and activate/deactivate the thread in the case of Processors so that they can be viewed in the UI and terminated

- Fixed system tests that would fail intermittently because they did not wait for node disconnection to complete and did not properly switch the client to look at the connected node before checking cluster status

This closes #7052

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:21:45 -05:00
Joe Gresock
9208d056ef
NIFI-11330: Restarting service referenced by parameter only when service is active (#7078) 2023-03-23 13:14:48 -04:00
dependabot[bot]
573187eaf1
NIFI-11328 Upgraded Jettison from 1.5.2 to 1.5.4
- Upgraded direct dependencies in Framework and Registry modules as well as Spark bundle

This closes #7073
This closes #7074
This closes #7075

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 10:49:58 -05:00
exceptionfactory
a7daebc1af
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:43 +01:00
Mark Bean
e27396e7c0
NIFI-11302 Corrected Registry version retrieval
- Updated Maven JAR plugin configuration for nifi-registry-data-model to include implementation version

This closes #7057

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-22 16:51:50 -05:00
simonbence
cef61c866d NIFI-11319 Fixing TestStatelessBootstrap::testClassNotAllowed (#7070) 2023-03-22 16:25:05 -04:00
Chris Sampson
110912fcfb
NIFI-11312 Rationalised Registry Docker scripts in one location
This closes #7064

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-22 09:47:26 -05:00
Matt Burgess
3321de01f2 NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL (#7068)
NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL
- Changed to allow 'unexpected' events to still be processed
2023-03-22 09:48:12 -04:00
Peter Turcsanyi
22c072e619 NIFI-11323: Fixed last modified change detection of dynamicallyModifiesClasspath resources (#7069) 2023-03-22 09:16:18 -04:00
exceptionfactory
771d289779
NIFI-11320 Upgraded Spring Framework from 5.3.24 to 5.3.26
- Upgraded Spring Security from 5.8.0 to 5.8.2
- Upgraded Spring Boot from 2.7.6 to 2.7.9 for NiFi Registry

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7067.
2023-03-22 10:48:22 +01:00
exceptionfactory
6634125476
NIFI-4651 Corrected anonymous HashMap usage failing on Java 8 2023-03-21 18:55:32 -05:00
mr1716
a2995f334e
NIFI-11318 Upgraded Jackson from 2.14.1 to 2.14.2
This closes #7066

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-21 16:38:18 -05:00
Mark Payne
cece57268e
NIFI-11310: Provide appropriate classpath resources to the ReloadComponent when a processor is terminated
NIFI-11310: Fixed META-INF/services file that was mistakenly listing an extra extension point, due to rebase
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2023-03-21 14:17:17 -04:00
krisztina-zsihovszki
5267a533bb
NIFI-4651 Add error message and code to PutSQL FlowFile attributes
NIFI-4651 Review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7007
2023-03-21 11:22:06 -04:00
Chris Sampson
8c13121e3d
NIFI-11311 Updated maven-antrun-plugin to 3.1.0 across all modules
This closes #7062

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-21 08:07:17 -05:00
Nandor Soma Abonyi
69afe7fd8d
NIFI-11264 Added debug logs for List Processor yielding
- Corrected ListFile Processor description

This closes #7027

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-21 08:07:16 -05:00
Matt Burgess
b554102f4a NIFI-11305: Fix logic to correctly stop CaptureChangeMySQL (#7059) 2023-03-20 16:05:02 -04:00
Mark Bathori
835c95fca0 NIFI-11204: Add configurable retry logic for table commits in PutIceberg processor
This closes #6976.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-20 19:24:21 +01:00
simonbence
4a6e6751d5 NIFI-11213 Showing version change in older (pre 1.18.0) contained version flows properly (#7017) 2023-03-20 16:59:05 +01:00
Dustin Rodrigues
c15f47da92
NIFI-11301 Fixed typos in ISPEnrichIP and DistributeLoad
This closes #7056

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-20 08:56:11 -05:00
Pierre Villard
073d107f6e
NIFI-11300 Upgraded json-smart from 2.4.8 to 2.4.10
This closes #7055

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-20 08:56:09 -05:00
Pierre Villard
626edcd80c
NIFI-11299 Upgraded SLF4J from 2.0.6 to 2.0.7
This closes #7054

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-20 08:56:07 -05:00
Mark Bathori
171c2ae670
NIFI-11263: Backported. Add case-insensitive and order independent field mapping to PutIceberg record converter
This closes #7026.

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-17 23:17:38 +01:00
Peter Turcsanyi
916e58a0a9
NIFI-11296 Backported improved code reusability of GRPC modules
This closes #7053

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-17 15:39:52 -05:00
Paul Grey
aeb89a6d6b
NIFI-11286 Added getter for ExtensionComponent.restricted
This closes #7048

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 15:47:21 -05:00