8291 Commits

Author SHA1 Message Date
Joe Witt
9c27ddcb1c
NIFI-11357-RC2 prepare for next development iteration 2023-04-03 14:40:08 -07:00
Joe Witt
892f822107
NIFI-11357-RC2 prepare release nifi-1.21.0-RC2 rel/nifi-1.21.0 nifi-1.21.0-RC2 2023-04-03 14:40:07 -07:00
exceptionfactory
ebaff2c616
NIFI-11378 This closes #7115. Upgraded Jersey from 2.36 to 2.39.1
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:17:12 -07:00
exceptionfactory
e3c550e73c
NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:11:41 -07:00
exceptionfactory
435caa7600
NIFI-11376 This closes #7112. Upgraded Jetty from 9.4.50 to 9.4.51
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:11:40 -07:00
exceptionfactory
1e043d479b
NIFI-11375 This closes #7111. Upgraded Surefire to 3.0.0 and upgraded other plugins
- Upgraded Surefire Plugin from 3.0.0-M8 to 3.0.0
- Upgraded Compiler Plugin from 3.10.1 to 3.11.0
- Upgraded Assembly Plugin from 3.4.2 to 3.5.0
- Upgraded Javadoc Plugin from 3.4.1 to 3.5.0
- Upgraded Release Plugin from 3.0.0-M7 to 3.0.0

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:11:40 -07:00
Nandor Soma Abonyi
0510f8cca2 NIFI-11137 Add record support to Consume/PublishJMS (#6987) 2023-04-03 21:47:27 +02:00
mr1716
37a63d39c5
NIFI-11352 Upgraded PostgreSQL JDBC from 42.5.3 to 42.6.0
This closes #7114

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 3fa25b6f119576144e95b17213f98bd729f39ed6)
2023-04-03 14:29:19 -05:00
Ferenc Erdei
5d50950534
NIFI-11344 Make minifi fips compatible
This closes #7098.

(cherry picked form commit 595b1b4dd3c92255c4d90dca77966d8f78102eec)
2023-04-03 11:57:02 +02:00
krisztina-zsihovszki
b12572af20 NIFI-11367 Database DATE value displayed incorrectly in record output if timezone is GMT-X
This closes #7103.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-04-02 22:51:35 +02:00
exceptionfactory
8f7549a438
NIFI-11372 Removed unused javax.el dependency from Registry
- Removed unnecessary JSTL dependency and reference from Documentation JSP

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7110.
2023-04-02 17:18:56 +02:00
exceptionfactory
e85af8a1cd
NIFI-11371 Upgraded Ranger from 2.3.0 to 2.4.0
- Updated Elasticsearch client false positive vulnerability suppressions for new Ranger transitive dependencies

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7109.
2023-04-02 17:15:33 +02:00
exceptionfactory
fbbb8046df
NIFI-11370 Corrected JWK Set retrieval for NIFI Trust Strategy (#7108)
- Added StandardOidcIdTokenDecoderFactory based on Spring Security OidcIdTokenDecoderFactory with custom REST Operations

Merged #7108 into main.

(cherry picked from commit e4f0508c90f7f354b4210dd80f3dbed5b3254bcd)
2023-03-31 18:28:58 -05:00
exceptionfactory
006d1507d4
NIFI-11365 Corrected OIDC Redirect URI resolution for reverse proxies (#7104)
- Added Authorization Request Resolver with support for building the base redirect URI using allowed proxy headers

This closes #7104

(cherry picked from commit 75eb449a312815b84545c1ee157144255b8fc97d)
2023-03-30 15:29:04 -05:00
Kevin Doran
ef119855fe
NIFI-11351 Support Docker image builds on ARM64
- Switch from spotify docker-maven-plugin to fabric8 docker-maven-plugin
- Add consistency to docker maven image names and tags
- Other minor Dockerfile changes for consistency

This closes #7105

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 08e18220e7f6e0f6c7546ccbd17bc52451533d4a)
2023-03-30 14:57:51 -05:00
exceptionfactory
d2cbec2613 NIFI-11363 Fixed precision number handling in Flow Encryption Commands
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #11363
2023-03-30 16:38:47 +02:00
Kevin Doran
1b62644884
NIFI-10017 Increase JVM heap size for tls-toolkit
This closes #7100

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 17:23:20 -05:00
Nandor Soma Abonyi
b387576fc0 NIFI-11270 Refactoring of the overly Paho-specific MQTT interface
This closes #7032.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-29 23:37:24 +02:00
exceptionfactory
3994c0a93e NIFI-11154 Removed Default Schedule from ConsumeMQTT
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6936.
2023-03-29 23:36:46 +02:00
exceptionfactory
6b6d779069
NIFI-11349 Excluded reload4j from HBase 2 jigsaw profile 2023-03-29 11:14:48 -05:00
exceptionfactory
10022567fd
NIFI-11359 This closes #7099. Upgraded woodstox-core to 6.5.0 for Solr 8.11.1
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-29 08:03:56 -07:00
Mark Payne
451941aad9
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:35:32 -05:00
exceptionfactory
3c2cb36c05
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 08:15:17 -05:00
exceptionfactory
6a5b8c39ef
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:23:07 -07:00
exceptionfactory
2468bb5963
NIFI-11355 Upgraded Couchbase Client from 2.5.8 to 2.7.23
- Suppressed vulnerability findings related to Couchbase Server

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7094.
2023-03-28 22:06:15 +02:00
exceptionfactory
c8c38bb8c6
NIFI-11349 Upgraded HBase from 2.2.2 to 2.5.3 with Hadoop 3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7091.
2023-03-28 22:04:21 +02:00
exceptionfactory
e5843cde6f
NIFI-11346 This closes #7088. Upgraded Parquet from 1.12.0 to 1.12.3 2023-03-28 08:26:07 -07:00
exceptionfactory
87768708ab
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:21:51 -07:00
exceptionfactory
d23ca26f7a
NIFI-11348 This closes #7090. Upgraded JRuby from 9.3.9.0 to 9.4.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:21:23 -07:00
exceptionfactory
ff5a783943
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 09:38:58 -05:00
exceptionfactory
588e0d74ab
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:50:14 +02:00
Mark Payne
d2fdff7b93
NIFI-11333: Do not allow components to be removed while a node is disconnected
This closes #7085

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 17:44:31 -05:00
Mark Payne
474e124667
NIFI-11341 Fixed OutputStream.close() handling for Content Claims
Fixed issue in StandardContentClaimWriteCache in which inner OutputStream class did not have an idempotent close() method; as a result, the stream could be written to while already in use for another active FlowFile; fixed bug in ContentClaimInputStream in which skip() method ignored its own BufferedInputStream - this was discovered because it was causing failures in StandardProcessSessionIT; fixed bug in StandardProcessSessionIT in which the length of StandardContentClaim was being doubled because the OutputStream was setting the claim length but that is already handled at a lower level.

This closes #7087

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:13:11 -05:00
Christian Wahl
06b0093130
NIFI-11232 Fixed buffer handling in ContentClaimInputStream
This closes #6996

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:13:10 -05:00
krisztina-zsihovszki
0b33ad8053
NIFI-11266 PutGoogleDrive, ListGoogleDrive, FetchGoogleDrive can't access a SharedDrive
This closes #7058

Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-27 19:46:42 +02:00
Matt Burgess
e7be544989 NIFI-11337: Update PutDatabaseRecord's Max Batch Size property documentation to reflect actual behavior (#7081) 2023-03-24 10:24:42 -04:00
exceptionfactory
7ee16dda49
NIFI-11254 Upgraded SnakeYAML from 1.33 to 2.0
- Updated MiNiFi and EasyRules references to use required arguments

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7084.
2023-03-24 11:11:58 +01:00
Mark Bathori
986a1f0891 NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:44:51 +01:00
dependabot[bot]
153089af39
NIFI-11338 Upgraded Spring Vault Core from 2.3.2 to 2.3.3
This closes #7083

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 19:50:12 -05:00
Bryan Bende
093935e1cd
NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService
This closes #7079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 14:30:26 -05:00
Joe Gresock
c6aa166e32
NIFI-11336 Added CapabilityDescription to PutAccumuloRecord
This closes #7080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:57 -05:00
Emilio Setiadarma
82886d6514
NIFI-9196 Corrected FetchSFTP Move File destination formatting
- Changed FetchSFTP to use String.format() instead of  File.getAbsolutePath() for defining the destination path as part of the Move File completion strategy

This closes #7072

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:56 -05:00
Joe Witt
fb31fcca54
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:32:43 -05:00
Mark Payne
8eeebdb614
NIFI-11290 Run Component Primary Node State changes in background thread
- Ensure that components are notified that primary node has changed in a background thread instead of the Leader Election thread and activate/deactivate the thread in the case of Processors so that they can be viewed in the UI and terminated

- Fixed system tests that would fail intermittently because they did not wait for node disconnection to complete and did not properly switch the client to look at the connected node before checking cluster status

This closes #7052

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:21:45 -05:00
Joe Gresock
9208d056ef
NIFI-11330: Restarting service referenced by parameter only when service is active (#7078) 2023-03-23 13:14:48 -04:00
dependabot[bot]
573187eaf1
NIFI-11328 Upgraded Jettison from 1.5.2 to 1.5.4
- Upgraded direct dependencies in Framework and Registry modules as well as Spark bundle

This closes #7073
This closes #7074
This closes #7075

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 10:49:58 -05:00
exceptionfactory
a7daebc1af
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:43 +01:00
Mark Bean
e27396e7c0
NIFI-11302 Corrected Registry version retrieval
- Updated Maven JAR plugin configuration for nifi-registry-data-model to include implementation version

This closes #7057

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-22 16:51:50 -05:00
simonbence
cef61c866d NIFI-11319 Fixing TestStatelessBootstrap::testClassNotAllowed (#7070) 2023-03-22 16:25:05 -04:00
Chris Sampson
110912fcfb
NIFI-11312 Rationalised Registry Docker scripts in one location
This closes #7064

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-22 09:47:26 -05:00