Commit Graph

341 Commits

Author SHA1 Message Date
exceptionfactory 429b521cb9
NIFI-12434 Upgraded Registry to Spring Framework 6.1.1
- Upgraded Spring Framework from 6.0.13 to 6.1.1
- Upgraded Spring Boot from 3.1.5 to 3.2.0
- Upgraded Spring Security from 6.1.5 to 6.2.0
- Upgraded Jetty from 11.0.18 to 12.0.3
- Upgraded Servlet API from 5.0.0 to 6.0.0
- Adjusted Registry Database Tests to streamline DataSource configuration

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8087.
2023-12-01 16:07:28 +01:00
mr1716 fcfb777587
NIFI-12433 Upgraded mariadb-java-client from 3.2.0 to 3.3.0
This closes #8082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:43:57 -06:00
mr1716 6255a98b22
NIFI-12430 Upgraded unboundid-ldapsdk from 6.0.9 to 6.0.10
This closes #8080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:42:10 -06:00
exceptionfactory 6617fe8fe2
NIFI-12384 This closes #8044. Upgraded Registry to Spring Framework 6
- Upgraded Spring from 5.3.30 to 6.0.13
- Upgraded Spring Boot from 2.7.16 to 3.1.5
- Upgraded Spring Security from 5.8.7 to 6.1.5
- Upgraded Jetty from 10.0.18 to 11.0.18
- Upgraded Servlet API from 3.1.0 to 5.0.0
- Upgraded JAX-RS from 2.1.1 to 3.1.0
- Upgraded Jersey from 2.41 to 3.1.3
- Upgraded JAXB from 2.3.2 to 4.0.4
- Upgraded Java Validation from 2.0.1 to 3.0.2
- Upgraded Flyway from 8.5.13 to 9.22.3
- Upgraded ASM from 9.3 to 9.6 for Java 21
- Upgraded NiFi Toolkit CLI to JAX RS 3 and Jersey 3
- Set Jersey 3 and JAX RS 3 dependency versions in nifi-flow-registry-client-bundle to align with updates to nifi-registry-client classes

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-21 09:06:51 -07:00
exceptionfactory 76a27b0ad8
NIFI-12375 Removed maxFileSize from non-applicable policies in Logback
- Removed the non-applicable maxFileSize from TimeBasedRollingPolicy configurations in default logback.xml files to avoid warnings on shutdown

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8033.
2023-11-15 22:36:34 +01:00
Mike Thomsen 6447aea258
NIFI-11788 Modified APP_FILE logback configuration to have better cleanup
NIFI-11788 Standardized Logback maximum settings
- Set MiNiFi maxHistory to 10 and totalSizeCap to 10MB
- Set NiFi maxHistory to 30 and totalSizeCap to 3GB except for deprecation log
- Set Stateless maxHistory to 30 and totalSizeCap to 3GB
- Set Registry maxHistory to 30 and totalSizeCap to 3GB
NIFI-11788 Increased MiNiFi maxFileSize to 10MB and cap to 100MB

This closes #7465. Coauthored by David Handermann and Mike Thomsen

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-13 09:48:40 -07:00
exceptionfactory ccd2f0677d
NIFI-12316 Upgraded MySQL Connector J from 8.1.0 to 8.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7979.
2023-11-03 23:54:19 -07:00
exceptionfactory c706877147
NIFI-12297 Standardized File Path resolution in Persistence Providers (#7975) 2023-11-03 12:26:11 -04:00
Zackeus Bengtsson 33c8029d65
NIFI-12298 add swagger annotations for createExtensionBundleVersion form fields
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7961.
2023-10-31 16:52:57 -07:00
dependabot[bot] a71cc4bee3
NIFI-12289 Upgraded browserify-sign from 4.2.1 to 4.2.2
This closes #7949

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 21:15:25 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Mark Bean 94e746dc47
NIFI-12283 Added include-swagger-ui profile with activation by default
Deactivating prevents attempt to download swagger asset from the Internet allowing for offline builds.

This closes #7945

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:24:21 -05:00
Chris Sampson 2e8d0214c0
NIFI-12177 Added integration tests for MiNiFi and C2 Docker
This closes #7919

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 15:35:04 -05:00
exceptionfactory f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 19:54:27 +01:00
Mark Payne 1d5f2f626b NIFI-12245: Removed deprecations around flow registry clients
NIFI-12245: Removed null check that is no  longer necessary

NIFI-12245: Fixed checkstyle violation

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #7899
2023-10-24 14:08:03 +02:00
exceptionfactory f352857e42
NIFI-12243 Refactored encrypt-config using picocli
- Replaced Groovy implementation with Java classes
- Added StandardEncryptConfig and RegistryEncryptConfig command implementations
- Added FileTransformer interface with implementations for configuration files
- Changed -A to -u for output authorizers.xml when targeting Registry
- Removed --newFlowProvider option not used
- Removed --translateCli option
- Removed --decrypt option

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7901.
2023-10-22 04:54:45 -04:00
dependabot[bot] 2687a591c3
Bump @babel/traverse (#7897)
Bumps [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse) from 7.21.2 to 7.23.2.
- [Release notes](https://github.com/babel/babel/releases)
- [Changelog](https://github.com/babel/babel/blob/main/CHANGELOG.md)
- [Commits](https://github.com/babel/babel/commits/v7.23.2/packages/babel-traverse)

---
updated-dependencies:
- dependency-name: "@babel/traverse"
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

This closes #7897
2023-10-20 14:28:41 -04:00
exceptionfactory f9615414bd
NIFI-12258 Upgraded MINA SSHD from 2.10.0 to 2.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7915.
2023-10-20 18:22:07 +02:00
Paul Grey 88bdeee219
NIFI-12200 Removed module nifi-toolkit-tls
This closes #7879

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 00:01:22 -05:00
Chris Sampson f6fcfb433c
NIFI-12175 Standardized Docker Image Tags on Liberica Java 21
This closes #7864

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-18 16:00:00 -05:00
Marcelo Vinicius de Sousa Campos 0fce806950
NIFI-12173 Added OpenID Connect documentation for Registry
This closes #7842

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-18 15:02:07 -05:00
Michael Moser 229199dab7
NIFI-12237 change label height and width from POSITION to SIZE difference (#7889) 2023-10-18 12:56:19 -04:00
Marcelo Vinícius de Sousa Campos 90ff874827
NIFI-12172 Added OpenID Connect example to Registry Docker README
This closes #7839

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-16 08:23:05 -05:00
dependabot[bot] 2cad5c5ad6
NIFI-12199 Upgraded PostCSS from 8.4.25 to 8.4.31
This closes #7856

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 16:13:24 -05:00
exceptionfactory c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:56:53 -07:00
Joseph Witt 9ba81c9564 NIFI-12147 Cleaned poms, updated Dockerfile, fixed Jersey version to get appropriate bundled ASM
This closes #7819

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-30 07:40:53 -04:00
Joseph Witt 67ba13796e
NIFI-12150 Restored NiFiRegistrySecurityConfig required for Registry
- NiFiRegistrySecurityConfig was removed mistakenly in NIFI-12147 and updating extractor to match changes in NIFI-12147 for DN extraction

This closes #7815

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-29 14:21:40 -05:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Joe Witt 249829af5f
NIFI-11917 removing support for RPM building as we lack the infrastructure/maintenance to keep it healthy and we dont publish the artifacts (#7801)
Signed-off-by: Otto Fowler <ottobackwards@gmail.com>
2023-09-27 15:50:03 -04:00
Joseph Witt 81dc36a473
NIFI-12128 updated cassandra, jgit, and netty
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7793.
2023-09-26 11:44:15 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Pierre Villard 4b9eb8361c
NIFI-12113 Replaced Validate.notNull() with Objects.requireNonNull()
This closes #7779

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-22 15:18:50 -05:00
exceptionfactory 4169352a2f
NIFI-12110 This closes #7775. Upgraded Spring Framework from 5.3.29 to 5.3.30
- Upgraded Spring Boot from 2.7.15 to 2.7.16 for Registry

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:41:18 -07:00
mr1716 b6bcce4fe1
NIFI-12106 Upgraded Spring Boot from 2.7.14 to 2.7.15
This closes #7772

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 14:53:34 -05:00
mr1716 66524ab267
NIFI-12043 Upgraded MariaDB Java Client from 3.1.4 to 3.2.0
This closes #7747

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:03:19 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
Joseph Witt a1fca9b44e
NIFI-12064 Upgraded Maven Plugin versions
This closes #7731

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 19:35:51 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:21:17 -07:00
exceptionfactory 98fa7d0290
NIFI-12060 This closes #7694. Removed Groovy Tests using Spock Framework
- Added org.spockframework to the list of banned dependencies
- Removed several other Groovy tests and associated build profiles

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 11:22:54 -07:00
exceptionfactory 6841aa6e99
NIFI-12047 Added HTTP/2 to Default Application Protocols
- Changed default value of nifi.web.https.application.protocols to include both h2 and http/1.1
- Changed default value of nifi.registry.web.https.application.protocols to include both h2 and http/1.1
- Updated HostHeaderHandler logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7684.
2023-09-14 13:50:01 +02:00
Ravinarayan Singh 56a65a5877
NIFI-11947 Support preserving created timestamp for Flow Snapshots
This closes #7610

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-30 12:19:59 -05:00
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
ravisingh 6bb2d62ffd
NIFI-11946 Support preserving created timestamp for Registry Flows
This closes #7604

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 16:59:12 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
mr1716 70c756ff78
NIFI-11953 Upgraded download-maven-plugin from 1.6.8 to 1.7.1
This closes #7613

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:03:41 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
Mike Thomsen cba6b00271
NIFI-11383 Updated Java documentation links from 8 to 17
This closes #7581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 09:17:48 -05:00