Commit Graph

151 Commits

Author SHA1 Message Date
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Mark Payne 92750c2746
NIFI-10261: Ensure that when comparing Sensitive Parameters during flow sync we decrypt values for the comparison
This closes #6231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:52:46 -05:00
exceptionfactory 21b57e36e8
NIFI-10268 This closes #6239. Upgraded Spring Framework from 5.3.21 to 5.3.22
- Upgraded Spring Boot from 2.7.1 to 2.7.2 for Registry

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:58:18 -07:00
Kevin Doran 1a1037022f
NIFI-9813 Excluded Ranger modules on ARM64
This closes #6216

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 08:03:16 -05:00
exceptionfactory eb91eb12b0
NIFI-10224 Moved GitHub Workflow Analysis to Separate Job
- Upgraded multiple GitHub Actions from Version 2 to 3
- Replaced Maven Cache step with cache feature in Setup Java Action
- Moved checkstyle and license checks from verify to validate phase in Maven execution
- Removed unnecessary contrib-check profile from nifi-registry

This closes #6202
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-18 12:46:30 -04:00
mr1716 291bd40013
NIFI-10195 Upgraded Testcontainers to 1.17.3
This closes #6179

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:37:39 -05:00
Matthew Burgess 7eec507118
NIFI-10181: Upgrade Groovy to 3.0.9
This closes #6170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:47:00 -05:00
exceptionfactory 4a9c3435db
NIFI-10174 Upgraded Spring Framework from 5.3.20 to 5.3.21
- Upgraded Spring Security from 5.7.1 to 5.7.2
- Upgraded Spring Boot from 2.7.0 to 2.7.1 for NiFi Registry

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6165.
2022-06-29 17:18:41 +02:00
Nissim Shiman db11961026
NIFI-9440 Allow Controller Services to have configurable Bulletins
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6035
2022-06-28 10:44:45 -04:00
exceptionfactory b3b13a4ee0
NIFI-10145 Upgraded Hadoop from 3.3.2 to 3.3.3
- Excluded slf4j-reload4j implementation of Log4j 1
- Updated nifi-hive3-processors to leverage shared Hadoop version from 3.1.1
- Updated nifi-accumulo-bundle to leverage shared Hadoop version from 3.1.1
- Updated nifi-atlas-bundle to leverage shared Hadoop version from 3.3.2
- Updated nifi-spark-receiver to leverage shared Hadoop version from 3.3.2

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6139.
2022-06-28 16:19:38 +02:00
Nathan Gough 62eb565daf
NIFI-5402 - Added more assembly options for different modules. Assemblies should build a zip by default, or a tar.gz with the -Ptargz profile
This closes #5694
Signed-off-by: Paul Grey <greyp@apache.org>
2022-06-23 13:52:41 -04:00
exceptionfactory 4aee4546b9
NIFI-10135 Upgraded maven-surefire-plugin to 3.0.0-M7
- Removed duplicate plugin configuration in nifi-registry
- Removed maven-failsafe-plugin override in nifi-elasticsearch-client-service
- Removed failing test ResourceAuthorizationFilterSpec in nifi-registry-web-api

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6132.
2022-06-18 09:43:46 +02:00
exceptionfactory bd45eb4995 NIFI-10100 Upgraded Jersey to 2.35
- Replaced individual version references with Jersey BOM dependency

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6106.
2022-06-16 23:09:22 -04:00
mr1716 f08c971a89
NIFI-10090 Upgraded to Guava 31.1 in Toolkit and Registry
This closes #6120

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 09:24:09 -05:00
exceptionfactory f91d877043
NIFI-10114 This closes #6122. Removed Single Refresh from ShellUserGroupProvider
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-13 14:38:19 -07:00
exceptionfactory 1342ea7025 NIFI-10079 Upgraded ZooKeeper from 3.5.9 to 3.8.0
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6096.
2022-06-03 19:05:21 -04:00
exceptionfactory 2015a4f22c
NIFI-10086 Upgraded Spring Framework from 5.3.19 to 5.3.20
- Upgraded Spring Security from 5.6.3 to 5.7.1
- Upgraded Spring Boot from 2.6.7 to 2.7.0 for NiFi Registry

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6095.
2022-06-03 10:30:03 +02:00
Joe Gresock 48de70a568
NIFI-10071: Adding support for HashiCorp Vault K/V version 2 Secrets Engine (#6087) 2022-06-01 15:09:01 -04:00
exceptionfactory 99be62be67
NIFI-9958 Add Framework Support for Sensitive Dynamic Properties (#6057)
* NIFI-9958 Implemented Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties annotation for components
- Added optional sensitive query parameter to Property Descriptor REST Resource methods
- Added system tests for components supporting sensitive dynamic properties
- Updated REST Resources to support Sensitive Dynamic Property Names
- Updated Documentation Writer to indicate component support for Sensitive Dynamic Properties
- Updated InvokeHTTP to support Sensitive Dynamic Properties
- Updated Auditor components to handle masking Sensitive Dynamic Properties

* Refactored Property Descriptor REST method handling

- Corrected AbstractDocumentationWriter evaluation of support for sensitive dynamic properties
- Refactored Controller Service Dynamic Properties system tests to new class

* Updated AbstractComponentNode.getProperties() to get canonical descriptor
2022-05-23 17:20:54 -04:00
markap14 88e53eae8c
NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. (#6049)
* NIFI-10001: Fixed issue in which some components may fail to update the scheduled state when comparing flows

* NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. When comparing two flows, now allow specifying how to determine a VersionedComponent's ID for comparison. When comparing local flow against flow from registry, use Versioned Component ID. But when comparing two instantiated flows, such as local flow vs. cluster flow, use the VersionedComponent's Instance ID instead. This ensures that we can properly compare two components even if there are several instances of a given flow
2022-05-18 13:53:36 -04:00
exceptionfactory 85d5e2071b
NIFI-10031 Downgraded Jakarta Mail from 2.0.1 to 1.6.7 (#6052)
- Downgraded Jakarta Activation from 2.0.1 to 1.2.2 in nifi-bootstrap
- Updated assembly configurations to include Jakarta Activation in java11 directory
2022-05-18 11:38:36 -04:00
exceptionfactory eecdf38158
NIFI-10014 Upgraded Registry Test JDBC Drivers
- Upgraded MySQL from 8.0.15 to 8.0.29
- Upgraded MariabDB from 2.4.1 to 3.0.4
- Upgraded PostgreSQL from 42.2.19 to 42.3.5
- Removed unsupported database version references from project README.md
- Added MariaDB 10.3 to list of Registry examples

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6033.
2022-05-12 22:41:00 +02:00
dependabot[bot] a038309ba4
NIFI-10006 Upgraded async from 2.6.3 to 2.6.4 for Registry
Bumps [async](https://github.com/caolan/async) from 2.6.3 to 2.6.4.
- [Release notes](https://github.com/caolan/async/releases)
- [Changelog](https://github.com/caolan/async/blob/v2.6.4/CHANGELOG.md)
- [Commits](https://github.com/caolan/async/compare/v2.6.3...v2.6.4)

---
updated-dependencies:
- dependency-name: async
  dependency-type: indirect
...

This closes #6007

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-09 14:02:05 -05:00
exceptionfactory 0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
Matthieu Bertin 65dbbc9e76 NIFI-9966 Corrects the registry loading of large flowfiles from git
This closes #6012

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2022-05-07 13:37:28 +01:00
exceptionfactory 5e8b4d3144
NIFI-9997 Upgraded Ranger from 2.1.0 to 2.2.0 (#6022)
- Upgraded Hadoop from 3.1.1 to 3.3.2 for Ranger Plugins
2022-05-06 16:07:53 -04:00
dependabot[bot] 3699d42116
NIFI-9932 Upgrade minimist from 1.2.5 to 1.2.6
Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

This closes #5971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-03 13:49:45 -05:00
exceptionfactory 6ae1590aef
NIFI-9954 This closes #5993. Upgraded Spring Framework from 5.3.18 to 5.3.19
- Upgraded Spring Security from 5.6.2 to 5.6.3
- Upgraded Log4j 2 from 2.17.1 to 2.17.2
- Upgraded Spring Boot from 2.6.6 to 2.6.7 for NiFi Registry

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-25 07:36:50 -07:00
exceptionfactory 56fecbb7d8 NIFI-9955 Upgraded ZooKeeper 3.4.14 to 3.5.9
This closes #5995.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-04-24 15:46:55 +02:00
exceptionfactory ac08d3311e NIFI-9901 Removed provided scope from nifi-xml-processing registry-ranger
- The nifi-xml-processing library is not provided in the nifi-registry lib directory
- The nifi-xml-processing library must be available to the instance ClassLoader for the RangerAuthorizer

This closes #5994.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-04-24 08:53:03 +02:00
exceptionfactory 4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries

This closes #5992

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
Bryan Bende 3a15d4fbe5 NIFI-9950 Identify MariaDB database type and use MySQL migration scripts
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes 5989.
2022-04-21 22:43:34 -04:00
exceptionfactory b288810316
NIFI-9943 Added Transform Provider to nifi-xml-processing
- Refactored TransformerFactory references using StandardTransformerProvider

This closes #5986
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 15:14:54 -04:00
exceptionfactory 18a4182cb0
NIFI-9883 Refactor Property Protection using Isolated ClassLoader (#5972)
* NIFI-9883 Refactored property protection to isolated ClassLoader

- Added nifi-property-protection-loader for abstracting access to implementation classes using ServiceLoader
- Updated Authorizer and Login Identity Provider configuration using isolated ClassLoader
- Updated NiFi Properties Loader using isolated ClassLoader
- Updated nifi-assembly to place property protection dependencies in lib/properties directory
- Updated and refactored unit tests
- Corrected LoginIdentityProviderFactoryBean getObject() Type
2022-04-19 11:08:04 -04:00
Joe Witt 84340962d4
NIFI-9927 Initial Commit to clean up all extraneous version/group declarations.
This closes #5969

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-16 12:05:07 -04:00
exceptionfactory 15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services

This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
dependabot[bot] 0a25f39410
Bump moment (#5952)
Bumps [moment](https://github.com/moment/moment) from 2.22.1 to 2.29.2.
- [Release notes](https://github.com/moment/moment/releases)
- [Changelog](https://github.com/moment/moment/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/moment/moment/compare/2.22.1...2.29.2)

---
updated-dependencies:
- dependency-name: moment
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

This closes #5952
2022-04-12 11:44:58 -04:00
Joe Witt 873d25585c
NIFI-9780 Merge branch 'NIFI-9780-RC3' 2022-04-04 08:35:23 -07:00
exceptionfactory 7fde2bbfd1 NIFI-9852 Upgraded Spring Framework from 5.3.16 to 5.3.18
- Upgraded Spring Boot from 2.6.4 to 2.6.6

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5921.
2022-03-31 18:22:54 -04:00
Bryan Bende 3c10910fe2 NIFI-9845 Fix NiFi Registry database ITs
- remove unsupported DB test containers, update admin guide

This closes #5914.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-03-31 13:42:25 -04:00
Hervé Boutemy 8abdd163ba
NIFI-9848 Upgraded Maven Plugins for Reproducible Builds
This closes #5915

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-30 20:09:44 -05:00
Jonathan Conti-Vock d09b828333
NIFI-9816 Added lang attribute to html tag for WCAG 2.1 Accessibility
This closes #5893

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-30 08:38:46 -05:00
Zoltán Kornél Török 2f501fcbe5
NIFI-9836: fix database selection during nifi registry startup (#5907) 2022-03-29 11:32:21 -04:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Mike Thomsen 2bb1a06a8c
NIFI-9788 Updated commons-codec to 1.15 across all modules.
This closes #5881

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-21 09:13:05 -05:00
exceptionfactory 7823156606
NIFI-9815 Corrected log message formatting in multiple classes
This closes #5879

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-18 20:11:05 -04:00
exceptionfactory 412e21be97
NIFI-9281 Enabled building on Java 17
- Added Ubuntu Zulu JDK 17 GitHub build
- Adjusted MiNiFi C2 FileSystemConfigurationCache test to avoid using environment variables
- Adjusted MiNiFi StatusLogger and StatusLoggerTest to avoid overriding private logger
- Adjusted failure reason attribute check in TestGetIgniteCache
- Adjusted TestRangerAuthorizer and TestRangerNiFiAuthorizer to avoid checking nested exceptions
- Adjusted encrypt-config TestUtil to avoid unnecessary comparison of different types
- Disabled Javascript tests on Java 15 and higher
- Disabled several Hive 3 tests on Java 17 for StringInternUtils illegal access
- Refactored nifi-enrich-processors tests to use Mockito without Powermock
- Refactored nifi-toolkit-tls tests to avoid illegal reflective access
- Removed deprecated X509Certificate test in CertificateUtilsTest
- Removed kryo serialization from nifi-site-to-site-client test
- Updated TestHashContent to use SHA-1 instead of SHA for hash algorithm
- Upgraded maven-war-plugin from 2.5 to 3.3.2
- Upgraded nifi-graph-bundle dependencies from Groovy 2.5.14 to 3.0.8
- Upgraded QuestDB from 4.2.1 to 6.2.1 in nifi-framework-core

This closes #5870

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:08:38 -04:00
Matthew Burgess a4a46d50c3
NIFI-9316: Registry Sort by label should be 'Last Updated (newest)' not 'Newest (update)'
NIFI-9316: Incorporated review comments
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5496
2022-03-16 14:25:32 -04:00
exceptionfactory 36b3f18424
NIFI-9796 This closes #5866. Updated Registry Security Configuration to avoid warnings
- Replaced WebSecurity.ignoring().antMatchers() with HttpSecurity.authorizeRequests().antMatchers()

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-14 12:52:36 -07:00