Commit Graph

100 Commits

Author SHA1 Message Date
Mark Payne 8959226b50
NIFI-9754: Introduced VersionedExternalFlow
- Updated stateless and StandardProcessGroup, etc. to make use of VersionedExternalFlow
- Updated StatelessDataflowDefinition to use ExternalVersionedFlow instead of generic type
- Updated Stateless Bootstrap to avoid loading stateless engine libs from root class path but instead use a NarClassLoader to load the statelss nar

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5832.
2022-03-04 07:19:38 -05:00
exceptionfactory 7438bc9244
NIFI-9759 Upgraded Spring Framework from 5.3.15 to 5.3.16
- Upgraded Spring Security from 5.6.1 to 5.6.2
- Upgraded Spring Boot from 2.6.3 to 2.6.4 in NiFi Registry
- Upgraded Spring Data Redis from 2.6.0 to 2.6.2
- Upgraded Spring Integration from 5.5.7 to 5.5.9

This closes #5835

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-04 06:23:51 -05:00
Shane Ardell 6cd30e3d0a
NIFI-9543: Add bring-to-front functionality to labels (#5765)
* NIFI-9543: add bring-to-front functionality to labels

* NIFI-9543: update zIndex changes to persist after shutdown

* NIFI-9543: remove commented code

* NIFI-9543: update flow comparator and snippet to account for zIndex

* NIFI-9543: changed add function to sort labels when a new label is added

* NIFI-9543: remove unnecessary call to position

* NIFI-9543: only register difference if zIndex is not default value

* NIFI-9543: add null checks to prevent primitive Long

This closes #5765
2022-03-03 18:50:15 -05:00
Adam Kocsis 6f5fda54e5
[NIFI-9746] NiFi Registy Bucket Side Nav no longer fails to open (#5831)
- all ViewCild queries are decorated with {static: true} which is needed because of new angular version
none of these ViewChild under *ng directives so they are available during init with static:true

Merged #5831 into main.
2022-03-03 14:45:35 -08:00
Bryan Bende db7690769d
NIFI-9745 - Prevent insertion of revisions in NiFi registry when revision feature is disabled
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5823.
2022-03-02 19:12:32 -05:00
Matthew Burgess bcc8d03314
NIFI-9585 Upgraded H2 from 1.4 to 2.1.210
- Added nifi-h2-database module shading H2 1.4.200
- Implemented version checking and migration

This closes #5724

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-25 19:20:48 -06:00
exceptionfactory fe1139b8bb
NIFI-9692 Upgraded Apache Commons Lang3 to 3.12.0
- Moved commons-lang3 version management to root Maven configuration
- Refactored limited usage of StringUtils is nifi-reporting-utils to remove commons-lang3
- Refactored limited usage of StringUtils in nifi-websocket-processors to remove commons-lang3

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5773
2022-02-16 09:28:21 -05:00
timeabarna 63a543cd67
NIFI-9475 Provide Framework-Level Retries for NiFi Relationships (#5593) 2022-02-15 15:40:41 -05:00
Scott Aslan b8ec6d38dc [NIFI-9554] upgrade node and npm
update lintin
update font awesome path
bump nifi-fds version
update nifi deps
update frontend maven plugin
change CI npm cache restore keys so that we will not use cached directories for older versions of node

This closes #5751.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-02-14 14:24:02 -05:00
Rob Fellows 8d143e8367 [NIFI-9623] - Attempt to look up messages locale file without country designation if it fails to find it with the country designation
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5707.
2022-02-04 18:44:15 -05:00
exceptionfactory 6fca4eb3ce
NIFI-9624 Removed JCenter Repository
- Removed moquette-broker and refactored tests
- Upgraded docker-compose-rule-junit4 to 1.7.0 for Maven Central retrieval
- Changed JSTL dependency groupId for Maven Central retrieval

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5719.
2022-01-28 10:11:34 -05:00
exceptionfactory c8fe5149a5 NIFI-9634 Upgraded Spring Framework to 5.3.15
- Upgraded Spring Framework from 5.3.14 to 5.3.15
- Upgraded Spring Boot from 2.5.8 to 2.6.3 in Registry
- Upgraded Jersey from 2.33 to 2.35
- Upgraded Jackson from 2.12.5 to 2.13.1

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5723.
2022-01-27 20:31:18 -05:00
exceptionfactory 5022a5ee07
NIFI-9630 Migrated Registry REST API docs to swagger-codegen (#5715)
- Added swagger-codegen-maven-plugin configuration
- Removed swagger2markup-maven-plugin and asciidoctor-maven-plugin configurations
- Removed generation of legacy REST API documentation and associated templates
2022-01-26 09:03:26 -05:00
Matthew Burgess bb24030f4a
NIFI-7840: Upgrade to Groovy 3.0.8 and Spock 2.1
This closes #5699

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-25 09:47:30 -06:00
Bryan Bende 4000b01909
NIFI-9570 Separate classpath for NiFi Registry sensitive property providers
This closes #5668

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-25 09:21:01 -06:00
exceptionfactory e2243500d3
NIFI-9618 Upgraded Checkstyle to 9.2.1
- Corrected several missing return statements
- Increased Maven heap size to 3 GB for ci-workflow

This closes #5700

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-21 20:08:16 -06:00
Bryan Bende 6ef6e71d05
NIFI-9501 Added REST end-point to retrieve a RuntimeManifest
- Switch ExtensionManifestParser implementation to use JAXB instead of Jackson XML
- Fix handling of older NARs that don't have newer fields in ExtensionManifest
- Add response merging for runtime-manifest REST end-point, remove commons-lang3 from c2 dependencies

This closes #5630

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-21 15:37:04 -06:00
Joe Witt 139a269c41
NIFI-9597 fixing all explicit version refs to main latest 2022-01-19 11:17:15 -07:00
Kevin Doran 3f69eeceb2
NIFI-9597 This closes #5681. Fix Dockerfile URLs
Update Docker Hub Dockerfiles for MiNiFi, MiNiFi C2, and Registry
to reflect new default binary download locations.

Also, make mirror base url configurable to streamline the RM process.

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 10:52:30 -07:00
Zoltan Kornel Torok 9783f1c5c3
NIFI-9552 Fix NoClassDefFound error in case of nifi-registry-ranger-assembly
Without define the jcl-over-slf4j runtime dependency, the assembly plugin will not copy the jcl jar to the ranger lib directory,
which cause NoClassDefFoundError in some cases

This closes #5663

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-18 08:52:43 -06:00
exceptionfactory 2ffd4a5a9a
NIFI-9438 Refactored sensitive-property-provider to multiple modules
- Added nifi-property-protection-api with provider interfaces
- Added nifi-property-protection-factory with implementation references
- Added ProtectionSchemeResolver for abstracting conversion from command arguments
- Refactored PropertyProtectionScheme to package private visibility
- Refactored multiple unit test and removed provider integration tests
- Renamed AESSensitivePropertyProvider to AesGcmSensitivePropertyProvider
- Added getSupportedProtectionSchemes() to StandardProtectionSchemeResolver
- Updated command argument descriptions for protection schemes to include supported values

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5650.
2022-01-13 13:18:04 -05:00
Joe Witt bc2ba9537a
NIFI-9525 including same pattern for nifi registry. This is commmit 2/2 for NIFI-9525 2022-01-12 15:52:03 -07:00
Pierre Villard dc42012755
NIFI-9407 Upgraded Ozone from 1.0.0 to 1.2.1
This closes #5547

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-05 22:59:36 -06:00
exceptionfactory 12ba579b8f NIFI-9539 Upgraded Netty from 4.1.69 to 4.1.72
- Added Netty 4 BOM to root Maven configuration
- Removed individual Netty 4 dependency overrides
- Removed commented dependencies and unnecessary declarations from MiNiFi

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5635.
2022-01-05 18:11:03 -05:00
exceptionfactory 7c407cf580
NIFI-9523 Consolidated Maven Enforcer Plugin executions
- Removed duplicative Enforcer Plugin configuration from nifi-registry

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5623.
2022-01-05 16:02:01 +01:00
exceptionfactory 81e57c9651
NIFI-9535 Upgraded Spring Framework to 5.3.14
- Centralized Spring Framework and Spring Security versions using BOM dependencies
- Upgraded Spring Security from 5.5.2 to 5.6.1
- Upgraded Spring Boot from 2.5.5 to 2.5.8 in Registry
- Upgraded Spring Integration from 5.5.2 to 5.5.7

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5631.
2022-01-05 15:30:03 +01:00
Zoltán Kornél Török e54cbe6451
NIFI-9524 exclude commons-logging and log4j-core banned dependencies for other build profiles as well (#5625) 2022-01-04 09:14:04 -05:00
Bryan Bende d6efc69585
NIFI-9502 Move extension manifest model and parser out of nifi-registry and into common modules
NIFI-9502 Move ExtensionManifest parser and impl from nifi registry into common module

NIFI-9502 Add jigsaw profile to nifi-extension-manifest-model in order to build on Java 11

Add apache license header to test resources

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5619
2021-12-22 10:46:59 -05:00
Bryan Bende 0f02dac3fa
NIFI-9452 Generate a RuntimeManifest for NiFi at build time
- Write additional fields to extnesion-manifest.xml for processors
- Update C2 model classes to support new fields for processors, properties, and scheduling
- Create converter between NiFi model and C2 model
- Create generator and execute during the build

Add profile to nifi-assembly that skips the binary assembly, update github workflow to enable this profile instead of excluding nifi-assembly

Add additional documentation on new fields in processor definition and reporting task definition

Set charset to UTF-8 on the OutputStreamWriter

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5612
2021-12-21 16:35:15 -05:00
Adam Kocsis f85ae68fb5
NIFI-8821 Registry - Sorting the grid-list no longer expands the listed buckets (#5611)
* [NIFI-8821] Registry - Sorting the grid-list no linger expands the listed buckets

- gitignore is added to support dev UI run with npm

* - trackByFn is specified for ngForOf to help td-expansion-panel to track elements after sorting

* - adding trackByFn to all grid list view component codes

Merged #5611 into main.
2021-12-20 09:13:29 -08:00
exceptionfactory 9dd6b5f3e5
NIFI-9483 This closes #5616. Excluded Log4j 2 log4j-core and related libraries
- Added log4j-core to list of banned dependencies
- Added log4j-to-slf4j for Elasticsearch 5 processors to support runtime logging

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-20 10:02:08 -07:00
exceptionfactory 7c6bdcb035
NIFI-9491 Excluded commons-logging and added jcl-over-slf4j references
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5608
2021-12-17 07:21:03 -05:00
Shane Ardell 293919f881
NIFI-9460: Update Lodash to 4.17.21 (#5605)
* NIFI-9460: update lodash transitive dep in registry

* NIFI-9460: use lodash instead of lodash-core

Merged #5605 into main.
2021-12-16 14:28:02 -08:00
Bryan Bende e7449bf0d3
NIFI-9486 This closes #5604. Add compile scope to logging deps in nifi-registry-assembly
NIFI-9486 Add compile scope to logging deps in minifi-assembly

This commit is 2 of 2.

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-14 13:17:37 -07:00
Bryan Bende 09f254c611
NIFI-9486 This closes #5604. Upgrade to logback 1.2.8, remove unnecessary dependencyManagement entries in minifi and nifi-registry in favor of root pom
Remove unnecessary use of slf4j-simple
2021-12-14 12:32:32 -07:00
Bryan Bende b5414ab195
NIFI-9474 Block log4j-core older than 2.15.0
- Add log4j-bom to root Maven configuration
- Remove previous overrides in favor of log4j-bom in root Maven configuration

This closes #5598

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-13 10:54:45 -06:00
Pierre Villard 6f22d3ad11
NIFI-9474 - Upgrade additional Log4j references to 2.15.0
This closes #5595

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 21:47:12 -06:00
Pierre Villard 8fdde86997
NIFI-9474 - Upgrade Log4j references to 2.15.0
This closes #5592

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 08:00:23 -06:00
Bryan Bende 0f027743d1
NIFI-9443 Update NAR plugin to 1.3.3 and update data model for extension manifest to capture new fields
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5570.
2021-12-06 08:58:40 -05:00
Mark Payne 90b39b593a
NIFI-9069 Changed framework dataflow serialization to support JSON
- Changed framework so that it serializes the dataflow into a VersionedDataflow using JSON as well as XML, and prefers the JSON representation on load, if it's available. This also results in the need for the cluster protocol to exchange its representation of the dataflow to using JSON. Rather than re-implementing all of the complex logic of Flow Fingerprinting, updated to just inherit the cluster's flow.
- Moved logic to synchronize Process Group with Versioned Process Group into a new ProcessGroupSynchronizer class instead of having all of the logic within StandardProcessGroup
- Reworked versioned components to use an instance id.
- Renamed StandardFlowSynchronizer to XmlFlowSynchronizer; introduced new StandardFlowSynchronizer that delegates to the appropriate (Xml or Versioned)FlowSynchronzer
- Updated to allow import of VersionedProcessGroup even if not all bundles are available - will now use ghost components
- Introduced a VersionedDataflow object to hold controller-level services, reporting tasks, parameter contexts, templates, etc.
- Allow mutable requests to be made while nodes are disconnected. Also fixed issue in AbstractPolicyBasedAuthorizer that caused ClassNotFoundException / NoClassDefFoundError if the authorizations were changed and then a node attempts to rejoin the cluster. The Authorizer was attempting to use XmlUtils, which is in nifi-security-utils and so so by madking nifi-security-utils a provided dependency of nifi-framework-api, but this doesn't work, because nifi-framework-api is loaded by a higher-level classloader, so the classloader that loads AbstractPolicyBasedAuthorizer will never have the appropriate classloader to provide nifi-security-utils. Addressed this by copying the code for creating a safe document builder from XmlUtils to AbstractPolicyBasedAuthorizer.
- Fixed bug that occurred when importing a Process Group that has 2 parameter contexts, one inheriting from another, where neither is pre-defined in the existing flow
- Fixed bug that was encountered when Updating a Versioned Process Group where one version had a disabled processor and the other had the processor running.
- Increased system-tests workflow timeout to 120 minutes
- Added additional exception handling to system tests

This closes #5514

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-02 15:10:38 -06:00
Bryan Bende 77f235bf1c
NIFI-9379 Add dependent properties and resource definitions to manifest model
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5522.
2021-11-17 06:36:10 -05:00
wiktor2200 1ae6dbdfb6
NIFI-9077 Added Registry H2 DB password change instructions
This closes #5328

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-15 10:41:42 -06:00
exceptionfactory 30293b2339
NIFI-9375 Refactored Registry using OSUtils from nifi-bootstrap-utils
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5520.
2021-11-14 15:57:01 +01:00
Joe Witt c055895952
NIFI-9344-RC3 prepare for next development iteration 2021-11-03 08:53:37 -07:00
Joe Witt 7fdc07cccd
NIFI-9344-RC3 prepare release nifi-1.15.0-RC3 2021-11-03 08:53:32 -07:00
exceptionfactory f01fb17555 NIFI-9354 Removed material-design-icons from Registry
- Registry bootstrap imports Material Icons font from covalent/core instead of material-design-icons

This closes #5500

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2021-11-01 15:28:54 -04:00
exceptionfactory 60d6d469bf
NIFI-9342 Upgraded to Netty 3.10.6 and 4.1.69
- Replaced Netty 3.6.9 and 3.7.1 with 3.10.6
- Replaced Netty 4.1 with 4.1.69

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5490.
2021-10-28 09:34:31 +02:00
Andrew Lim 66b5fd1c6d
NIFI-8738 Update User Guide with Import and Export Flow from the UI
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5470.
2021-10-21 11:00:27 +02:00
exceptionfactory 70274ebcfc
NIFI-9306 Upgraded Spring Framework to 5.3.11
- Upgraded Spring Security from 5.5.1 to 5.5.2
- Upgraded Spring Boot from 2.5.2 to 2.5.5 in Registry
- Upgraded Spring Data Redis from 2.5.3 to 2.5.5 in Redis modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5463.
2021-10-19 11:26:37 +02:00
Joe Gresock f3136f07eb
NIFI-9221: Add AWS SecretsManager Sensitive Props Provider
This closes #5410

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-10-08 11:44:43 -05:00