Commit Graph

2423 Commits

Author SHA1 Message Date
Bryan Bende 5386095083
NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService
This closes #7079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 14:29:17 -05:00
Joe Witt 58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
Mark Payne 016d58612c
NIFI-11290 Run Component Primary Node State changes in background thread
- Ensure that components are notified that primary node has changed in a background thread instead of the Leader Election thread and activate/deactivate the thread in the case of Processors so that they can be viewed in the UI and terminated

- Fixed system tests that would fail intermittently because they did not wait for node disconnection to complete and did not properly switch the client to look at the connected node before checking cluster status

This closes #7052

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:20:37 -05:00
Joe Gresock 9de93f19a4
NIFI-11330: Restarting service referenced by parameter only when service is active (#7078) 2023-03-23 13:13:22 -04:00
dependabot[bot] 24bbe51b54
NIFI-11328 Upgraded Jettison from 1.5.2 to 1.5.4
- Upgraded direct dependencies in Framework and Registry modules as well as Spark bundle

This closes #7073
This closes #7074
This closes #7075

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 10:48:20 -05:00
exceptionfactory 8154fcce49
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:15 +01:00
Mark Payne 6adfb6131d
NIFI-11310: Provide appropriate classpath resources to the ReloadComponent when a processor is terminated
NIFI-11310: Fixed META-INF/services file that was mistakenly listing an extra extension point, due to rebase
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7061
2023-03-21 14:29:44 -04:00
simonbence 7954ff355c
NIFI-11213 Showing version change in older (pre 1.18.0) contained version flows properly (#7017) 2023-03-20 11:52:07 -04:00
Mark Payne 450a46bc58
NIFI-11289: Avoid obtaining read locks on queues when fetching Group Status, except in those few specific situations where it's needed.
This closes #7046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 14:18:22 -05:00
Matt Burgess 668d309c7e
NIFI-11279: Allow event stream processing to continue in CaptureChangeMySQL after sync issue (#7039) 2023-03-14 16:23:43 -04:00
exceptionfactory ccea9760f9
NIFI-11194 Remove gzip CSS and JS from nifi-web-ui (#6968)
* NIFI-11194 Removed gzip CSS and JS from nifi-web-ui

* NIFI-11194 Updated comment for static content aggregation

This closes #6968
2023-03-08 12:06:45 -05:00
exceptionfactory 512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
exceptionfactory d3908dede8
NIFI-11253 Removed H2 1.4 database migration modules
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7014
2023-03-07 10:35:21 -05:00
Joe Gresock 5cf909ccf6
NIFI-11247: Using parameterContextName instead of group name when fetching parameters (#7011)
Merged #7011.
2023-03-06 10:48:41 -08:00
Joe Gresock 5e3b93b2d6
NIFI-11238: Creating missing parameter providers when importing inherited provided contexts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7002.
2023-03-03 22:11:45 +01:00
exceptionfactory 44c70277ea
NIFI-11245 Corrected reducing Maximum Thread Count while running (#7005)
- Corrected implementation to allow reducing Maximum Thread Count below the default of 10
2023-03-03 11:35:34 -05:00
Mark Bean b08ae75be4
NIFI-11134 Added Label auditing to Flow Configuration History
This closes #6949

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-27 12:55:43 -06:00
exceptionfactory 48689a2567
NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-02-23 10:33:45 -05:00
Mark Payne 87e61c50ee
NIFI-11192: Ensure that if ports moved between parent/child group in between flow versions that we can properly handle that. Added system tests to verify.
NIFI-11192: If a failure is encountered when changing the version of a flow from 1 version to another, attempt to rollback the changes instead of just failing with the flow in a bad state
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6981
2023-02-22 15:38:00 -05:00
exceptionfactory 284804ac42
NIFI-11188 Removed ProcessContext encrypt and decrypt methods
- Removed unnecessary references to PropertyEncryptor from multiple framework components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6962.
2023-02-16 12:16:15 -05:00
Mark Payne fed175d46f NIFI-11189: When synchronizing a ProcessGroup to match a VersionedProcessGroup, do not remove the temporary funnel until the very end. This is important if the temporary funnel already exists in the flow on startup
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6963
2023-02-16 14:18:50 +01:00
Mark Payne 471cccbbda
NIFI-11176: This closes #6948. When comparing a VersionedConnection with an existing connection, we examined the source component's VersionedComponentId. But the existing component may not have a VersionedComponentId. We should only be comparing these if they are populated
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 18:52:15 -05:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Bence Simon b0ec28a452 NIFI-11159 Fixing connections with source having reassigned id 2023-02-10 11:12:51 -05:00
exceptionfactory a66727c4d1
NIFI-11160 Upgraded Apache Tika from 2.6.0 to 2.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6938.
2023-02-10 11:38:25 +01:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
dan-s1 99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
Joe Witt 4f91420cc1
NIFI-11139 Updated multiple Maven Plugins
This closes #6925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 16:07:02 -06:00
Mark Payne 28b9f6fc02
NIFI-11118: This closes #6909. When changing version of a versioned flow, ensure that we properly set the Version Control Information's StorageLocation for the NiFi Registry client in order to maintain backward compatibility
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:02:38 -07:00
Joe Gresock 2609fd5f55
NIFI-11122 Corrected provided parameter context inheritance after creation
This closes #6913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-02 13:20:35 -06:00
Joe Gresock afdf49b3cd
NIFI-11100: Limiting scope of external controller services during version sync to services outside the versioning context (#6898) 2023-02-01 12:14:38 -05:00
simonbence ae66ebdc22
NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes (#6870)
* NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes
2023-01-31 10:58:42 -05:00
Mark Payne d9f35b8974
NIFI-11105: This closes #6895. When mapping Parameter Context to VersionedParameterContext, don't bother mapping those that have already been mapped, as it is redundant
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-26 15:35:18 -07:00
exceptionfactory d913f8046a
NIFI-10581 Upgraded Apache Tika from 2.4.1 to 2.6.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6894.
2023-01-26 19:52:17 +01:00
exceptionfactory d60f541d7e
NIFI-11098 Deprecated ProcessContext encrypt and decrypt methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6891.
2023-01-26 18:18:09 +01:00
Priyanka Awatramani b3f2d95092
NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes
- Updated TestAttributesToCSV with LinkedHashMap for deterministic test behavior
- Updated TestHttpFlowFileServerProtocol with adjusted checksums to match expectations from LinkedHashMap changes

This closes #6748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 16:19:20 -06:00
Joe Gresock 7d99521d4c
NIFI-11089: Resolving previously resolved parameter providers when possible on version sync (#6886) 2023-01-25 13:42:52 -05:00
Paul Grey 567e95aa28
NIFI-11047 - Issue when upgrading version of dataflow with external service
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6849
2023-01-25 12:52:52 -05:00
Mark Payne 228a3441b5
NIFI-11001: This closes #6836. When new components are added, track a mapping of its Versioned Compoenent ID to the component itself. Then, use this when creating connections. This is important because if a Process Group has multiple components with the same Versioned Component ID across multiple child groups, the Versioned Component ID may be changed upon adding the component. Maintaining this mapping allows us to still create the connection correctly.
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:55:16 -07:00
exceptionfactory 84f48b5e8c
NIFI-11090 This closes #6883. Removed unused Jasypt test dependency
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-24 08:42:33 -07:00
Bence Simon 0ab1fbccc8
NIFI-10934 Added uniqueness check for Registry Client creation
This closes #6750

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Chris Sampson <12159006+ChrisSamo632@users.noreply.github.com>
2023-01-23 14:57:17 -06:00
Joe Gresock bf871e0b8d
NIFI-11032: Addressing NPE when retrieving registry client info with unauthorized user (#6879) 2023-01-23 15:51:25 -05:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Joe Gresock 8640989ad7
NIFI-11039: Fixing bug when importing parameter providers from nifi-registry (#6868)
* NIFI-11039: Fixing NPE in registry retrieval
* NIFI-11039: Fixing bug when importing parameter providers from nifi registry
2023-01-23 11:59:34 -05:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Joe Gresock 29618ae5c6
NIFI-11076: Resolving deadlock issue in StandardParameterContext (#6865)
* NIFI-11076: Resolving deadlock issue in StandardParameterContext

* NIFI-11076: Resolving deadlock issue in StandardParameterContext
2023-01-23 10:54:38 -05:00
Timea Barna a9274c12c5
NIFI-11079 Extend QueryNifiReportingTask and ProcessGroup Summary Table
Correcting EmbeddedQuestDbStatusHistoryRepositoryForComponentsTest

Correcting TestQueryNiFiReportingTask

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6869
2023-01-20 15:22:20 -05:00
krisztina-zsihovszki 9ad1d8a7ae
NIFI-11028 Handle controller service 'Scheduled State' change (#6831) 2023-01-17 18:40:47 -05:00
Matthew Burgess 6adbc1aeb0
NIFI-11036: Add Cluster Summary Metrics to Prometheus endpoint
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6834.
2023-01-17 14:44:33 +01:00
Nissim Shiman 692e74e90d
NIFI-10241 Add comments tooltip for controller services, reporting tasks
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6768
2023-01-11 14:29:14 -05:00