1387 Commits

Author SHA1 Message Date
Pierre Villard
20b19992d2
NIFI-11816 - Removed deprecated Primary Node Scheduling Strategy
This closes #7501

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:49:03 -05:00
Mark Payne
7405dcb510
NIFI-11814 Optimized Cluster Replication Component status evaluation
When waiting for all controller services to reach the desired status in the ClusterReplicationComponentLifecycle component, return immediately if there are no services to wait for. Otherwise, request that referencing components not be included in the return value of the Controller Services

This closes #7493

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 14:19:11 -05:00
Pierre Villard
150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
exceptionfactory
95bb23d403
NIFI-11781 Corrected OIDC Claim Identity Processing
- Added StandardOidcUserService supporting fallback claim names
- Updated StandardClientRegistrationProvider to use standard Subject claim
- Updated OIDC Security Configuration to use customized OidcUserService for claim handling

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7468.
2023-07-15 11:03:58 -04:00
Emilio Setiadarma
a85ef2c1f4
NIFI-11536 Corrected Keystore and Truststore auto-reloading
- Replaced Jetty KeyStoreScanner and custom TrustStoreScanner with shared StoreScanner
- New StoreScanner uses TLS Configuration to reload SSLContext instead of relying on Jetty SslContextFactory properties

This closes #7446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-10 11:07:04 -05:00
dan-s1
d24318cdb8
NIFI-11767 Refactored Groovy tests in nifi-web-error and nifi-web-security to Java
This closes #7457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-06 16:30:34 -05:00
simonbence
5f4cc106f1
NIFI-11769 Adding details on Registry Clients and Registrty Client types on UI (#7453)
Co-authored-by: Shane Ardell <shane.m.ardell@gmail.com>

Merged #7453 into main.
2023-06-30 11:33:41 -07:00
Bence Simon
cadf2fb6f2
NIFI-11706 Add option to create dedicated Parameter Contexts for Imported Flows
This closes #7401

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-30 12:56:27 -05:00
exceptionfactory
50b01ffd63
NIFI-11714 Added Error Handler to Jetty Server
- Configured Error Handler with Stack Traces disabled for NiFi and Registry

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7447.
2023-06-29 16:44:01 -04:00
dan-s1
2a7fa6d17b
NIFI-11754 Refactored Groovy test in nifi-jetty to Java (and JUnit 5)
This closes #7442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-27 14:39:08 -05:00
dan-s1
7748d9d1e5
NIFI-11747 Refactored Groovy tests in nifi-web-api to Java (and JUnit 5)
This closes #7434

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:18:48 -05:00
timeabarna
ba6797bb94
NIFI-3065 Per Process Group logging (#7315)
* NIFI-3065 Per Process Group logging
2023-06-23 21:14:34 -04:00
exceptionfactory
7d6af0dbb0 NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7428
2023-06-23 18:27:36 -04:00
exceptionfactory
0f736e060a
NIFI-11735 Refactored Identity Provider Groups Handling (#7419)
- Removed H2 database approach in favor of passing groups in Application Bearer Token
2023-06-22 11:07:23 -04:00
exceptionfactory
0ed1efc50a
NIFI-11712 Removed java.net.preferIPv4Stack from bootstrap.conf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7392.
2023-06-19 10:22:31 +02:00
exceptionfactory
ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
2023-06-13 15:36:23 -04:00
Shane Ardell
7a7f6f6229
NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:36:49 -07:00
Bryan Bende
ce50ffbe0e
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:11:33 -04:00
Scott Aslan
7a10ba6165
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:13:08 -04:00
exceptionfactory
bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations (#7222)
* NIFI-11513 Removed deprecated NarProvider and implementations

- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
exceptionfactory
8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7251.
2023-05-16 10:34:23 +02:00
M Tien
09cef4ff99
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) (#7117)
* NIFI-11287: detect dependent properties when the property it depends on references a parameter

* address review feedback

* address more review comments

* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class

* add type parameter to all places calling loadProperties

* get reference parameters by invoking provided callbacks from the client

* check for user permissions before requesting for referenced parameters

* address review feedback

This closes #7117
2023-05-11 17:00:57 -04:00
Timea Barna
5811a9c579
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics
This closes #7124

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-08 08:11:20 -05:00
exceptionfactory
ee03db0e8f
NIFI-11488 Removed Deprecated Sensitive Properties Algorithms
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7198.
2023-04-27 20:16:26 +03:00
Timea Barna
d54940c397
NIFI-11473 Flow version change in NiFi should not stop a component when only position is changed
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7185
2023-04-27 12:59:24 -04:00
Lehel Boér
ffaf81ec46
NIFI-11067 Delete Property History when changing Sensitive status
This closes #7082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 09:55:21 -05:00
Scott Aslan
387504b66f
NIFI-11433 - use .add() for set instead of .push() (#7193)
* replace d3.nest, use add instead of push for Set, use forEach to loop over Set

* es5 function syntax

Merged #7193 into main.
2023-04-25 10:43:45 -07:00
Scott Aslan
38ece1d7d9
[NIFI-11433] update angular, d3, moment, slickgrid, and jquery depen… (#7174)
* [NIFIF-11433] update angular, d3, moment, slickgrid, and jquery dependencies

* address review feedback

* .entries instead of .keys

Merged #7174 into main.
2023-04-24 10:16:20 -07:00
exceptionfactory
1639ecee11
NIFI-11438 Set standard OpenID Connect Scopes
- Restored previous behavior of sending openid and email scopes for OpenID Connect token requests
- Added offline_access scope as the default value in nifi.properties to support Refresh Tokens

This closes #7168
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-21 11:29:16 -04:00
exceptionfactory
bdff3abcd6
NIFI-11461 Improve User and Group Tenants Search (#7181)
* NIFI-11461 Improved User and Group Tenants Search

- Added searchTenants method to NiFiServiceFacade and removed unnecessary object creation
- Updated TenantsResource to use delegated NiFiServiceFacade.searchTenants method
- Changed autocomplete delay from default 300 ms to 500 ms

* NIFI-11461 Adjusted implementation to use EntityFactory.createTenantEntity

This closes #7181
2023-04-19 09:58:25 -04:00
Mark Payne
7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Bryan Bende
ba93f60731
NIFI-11436 Fix NPE during updateFlow when called from a replace request for a PG that is not under version control (#7167) 2023-04-12 19:24:22 -04:00
exceptionfactory
e4f0508c90
NIFI-11370 Corrected JWK Set retrieval for NIFI Trust Strategy (#7108)
- Added StandardOidcIdTokenDecoderFactory based on Spring Security OidcIdTokenDecoderFactory with custom REST Operations

Merged #7108 into main.
2023-03-31 16:26:02 -07:00
exceptionfactory
75eb449a31
NIFI-11365 Corrected OIDC Redirect URI resolution for reverse proxies (#7104)
- Added Authorization Request Resolver with support for building the base redirect URI using allowed proxy headers

This closes #7104
2023-03-30 16:26:35 -04:00
Mark Payne
23d6d6ede4
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:30:18 -05:00
exceptionfactory
26400fcbe9
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 08:35:10 -04:00
exceptionfactory
8154fcce49
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:15 +01:00
exceptionfactory
ccea9760f9
NIFI-11194 Remove gzip CSS and JS from nifi-web-ui (#6968)
* NIFI-11194 Removed gzip CSS and JS from nifi-web-ui

* NIFI-11194 Updated comment for static content aggregation

This closes #6968
2023-03-08 12:06:45 -05:00
exceptionfactory
512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
Joe Gresock
5cf909ccf6
NIFI-11247: Using parameterContextName instead of group name when fetching parameters (#7011)
Merged #7011.
2023-03-06 10:48:41 -08:00
Mark Bean
b08ae75be4
NIFI-11134 Added Label auditing to Flow Configuration History
This closes #6949

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-27 12:55:43 -06:00
exceptionfactory
48689a2567
NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-02-23 10:33:45 -05:00
Mark Payne
87e61c50ee
NIFI-11192: Ensure that if ports moved between parent/child group in between flow versions that we can properly handle that. Added system tests to verify.
NIFI-11192: If a failure is encountered when changing the version of a flow from 1 version to another, attempt to rollback the changes instead of just failing with the flow in a bad state
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6981
2023-02-22 15:38:00 -05:00
exceptionfactory
284804ac42
NIFI-11188 Removed ProcessContext encrypt and decrypt methods
- Removed unnecessary references to PropertyEncryptor from multiple framework components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6962.
2023-02-16 12:16:15 -05:00
exceptionfactory
1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Joe Witt
43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
dan-s1
99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
Joe Witt
4f91420cc1
NIFI-11139 Updated multiple Maven Plugins
This closes #6925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 16:07:02 -06:00
Joe Gresock
2609fd5f55
NIFI-11122 Corrected provided parameter context inheritance after creation
This closes #6913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-02 13:20:35 -06:00
simonbence
ae66ebdc22
NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes (#6870)
* NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes
2023-01-31 10:58:42 -05:00