1401 Commits

Author SHA1 Message Date
Freedom9339
2b330d9fee
NIFI-10904 Changed the font color for drop down menus to avoid the app… (#7502)
* NIFI-10904 Changed the font color for dropdown menus to avoid the appearance of menu items being disabled

* NIFI-10904 Changed the CSS tag used to set the color of the dropdown menu text

* NIFI-10904 Used a new css class to set the color of dropdown options

* nifi-10904 Changed the css class for create/reference drop down menu items.

Merged #7502 into main.
2023-08-31 09:41:08 -07:00
exceptionfactory
5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00
Tamas Palfy
d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
Tamas Palfy
1e12800912
NIFI-11978 Fix: NPE when trying to disable Management Controller Service
This closes #7637

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 13:58:58 -05:00
exceptionfactory
c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
Freedom9339
52cc831a2a
NIFI-11303 Added a go-to entry on the right click context menu for th… (#7461)
* NIFI-11303 Added a go-to entry on the right click context menu for the provenance lineage tree to take you to the specified component in the graph

* nifi-11303 Removed unused variable.

Merged #7461 into main.
2023-08-21 09:23:38 -07:00
mr1716
0d119f6f39
NIFI-11955 Upgraded maven-clean-plugin from 3.2.0 to 3.3.1
This closes #7616

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:05:01 -05:00
Mark Payne
b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
Yolanda M. Davis
f8e3b9ebac
NIFI-11899 Correct Bulletin Metrics Registry to return latest Bulletins
This closes #7567

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:20:00 -05:00
Pierre Villard
572e661d12
NIFI-11901 Added name and version subtitle in Processor Details view
This closes #7563

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:14:14 -05:00
Timea Barna
42910e80d1
NIFI-11658 Streamline using single Parameter Context for nested PGs
This closes #7353

Co-authored-by: Matt Gilman <mcgilman@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-27 15:02:54 -05:00
Mark Payne
0eebf6b14e
NIFI-3065 When copying a PG, do not set the Log File Suffix if not already set
This closes #7522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:05:27 -05:00
Pierre Villard
969679e43b
NIFI-11846 - Change version should not show keep existing parameter context
This closes #7517

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 11:35:05 -05:00
Mark Payne
c009b55762
NIFI-11813: Fixed a bug in nf-processor-configuration.js that caused the UI to ignore the Scheduling Period when using a Timer-Driven strategy; removed some additional remnants of event-driven strategy from the UI
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7518.
2023-07-24 17:24:26 +02:00
Pierre Villard
20b19992d2
NIFI-11816 - Removed deprecated Primary Node Scheduling Strategy
This closes #7501

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:49:03 -05:00
Mark Payne
7405dcb510
NIFI-11814 Optimized Cluster Replication Component status evaluation
When waiting for all controller services to reach the desired status in the ClusterReplicationComponentLifecycle component, return immediately if there are no services to wait for. Otherwise, request that referencing components not be included in the return value of the Controller Services

This closes #7493

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 14:19:11 -05:00
Pierre Villard
150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
exceptionfactory
95bb23d403
NIFI-11781 Corrected OIDC Claim Identity Processing
- Added StandardOidcUserService supporting fallback claim names
- Updated StandardClientRegistrationProvider to use standard Subject claim
- Updated OIDC Security Configuration to use customized OidcUserService for claim handling

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7468.
2023-07-15 11:03:58 -04:00
Emilio Setiadarma
a85ef2c1f4
NIFI-11536 Corrected Keystore and Truststore auto-reloading
- Replaced Jetty KeyStoreScanner and custom TrustStoreScanner with shared StoreScanner
- New StoreScanner uses TLS Configuration to reload SSLContext instead of relying on Jetty SslContextFactory properties

This closes #7446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-10 11:07:04 -05:00
dan-s1
d24318cdb8
NIFI-11767 Refactored Groovy tests in nifi-web-error and nifi-web-security to Java
This closes #7457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-06 16:30:34 -05:00
simonbence
5f4cc106f1
NIFI-11769 Adding details on Registry Clients and Registrty Client types on UI (#7453)
Co-authored-by: Shane Ardell <shane.m.ardell@gmail.com>

Merged #7453 into main.
2023-06-30 11:33:41 -07:00
Bence Simon
cadf2fb6f2
NIFI-11706 Add option to create dedicated Parameter Contexts for Imported Flows
This closes #7401

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-30 12:56:27 -05:00
exceptionfactory
50b01ffd63
NIFI-11714 Added Error Handler to Jetty Server
- Configured Error Handler with Stack Traces disabled for NiFi and Registry

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7447.
2023-06-29 16:44:01 -04:00
dan-s1
2a7fa6d17b
NIFI-11754 Refactored Groovy test in nifi-jetty to Java (and JUnit 5)
This closes #7442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-27 14:39:08 -05:00
dan-s1
7748d9d1e5
NIFI-11747 Refactored Groovy tests in nifi-web-api to Java (and JUnit 5)
This closes #7434

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:18:48 -05:00
timeabarna
ba6797bb94
NIFI-3065 Per Process Group logging (#7315)
* NIFI-3065 Per Process Group logging
2023-06-23 21:14:34 -04:00
exceptionfactory
7d6af0dbb0 NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7428
2023-06-23 18:27:36 -04:00
exceptionfactory
0f736e060a
NIFI-11735 Refactored Identity Provider Groups Handling (#7419)
- Removed H2 database approach in favor of passing groups in Application Bearer Token
2023-06-22 11:07:23 -04:00
exceptionfactory
0ed1efc50a
NIFI-11712 Removed java.net.preferIPv4Stack from bootstrap.conf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7392.
2023-06-19 10:22:31 +02:00
exceptionfactory
ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
2023-06-13 15:36:23 -04:00
Shane Ardell
7a7f6f6229
NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:36:49 -07:00
Bryan Bende
ce50ffbe0e
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:11:33 -04:00
Scott Aslan
7a10ba6165
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:13:08 -04:00
exceptionfactory
bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations (#7222)
* NIFI-11513 Removed deprecated NarProvider and implementations

- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
exceptionfactory
8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7251.
2023-05-16 10:34:23 +02:00
M Tien
09cef4ff99
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) (#7117)
* NIFI-11287: detect dependent properties when the property it depends on references a parameter

* address review feedback

* address more review comments

* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class

* add type parameter to all places calling loadProperties

* get reference parameters by invoking provided callbacks from the client

* check for user permissions before requesting for referenced parameters

* address review feedback

This closes #7117
2023-05-11 17:00:57 -04:00
Timea Barna
5811a9c579
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics
This closes #7124

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-08 08:11:20 -05:00
exceptionfactory
ee03db0e8f
NIFI-11488 Removed Deprecated Sensitive Properties Algorithms
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7198.
2023-04-27 20:16:26 +03:00
Timea Barna
d54940c397
NIFI-11473 Flow version change in NiFi should not stop a component when only position is changed
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7185
2023-04-27 12:59:24 -04:00
Lehel Boér
ffaf81ec46
NIFI-11067 Delete Property History when changing Sensitive status
This closes #7082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 09:55:21 -05:00
Scott Aslan
387504b66f
NIFI-11433 - use .add() for set instead of .push() (#7193)
* replace d3.nest, use add instead of push for Set, use forEach to loop over Set

* es5 function syntax

Merged #7193 into main.
2023-04-25 10:43:45 -07:00
Scott Aslan
38ece1d7d9
[NIFI-11433] update angular, d3, moment, slickgrid, and jquery depen… (#7174)
* [NIFIF-11433] update angular, d3, moment, slickgrid, and jquery dependencies

* address review feedback

* .entries instead of .keys

Merged #7174 into main.
2023-04-24 10:16:20 -07:00
exceptionfactory
1639ecee11
NIFI-11438 Set standard OpenID Connect Scopes
- Restored previous behavior of sending openid and email scopes for OpenID Connect token requests
- Added offline_access scope as the default value in nifi.properties to support Refresh Tokens

This closes #7168
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-21 11:29:16 -04:00
exceptionfactory
bdff3abcd6
NIFI-11461 Improve User and Group Tenants Search (#7181)
* NIFI-11461 Improved User and Group Tenants Search

- Added searchTenants method to NiFiServiceFacade and removed unnecessary object creation
- Updated TenantsResource to use delegated NiFiServiceFacade.searchTenants method
- Changed autocomplete delay from default 300 ms to 500 ms

* NIFI-11461 Adjusted implementation to use EntityFactory.createTenantEntity

This closes #7181
2023-04-19 09:58:25 -04:00
Mark Payne
7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Bryan Bende
ba93f60731
NIFI-11436 Fix NPE during updateFlow when called from a replace request for a PG that is not under version control (#7167) 2023-04-12 19:24:22 -04:00
exceptionfactory
e4f0508c90
NIFI-11370 Corrected JWK Set retrieval for NIFI Trust Strategy (#7108)
- Added StandardOidcIdTokenDecoderFactory based on Spring Security OidcIdTokenDecoderFactory with custom REST Operations

Merged #7108 into main.
2023-03-31 16:26:02 -07:00
exceptionfactory
75eb449a31
NIFI-11365 Corrected OIDC Redirect URI resolution for reverse proxies (#7104)
- Added Authorization Request Resolver with support for building the base redirect URI using allowed proxy headers

This closes #7104
2023-03-30 16:26:35 -04:00
Mark Payne
23d6d6ede4
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:30:18 -05:00
exceptionfactory
26400fcbe9
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 08:35:10 -04:00