2582 Commits

Author SHA1 Message Date
simonbence
2abd1c5092
NIFI-11769 Adding details on Registry Clients and Registrty Client types on UI (#7453)
Co-authored-by: Shane Ardell <shane.m.ardell@gmail.com>

Merged #7453 into main.
2023-07-01 20:58:38 +02:00
Bence Simon
5acbb8a702
NIFI-11706 Add option to create dedicated Parameter Contexts for Imported Flows
This closes #7401

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit cadf2fb6f25caf334bf787292380af5b25fdcbb1)
2023-06-30 13:15:41 -05:00
exceptionfactory
5a68069b8f
NIFI-11714 Added Error Handler to Jetty Server
- Configured Error Handler with Stack Traces disabled for NiFi and Registry

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7447.
2023-06-29 16:46:40 -04:00
dan-s1
ce5eb85c1d
NIFI-11754 Refactored Groovy test in nifi-jetty to Java (and JUnit 5)
This closes #7442

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 2a7fa6d17b1807091659197c702a221825a30eeb)
2023-06-27 14:45:26 -05:00
dan-s1
207af04ea2
NIFI-11747 Refactored Groovy tests in nifi-web-api to Java (and JUnit 5)
This closes #7434

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 7748d9d1e5287c6b99c965ee0ed93ed154802def)
2023-06-26 15:23:24 -05:00
exceptionfactory
cb76a62a14
NIFI-3065 Corrected TestStandardLoggingContext for Java 8
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 11:09:50 -05:00
timeabarna
d5fb6b4518 NIFI-3065 Per Process Group logging (#7315)
* NIFI-3065 Per Process Group logging
2023-06-23 21:20:34 -04:00
exceptionfactory
072c9547bf NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-23 18:26:51 -04:00
Timea Barna
2052f15c79
NIFI-11705 Append Operating System section in NiFi diagnostic tool
This closes #7388

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit dceee57dfd1d0540463ddb6d15cee8858eb66928)
2023-06-23 17:00:29 -05:00
Bryan Bende
f9d48cb78a
NIFI-11492 Allow authorization to proceed based on request groups even if user does not exist
This closes #7425

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 40014486a408c2676afecad9d20b8c130a4bc8d1)
2023-06-22 15:51:06 -05:00
exceptionfactory
411111925b
NIFI-11735 Refactored Identity Provider Groups Handling (#7419)
- Removed H2 database approach in favor of passing groups in Application Bearer Token
2023-06-22 11:11:44 -04:00
exceptionfactory
4d55615c7a NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-20 16:20:54 -04:00
exceptionfactory
0ecd15537e
NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233

(cherry picked from commit ca6c7f704164e922e11d72e7c972a50ac46e6b0e)
2023-06-13 15:22:40 -05:00
exceptionfactory
65436cb829 NIFI-11680 Corrected Buffer Size Calculation for Connection Balancing (#7370)
- Resolved BufferOverflowException in PeerChannel with Bouncy Castle Provider
- Changed prepareForWrite() to use Destination Buffer remaining instead of Application Buffer Size
- Changed encrypt() to Packet Buffer Size instead of Application Buffer Size
2023-06-13 11:02:02 -04:00
Mark Payne
b85063cb81
NIFI-11681: Terminate Process Sessions before interrupting processor threads
This closes #7371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 787e0d82614e345b5afbef6691c418c43cf0ab08)
2023-06-13 08:24:33 -05:00
Mark Payne
181b287b1d
NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile
Rather than creating many FlowFiles with the same Content Claim, refactored content repos' OutputStreams and ClaimWriteCache so that a new ContentClaim is created for each FlowFile. This ensures that we have a content claim offset of 0. The poor performance was due to having to use StreamUtils.skip() in conjunction with the CipherInputStream, which would only skip a max of 511 bytes at a time. By using a separate Content Claim per FlowFile, we no longer need to seek after creating the CipherInputStream

This closes #7363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 702c6350344e4ae4cd31349747e96c1384017ed4)
2023-06-12 10:23:29 -05:00
Joe Witt
edc9e40582
Merge branch 'NIFI-11654-RC1' into support/nifi-1.x 2023-06-11 20:45:15 -04:00
mr1716
bc175fb011
NIFI-11665 Upgraded oauth2-oidc-sdk from 9.43.1 to 9.43.3
This closes #7358

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 054df20aed41810755934becd71799e0f2e14026)
2023-06-08 16:19:25 -05:00
siddr
4bdf6b9338 NIFI-11587: Update questdb to 6.7
This closes #7319
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-06-07 09:41:54 +02:00
Joe Witt
f1d5a8c4de
NIFI-11654-RC1 prepare for next development iteration 2023-06-06 12:32:00 -07:00
Joe Witt
71e3ea9f2c
NIFI-11654-RC1 prepare release nifi-1.22.0-RC1 2023-06-06 12:31:58 -07:00
mr1716
40889f0037
NIFI-11649 Upgraded icu4j from 72.1 to 73.1
This closes #7346

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit d956ede743342adea50ff31c17ea046c8fdd8bd4)
2023-06-06 10:42:42 -05:00
exceptionfactory
580b3a61aa
NIFI-11548 Upgraded Apache Tika from 2.7.0 to 2.8.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7247.
2023-06-05 15:00:11 -07:00
exceptionfactory
52e2f0ccd6
NIFI-11160 Upgraded Apache Tika from 2.6.0 to 2.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6938.
2023-06-05 14:59:09 -07:00
exceptionfactory
6d00ce4fe5
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:52:00 -07:00
Shane Ardell
70bb41ec95 NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:38:59 -07:00
Bryan Bende
64b110c292
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:34:10 -04:00
Peter Turcsanyi
8af6f9416d
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 803868935afc424bf0b69b6b82802e557e689c04)
2023-06-02 15:01:38 -05:00
Mark Payne
5da77e8e74 NIFI-11636: Do not buffer Parquet content into memory unnecessarily
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-02 15:33:01 -04:00
Scott Aslan
765d9bc864
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:27:47 -04:00
Mark Payne
e75d78b3c3
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 50811660d00b4bcfcb431f9897807352b947813a)
2023-06-01 13:34:27 -05:00
Mark Payne
bd26936f24
NIFI-11591: Added additional logging for DynamicallyModifyClasspath system test
This closes #7312

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 4b7e20740e4777f6e64e69db7b0c597cc0fb7e5e)
2023-05-31 16:24:22 -05:00
Bence Simon
c8fbad875d
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 007bf3bcec8c1dcc898abe0673d55465df37ee29)
2023-05-31 11:04:12 -05:00
Michael Moser
8143a12715 NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232)
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:52 -04:00
NissimShiman
e18886fcb3 NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273)
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:33:18 -04:00
Matthew Burgess
a84a7cb60a
NIFI-11557: Fixed error with Java 11 code 2023-05-23 16:05:26 -04:00
Mark Payne
82a55ebdd4
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
2023-05-23 14:30:59 -04:00
Bence Simon
9cebdc2824
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit ec01bce20786dfef0bd457fa7de8e04edbef9589)
2023-05-23 10:15:19 -05:00
Joe Gresock
0e6a099eb6
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:25:17 -04:00
Nissim Shiman
434154b514 NIFI-10756 Generate error message when processor and/or controller
service is unable to transition to start and/or enabled state

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-05-12 14:46:32 +00:00
M Tien
7f660d7d87
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) (#7117)
* NIFI-11287: detect dependent properties when the property it depends on references a parameter

* address review feedback

* address more review comments

* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class

* add type parameter to all places calling loadProperties

* get reference parameters by invoking provided callbacks from the client

* check for user permissions before requesting for referenced parameters

* address review feedback

This closes #7117
2023-05-11 17:05:06 -04:00
Timea Barna
e1ddc44b07
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics
This closes #7124

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 5811a9c579a11aa8fc8358851df33d0456a5e10c)
2023-05-08 08:12:16 -05:00
Lehel Boér
ab20a93a90 NIFI-11493: Defaulted dynamically modified classpath fix
This closes #7201.

Co-authored-by: Peter Turcsanyi <turcsanyi@apache.org>
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-04 15:43:03 +02:00
Pierre Villard
4bc38d0d93
NIFI-11506 Upgraded Curator from 5.4.0 to 5.5.0
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:17:25 -05:00
Timea Barna
b146ab7407
NIFI-11473 Flow version change in NiFi should not stop a component when only position is changed
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2023-04-27 12:58:05 -04:00
Lehel Boér
4e1b1e7926
NIFI-11067 Delete Property History when changing Sensitive status
This closes #7082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit ffaf81ec462c4093f0fcf6d61d36be9849f0eda2)
2023-04-26 11:11:54 -05:00
Scott Aslan
8d04559e07 NIFI-11433 - use .add() for set instead of .push() (#7193)
* replace d3.nest, use add instead of push for Set, use forEach to loop over Set

* es5 function syntax

Merged #7193 into main.
2023-04-25 10:46:39 -07:00
Scott Aslan
10eab2a6d3
[NIFI-11433] update angular, d3, moment, slickgrid, and jquery depen… (#7174)
* [NIFIF-11433] update angular, d3, moment, slickgrid, and jquery dependencies

* address review feedback

* .entries instead of .keys

Merged #7174 into main.
2023-04-24 13:47:01 -07:00
exceptionfactory
290a3ac217
NIFI-11438 Set standard OpenID Connect Scopes
- Restored previous behavior of sending openid and email scopes for OpenID Connect token requests
- Added offline_access scope as the default value in nifi.properties to support Refresh Tokens

This closes #7168
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-21 11:48:27 -04:00
exceptionfactory
033134e843
NIFI-11461 Improve User and Group Tenants Search (#7181)
* NIFI-11461 Improved User and Group Tenants Search

- Added searchTenants method to NiFiServiceFacade and removed unnecessary object creation
- Updated TenantsResource to use delegated NiFiServiceFacade.searchTenants method
- Changed autocomplete delay from default 300 ms to 500 ms

* NIFI-11461 Adjusted implementation to use EntityFactory.createTenantEntity

This closes #7181

(cherry picked from commit bdff3abcd6d072a61e6399e694e3213732696561)
2023-04-19 09:11:59 -05:00