2482 Commits

Author SHA1 Message Date
exceptionfactory
9cd720ee20 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

NIFI-12001: Changes related to backporting
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-08-30 15:06:37 -04:00
Matt Burgess
1a9e972721 NIFI-11195: Fixed NiFi versions for backport 2023-08-29 15:43:06 -04:00
exceptionfactory
fec34036a5 NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-08-29 15:43:06 -04:00
Mark Payne
24906dd20b
NIFI-11971: Ensure that when creating a new content claim that we always treat an existing claim length of -1 as 0, to ensure that we never add -1 to our offset
This closes #7631

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit baea7ffee943009f5bf178dedf7f6e0de5bfc9ae)
2023-08-21 12:07:52 -05:00
Freedom9339
1bec97542c NIFI-11303 Added a go-to entry on the right click context menu for th… (#7461)
* NIFI-11303 Added a go-to entry on the right click context menu for the provenance lineage tree to take you to the specified component in the graph

* nifi-11303 Removed unused variable.

Merged #7461 into main.
2023-08-21 09:42:36 -07:00
Mark Payne
af85aa976a
NIFI-11971: Ensure that if we do not write any bytes to a file after calling ProcessSession.write() that we set content claim's length to 0 when closing OutputStream; otherwise it remains -1, which causes issues, since the length will later be added to the offset to determine the position in the ste stream
This closes #7629

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 5e2a10c32834973ba2837c3bdf5963aab2aa92bc)
2023-08-21 08:26:23 -05:00
mr1716
f17e281267
NIFI-11955 Upgraded maven-clean-plugin from 3.2.0 to 3.3.1
This closes #7616

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 0d119f6f394e26ba02123a6554a8f2dd56550af9)
2023-08-16 21:08:56 -05:00
Yolanda M. Davis
104af930d7
NIFI-11899 Correct Bulletin Metrics Registry to return latest Bulletins
This closes #7567

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit f8e3b9ebacb4d927ac6a4f9a3fee0eaaf2d9fd36)
2023-08-04 11:21:36 -05:00
Pierre Villard
1307a63eba
NIFI-11901 Added name and version subtitle in Processor Details view
This closes #7563

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 572e661d1271082f6a7aa7195853609127b83dec)
2023-08-04 11:17:18 -05:00
mr1716
d0a53e0fba
NIFI-11906 Updated nifi-resources description for consistency
This closes #7571

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 1fda6bca7ac31dac8614ed0477c01b5fbbeeb06b)
2023-08-03 13:03:07 -05:00
exceptionfactory
3c0b21907f
NIFI-11896 Corrected backported changes for QuestDB 6
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 11:50:33 -05:00
exceptionfactory
485ece3300
NIFI-11896 Corrected QuestDB Status Repository Shutdown handling
- Updated QuestDB Status Repository shutdown method to cancel scheduled tasks before immediate shutdown of Scheduled Executor Service
- Updated QuestDB Scheduled Tasks to include initial delay to avoid unnecessary execution when starting
- Updated QuestDB test class to minimize logging for QuestDB 7
- Improved logging and exception messages

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7564.
2023-08-03 17:29:37 +02:00
exceptionfactory
27a690a30a NIFI-11832-RC3 prepare for next development iteration 2023-07-25 14:03:12 -05:00
exceptionfactory
b7792f03b7 NIFI-11832-RC3 prepare release nifi-1.23.0-RC3 2023-07-25 14:03:11 -05:00
exceptionfactory
c35df3edfd
NIFI-11853 Changed Embedded QuestDB Tests to use JUnit5 TempDir
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7523.
2023-07-25 15:50:01 +02:00
Mark Payne
7b588fad17
NIFI-3065 When copying a PG, do not set the Log File Suffix if not already set
This closes #7522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 0eebf6b14ea6bfe230cc675577edf166019f5ef7)
2023-07-24 13:07:33 -05:00
Pierre Villard
ff6bfe5fcd
NIFI-11846 - Change version should not show keep existing parameter context
This closes #7517

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 969679e43b82af0b9d217c3b971b751b4ded3eb2)
2023-07-24 11:36:18 -05:00
Mark Payne
9bc119ca19
NIFI-11837: When determining whether or not a queue should exit 'swap mode' we need to look at the updated size of the queue after migrating data from swapped queue to active queue. Previously, we were looking at the size variable that was obtained from before the migration happened.
This closes #7506

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 8f5392dd114ab5daeed12c6792d8dd2eb75bc362)
2023-07-20 13:19:49 -05:00
Mark Payne
eb09df672b NIFI-11783: Fixed a bug in which a FlowFile split into multiple and then removed did not properly handle retries when one of the outputs was retried.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-07-19 15:50:35 -04:00
Mark Payne
6854d9ba86
NIFI-11814 Optimized Cluster Replication Component status evaluation
When waiting for all controller services to reach the desired status in the ClusterReplicationComponentLifecycle component, return immediately if there are no services to wait for. Otherwise, request that referencing components not be included in the return value of the Controller Services

This closes #7493

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 7405dcb510d0740d7e0eaf3200ed2d8900f5b3f0)
2023-07-19 14:26:47 -05:00
exceptionfactory
1b0b37e6e4
NIFI-11781 Corrected OIDC Claim Identity Processing
- Added StandardOidcUserService supporting fallback claim names
- Updated StandardClientRegistrationProvider to use standard Subject claim
- Updated OIDC Security Configuration to use customized OidcUserService for claim handling

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7468.
2023-07-15 11:04:47 -04:00
Pierre Villard
00a6478c06
NIFI-11794 - Fix NPE + configure max attempts for Redis State Provider (#7473)
Signed-off-by: Otto Fowler<ottobackwards@gmail.com>

This closes #7473.
2023-07-14 18:46:22 +02:00
Emilio Setiadarma
3649ade3c7
NIFI-11536 Corrected Keystore and Truststore auto-reloading
- Replaced Jetty KeyStoreScanner and custom TrustStoreScanner with shared StoreScanner
- New StoreScanner uses TLS Configuration to reload SSLContext instead of relying on Jetty SslContextFactory properties

This closes #7446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit a85ef2c1f49780be93b49ec6cb077a61c8cc063e)
2023-07-10 11:08:22 -05:00
exceptionfactory
9161485f21
NIFI-11767 Replaced String.repeat() with StringUtils.repeat() for Java 8
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-06 18:09:07 -05:00
dan-s1
c091eade00
NIFI-11767 Refactored Groovy tests in nifi-web-error and nifi-web-security to Java
This closes #7457

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit d24318cdb8003925f9a5411bf20094a02b0c084a)
2023-07-06 16:32:28 -05:00
simonbence
2abd1c5092
NIFI-11769 Adding details on Registry Clients and Registrty Client types on UI (#7453)
Co-authored-by: Shane Ardell <shane.m.ardell@gmail.com>

Merged #7453 into main.
2023-07-01 20:58:38 +02:00
Bence Simon
5acbb8a702
NIFI-11706 Add option to create dedicated Parameter Contexts for Imported Flows
This closes #7401

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit cadf2fb6f25caf334bf787292380af5b25fdcbb1)
2023-06-30 13:15:41 -05:00
exceptionfactory
5a68069b8f
NIFI-11714 Added Error Handler to Jetty Server
- Configured Error Handler with Stack Traces disabled for NiFi and Registry

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7447.
2023-06-29 16:46:40 -04:00
dan-s1
ce5eb85c1d
NIFI-11754 Refactored Groovy test in nifi-jetty to Java (and JUnit 5)
This closes #7442

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 2a7fa6d17b1807091659197c702a221825a30eeb)
2023-06-27 14:45:26 -05:00
dan-s1
207af04ea2
NIFI-11747 Refactored Groovy tests in nifi-web-api to Java (and JUnit 5)
This closes #7434

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 7748d9d1e5287c6b99c965ee0ed93ed154802def)
2023-06-26 15:23:24 -05:00
exceptionfactory
cb76a62a14
NIFI-3065 Corrected TestStandardLoggingContext for Java 8
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 11:09:50 -05:00
timeabarna
d5fb6b4518 NIFI-3065 Per Process Group logging (#7315)
* NIFI-3065 Per Process Group logging
2023-06-23 21:20:34 -04:00
exceptionfactory
072c9547bf NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-23 18:26:51 -04:00
Timea Barna
2052f15c79
NIFI-11705 Append Operating System section in NiFi diagnostic tool
This closes #7388

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit dceee57dfd1d0540463ddb6d15cee8858eb66928)
2023-06-23 17:00:29 -05:00
Bryan Bende
f9d48cb78a
NIFI-11492 Allow authorization to proceed based on request groups even if user does not exist
This closes #7425

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 40014486a408c2676afecad9d20b8c130a4bc8d1)
2023-06-22 15:51:06 -05:00
exceptionfactory
411111925b
NIFI-11735 Refactored Identity Provider Groups Handling (#7419)
- Removed H2 database approach in favor of passing groups in Application Bearer Token
2023-06-22 11:11:44 -04:00
exceptionfactory
0ecd15537e
NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233

(cherry picked from commit ca6c7f704164e922e11d72e7c972a50ac46e6b0e)
2023-06-13 15:22:40 -05:00
exceptionfactory
65436cb829 NIFI-11680 Corrected Buffer Size Calculation for Connection Balancing (#7370)
- Resolved BufferOverflowException in PeerChannel with Bouncy Castle Provider
- Changed prepareForWrite() to use Destination Buffer remaining instead of Application Buffer Size
- Changed encrypt() to Packet Buffer Size instead of Application Buffer Size
2023-06-13 11:02:02 -04:00
Mark Payne
b85063cb81
NIFI-11681: Terminate Process Sessions before interrupting processor threads
This closes #7371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 787e0d82614e345b5afbef6691c418c43cf0ab08)
2023-06-13 08:24:33 -05:00
Mark Payne
181b287b1d
NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile
Rather than creating many FlowFiles with the same Content Claim, refactored content repos' OutputStreams and ClaimWriteCache so that a new ContentClaim is created for each FlowFile. This ensures that we have a content claim offset of 0. The poor performance was due to having to use StreamUtils.skip() in conjunction with the CipherInputStream, which would only skip a max of 511 bytes at a time. By using a separate Content Claim per FlowFile, we no longer need to seek after creating the CipherInputStream

This closes #7363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 702c6350344e4ae4cd31349747e96c1384017ed4)
2023-06-12 10:23:29 -05:00
Joe Witt
edc9e40582
Merge branch 'NIFI-11654-RC1' into support/nifi-1.x 2023-06-11 20:45:15 -04:00
siddr
4bdf6b9338 NIFI-11587: Update questdb to 6.7
This closes #7319
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-06-07 09:41:54 +02:00
Joe Witt
f1d5a8c4de
NIFI-11654-RC1 prepare for next development iteration 2023-06-06 12:32:00 -07:00
Joe Witt
71e3ea9f2c
NIFI-11654-RC1 prepare release nifi-1.22.0-RC1 2023-06-06 12:31:58 -07:00
Shane Ardell
70bb41ec95 NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:38:59 -07:00
Bryan Bende
64b110c292
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:34:10 -04:00
Peter Turcsanyi
8af6f9416d
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 803868935afc424bf0b69b6b82802e557e689c04)
2023-06-02 15:01:38 -05:00
Mark Payne
5da77e8e74 NIFI-11636: Do not buffer Parquet content into memory unnecessarily
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-02 15:33:01 -04:00
Scott Aslan
765d9bc864
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:27:47 -04:00
Mark Payne
e75d78b3c3
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 50811660d00b4bcfcb431f9897807352b947813a)
2023-06-01 13:34:27 -05:00