180 Commits

Author SHA1 Message Date
David Handermann
8ad6aa6ede
NIFI-13609 Correct Component Search Configuration (#9131)
* NIFI-13609 Corrected Component Search Configuration
- Removed duplicate Controller Search Service bean definition
- Wired Controller Search Service to Controller Facade bean definition
- Added Flow Controller reference for SearchableMatcher
2024-07-31 15:04:49 -04:00
Matt Gilman
6c930626dc
NIFI-13606 Corrected Custom UI loading in reverse proxy deployments
This closes #9130

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-31 11:10:07 -05:00
David Szabo
2542927b53 NIFI-12741 - Remove write permission requirement for the referenced controller service when changing component property referencing a controller service through parameter
This closes #9093.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-07-31 17:26:10 +02:00
David Handermann
5a6bee2154
NIFI-13602 Corrected Logout Supported Status for Clustered User (#9127)
- Set CurrentUserEntity.logoutSupported based on local authentication instead of replicated and merged responses

This closes #9127
2024-07-31 11:06:25 -04:00
David Handermann
33da3463b6
NIFI-13594 Added web-servlet-shared abstracted from web-utils (#9123)
- Moved RequestUriBuilder from web-utils to web-servlet-shared
- Refactored proxy header parsing from WebUtils to StandardRequestUriProvider
- Renamed WebUtils to WebClientUtils

This closes #9123
2024-07-30 15:41:49 -04:00
Timea Barna
f262e74170
NIFI-13439 Added Performance Status to Group Status responses
- Added ProcessingPerformanceStatus to nifi-api
- Added Performance Status to Process Group and Processor Sources for Query NiFi Reporting Task

This closes #9014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-30 12:56:55 -05:00
David Handermann
25299f8106
NIFI-13592 Removed unused nifi-runtime classes and methods (#9120)
- Removed unused key processing methods from NiFi runtime class
- Removed unused stateless and embedded NiFi classes along with tests
2024-07-29 14:05:40 -04:00
exceptionfactory
60a03b90cb
NIFI-13562 Removed carriage return characters from TestProcessorAuditor
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-29 12:30:08 -05:00
David Handermann
692c8be2f1
NIFI-13575 Improve Jetty Server handling of Web App Exceptions (#9112)
* NIFI-13575 Improved Jetty Server handling of Web App Exceptions
- Enabled throwUnavailableOnStartupException for configured Web Apps

* NIFI-13575 Checked Context Path to determine startup exception handling
2024-07-29 11:48:47 -04:00
David Handermann
d5b69c588f
NIFI-13562 Migrated web-api Configuration from XML to Java (#9111)
- Configured Controller annotation wiring for Resource classes
- Configured Service annotation wiring for Auditor classes
- Configured Repository annotation wiring for DAO classes
2024-07-29 10:21:57 -04:00
Ferenc Kis
dca7aac9b3
NIFI-13541 [MiNiFi] Validate flow during startup
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #9073.
2024-07-25 07:57:54 -04:00
David Handermann
11fdc44fb9
NIFI-13577 Corrected null handling in Parameter Value Mapper (#9107) 2024-07-24 08:01:41 -04:00
David Handermann
b0f419be2c
NIFI-13560 Changed Parameter Provider handling to avoid storing values (#9102)
- Added ParameterValueMapper for handling serialization of Parameter Values for Flow Configuration
- Added Parameter Group retrieval method for Flow Synchronizer
2024-07-23 11:31:16 -04:00
Bryan Bende
79ac0c2d89
NIFI-13570 Use NiFiProperties isHTTPSConfigured to determine if NAR Manager should use https
This closes #9100

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-22 10:58:08 -07:00
Bryan Bende
0e422f0ea3 NIFI-13566 Catch Throwable during JettyServer start to ensure any issue during start will exit
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9101
2024-07-22 13:00:50 -04:00
Mark Payne
6dd83b7034 NIFI-13563: Updated Provenance Repository so that instead of returning the single latest event for a component, we return the events from the latest invocation / session. Added system tests to verify the behavior. Also, when replaying latest event, attempt all of those events until one succeeds or all fail
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9095
2024-07-22 12:44:35 -04:00
David Handermann
e72b099887
NIFI-13559 Removed Legacy Access Resource REST Methods (#9091)
- Removed GET /access for Access Status
- Removed GET /access/config for Login Configuration
- Removed GET /access/token/expiration for Access Token Expiration
2024-07-19 09:15:19 -04:00
Ferenc Erdei
ee7a905c40
NIFI-13551 Fixed framework SSLContext loading for Headless Server
- Changed conditional from evaluating HTTPS port to evaluating store path and password properties

This closes #9083

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-18 12:44:00 -05:00
David Handermann
e35cbbba81
NIFI-13558 Configured Web Security to ignore unauthenticated requests (#9090)
This closes #9090
2024-07-18 13:26:26 -04:00
Bryan Bende
16c9ea4f7c
NIFI-13536 Added branch parameter to REST methods for listing buckets and flows
This closes #9071

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-18 08:39:58 -05:00
Bryan Bende
8e5cf99cd7
NIFI-13556 Fixed logic for identifying components from uploaded NAR
- Return copied set of Extensions from ExtensionManager to avoid concurrent modification

This closes #9089

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-17 13:51:22 -05:00
Mark Payne
0e7e511aec
NIFI-13546 Fixed Content Repository recovery when archive directories are missing
Ensure on startup that Content Repo archive directories are created, if configured to do so, rather than creating them on demand. If IOException thrown when archiving file, delete it instead. Cleaned up some code duplication between remove(ResourceClaim) and archive(ResourceClaim) methods

This closes #9079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-17 12:39:19 -05:00
Bryan Bende
76a23d921f
NIFI-13545 Improve BootstrapListener getClusterStatus to handle factory being null
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9078.
2024-07-15 21:33:24 +07:00
Bryan Bende
b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Joseph Witt
3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Joseph Witt
f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
exceptionfactory
4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
Joseph Witt
15e5193099
NIFI-13517 Upgraded Jetty from 12.0.10 to 12.0.11 and others
- Upgraded AWS SDK 1 from 1.12.755 to 1.12.756
- Upgraded AWS SDK 2 from 2.26.14 to 2.26.15
- Upgraded Azure SDK BOM from 1.2.24 to 1.2.25
- Upgraded Elasticsearch Client from 8.14.1 to 8.14.2
- Upgraded GitHub Client from 1.322 to 1.323
- Upgraded mysql-connector-j from 8.4.0 to 9.0.0
- Upgraded Azure Kusto from 5.0.5 to 5.1.0
- Upgraded Datafaker from 2.2.2 to 2.3.0
- Upgraded nimbus-jose-jwt from 9.37.3 to 9.40
- Upgraded oauth2-oidc-sdk from 11.10.1 to 11.13

This closes #9051

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:00:13 -05:00
Joseph Witt
4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
exceptionfactory
7cb6684801
NIFI-13494 Removed support for Repository Encryption
This closes #9039

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:48:40 -07:00
exceptionfactory
eb154d0640
NIFI-13518 Removed duplicative Windows start scripts
This closes #9052

- Removed run-nifi.bat in favor of nifi.cmd

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:41:20 -07:00
exceptionfactory
dd71fa35ac
NIFI-13521 Removed nifi-headless-server-nar
This closes #9053

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:38:53 -07:00
Joseph Witt
1d2b755edf
NIFI-13511 Removed ShellUserGroupProvider from NiFi and Registry
This closes #9046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:24:31 -05:00
David Handermann
3bb79f1ba6
NIFI-13476 Optimized Authorization Checking in Process Group Status (#9021)
- Avoided invoking Authorizer when nested component is not included in Process Group Status based on depth of recursion
2024-07-01 14:58:22 -04:00
exceptionfactory
275890a226
NIFI-13444 Removed unused test logging configuration
This closes #9004

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-25 20:03:15 -07:00
dan-s1
b3fac8c80b
NIFI-13403 Removed unnecessary toString in logging statements
This closes #8984

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 20:13:08 -05:00
Ferenc Kis
a5501baa7f
NIFI-13396 Added Python constant Allowable Values to Manifests
This closes #8963

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 16:49:05 -05:00
David Handermann
42c0aa6aa7
NIFI-12125 Refactored Framework SSLContext Loading (#8967)
- Added Framework SSLContext Provider for centralized loading
- Refactored Spring Framework XML to Java Configuration
- Removed Jetty StoreScanner
2024-06-25 16:08:04 -04:00
Joseph Witt
87107b311a
NIFI-13438 Upgraded Spring to 6.1.10 along with other dependencies
- Upgraded sshd from 2.12.1 to 2.13.1
- Upgraded reactor-netty-http from 1.1.19 to 1.1.20
- Upgraded guava from 33.2.0-jre to 33.2.1-jre
- Upgraded maven-artifact from 3.9.7 to 3.9.8
- Upgraded spring-integrations from 6.3.0 to 6.3.1
- Upgraded jjwt from 0.12.5 to 0.12.6
- Upgraded unboundid from 7.0.0 to 7.0.1
- Upgraded json-schema-validator from 1.4.0 to 1.4.2
- Upgraded Spring Boot from 3.3.0 to 3.3.1
- Upgraded jline from 3.26.1 to 3.26.2
- Upgraded com.amazonaws from 1.12.742 to 1.12.748
- Upgraded AWS SDK from 2.26.1 from 2.26.8
- Upgraded Spring from 6.1.9 to 6.1.10
- Upgraded Spring Security from 6.3.0 to 6.3.1

This closes #9001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 21:59:55 -05:00
Nissim Shiman
22f700f476
NIFI-13031 Changed PG StatusSnapshotDTO to use cloned copy for accurate status
This closes #8946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 13:48:11 -05:00
dan-s1
957510e65a NIFI-13421 Replaced String.format in logging statements where only formatting strings (%s) with the use of logging parameters ({})
This closes #8994

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-06-23 18:13:39 -04:00
David Handermann
14b1776739
NIFI-13424 Switched to EdDSA for Application Bearer Tokens (#8986)
- Replaced PS512 algorithm based on RSASSA-PSS with EdDSA algorithm using Ed25519
- Added Ed25519 Signer and Verifier implementations based on Java Signature processing

This closes #8986
2024-06-21 08:49:45 -04:00
exceptionfactory
49a0401058
NIFI-13414 Removed Property Protection Modules and Encrypt Config
This closes #8978

- Removed nifi-property-protection-api and implementation modules
- Removed nifi-toolkit-encrypt-config and minifi-toolkit-encrypt-config modules
- Removed extra bootstrap.conf configuration files for property protection implementations

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-20 13:04:00 -07:00
Nissim Shiman
d61b87bd9b
NIFI-13420 Maintain consistent maxNonHeapBytes for clustered diagnostics
- The merged value of maxNonHeapBytes should be -1 when at least one node has that value

This closes #8983

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-20 09:09:18 -05:00
exceptionfactory
9d618cc8d0
NIFI-13410 Upgraded Apache Curator from 5.6.0 to 5.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8972.
2024-06-19 10:29:07 +02:00
greyp9
dfd1276230
NIFI-13184 - mark invalid processors to start once they become valid (#8809) 2024-06-18 11:12:20 -04:00
Mark Payne
039cd2f18a
NIFI-13340 Fixed a bug in which an Output Port can leave a Process Group's DataValve open for output, but then the last FlowFile is terminated instead of going to an Output Port, ultimately resulting in the DataValve remaining open indefinitely. Now, this will be detected and the valve will be closed.
This closes #8951

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 09:39:38 -05:00
Joseph Witt
bf637e0bfe
NIFI-13401 Upgraded Spring to 6.1.9 and Jetty to 12.0.10 and others
- Upgraded com.amazonaws from 1.12.733 to 1.12.742
- Upgraded software.amazon.awssdk from 2.25.63 to 2.26.1
- Upgraded com.box SDK from 4.9.1 to 4.10.0
- Upgraded commons-net from 3.11.0 to 3.11.1
- Upgraded io.dropwizard.metrics from 4.2.25 to 4.2.26
- Upgraded Netty from 4.1.110.Final to 4.1.111.Final
- Upgraded Commons Configuration2 from 2.10.1 to 2.11.0
- Upgraded Lucene from 9.10.0 to 9.11.0
- Upgraded org.checkerframework from 3.43.0 to 3.44.0
- Upgraded org.eclipse.jdt ecj from 3.37.0 to 3.38.0
- Upgraded Jetty from 12.0.9 to 12.0.10
- Upgraded Elasticsearch Client from 8.13.4 to 8.14.1
- Upgraded Spring Framework from 6.1.8 to 6.1.9
- Upgraded com.slack.api from 1.39.3 to 1.40.0
- Upgraded io.projectreactor from 3.6.6 to 3.6.7
- Upgraded JGit from 6.9.0.202403050737-r to 6.10.0.202406032230-r
- Upgraded Flyway from 10.13.0 to 10.15.0
- Upgraded Spring Integration from 6.2.5 to 6.3.0

This closes #8966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-14 16:36:19 -05:00
dan-s1
7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Matt Gilman
b3c7952ef3
NIFI-13373: Adding support for banner text (#8947)
* NIFI-13373:
- Adding support for banner text.

* NIFI-13373:
- Prettier.

* NIFI-13373:
- Removing unused property.

* NIFI-13373:
- Defining reponse payload when loading banner text.
- Removing banner text from login, logout, and error pages.

* NIFI-13373:
- Only loading the banner text when necessary.

This closes #8947
2024-06-11 11:47:56 -04:00