Commit Graph

186 Commits

Author SHA1 Message Date
Joseph Witt 3096c983f5
NIFI-13648 Upgraded Jetty to 12.0.12 along with other common dependencies
- Upgraded AWS SDK from 1.12.762 to 1.12.767
- Upgraded AWSK SDK from 2.26.21 to 2.27.1
- Upgraded zstd-jni from 1.5.6-3 to 1.5.6-4
- Upgraded excel-streaming-reader from 4.4.0 to 5.0.2
- Upgraded azure-sdk-bom from 1.2.25 to 1.2.26
- Upgraded json-schema-validator from 1.5.0 to 1.5.1
- Upgraded oauth2-oidc-sdk from 11.13 to 11.14
- Upgraded Fabric8 Kubernetes Client from 6.13.1 to 6.13.2
- Upgraded commons-compress from 1.26.2 to 1.27.0
- Upgraded commons-lang3 from 3.15.0 to 3.16.0
- Upgraded Apache SSHD from 2.13.1 to 2.13.2
- Upgraded Jetty from 12.0.11 to 12.0.12
- Upgraded Elasticsearch Client from 8.14.3 to 8.15.0
- Upgraded Jersey from 3.1.7 to 3.1.8
- Upgraded SLF4J from 2.0.13 to 2.0.15
- Upgraded Testcontainers from 1.20.0 to 1.20.1
- Upgraded org.tukaani xz from 1.9 to 1.10
- Upgraded snappy-java from 1.1.10.5 to 1.1.10.6
- Upgraded google-api-services-drive from v3-rev20240628-2.0.0 to v3-rev20240730-2.0.0
- Upgraded Hazelcast from 5.4.0 to 5.5.0
- Upgraded Azure Kusto from 5.1.0 to 5.1.1
- Upgraded ActiveMQ from 6.1.2 to 6.1.3
- Upgraded Clojure from 1.11.3 to 1.11.4
- Upgraded FlywayDB from 10.16.0 to 10.17.0
- Upgraded MongoDB from 4.11.2 to 4.11.3
- Upgraded Neo4j from 5.22.0 to 5.23.0

This closes #9167

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-12 13:03:46 -05:00
David Handermann 9cd319e3e5
NIFI-13646 Corrected Current User Replicated Response Handling (#9164)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-07 16:22:39 -05:00
Matt Gilman 38292762bd
NIFI-13638: Limiting the maximum number of provenance events to return when fetching the latest events. (#9156) 2024-08-06 17:26:34 -04:00
Matt Gilman da6c9c4791
NIFI-13017: Replace JoltTransformJSON custom UI (#9117)
* NIFI-13017:
- Remove old JoltTransformJSON custom UI.
- Update build to use new JoltTransformJSON custom UI.
- Fix revision query parameter.

* NIFI-13017:
- Excluding jolt transform json ui in workflow ci.

* NIFI-13017:
- Excluding jolt nar in workflow ci.

* NIFI-13017:
- Excluding jolt ui war from code coverage.

* NIFI-13017:
- Incorporating nifi-web-servlet-shared.
- Moving QueryStringToFragmentFilter to nifi-web-servlet-shared.

This closes #9117
2024-08-06 13:51:41 -04:00
dan-s1 f64e68b23c
NIFI-13625 Removed or Replaced System.out.println in Tests (#9150)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 20:35:40 -05:00
David Handermann 141ca71cbc
NIFI-13622 Corrected Logout Complete Redirect for Proxies (#9143)
This closes #9143
2024-08-02 16:40:47 -04:00
David Handermann 8ad6aa6ede
NIFI-13609 Correct Component Search Configuration (#9131)
* NIFI-13609 Corrected Component Search Configuration
- Removed duplicate Controller Search Service bean definition
- Wired Controller Search Service to Controller Facade bean definition
- Added Flow Controller reference for SearchableMatcher
2024-07-31 15:04:49 -04:00
Matt Gilman 6c930626dc
NIFI-13606 Corrected Custom UI loading in reverse proxy deployments
This closes #9130

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-31 11:10:07 -05:00
David Szabo 2542927b53 NIFI-12741 - Remove write permission requirement for the referenced controller service when changing component property referencing a controller service through parameter
This closes #9093.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-07-31 17:26:10 +02:00
David Handermann 5a6bee2154
NIFI-13602 Corrected Logout Supported Status for Clustered User (#9127)
- Set CurrentUserEntity.logoutSupported based on local authentication instead of replicated and merged responses

This closes #9127
2024-07-31 11:06:25 -04:00
David Handermann 33da3463b6
NIFI-13594 Added web-servlet-shared abstracted from web-utils (#9123)
- Moved RequestUriBuilder from web-utils to web-servlet-shared
- Refactored proxy header parsing from WebUtils to StandardRequestUriProvider
- Renamed WebUtils to WebClientUtils

This closes #9123
2024-07-30 15:41:49 -04:00
Timea Barna f262e74170
NIFI-13439 Added Performance Status to Group Status responses
- Added ProcessingPerformanceStatus to nifi-api
- Added Performance Status to Process Group and Processor Sources for Query NiFi Reporting Task

This closes #9014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-30 12:56:55 -05:00
David Handermann 25299f8106
NIFI-13592 Removed unused nifi-runtime classes and methods (#9120)
- Removed unused key processing methods from NiFi runtime class
- Removed unused stateless and embedded NiFi classes along with tests
2024-07-29 14:05:40 -04:00
exceptionfactory 60a03b90cb
NIFI-13562 Removed carriage return characters from TestProcessorAuditor
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-29 12:30:08 -05:00
David Handermann 692c8be2f1
NIFI-13575 Improve Jetty Server handling of Web App Exceptions (#9112)
* NIFI-13575 Improved Jetty Server handling of Web App Exceptions
- Enabled throwUnavailableOnStartupException for configured Web Apps

* NIFI-13575 Checked Context Path to determine startup exception handling
2024-07-29 11:48:47 -04:00
David Handermann d5b69c588f
NIFI-13562 Migrated web-api Configuration from XML to Java (#9111)
- Configured Controller annotation wiring for Resource classes
- Configured Service annotation wiring for Auditor classes
- Configured Repository annotation wiring for DAO classes
2024-07-29 10:21:57 -04:00
Ferenc Kis dca7aac9b3
NIFI-13541 [MiNiFi] Validate flow during startup
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #9073.
2024-07-25 07:57:54 -04:00
David Handermann 11fdc44fb9
NIFI-13577 Corrected null handling in Parameter Value Mapper (#9107) 2024-07-24 08:01:41 -04:00
David Handermann b0f419be2c
NIFI-13560 Changed Parameter Provider handling to avoid storing values (#9102)
- Added ParameterValueMapper for handling serialization of Parameter Values for Flow Configuration
- Added Parameter Group retrieval method for Flow Synchronizer
2024-07-23 11:31:16 -04:00
Bryan Bende 79ac0c2d89
NIFI-13570 Use NiFiProperties isHTTPSConfigured to determine if NAR Manager should use https
This closes #9100

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-22 10:58:08 -07:00
Bryan Bende 0e422f0ea3 NIFI-13566 Catch Throwable during JettyServer start to ensure any issue during start will exit
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9101
2024-07-22 13:00:50 -04:00
Mark Payne 6dd83b7034 NIFI-13563: Updated Provenance Repository so that instead of returning the single latest event for a component, we return the events from the latest invocation / session. Added system tests to verify the behavior. Also, when replaying latest event, attempt all of those events until one succeeds or all fail
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9095
2024-07-22 12:44:35 -04:00
David Handermann e72b099887
NIFI-13559 Removed Legacy Access Resource REST Methods (#9091)
- Removed GET /access for Access Status
- Removed GET /access/config for Login Configuration
- Removed GET /access/token/expiration for Access Token Expiration
2024-07-19 09:15:19 -04:00
Ferenc Erdei ee7a905c40
NIFI-13551 Fixed framework SSLContext loading for Headless Server
- Changed conditional from evaluating HTTPS port to evaluating store path and password properties

This closes #9083

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-18 12:44:00 -05:00
David Handermann e35cbbba81
NIFI-13558 Configured Web Security to ignore unauthenticated requests (#9090)
This closes #9090
2024-07-18 13:26:26 -04:00
Bryan Bende 16c9ea4f7c
NIFI-13536 Added branch parameter to REST methods for listing buckets and flows
This closes #9071

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-18 08:39:58 -05:00
Bryan Bende 8e5cf99cd7
NIFI-13556 Fixed logic for identifying components from uploaded NAR
- Return copied set of Extensions from ExtensionManager to avoid concurrent modification

This closes #9089

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-17 13:51:22 -05:00
Mark Payne 0e7e511aec
NIFI-13546 Fixed Content Repository recovery when archive directories are missing
Ensure on startup that Content Repo archive directories are created, if configured to do so, rather than creating them on demand. If IOException thrown when archiving file, delete it instead. Cleaned up some code duplication between remove(ResourceClaim) and archive(ResourceClaim) methods

This closes #9079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-17 12:39:19 -05:00
Bryan Bende 76a23d921f
NIFI-13545 Improve BootstrapListener getClusterStatus to handle factory being null
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9078.
2024-07-15 21:33:24 +07:00
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Joseph Witt 3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
exceptionfactory 4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
Joseph Witt 15e5193099
NIFI-13517 Upgraded Jetty from 12.0.10 to 12.0.11 and others
- Upgraded AWS SDK 1 from 1.12.755 to 1.12.756
- Upgraded AWS SDK 2 from 2.26.14 to 2.26.15
- Upgraded Azure SDK BOM from 1.2.24 to 1.2.25
- Upgraded Elasticsearch Client from 8.14.1 to 8.14.2
- Upgraded GitHub Client from 1.322 to 1.323
- Upgraded mysql-connector-j from 8.4.0 to 9.0.0
- Upgraded Azure Kusto from 5.0.5 to 5.1.0
- Upgraded Datafaker from 2.2.2 to 2.3.0
- Upgraded nimbus-jose-jwt from 9.37.3 to 9.40
- Upgraded oauth2-oidc-sdk from 11.10.1 to 11.13

This closes #9051

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:00:13 -05:00
Joseph Witt 4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
exceptionfactory 7cb6684801
NIFI-13494 Removed support for Repository Encryption
This closes #9039

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:48:40 -07:00
exceptionfactory eb154d0640
NIFI-13518 Removed duplicative Windows start scripts
This closes #9052

- Removed run-nifi.bat in favor of nifi.cmd

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:41:20 -07:00
exceptionfactory dd71fa35ac
NIFI-13521 Removed nifi-headless-server-nar
This closes #9053

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:38:53 -07:00
Joseph Witt 1d2b755edf
NIFI-13511 Removed ShellUserGroupProvider from NiFi and Registry
This closes #9046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:24:31 -05:00
David Handermann 3bb79f1ba6
NIFI-13476 Optimized Authorization Checking in Process Group Status (#9021)
- Avoided invoking Authorizer when nested component is not included in Process Group Status based on depth of recursion
2024-07-01 14:58:22 -04:00
exceptionfactory 275890a226
NIFI-13444 Removed unused test logging configuration
This closes #9004

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-25 20:03:15 -07:00
dan-s1 b3fac8c80b
NIFI-13403 Removed unnecessary toString in logging statements
This closes #8984

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 20:13:08 -05:00
Ferenc Kis a5501baa7f
NIFI-13396 Added Python constant Allowable Values to Manifests
This closes #8963

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 16:49:05 -05:00
David Handermann 42c0aa6aa7
NIFI-12125 Refactored Framework SSLContext Loading (#8967)
- Added Framework SSLContext Provider for centralized loading
- Refactored Spring Framework XML to Java Configuration
- Removed Jetty StoreScanner
2024-06-25 16:08:04 -04:00
Joseph Witt 87107b311a
NIFI-13438 Upgraded Spring to 6.1.10 along with other dependencies
- Upgraded sshd from 2.12.1 to 2.13.1
- Upgraded reactor-netty-http from 1.1.19 to 1.1.20
- Upgraded guava from 33.2.0-jre to 33.2.1-jre
- Upgraded maven-artifact from 3.9.7 to 3.9.8
- Upgraded spring-integrations from 6.3.0 to 6.3.1
- Upgraded jjwt from 0.12.5 to 0.12.6
- Upgraded unboundid from 7.0.0 to 7.0.1
- Upgraded json-schema-validator from 1.4.0 to 1.4.2
- Upgraded Spring Boot from 3.3.0 to 3.3.1
- Upgraded jline from 3.26.1 to 3.26.2
- Upgraded com.amazonaws from 1.12.742 to 1.12.748
- Upgraded AWS SDK from 2.26.1 from 2.26.8
- Upgraded Spring from 6.1.9 to 6.1.10
- Upgraded Spring Security from 6.3.0 to 6.3.1

This closes #9001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 21:59:55 -05:00
Nissim Shiman 22f700f476
NIFI-13031 Changed PG StatusSnapshotDTO to use cloned copy for accurate status
This closes #8946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 13:48:11 -05:00
dan-s1 957510e65a NIFI-13421 Replaced String.format in logging statements where only formatting strings (%s) with the use of logging parameters ({})
This closes #8994

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-06-23 18:13:39 -04:00
David Handermann 14b1776739
NIFI-13424 Switched to EdDSA for Application Bearer Tokens (#8986)
- Replaced PS512 algorithm based on RSASSA-PSS with EdDSA algorithm using Ed25519
- Added Ed25519 Signer and Verifier implementations based on Java Signature processing

This closes #8986
2024-06-21 08:49:45 -04:00
exceptionfactory 49a0401058
NIFI-13414 Removed Property Protection Modules and Encrypt Config
This closes #8978

- Removed nifi-property-protection-api and implementation modules
- Removed nifi-toolkit-encrypt-config and minifi-toolkit-encrypt-config modules
- Removed extra bootstrap.conf configuration files for property protection implementations

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-20 13:04:00 -07:00
Nissim Shiman d61b87bd9b
NIFI-13420 Maintain consistent maxNonHeapBytes for clustered diagnostics
- The merged value of maxNonHeapBytes should be -1 when at least one node has that value

This closes #8983

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-20 09:09:18 -05:00