Commit Graph

209 Commits

Author SHA1 Message Date
Bryan Bende ee29562517
NIFI-13795 Improve NAR Manager handling of dependent NARs (#9310)
- Ensure NARs are loaded in parent-first order during restart
- Allow replacing a NAR when other NARs are dependent on it
- Improvements to catch Throwable in several places to handle NoClassDefFoundError

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-26 12:28:17 -05:00
Mark Payne f39cce5dec
NIFI-13807 Fixed Stream Handling in Runtime Management Server HTTP Exchanges (#9316)
- Drained request InputStream
- Added try-with-resources for response OutputStream

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-26 10:57:37 -05:00
Mark Payne e9ce40d209
NIFI-12992 Reset Validation State when Updating Process Group Execution Engine (#9187)
- Do not reset validation status for a component if it is not in a state where validation will be performed

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-25 16:19:46 -05:00
David Handermann 2e7a39d200
NIFI-13799 Improved Replicated Cluster Response Handling (#9312)
- Return the remote Response Stream in the Replicated Response for unknown or large content length values
- Buffered smaller responses
- Addressed code warnings in ThreadPoolRequestReplicator
2024-09-25 15:03:49 -04:00
Mark Payne 69b99390e6
NIFI-13800 Fixed Missing Registry Client Handling when Inheriting Cluster Flow (#9309)
When inheriting Registry Clients from a cluster's flow, any missing registry clients are removed at the end instead of the beginning of the synchronization logic. This allows those registry clients to still be referenced while performing synchronization. Also found that if a Processor is missing from cluster's flow but is running in local flow, on startup we get an error indicating that the processor does not belong to the associated process group so fixed that in tandem. Finally, noticed while verifying the fix that we check if the proposed flow is empty with a null check instead of using the isFlowEmpty() method - this could result in inheriting an empty flow from cluster even when a flow is loaded locally.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-24 16:35:49 -05:00
Mark Payne 457d83ef84
NIFI-13796: When writing to a content claim and its size + offset exceeds the max appendable size, do not write to that content claim again
This closes #9306.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-23 21:06:08 -07:00
Mark Bathori b12d26b6ba
NIFI-13720: Component is not reloaded when the isolation key depends on service property
This closes #9236.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 12:00:00 +02:00
Mark Payne e9577ded29
NIFI-13777 Fixed Stateless Group Startup around Controller Services (#9291)
Fixed stateless group startup around Controller Services by changing the startup logic in two ways. First, we enable Controller Services before we create the Stateless Flow. Secondly, we do not bother enabling the ephemeral Controller Services that are created during the Stateless Flow creation/synchronization. This ensures that if Processors make use of a Controller Service during its @OnScheduled method (which is part of the Stateless Flow initialization process) that the Controller Service is Enabled. It also avoids calling @OnEnabled methods of Controller Services that will never actually be used, as Processors make use of the existing Controller Services when running within standard NiFi .

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-20 13:47:47 -05:00
David Handermann 563d7ea614
NIFI-13770 Removed Placeholder Prefix from Python Component Types (#9283)
This closes #9283
2024-09-20 11:26:41 -04:00
Bryan Bende 44abe39983
NIFI-13757 Improve handling when a NAR contains an extension that produces an Error (#9274)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-17 21:41:45 -05:00
David Handermann 6e5a276cb2
NIFI-13718 Switched Request Replication to Web Client Service (#9234)
- Added Request Replication Header enumeration with lowercased header names for HTTP/2
2024-09-12 13:50:03 -04:00
Bryan Bende 68b74547e8
NIFI-13713 Use Asynchronous Loading for Extension UIs in Jetty Server (#9231)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-09 07:47:35 -05:00
Matt Gilman 39ab3129f0
NIFI-13632: Updating content access. (#9221)
* NIFI-13632: Updating content access.
- Removing existing content viewer application.
- Introduced new front end based content viewer applicaiton.
- Introduced new bundled content viewers for hex and images.
- Deleted previous image content viewer.
- Migrated existing standard content viewer (which handles json, xml, yaml, csv, and text) to utilize new content access interface.
- Moved standard content viewer into its own NAR.
- Moved and renamed custom ui utils and content viewer utils into nifi-common.
- Added mime type to FlowFileSummary response payload to help drive the initially opened content viewer.

* NIFI-13632: Fixing rat issue.

* NIFI-13632: Fixing CI issue.

* NIFI-13632: Removing standard content viewer war from code coverage.

* NIFI-13632: Addressing review feedback.

* NIFI-13632: Fixing import.

* NIFI-13632: Further simplification of content viewer state.

* NIFI-13632: Removing unneeded code.

* NIFI-13632: Adding a min height around codemirror.

* NIFI-13632: Addressing review feedback.
- Rendering mime type in the content viewer.
- Preventing additions to the browser history as the user changes how the content is viewed.
- Appending forward slash to content viewer UIs to prevent unnecessary redirect.
- Removing Standard Content Viewer title based on review feedback.
- Fixing double scroll bar in the Standard Content Viewer on small browser heights.
- Removed unnecessary application.yml.
- Bumping spring boot version.

This closes #9221
2024-09-06 09:12:38 -04:00
David Handermann 0510e716b4
NIFI-13706 Handled Exceptions Fetching Parameters on Startup (#9227) 2024-09-03 16:29:32 -05:00
Mike Moser ba13c5d48a
NIFI-13664 Support Component Search on NAR Bundle ID
This closes #9197

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 10:50:48 -05:00
Bryan Bende 5845d631cf
NIFI-13694 Remove MissingComponentsCheck from VersionFlowSynchronizer (#9217)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-30 07:59:08 -05:00
exceptionfactory e540f72989
NIFI-13688 Run Validation on Parameter Providers before fetching
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9220.
2024-08-30 13:42:47 +02:00
Bryan Bende 71face8ea7
NIFI-13659 Call migrateProperties on components changed in synchronization (#9201)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-29 09:25:49 -05:00
exceptionfactory bdaf514018
NIFI-13688 Checked Validation Status before Fetching Parameters
- Added perform validation for Controller-level Services
- Added wait on Parameter Provider validation status to allow for Controller Service enabling

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9210.
2024-08-29 15:28:54 +02:00
David Handermann e9f84083eb
NIFI-13684 Set Cluster Status HTTP Code based on Connection (#9202) 2024-08-27 13:38:58 -04:00
David Handermann 6b6e8d6f78
NIFI-13665 Refactored Bootstrap and Runtime Process Handling (#9192)
- Added BootstrapProcess main class to nifi-bootstrap
- Added HTTP Management Server to nifi-runtime for status
- Added HTTP client to nifi-bootstrap for status
- Removed TCP socket listeners from nifi-bootstrap and nifi-runtime
- Removed dump and env commands
- Removed java property from bootstrap.conf
- Removed nifi.bootstrap.listen.port from bootstrap.conf
2024-08-26 14:22:04 -04:00
exceptionfactory fa6e55f1de
NIFI-13677 Removed install command from nifi.sh
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9194.
2024-08-23 18:01:30 +02:00
Mark Payne da9c296820
NIFI-12991 Fixed Recursive Validation of Group Execution Engine (#9186)
Fixed issue in which we recursively validate that we can change Execution Engine of a group, but without changing the top level, inherited groups can't actually be changed; instead, replaced logic to ensure that we can change the top level, that we don't validate the constraint that a STATELESS group cannot have a STATEFUL child, and then validate that all descendant groups can be updated, but without checking the descendants' parent groups.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-20 15:26:44 -05:00
exceptionfactory 7348740ecc
NIFI-13639 Replaced OkHttp with web-client-api in web-security
This closes #9157

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-08-16 14:53:55 -07:00
exceptionfactory 98f55b21b8
NIFI-13532 Fixed Flow Configuration History Sorting when Filtered
This closes #9179

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-08-16 14:41:40 -07:00
Joseph Witt e4ec0cb20d
NIFI-13651 Moved framework-related modules under framework-bundle
- Removed references to nifi-property-utils under nifi-extension-bundles

This closes #9169

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 13:44:13 -05:00
Bryan Bende e46c7db1ec
NIFI-13657 Fixed Reducer for Processor Load Average in Node Status
This closes #9177

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-14 20:28:21 -05:00
David Handermann 89c757999b
NIFI-13652 Added Range Header Handling for Content Download (#9172)
This closes #9172
2024-08-14 14:44:21 -04:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
David Handermann 265ef593a6
NIFI-13653 Fixed Sensitive Dynamic Property Update Handling (#9175)
- Avoided removing Sensitive Dynamic Property Names unless the property itself is removed

This closes #9175
2024-08-13 09:34:44 -04:00
Bryan Bende e349b7e7b4
NIFI-13649 Check Cluster Node Address Status before marking CONNECTED (#9168)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-12 16:27:52 -05:00
David Handermann 9cd319e3e5
NIFI-13646 Corrected Current User Replicated Response Handling (#9164)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-07 16:22:39 -05:00
Matt Gilman 38292762bd
NIFI-13638: Limiting the maximum number of provenance events to return when fetching the latest events. (#9156) 2024-08-06 17:26:34 -04:00
Matt Gilman da6c9c4791
NIFI-13017: Replace JoltTransformJSON custom UI (#9117)
* NIFI-13017:
- Remove old JoltTransformJSON custom UI.
- Update build to use new JoltTransformJSON custom UI.
- Fix revision query parameter.

* NIFI-13017:
- Excluding jolt transform json ui in workflow ci.

* NIFI-13017:
- Excluding jolt nar in workflow ci.

* NIFI-13017:
- Excluding jolt ui war from code coverage.

* NIFI-13017:
- Incorporating nifi-web-servlet-shared.
- Moving QueryStringToFragmentFilter to nifi-web-servlet-shared.

This closes #9117
2024-08-06 13:51:41 -04:00
dan-s1 f64e68b23c
NIFI-13625 Removed or Replaced System.out.println in Tests (#9150)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 20:35:40 -05:00
David Handermann 141ca71cbc
NIFI-13622 Corrected Logout Complete Redirect for Proxies (#9143)
This closes #9143
2024-08-02 16:40:47 -04:00
David Handermann 8ad6aa6ede
NIFI-13609 Correct Component Search Configuration (#9131)
* NIFI-13609 Corrected Component Search Configuration
- Removed duplicate Controller Search Service bean definition
- Wired Controller Search Service to Controller Facade bean definition
- Added Flow Controller reference for SearchableMatcher
2024-07-31 15:04:49 -04:00
Matt Gilman 6c930626dc
NIFI-13606 Corrected Custom UI loading in reverse proxy deployments
This closes #9130

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-31 11:10:07 -05:00
David Szabo 2542927b53 NIFI-12741 - Remove write permission requirement for the referenced controller service when changing component property referencing a controller service through parameter
This closes #9093.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-07-31 17:26:10 +02:00
David Handermann 5a6bee2154
NIFI-13602 Corrected Logout Supported Status for Clustered User (#9127)
- Set CurrentUserEntity.logoutSupported based on local authentication instead of replicated and merged responses

This closes #9127
2024-07-31 11:06:25 -04:00
David Handermann 33da3463b6
NIFI-13594 Added web-servlet-shared abstracted from web-utils (#9123)
- Moved RequestUriBuilder from web-utils to web-servlet-shared
- Refactored proxy header parsing from WebUtils to StandardRequestUriProvider
- Renamed WebUtils to WebClientUtils

This closes #9123
2024-07-30 15:41:49 -04:00
Timea Barna f262e74170
NIFI-13439 Added Performance Status to Group Status responses
- Added ProcessingPerformanceStatus to nifi-api
- Added Performance Status to Process Group and Processor Sources for Query NiFi Reporting Task

This closes #9014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-30 12:56:55 -05:00
David Handermann 25299f8106
NIFI-13592 Removed unused nifi-runtime classes and methods (#9120)
- Removed unused key processing methods from NiFi runtime class
- Removed unused stateless and embedded NiFi classes along with tests
2024-07-29 14:05:40 -04:00
exceptionfactory 60a03b90cb
NIFI-13562 Removed carriage return characters from TestProcessorAuditor
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-29 12:30:08 -05:00
David Handermann 692c8be2f1
NIFI-13575 Improve Jetty Server handling of Web App Exceptions (#9112)
* NIFI-13575 Improved Jetty Server handling of Web App Exceptions
- Enabled throwUnavailableOnStartupException for configured Web Apps

* NIFI-13575 Checked Context Path to determine startup exception handling
2024-07-29 11:48:47 -04:00
David Handermann d5b69c588f
NIFI-13562 Migrated web-api Configuration from XML to Java (#9111)
- Configured Controller annotation wiring for Resource classes
- Configured Service annotation wiring for Auditor classes
- Configured Repository annotation wiring for DAO classes
2024-07-29 10:21:57 -04:00
Ferenc Kis dca7aac9b3
NIFI-13541 [MiNiFi] Validate flow during startup
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #9073.
2024-07-25 07:57:54 -04:00
David Handermann 11fdc44fb9
NIFI-13577 Corrected null handling in Parameter Value Mapper (#9107) 2024-07-24 08:01:41 -04:00
David Handermann b0f419be2c
NIFI-13560 Changed Parameter Provider handling to avoid storing values (#9102)
- Added ParameterValueMapper for handling serialization of Parameter Values for Flow Configuration
- Added Parameter Group retrieval method for Flow Synchronizer
2024-07-23 11:31:16 -04:00
Bryan Bende 79ac0c2d89
NIFI-13570 Use NiFiProperties isHTTPSConfigured to determine if NAR Manager should use https
This closes #9100

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-22 10:58:08 -07:00