Commit Graph

2524 Commits

Author SHA1 Message Date
Nathan Gough c40639a51f
NIFI-10332 Selected OIDC Logout method using Discovery URLs
This closes #6594

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-01 21:33:26 -05:00
priyanka-28 6f65cd1f32
NIFI-10629 Updated TestJsonEntitySerializer with sorted properties
This closes #6515

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 15:09:04 -05:00
mr1716 8d2789dbc4 NIFI-10725 Update ICU4J to 72.1
This closes #6603

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-30 08:44:48 -04:00
M Tien e862a02df6
NIFI-10715: improve tooltips in parameter providers (#6598)
* NIFI-10715: clean up tooltips in parameter providers

* more clean up

This closes #6598
2022-10-28 16:23:18 -04:00
Paul Grey 61ccb23b47
NIFI-10704 - include API name of properties in processor documentation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6586
2022-10-28 14:13:16 -04:00
Ferenc Kis 65558accda
NIFI-10679 MiNiFi C2 Update Asset Command
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #6583.
2022-10-28 20:09:15 +02:00
M Tien be64f5560c
NIFI-10603: fix showing the referencing components border in the fetch parameters dialog (#6491)
This closes #6491
2022-10-27 13:45:24 -04:00
Matt Gilman b05bd988b6 NIFI-10700:
- Only restart ports if their scheduledState is Running.
- Adding unit tests.
- Fixing unit test to properly verify Port isn't restarted.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6582.
2022-10-26 16:31:27 -04:00
Mark Payne d390a0becf
NIFI-10673: When a component is added to a ProcessGroup, we had a method called ensureUniqueVersionControlId but the method only took into accounts in that Process Group. Updated methods to now consider components in any Process Group that is part of the same Versioned Flow. Also added system test to verify the problem and the fix. Added Toolkit clients and additional methods as necessary in order to implement system tests
NIFI-10673: Addresed checkstyle issue

NIFI-10673: Removed TODO comment
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2022-10-26 14:38:01 -04:00
Denes Arvay 3ed87a2982
NIFI-10594 Render empty lines in Labels
This closes #6519

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:39:29 -05:00
UcanInfosec 3d1bf497a3
NIFI-10686 Upgraded questdb-core from 6.5.2 to 6.5.3
This closes #6570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:22:26 -05:00
mtien 643b6a6c1d
NIFI-10689 Fixed Parameter Provider Name encoding in context dialog
This closes #6576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:16:36 -05:00
Timea Barna 7c33516aee NIFI-9437 Flowfile Expiration cannot exceed 24 days
NIFI-9437 Addressing review comments, correcting setter in StatelessFlowQueue class

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6558.
2022-10-24 14:46:56 -04:00
Malthe Borch 831a11d0b5
NIFI-7823 Added groups mapping from OIDC token claim
This closes #6454

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 09:12:24 -05:00
markap14 d64574b565
NIFI-10682: When determining effective property values, ensure that we always use the up-to-date version of Property Descriptors (#6567)
This closes #6567
2022-10-24 09:59:16 -04:00
Nandor Soma Abonyi 2049268372
NIFI-10668 Persist proxy password in remote process group (#6557)
* NIFI-10668 Persist proxy password in remote process group
2022-10-21 11:44:12 -04:00
Joe Witt c155d29658
NIFI-10614 Upgraded Bouncy Castle from 1.70 to 1.71
- Blocked Bouncy Castle jdk15on dependencies
- Forced jdk18on dependencies and validated across entire build

This closes #6498

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 19:35:02 -05:00
markap14 e83e3eb849
NIFI-10663: When ProcessorNode.stop() is called, it returns a Future. That future, however, may be completed when the processor is fully stopped or whenever it becomes stopping. Fixed this behavior by only completing the future whenever the processor has fully stopped. Also addressed an issue in the synchronizer in which we did not stop a processor when it had a state of STARTING. (#6561)
This closes #6561
2022-10-20 15:42:37 -04:00
dependabot[bot] 531a9de28f
NIFI-10669 Upgraded Jettison from 1.3.7 to 1.5.1
- Upgraded Jettison in nifi-framework-bundle
- Upgraded Jettison in nifi-registry-ranger
- Upgraded Jettison in nifi-spark-bundle

This closes #6548
This closes #6549
This closes #6550

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-19 09:45:49 -05:00
Joe Gresock 2d7f86b265
NIFI-10641: Resolving typo on ParameterProvider warning message
This closes #6527

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-15 09:05:57 -05:00
exceptionfactory 0dc02e26d2 NIFI-10648 Upgraded Apache Commons Text to 1.10.0
- Added org.apache.commons.text.version property in root Maven configuration
- Removed direct version references in favor of managed dependency version

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6531.
2022-10-14 14:07:23 -04:00
exceptionfactory ed8197eacb
NIFI-10567 Corrected Sensitive Dynamic Property handling for flow.xml (#6524)
- Updated XmlFlowSynchronizer to filter parsed Sensitive Dynamic Property Names using dynamic status of component Property Descriptor
- Lack of access to the Component Property Descriptor when parsing DOM elements required subsequent dynamic status filtering
2022-10-13 19:38:17 -04:00
exceptionfactory 11314e8132
NIFI-10624 Removed sensitive properties key warning
- Corrected logging statements with placeholders instead of concatenation
- Removed unused NiFiServerStub

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6513
2022-10-12 21:58:29 -04:00
Joe Witt c6a9d70814
Merge branch 'NIFI-10521-RC4' 2022-10-06 14:13:30 -07:00
Ferenc Erdei 504baae227
NIFI-10531 Add supported operations to c2 heartbeat:
This closes #6438

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-10-04 17:16:51 +02:00
Ferenc Kis 16bcb8f145
NIFI-10458 MiNiFi: Add C2 handler for Transfer/Debug operation
This closes #6434

Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
2022-10-04 10:35:39 +02:00
Andrew Lim d29f67465a
NIFI-10564 Update text for access the controller access policy in UI and Admin Guide
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6476.
2022-10-03 20:50:31 -04:00
exceptionfactory 7a01e22125
NIFI-10577 Fix Sensitive Checkbox rendering for Fetch Parameters (#6473)
* NIFI-10577 Fixed Sensitive Checkbox rendering for Fetch Parameters

- Corrected rendering of Sensitive status checkbox on Firefox using standard nf-checkbox

* NIFI-10577 Corrected canvas rendering in Safari

Merged #6473 in main.
2022-10-03 13:24:36 -07:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Joe Gresock 10a5e9194c
NIFI-10572: Allowing variables to be deleted between versions, and considering ancestor variable additions to be environmental
This closes #6474

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-03 12:44:07 -05:00
M Tien 5546b7ab01
NIFI-10566: update availability text in Controller Settings (#6463)
* NIFI-10566: update availability text in Controller Settings
- fix link in controller service referencing a parameter provider

* add Registry Clients to the availability message

This closes #6463
2022-10-03 08:23:52 -04:00
Joe Gresock 094222260c
NIFI-9402: Adding DatabaseParameterProvider
Adding provided scope to api dependency in nifi-standard-parameter-providers module

Adding additional documentation, other minor code cleanup

Correcting error handling in StandardParameterProviderNode, updating additional details for DatabaseParameterProvider

Correcting null columm value handling

NIFI-9402: Fixed Checkstyle violation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6391
2022-09-28 17:41:57 -04:00
M Tien 34084d083a
NIFI-10542: set sensitivity for new parameters in a synced parameter context (#6446)
* NIFI-10542: set sensitivity for new parameters in a synced parameter context

* show removed or missing but referenced parameters with tooltip in the selectable parameters table
- remove default parameter value

* address review feedback
- fix showing a referencing icon for a missing but removed parameter

* fix discovering new parameters

This closes #6446
2022-09-26 19:32:00 -04:00
Shane Ardell 17084a1f09
NIFI-10538: UI updates for making RegistryClient an extension point (#6437)
* init commit

* remove test string

* display only class name for types combo

* remove commented code

* add UI support for dynamic properties

* add support for controller services

* address review feedback:

* fix syntax error
* remove console logs
* move contents of editRegistry into callback
* add name and description fields back to edit dialog

* add referencing component logic for registry clients

* implement reload logic

* more review findings
* increase size of description textarea in config
* remove location column from registry table
* remove commented out code

* post-rebase tweaks
* change if condition from assignment to evaluation
* add missing semicolons
* refactor new registry initialization into function

* more feedback addressed
* fix rebase error around controller service reference
* render registry references in their own list
* remove duplicate updateValidationError function
* remove TODO comment

* expose reload through nfSettings public variable

* show add registry dialog only after available types returns

* fix css class name

This closes #6437
2022-09-26 16:03:51 -04:00
simonbence 94fdc794b0
NIFI-10497 Making RegistryClient an extension point (#6433)
- NIFI-10497 Mae FlowRegistryClient an extension point
2022-09-26 12:16:21 -04:00
M Tien d82ce18f88
NIFI-9514 NIFI-9515: Add UI support for Parameter Providers in Controller Services (#5671)
* NIFI-9514 - Add UI support for Parameter Providers in Controller Services

* - Fix a dialog closing issue

* - Hide fetch parameters button if there are config errors

* - Update Fetch Parameters dialog with new UX
- Implement checkbox logic for Selectable Parameters table

* - add createNewParameterContext property to track if group will be created as a new parameter context
- update fetch parameters dialog views for editing and after applying changes
- show affected referencing components after applying changes
- disable apply button if no parameter contexts will be updated
- refactor showing and hiding fetched parameters and selectable parameters tables logic
- add tooltip for parameter context icon

* - update parameter contexts view for provided contexts

* - add affected referencing components after applying fetched parameters
- add referencing parameter contexts to the provider settings tab
- update checkbox style in the selectable parameters table
- fix updating the referencing components border
- fix lint errors

* - fix selectable parameters table checkbox styles

* - fix hasParameterContextChanged checks
- checkbox style tweaks

* - add status bar to fetch parameters dialog

* - more style tweaks and remove unnecessary code

* - fix the selectable parameters table not saving and loading correctly

* - add tooltips
- fix styles

* - link from the parameter context to the associated parameter provider

* 9514: support navigating to the controller service created in parameter providers

* fix bulletins format in status bar

* address review feedback
- manage permissions for parameter providers
- disable/enable Fetch Parameters dialog Apply button

* manage authorizations to access parameter providers and parameter contexts

* fix lint errors

* fix and refactor hasGroupsChanged to determine the Apply button state

* new parameter context name input cannot be empty in Fetch Parameters dialog

* address review feedback

* fix duplicate code

* more fixes

* update fetch parameters checkbox states

* replace slickgrid checkbox selection plugin with custom implementation for different selection types
- check for affected parameters using the parameter status

* fixed showing the correct referencing components when switching groups

* fixed selectable parameters table shifting contents on row selection

* leverage slickgrid onClick to set user-selected parameter sensitivities in the selectable parameters table

* fix statusbar bulletins in processor details
- fix updating borders for referencing components
- update referencing parameter icon
- update table title in fetch parameters dialog

* address review feedback

* populate controller services referencing components of a referenced provider
- update controller services tab name

* showing parameter providers in CS controller service

* update tooltip messages in fetch parameters dialog
- fix dialog height to make room for the status bar

* reload the parameter providers table after a referenced parameter provider change in controller services
- fix conditions for enabling/disabling fetch parameters dialog Apply button
- add affected components no permissions message in the dialog

* fix always reloading the parameter providers table
- fix disableApplyButton checks
- add dialog message for a missing new parameter context name

* remove extra reload

* more fixes for disableApplyButton
- fixed styles for dialog message

* add a check in disableApplyButton for changed parameter values that are not referenced
- add changed value icon for parameters that are not referenced
- fix border on the referencing affected components container

* removed unnused plugins

This closes #5671
2022-09-24 08:43:27 -04:00
Joe Gresock ece83709f4
NIFI-10473: Removing referencing components check on param provider f… (#6388)
* NIFI-10473: Removing referencing components check on param provider fetch

* NIFI-10473: Adding parameter status DTO to ParameterProviderDTO

* Allowing parameterStatus to be populated even when no parameters were updated

* Adding ParameterStatus enum for parameter fetching

* Adding MISSING_BUT_REFERENCED ParameterStatus

This closes #6388
2022-09-23 13:44:52 -04:00
Ferenc Kis 1b1d388ef7
NIFI-10530 MiNiFi: Add option to compress c2 requests
This closes #6439

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-09-22 16:23:28 +02:00
Joe Gresock 43931b1504
NIFI-10518: Adding intended state to ScheduledStateChangeListener (#6428)
- NIFI-10518: Adding intended state to ScheduledStateChangeListener
- Notifying of scheduled state change when transitionComponentState is called
- Notifying scheduled state change when reporting task state is changed
- Notifying scheduledState changes for remote group port start/stop components calls
2022-09-19 10:38:00 -04:00
Mark Payne eaa275a5e4
NIFI-10515: If propopsed controller service is disabled, ensure that we don't re-enable the service and references when synchronize(ControllerServiceNode...) is called
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6425.
2022-09-16 16:36:55 -04:00
exceptionfactory 6398c2deb7
NIFI-10505 Removed unused HttpClient dependency from nifi-web-api
- Removing org.apache.httpcomponents:httpclient from nifi-web-api avoids Linkage Errors with Sensitive Property Providers

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6423.
2022-09-16 10:19:28 +02:00
Joe Gresock 51d01f874e
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer (#6341)
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer
2022-09-15 09:15:44 -04:00
exceptionfactory 04c0df1723
NIFI-10471 Documented and applied standard deprecation logging
- Updated Admin Guide with section on Logging Configuration and Deprecation Logging
- Updated Developer Guide with section on Deprecating Components and Features
- Added Deprecation Logging when adding components marked with DeprecationNotice to the Flow Configuration
- Added Deprecation Logging on deprecated methods in standard Controller Service implementations
- Removed integration tests for deprecated PersistentProvenanceRepository
- Updated logging and added documentation on minor upgrade steps
- Updated logging for HDFSNarProvider and RocksDB Repository

This closes #6390
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-13 19:40:03 -04:00
Csaba Bejan e26aa233d7 NIFI-10458 Add support for the DESCRIBE/MANIFEST Operation
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #6375
2022-09-13 19:22:35 +02:00
exceptionfactory 158c5417bc
NIFI-9500 Added nifi.cmd for Windows; Switched to NiFi Home directory to run command actions
This closes #6370
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-12 14:13:02 -04:00
mr1716 ccebf2b271
NIFI-10466 Updated questdb to 6.5.2-jdk8
This closes #6384

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:23:56 -04:00
Joe Gresock de7793e69b
NIFI-9003 Added framework support for Parameter Providers
- Added Environment Variable and File Parameter Provider implementations
- Added Parameter Provider commands to CLI
- Added component search handling for Parameter Providers
- Added documentation for integrating Parameter Providers

This closes #5369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 13:04:56 -05:00
Peter Turcsanyi e81466d4f3
NIFI-10465: Fixed error message for invalid Controller Service type
This closes #6381

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:16:06 -05:00
Bence Simon a4a3bdbc98
NIFI-10451 Updated QuestDB Status History Rollover to work with version 6
This closes #6374

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:08:07 -05:00
mr1716 b12510e54a
NIFI-10443 Upgraded oauth2-oidc-sdk from 9.10 to 9.43
- Upgraded nimbus-jose-jwt to 9.11.2 to 9.24.3

This closes #6366

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 17:54:39 -05:00
Mark Payne a0c705715b
NIFI-10429: Added the ability to Replay latest provenance event for a given Processor.
This closes #6359

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 15:55:26 -05:00
Mark Payne 7a90137cef
NIFI-10431: Improved log messages and Exception messages to indicate which components they pertain to. Also added a toString() for StandardLabel to make it more clear which Label is being referenced
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6361.
2022-09-02 15:56:33 -04:00
Nathan Gough 10d1fbe888
NIFI-10378 Added OIDC client secret to encrypted properties
This closes #6352

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 16:14:32 -05:00
Lehel Boér 28fc030ef5
NIFI-10366: Make Default Run Duration configurable (#6310)
NIFI-10366: Make Default Run Duration configurable
2022-08-30 14:38:56 -04:00
exceptionfactory b777978293 NIFI-10313 Removed Expiration Token on Authentication Errors
- Updated standard user interface error handler to clear the Access-Token-Expiration item from Session Storage when receiving an error with the WWW-Authenticate Header indicating a problem with the Bearer Token

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6334.
2022-08-25 13:12:01 -04:00
Matthew Burgess d698e7af1a
NIFI-10306: Add logging to StandardProcessGroup.addConnection() with more details
This closes #6264

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 07:50:55 -05:00
exceptionfactory 777238eb32 NIFI-10321 Send Session Expired message for Expired JWT errors
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6332.
2022-08-24 12:40:04 -04:00
exceptionfactory fa85a05a2b
NIFI-9374 Added Deprecation Logger
- Added nifi-deprecation-log module with interface and implementation using SLF4J
- Updated standard logback.xml with nifi-deprecation.log appender
- Updated NiFiLegacyCipherProvider with deprecation logging
- Set Size, Time Policy, and Total Size Limit for Deprecation Log

This closes #6300
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-23 11:25:03 -04:00
Mark Payne 9070cd0904
NIFI-10383: When importing/synching to a VersionedFlow, if the Versioned PropertyDescriptor indicates that a property references a Controller Service, treat it the same as if the PropertyDescriptor itself indicates that it references a service. This allows us to ensure that scripted components' property descriptors that reference controller services are properly mapped. Additionally updated StandardProcessorNode so that when we have this condition that we properly account for the Controller Service reference
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6322
2022-08-23 09:59:07 -04:00
exceptionfactory 0a065538e2 NIFI-10368 Upgraded jQuery UI from 1.12.1 to 1.13.2
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6312.
2022-08-22 14:14:15 -04:00
Mark Payne b012e9aad2
NIFI-10371: When a component is moved between groups, ensure that its versioned component id is unique within the destination group. Also ensure that when adding a connection to a PG with the VersionedComponentSynchronizer that we prefer obtaining source/destination by instance id instead of versioned id.
Fixed bug where ProcessGroup would inadvertently set the wrong component's Versioned Component ID to null when there was an ID conflict

This closes #6314

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-22 08:07:27 -05:00
Hsin-Ying Lee 2685856c62
NIFI-10052 Avoid obtaining any locks when creating/sending heartbeats (#6298) 2022-08-17 14:05:55 -04:00
Mark Payne 21503f6353
NIFI-10362: When asynchronous node disconnect is issued, do not send disconnect to node if the node becomes reconnected in the interim. Also, addressed the issue in which a disconnected node acts on a replicated request during the first phase by detect that it's the first phase if configured for cluster, not when only when connected to a cluster.
This closes #6308

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-17 11:09:47 -05:00
Malthe Borch 1b4d66a726
NIFI-10343 Add error code to exception message
The error object may not have a description, but should have a code.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6288.
2022-08-16 09:49:58 +02:00
exceptionfactory 24cea2a93b
NIFI-10183 Upgraded swagger-annotations to 1.6.6
- Added managed dependency in root Maven configuration
- Removed different versions from other Maven configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6284.
2022-08-10 15:32:30 +02:00
exceptionfactory 77033ec11a NIFI-10322 Corrected Cookie path when removing Bearer Token
- Appended root path to Cookie path attribute when removing Bearer Tokens as part of unauthorized response handling
- Updated Saml2AuthenticationSuccessHandler to follow standard Cookie path building strategy

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6278.
2022-08-09 16:09:41 -04:00
Emilio Setiadarma df2c187761
NIFI-10298 Changed nifi-framework-cluster tests to use Java and JUnit 5
This closes #6262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-04 10:31:17 -05:00
Joe Witt ded48269fe
Merge branch 'NIFI-10272-RC2' 2022-08-01 06:10:25 -07:00
Emilio Setiadarma 296f308cdc
NIFI-10048 Corrected StandardFlowDifference.hashCode() to avoid NPE
- Added tests to TestFlowController for JSON flow configuration

This closes #6227

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 13:44:26 -05:00
Emilio Setiadarma 67c463627c
NIFI-10292 Refactor nifi-framework-authorization-providers tests with Java and JUnit 5
This closes #6257

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 10:48:11 -05:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Nathan Gough c77f85aafb
NIFI-10070 Updated status merging for ControllerService and ReportingTask entities
- Corrected node identifier selection in multiple Mergers

This closes #6154

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-27 14:48:02 -05:00
exceptionfactory afa85a03ce
NIFI-10286 This closes #6251. Removed c2-client-api references from nifi-nar-utils
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-27 08:01:24 -07:00
exceptionfactory 9bb22fcb11
NIFI-10284 Corrected HTTP Request Authenticated User logging
- Moved RequestAuthenticationFilter before HeaderWriterFilter

This closes #6250
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-27 10:26:43 -04:00
exceptionfactory 02e37713b3
NIFI-10277 This closes #6245. Refactored ConnectionLoadBalanceServerTest
NIFI-10277 Changed failure test to throw SocketException
NIFI-10277 Increased timeout to 30 seconds and moved verify method

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 15:10:27 -07:00
Mark Payne 92750c2746
NIFI-10261: Ensure that when comparing Sensitive Parameters during flow sync we decrypt values for the comparison
This closes #6231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:52:46 -05:00
Mark Payne 0497907829
NIFI-10262: Ensure that when an Exception is thrown from a Controller Service's @OnEnabled method that we properly handle that Exception and continue enabling the other services in the given collection of services
This closes #6236

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:02:21 -05:00
exceptionfactory a661b035e8 NIFI-10259 Improved HTTP error handling for authentication failures
- Added Standard AuthenticationEntryPoint
- Configured AuthenticationEntryPoint for SecurityFilterChain and BearerTokenAuthenticationFilter

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6233.
2022-07-22 17:33:51 -04:00
Mark Payne d7ed66032e
NIFI-10050: When copying a process group and 1 CS references a higher-level CS, ensure that we don't drop that reference
This closes #6077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 16:25:58 -05:00
Mark Payne bc4e3e850b
NIFI-10246: When syncing Controller Services, wait until any DISABLING Controller Service has fully disabled before attempting to synchronize them. Also performed some minor refactoring/cleanup for System Tests in order to make writing a system test for this simpler
This closes #6219

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 13:31:06 -05:00
Kevin Doran ccf3866261
NIFI-9812 Disabled Native Lib loading tests on ARM64
- Migrate tests in nifi-framework-mark-loading-utils to JUnit5
- Annotate tests that use x86_64 native binaries to be conditional on x86_64 os.arch

This closes #6215

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 11:38:26 -05:00
Paul Grey 148834e71b
NIFI-10247 Corrected REST API documentation for empty-all-connection-requests
This closes #6220

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 07:51:32 -05:00
exceptionfactory 047b3611bf NIFI-10233 Corrected Anonymous Authentication for HTTP Access
- Enabled Standard Anonymous Authentication Filter when unencrypted HTTP is enabled

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6209.
2022-07-14 23:27:54 -04:00
exceptionfactory a9b5bebb15 NIFI-10216 Refactored NiFi Web API Security Configuration
- Removed extension of deprecated WebSecurityConfigurerAdapter
- Moved Filter bean configuration associated configuration classes
- Set default Spring Security log level to INFO
- Adjusted CSRF Token Repository to leverage simplified RequestUriBuilder for retrieving allowed context paths

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6195
2022-07-13 19:11:03 -04:00
Mark Payne 4c0555a476
NIFI-10203: Ensure that when a FlowFile is transferred and is not retried that we remove the retryCount.<uuid> attribute
This closes #6201
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 19:01:41 -04:00
exceptionfactory 51626d728b
NIFI-10215 This closes #6194. Upgraded Curator from 5.2.1 to 5.3.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-12 09:51:26 -07:00
Mark Payne 996d8faaf4
NIFI-10203: Fixed bug in which same FlowFile Builder was used repeatedly for multiple FlowFiles; this caused mingling of their attributes when a FlowFile is routed to a relationship that has more than 1 destination (i.e., many connections with the same Relationship)
This closes #6187
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 09:52:49 -04:00
Otto Fowler cf4eed0224 NIFI-10207: ensure allowableValues matches SUPPORTED_STATE in ProcessorRunStatusEntity
This closes #6188.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-11 21:34:27 +02:00
mr1716 291bd40013
NIFI-10195 Upgraded Testcontainers to 1.17.3
This closes #6179

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:37:39 -05:00
Ferenc Erdei d78c667c19
NIFI-10166 Improved MiNiFi bootstrap test coverage
This closes #6160

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-01 14:45:31 -05:00
exceptionfactory 1f18345929
NIFI-10163 Corrected StandardProcessSessionTest after NIFI-10167 2022-06-30 19:10:57 -05:00
exceptionfactory 943197c18b NIFI-10163
- Corrected StandardProcessSession.exportTo() byte counting
- Removed bytesWritten incrementing from exportTo methods

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6153.
2022-06-30 18:42:44 -04:00
Kevin Doran 9cf5c170b1
NIFI-9810 Deprecated RocksDB repository and moved to NAR
- Bump version to 6.29.5 for arm64 compatibility
- Extract RocksDBFlowFileRepository and supporting code to its own module
- Mark RocksDBFlowFileRepository as deprecated, both in code and documentation
- Log deprecation warning at startup if RocksDBFlowFileRepository is used
- Move native RocksDB info logs to NiFi debug level logs

This closes #6155

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:23:10 -05:00
Mark Payne 5e83bda9e9
NIFI-10167: Added advanced timing metrics for processors, such as CPU Usage, time reading/writing content repo, process session commit time, etc. Exposed via nifi.sh diagnostics and made configurable via nifi.properties
This closes #6156

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 10:50:24 -05:00
timeabarna d5b626f0e4
NIFI-10108 Processor scheduling via parameter (#6115)
- NIFI-10108 Processor scheduling via parameter
- Refactoring component referencing check in AbstractComponentNode and StandardParameterReferenceManager classes.
2022-06-30 10:11:13 -04:00
exceptionfactory 7a47c8cfbd
NIFI-10162 Reorganized InvokeHTTP Properties
- Corrected handling of documentation for allowable values

NIFI-10162 Updated Multipart Form-Data Name description

This closes #6163.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-29 16:52:19 -04:00
Emilio Setiadarma a098653d07
NIFI-10165 Increased NiFi bootstrap heap size to 48 MB
- Increased bootstrap heap size from 24 MB to 48 to avoid heap constraints when using HTTP notifications

This closes #6161

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 14:56:55 -05:00
exceptionfactory 0de83292de NIFI-9849 Refactored SAML Support with Spring Security 5
- Updated SAML Authentication Configuration with Spring Security SAML 2 components
- Updated Administration Guide with REST Resources
- Replaced SAMLAccessResource methods with applicable Spring Security Filters
- Removed IDP Credential Service and supporting components
- Removed message.logging.enabled, metadata.signing.enabled, and signature.digest.algorithm properties
- Added Access Token Expiration resource method
- Removed Saml2AccessResource and replaced with Access Token Expiration to avoid unnecessary conflicts with SAML login consumer
- Corrected Resource URI handling to support proxy server access

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6149.
2022-06-28 13:57:35 -04:00
Csaba Bejan 1465c2c629
NIFI-9908 C2 refactor and test coverage improvements
This closes #6149

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 12:02:31 -05:00
Nissim Shiman db11961026
NIFI-9440 Allow Controller Services to have configurable Bulletins
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6035
2022-06-28 10:44:45 -04:00
exceptionfactory c1c1d0da82
NIFI-10153 Refactored DocGeneratorTest and removed binary test files
This closes #6146

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-27 22:05:53 -04:00
Mark Payne 1442dcef23
NIFI-10111: Added option to unpack NARs into an Uber Jar and updated stateless nifi to always use this.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6117
2022-06-24 13:12:14 -04:00
Joe Gresock 3dda694fd6
NIFI-10139: Adding fields to RemoteProcessGroupStatus (#6137) 2022-06-22 12:24:23 -04:00
exceptionfactory 47121614a2
NIFI-10146 Upgraded Apache Tika from 2.4.0 to 2.4.1
- Removed direct dependency on metadata-extractor to inherit newer transitive version

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6140.
2022-06-21 22:58:40 +02:00
Mark Payne ac8c1b0326
NIFI-10148: Fixed bug in SwappablePriorityQueue, in which the Active Queue Size could be decremented before the Unacknowledged Queue Size is incremented when FlowFiles are polled. This can result in the SwappablePrioriotyQueue incorrectly returning a value of true from the isEmpty() method. Additionally, updated the NiFiSystemIT so that if waiting for a particular queue size we periodically log size of all queues, which aids in debugging, and added necessary methods to FlowClient to make that happen.
This closes #6143

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-21 15:55:47 -05:00
Bryan Bende 1de9c72779
NIFI-10140 Handle deleted parameters in StandardVersionedComponentSynchronizer
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6138.
2022-06-21 10:43:38 -04:00
Joe Gresock 5e01d3de06
NIFI-10117: Allowing remote group ports to be synchronized from Stand… (#6128)
NIFI-10117: Allowing remote group ports to be synchronized from StandardVersionedComponentSynchronizer
2022-06-17 14:28:14 -04:00
Matthew Burgess d89f98f5b4
NIFI-9666 Implemented MiNiFi C2 client and refactored bootstrap
- Implemented MiNiFi C2 client using OkHttp
- Refactored MiNiFi bootstrap command handling and socket communication
- Added C2 Client Service to nifi-framework-core

This closes #6075

Co-authored-by: Matthew Burgess <mattyb149@apache.org>
Co-authored-by: Csaba Bejan <bejan.csaba@gmail.com>
Co-authored-by: Ferenc Erdei <ferdei@cloudera.com>

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-17 09:23:52 -05:00
exceptionfactory bd45eb4995 NIFI-10100 Upgraded Jersey to 2.35
- Replaced individual version references with Jersey BOM dependency

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6106.
2022-06-16 23:09:22 -04:00
Emilio Setiadarma 2161d0fe9c
NIFI-10104 Refactored usage of PropertyEncryptor
This closes #6119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-16 16:38:34 -05:00
Mark Bean 0f5d8517b5
NIFI-5378 Prevent duplicate keys with different values in nifi.properties
This closes #6061

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 11:06:35 -05:00
exceptionfactory f91d877043
NIFI-10114 This closes #6122. Removed Single Refresh from ShellUserGroupProvider
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-13 14:38:19 -07:00
Nandor Soma Abonyi f99298f98e
NIFI-7535 add detailed error message when .nar file is not readable
This closes #6056
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-06-10 09:40:27 +02:00
exceptionfactory c51f70b6e6
NIFI-10096 Corrected nested inherited Parameter Context loading
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6114.
2022-06-09 21:10:44 -04:00
exceptionfactory a5bed1391e
NIFI-10098 Upgraded Apache Tika from 2.3.0 to 2.4.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6104.
2022-06-07 17:53:58 +01:00
exceptionfactory e19efa6658
NIFI-10095 Use Allowable Value Display Name for Default Value when found
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6103.
2022-06-07 14:36:47 +01:00
exceptionfactory 2455ba2c45
NIFI-10094 Removed unused test HttpServer classes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6102.
2022-06-07 14:33:57 +01:00
exceptionfactory e618e85da7
NIFI-10093 Set timeout to 5 seconds on SocketProtocolListenerTest (#6101) 2022-06-06 16:23:17 -04:00
Matthew Burgess 5591bec44b
NIFI-9742: Use dependent property Display Names in documentation
This closes #5820

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-06 13:43:02 -05:00
exceptionfactory 1342ea7025 NIFI-10079 Upgraded ZooKeeper from 3.5.9 to 3.8.0
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6096.
2022-06-03 19:05:21 -04:00
exceptionfactory 4b655ecb68
NIFI-9804 Added HTTP/2 support to Application Server
- Added nifi.web.https.application.protocols property
- Set default protocol to HTTP/1.1 and provided documentation for enabling HTTP/2
- Changed StandardALPNProcessor handshakeFailed log to debug

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6093.
2022-06-03 11:54:21 -04:00
exceptionfactory 5a2992c243
NIFI-9960 Add documentation for Sensitive Dynamic Properties (#6089)
* NIFI-9960 Added documentation for Sensitive Dynamic Properties

- Updated User Guide with Add Property details
- Updated Developer Guide with annotation configuration details
- Updated Document Writer to indicate Supports Sensitive Dynamic Properties status

* NIFI-9960 Adjusted User Guide wording based on feedback
2022-06-02 08:12:22 -04:00
Joe Gresock 48de70a568
NIFI-10071: Adding support for HashiCorp Vault K/V version 2 Secrets Engine (#6087) 2022-06-01 15:09:01 -04:00
Joe Gresock 314232ca6c
NIFI-10072: Adding LoadBalanceStatus to ConnectionStatus (#6086) 2022-05-31 16:27:23 -04:00
Bryan Bende 98ec2563e9
NIFI-10059 Remove incorrect removal of controller service from cache (#6082) 2022-05-26 17:13:28 -04:00
Mark Payne 35d8bb5ca9
NIFI-10051: Clear Controller Services' state in a background thread instead of the web thread.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6078
2022-05-26 10:31:55 -04:00
exceptionfactory 83316736f8
NIFI-9959 Add UI Support for Sensitive Dynamic Properties (#6073)
* NIFI-9959 Added UI Support for Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties to DBCPConnectionPool and ScriptedReportingTask

* NIFI-9959 Added sensitive parameter argument for Controller Service descriptors

* NIFI-9959 Adjusted sensitive property descriptor handling to support changing status

* NIFI-9959 Added info icon for Sensitive Value field

* NIFI-9959 Corrected handling of descriptor for existing dynamic properties

* NIFI-9959 Cleaning up dialog markup.

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

This closes #6073
2022-05-25 21:36:31 -04:00
Mark Payne d664708dd3
NIFI-10049: When unscheduling reporting task, increment its concurrent task count until we've finished all shutdown logic and then decrement it, in much the same way that we do for processors
This closes #6076

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-24 17:54:17 -05:00
exceptionfactory 99be62be67
NIFI-9958 Add Framework Support for Sensitive Dynamic Properties (#6057)
* NIFI-9958 Implemented Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties annotation for components
- Added optional sensitive query parameter to Property Descriptor REST Resource methods
- Added system tests for components supporting sensitive dynamic properties
- Updated REST Resources to support Sensitive Dynamic Property Names
- Updated Documentation Writer to indicate component support for Sensitive Dynamic Properties
- Updated InvokeHTTP to support Sensitive Dynamic Properties
- Updated Auditor components to handle masking Sensitive Dynamic Properties

* Refactored Property Descriptor REST method handling

- Corrected AbstractDocumentationWriter evaluation of support for sensitive dynamic properties
- Refactored Controller Service Dynamic Properties system tests to new class

* Updated AbstractComponentNode.getProperties() to get canonical descriptor
2022-05-23 17:20:54 -04:00
Mark Payne 38b51b0dde
NIFI-10037: When system test fails to clean up flow, destroy the entire environment so that the next test starts in a healthy state. Name troubleshooting directories with the name of the test class to avoid ambiguity. Also added a log statement so that we know which test is running when looking at the log output from the tests themselves. Finally, found an issue in AbstractComponentNode in which we iterate over the elements in a Map and call setProperty, which can update the underlying Map - updated to first create a copy of the HashMap. Updated that in this Jira because I suspect it is causing one of the tests failures that I've been investigating.
This closes #6059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-19 13:14:30 -05:00
markap14 88e53eae8c
NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. (#6049)
* NIFI-10001: Fixed issue in which some components may fail to update the scheduled state when comparing flows

* NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. When comparing two flows, now allow specifying how to determine a VersionedComponent's ID for comparison. When comparing local flow against flow from registry, use Versioned Component ID. But when comparing two instantiated flows, such as local flow vs. cluster flow, use the VersionedComponent's Instance ID instead. This ensures that we can properly compare two components even if there are several instances of a given flow
2022-05-18 13:53:36 -04:00
exceptionfactory fe424a2d42
NIFI-9805 Refactored Distributed Cache Servers using Netty
- Added Map and Set Cache Servers based on nifi-event-transport components
- Removed custom servers and unused socket stream components
- Reduced duplication on protocol classes
- Added checks for readable bytes
- Added mark and reset handling for buffer reads

This closes #6040
Signed-off-by: Paul Grey <greyp@apache.org>
2022-05-18 12:40:16 -04:00
tpalfy 2a8d07641e
NIFI-9895 Allow parameters to reference controller services (#5958)
* NIFI-9895 Allow parameter to reference controller service. Check read and write authorization for both previous and newly set controller service. Authorization done for both property or parameter change. Import/export handled by switching between instance id and versioned id.
2022-05-16 17:55:03 -04:00
Matthew Burgess bd1e033d55 NIFI-9967: Added FlowSerializationStrategy to determine which flow formats (XML,JSON) to save
This closes #6001.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-05-16 16:22:19 -04:00
markap14 8031b62351
NIFI-10001: When enabling a collection of Controller Services, change… (#6042)
* NIFI-10001: When enabling a collection of Controller Services, changed logic. Instead of enabling dependent services and waiting for them to complete enablement before starting a given service, just start the services given. The previous logic was necessary long ago because we couldn't enable a service unless all dependent services were fully enabled. But that changed a while ago. Now, we can enable a service when it's invalid. It'll just keep trying to enable until it becomes valid. At that point, it will complete its transition from ENABLING to ENABLED.

* NIFI-10001: Restored previous implementation for StandardControllerServiceProvider, as the changes were not ultimately what we needed. Changed StandardProcessGroup to use a ConcurrentHashMap for controller services instead of a HashMap with readLock. This was causing a deadlock when we enable a Controller Service that references another service during flow synchronization. Flow Synchronization was happening within a write lock and enabling the service required a read lock on the group. Eventually the thread holding the write lock would timeout and release the write lock. But this caused significant delays on startup. By changing to a ConcurrentHashMap, we alleviate the need for the Read Lock. Also noticed in testing that the StandardNiFiServiceFacade did not save flow changes when enabling dependent services so added call to controllerFacade.save().
2022-05-13 15:09:23 -04:00
Chris Sampson 313d70520d
NIFI-9470 This closes #6027. Allow creation of Parameter Context without any Inherited Parameter Contexts
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-05-13 07:39:11 -07:00
Mark Payne 4a60d1673e
NIFI-10023: Ensure that any files that are archived upon startup properly increment the archival count in the content repo
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6037
2022-05-12 15:38:49 -04:00
Mark Payne b25201dd22
NIFI-9993: Fixed bug in initialization in which the Content Repo did not properly increment the counter for how many files exist in the archive directories. This was causing the counter to become negative in some cases, which caused processors to incorrectly pause, waiting for content archive cleanup to occur when, in fact, there were no files archived
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6021.
2022-05-09 12:22:00 -04:00
exceptionfactory 0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
exceptionfactory ea75a0a996 NIFI-9995 Replaced Custom Filters with Spring Security HeaderWriter
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6020.
2022-05-06 12:22:30 -04:00
Matt Gilman e175b146cd NIFI-9978:
- Updating the condition under which we show the Download Flow menu items.

This closes #6008.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-02 19:40:48 +02:00
exceptionfactory fc2f539c7d
NIFI-9976 Upgraded json-smart to 2.4.8
- Replaced nifi-framework-bundle managed dependency to root managed dependency

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6005.
2022-04-29 10:12:41 +02:00
exceptionfactory 4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries

This closes #5992

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
exceptionfactory b288810316
NIFI-9943 Added Transform Provider to nifi-xml-processing
- Refactored TransformerFactory references using StandardTransformerProvider

This closes #5986
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 15:14:54 -04:00
Paul Grey 4450f4ce50
NIFI-9941 - fix handling of ReportingTask stop request
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5985
2022-04-21 14:18:09 -04:00
Mark Payne 5a3c7d1fbd
NIFI-9940: Renamed StandardProcessGroupSynchronizer to StandardVersionedComponentSynchronizer. Added synching for processors, input/output ports, connections, etc. Added unit tests.
This closes #5983
2022-04-21 10:28:21 -04:00
simonbence 285a8cbc3c
NIFI-9776 Adding the possibility to export flow definition with referenced services (#5859)
* NIFI-9776 Adding the possibility to export flow definition with referenced services

* NIFI-9776 Refining naming based on code review
2022-04-20 10:29:38 -04:00
exceptionfactory 18a4182cb0
NIFI-9883 Refactor Property Protection using Isolated ClassLoader (#5972)
* NIFI-9883 Refactored property protection to isolated ClassLoader

- Added nifi-property-protection-loader for abstracting access to implementation classes using ServiceLoader
- Updated Authorizer and Login Identity Provider configuration using isolated ClassLoader
- Updated NiFi Properties Loader using isolated ClassLoader
- Updated nifi-assembly to place property protection dependencies in lib/properties directory
- Updated and refactored unit tests
- Corrected LoginIdentityProviderFactoryBean getObject() Type
2022-04-19 11:08:04 -04:00
Joe Witt 84340962d4
NIFI-9927 Initial Commit to clean up all extraneous version/group declarations.
This closes #5969

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-16 12:05:07 -04:00
exceptionfactory e76acabe9e
NIFI-9923 Corrected SimpleProcessLogger handling of Throwable causes
- Changed log methods that accept a String and Object array to replace the last Throwable argument with a formatted summary of causes when calling LogRepository.addLogMessage()

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5965.
2022-04-14 12:30:57 -04:00
exceptionfactory 15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services

This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
greyp9 3034f2637a
NIFI-9893 - Ensure orderly cluster node removal on node delete via UI (#5946) 2022-04-13 13:44:28 -04:00
dependabot[bot] 5ec02c3464
Bump moment (#5951)
Bumps [moment](https://github.com/moment/moment) from 2.29.1 to 2.29.2.
- [Release notes](https://github.com/moment/moment/releases)
- [Changelog](https://github.com/moment/moment/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/moment/moment/compare/2.29.1...2.29.2)

---
updated-dependencies:
- dependency-name: moment
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

This closes #5951
2022-04-12 11:45:13 -04:00
exceptionfactory 27e78c6f0c
NIFI-9871 Correct Component Stack Trace Logging (#5945)
- Refactored SimpleProcessLogger to avoid sending stack trace causes to SLF4J Logger
- Refactored SimpleProcessLogger to minimize duplication of component message formatting
- Updated ConnectableTask logging to avoid repeating Throwable class in message string
- Refactored TestSimpleProcessLogger to improve coverage and confirm consistent argument handling
- Corrected handling of exception strings in argument arrays
2022-04-12 11:14:36 -04:00
Mark Payne 0bd5f5f34e
NIFI-9874: Consider Flow Difference Type of PARAMETER_CONTEXT_CHANGED an environmental change
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5939
2022-04-11 19:26:02 -04:00
Mark Payne c75fa3857e
NIFI-9885: This closes #5938. When creating ContainerState, ensure that we pass the correct value for the archiveEnabled flag.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-11 07:34:22 -07:00
tpalfy 1cf4e72084
NIFI-9875 In StandardProcessGroupSynchronizer.updateConnectionDestinations handle special case when output port is moved to a child process group while kept connected. (#5931) 2022-04-08 10:08:31 -04:00
exceptionfactory 74a4104259
NIFI-9882 Updated HtmlDocumentationWriter to avoid writing null characters
This closes #5935

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-06 14:37:38 -04:00
Bence Simon 9c71d83c5c NIFI-9615 Extending capabilities of NAR provider with restraining, conflict resolution strategy and refactors to make it more flexible 2022-04-06 11:54:31 -04:00
exceptionfactory e052cf81ba
NIFI-9872 Upgraded azure-sdk-bom to 1.2.0 for Sensitive Properties
- Replaced individual Azure dependencies with azure-sdk-bom in nifi-property-protection-azure
- Removed woodstox-core and stax2-api exclusions
- Refactored TemplateDeserializer test class to avoid dependency on specific XML implementation

This closes #5929

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-04 21:26:32 -04:00
Joe Witt 873d25585c
NIFI-9780 Merge branch 'NIFI-9780-RC3' 2022-04-04 08:35:23 -07:00
markap14 a4087f32bb
NIFI-9853: Refactored StandardProcessGroupSynchronizer to make use of… (#5919)
* NIFI-9853: Refactored StandardProcessGroupSynchronizer to make use of State Lookups and Compoennt Schedulers to ensure that we properly synchronize states when starting up, when exporting flow definitions, and when importing Flow Definitions

* NIFI-9853: Fixed NPE
2022-04-01 14:28:38 -04:00
exceptionfactory c9dee4ddba NIFI-9859 Upgraded Apache Curator from 5.2.0 to 5.2.1
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5923.
2022-04-01 12:07:48 -04:00
Hervé Boutemy 8abdd163ba
NIFI-9848 Upgraded Maven Plugins for Reproducible Builds
This closes #5915

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-30 20:09:44 -05:00
markap14 940fd8e81c
NIFI-9847: Switched LifecycleState to use a WeakHashMap to track Acti… (#5917)
* NIFI-9847: Switched LifecycleState to use a WeakHashMap to track ActiveProcessSessionFactory instances, instead of a regular Set that removed the instance after calling onTrigger. This was necessary for processors such as MergeRecord that may stash away an ActiveProcessSessionFactory for later use, as we need to be able to force rollback on processor termination

* NIFI-9847: Fixed checkstyle violation
2022-03-30 15:25:14 -04:00
Paul Grey cd0b289146
NIFI-9824 - Address WARN log message in ProcessorAuditor on action RunOnce
This closes #5890

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-30 10:23:40 -05:00
Jonathan Conti-Vock d09b828333
NIFI-9816 Added lang attribute to html tag for WCAG 2.1 Accessibility
This closes #5893

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-30 08:38:46 -05:00
Jon Conti-Vock 14e4f1bfc2
NIFI-9787: Increasing visibility of selected slickgrid row with 1px b… (#5857)
* NIFI-9787: Increasing visibility of selected slickgrid row with 1px borders on the top and bottom plus a slightly darker yellow background-color value.

* NIFI-9787: Added missing units to the padding values.

Merged #5857 into main.
2022-03-29 11:18:53 -07:00
exceptionfactory bf51687291
NIFI-9823 Removed VolatileContentRepository
- Removed Volatile Content Repository documentation references

This closes #5889

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-29 07:15:54 -04:00
markap14 b03fdac1b5
NIFI-9839: Fixed bug in which Process Group would return true for isEmpty even if it has a Controller Service (#5910) 2022-03-28 16:58:45 -04:00
Mark Payne 63f02c99bf
NIFI-9835: Fixed threading bug in which NioAsyncLoadBalanceClient calls LoadBalanceSession.isComplete() followed by LoadBalanceSession.isCanceled() but it's possible for the complete flag to change before the canceled flag (they are not updated atomically). So changed to use a single LoadBalanceSessionState enum that represents the state. Also made the private StandardProcessSession.commit(boolean) method synchronized. When a processor is terminated (as is the case in Offload), we roll back sessions and both the commit() and rollback() need to be synchronized. Only the public commit() method was synchronized, and now with commitAsync() happening, we had the ability to commit without any synchronization. This addresses that concern. Also fixed a typo in docs for MergeRecord.
This closes #5902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-25 12:42:03 -05:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Mike Thomsen 2bb1a06a8c
NIFI-9788 Updated commons-codec to 1.15 across all modules.
This closes #5881

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-21 09:13:05 -05:00
exceptionfactory 7823156606
NIFI-9815 Corrected log message formatting in multiple classes
This closes #5879

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-18 20:11:05 -04:00
exceptionfactory e17a436797
NIFI-9662 Remove unused mail-1.4.7 dependency from nifi-framework-bundle
This closes #5873

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:38:57 -04:00
exceptionfactory 412e21be97
NIFI-9281 Enabled building on Java 17
- Added Ubuntu Zulu JDK 17 GitHub build
- Adjusted MiNiFi C2 FileSystemConfigurationCache test to avoid using environment variables
- Adjusted MiNiFi StatusLogger and StatusLoggerTest to avoid overriding private logger
- Adjusted failure reason attribute check in TestGetIgniteCache
- Adjusted TestRangerAuthorizer and TestRangerNiFiAuthorizer to avoid checking nested exceptions
- Adjusted encrypt-config TestUtil to avoid unnecessary comparison of different types
- Disabled Javascript tests on Java 15 and higher
- Disabled several Hive 3 tests on Java 17 for StringInternUtils illegal access
- Refactored nifi-enrich-processors tests to use Mockito without Powermock
- Refactored nifi-toolkit-tls tests to avoid illegal reflective access
- Removed deprecated X509Certificate test in CertificateUtilsTest
- Removed kryo serialization from nifi-site-to-site-client test
- Updated TestHashContent to use SHA-1 instead of SHA for hash algorithm
- Upgraded maven-war-plugin from 2.5 to 3.3.2
- Upgraded nifi-graph-bundle dependencies from Groovy 2.5.14 to 3.0.8
- Upgraded QuestDB from 4.2.1 to 6.2.1 in nifi-framework-core

This closes #5870

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:08:38 -04:00
markap14 21922af90c
NIFI-9794: If a node is OFFLOADING, do not allow connections to be deleted. Also if we fail to notify the node that it needs to offload its data, change its state back to DISCONNECTED. (#5865) 2022-03-14 15:45:02 -04:00
Mark Payne 7ff70706ee
NIFI-9790: This closes #5860. Fixed race condition in which SwappablePriorityQueue could attempt to access the 0th element of an empty collection
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-14 08:38:39 -07:00
Nathan Gough 885c475f90
NIFI-9699 - Updated oidcCallback method to handle error cases. Added some unit tests.
This closes #5824

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-11 11:40:47 -06:00
Joe Witt 72fadf9e51
NIFI-9780 fixing many inconsistent pom project declarations and updated org apache parent version 2022-03-10 11:15:16 -07:00
Bryan Bende 546f986603
NIFI-9775 Create RuntimeManifestService
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5849.
2022-03-10 07:52:16 -05:00
Mark Payne 73356ea448
NIFI-9783: This closes #5855. When migrating FlowFiles from one ProcessSession to another, if any FlowFile had already been transferred, and the Relationship to which it was transferred was auto-terminated, we were updating the wrong member variable, which threw off our stats for the processor. Fixed that.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-09 13:26:32 -07:00
exceptionfactory c73573b325
NIFI-9761 Correct PeerChannel processing for TLS 1.3 (#5836)
* NIFI-9761 Corrected PeerChannel processing for TLS 1.3
- Added TestPeerChannel with methods for TLS 1.2 and TLS 1.3
- Updated PeerChannel.close() to process SSLEngine close notification
- Improved logging and corrected handling after decryption
2022-03-09 15:15:52 -05:00
Matt Gilman 227dcf5456
NIFI-9777: (#5850) - Adding support to remove attributes from verification requests.
This closes #5850
2022-03-08 16:25:32 -05:00
Matthew Burgess 43bf2b5975
NIFI-9763: Additional escaped VALUE column due to H2 changes
This closes #5848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-07 19:18:02 -06:00
Joe Gresock 743020eeb4
NIFI-9762: Adding DBCPConnectionPool config verification
Relaxing MockPropertyValue validation to allow for variables to be passed to config verification

Fixing underlying framework issue with config verification: wrong variable registry was being used

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5843
2022-03-07 14:43:11 -05:00
Paul Grey fc5c810de7
NIFI-9750 - Logging Improvements to support LoadBalanceProtocol troubleshooting
This closes #5828

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-07 13:41:07 -06:00
Eduardo Fontes d062029258
NIFI-8927 - Add option to start/stop all controllers (#5247)
* Update nf-context-menu.js

Include enable/disable all controllers menu item

* Update nf-actions.js

Create enableAllControllers and disableAllControllers actions

* Rename ...Controllers to ...ControllerServices

* Rename *controllers to *controller services

* Adjusts proposed by reviewer.

* Refactor enable and disable AllControllerServices

This closes #5247
2022-03-07 13:57:35 -05:00
exceptionfactory 7d046fe3de
NIFI-9763 Escaped VALUE column for Configure Details Auditing
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5838
2022-03-07 08:53:08 -05:00
Mark Payne 8959226b50
NIFI-9754: Introduced VersionedExternalFlow
- Updated stateless and StandardProcessGroup, etc. to make use of VersionedExternalFlow
- Updated StatelessDataflowDefinition to use ExternalVersionedFlow instead of generic type
- Updated Stateless Bootstrap to avoid loading stateless engine libs from root class path but instead use a NarClassLoader to load the statelss nar

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5832.
2022-03-04 07:19:38 -05:00
Shane Ardell 6cd30e3d0a
NIFI-9543: Add bring-to-front functionality to labels (#5765)
* NIFI-9543: add bring-to-front functionality to labels

* NIFI-9543: update zIndex changes to persist after shutdown

* NIFI-9543: remove commented code

* NIFI-9543: update flow comparator and snippet to account for zIndex

* NIFI-9543: changed add function to sort labels when a new label is added

* NIFI-9543: remove unnecessary call to position

* NIFI-9543: only register difference if zIndex is not default value

* NIFI-9543: add null checks to prevent primitive Long

This closes #5765
2022-03-03 18:50:15 -05:00
Matthew Burgess c91f543c2b NIFI-9425: Added auto-load NAR capability to MiNiFi
NIFI-9425: Added autoload directory property and defensive code for stop() called twice

This closes #5762.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-03-03 16:30:47 -05:00
Adam Kocsis 7a16619969
[NIFI-9690] Display icon on Connection Label to show when head of the queue is penalized (#5812)
This closes #5812
2022-03-03 09:13:00 -05:00
Mark Payne 53a35ae4c9
NIFI-9689: When checking FlowFile Availability, consider swap queue and trigger data to be swapped in, since calling poll() will no longer happen if no data is available
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5821.
2022-03-02 06:22:37 -05:00
exceptionfactory d17fcf6427 NIFI-9735 Corrected Jetty Duplicate Mapping Warning
- Removed duplicate default servlet mapping from addDocsServlets()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5817.
2022-03-01 15:49:23 -05:00
Shane Ardell 4719f78ef4
NIFI-9580: UI work for framework-level retry in Processors (#5666)
* NIFI-9580: initial ui work for framework-level retry in processors

* NIFI-9580: disable retry controls when retry not selected

* NIFI-9580: refactor marshalling to be one function

* NIFI-9580: style tweaks and documentation update

* NIFI-9580: update tooltip content

* NIFI-9580: change tooltip copy for clarity

* NIFI-9580: only submit retry configs if selected

* NIFI-9580: add relationship details to read-only dialog

* NIFI-9580: change styling based on feedback

This closes #5666
2022-03-01 14:57:18 -05:00
Mark Payne 9d3788ff05
NIFI-9730: Consider a change in value for retry-related fields from 'null' to the default value as an environmental change so that it's not flagged as a Local Modification, which would prevent users from updating the version of the Process Group that they are using
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5809.
2022-03-01 13:49:47 -05:00
Joe Gresock db28c91cdb
NIFI-9733: Fixing StandardConnection.verifySourceStoppedOrFunnel infinite recursion (#5815) 2022-03-01 09:57:51 -05:00
exceptionfactory 9bb34188c9
NIFI-9734 Standardized exception cause message formatting
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5813.
2022-03-01 06:49:34 -05:00
Paul Grey 875f589548
NIFI-9738 - VersionedComponent data members should derive from Object
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5816.
2022-03-01 06:06:48 -05:00
exceptionfactory 52f21390db
NIFI-9688 Improve Logback shutdown handling (#5805)
* NIFI-9688 Improved Logback shutdown handling
- Added environment variable to disable Logback shutdown on web application termination
- Added shutdown hook to Logback configuration
- Added Logback shutdown hook configuration to system tests
2022-02-28 14:29:44 -05:00
Mark Payne 649e2d2556
NIFI-9731: Updated to use a shorter, simpler output format for FlowFiles when creating bulletins
NIFI-9731: Only simplify flowfile arg in bulletin after extracting the flowfile uuid
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5808
2022-02-28 13:21:10 -05:00
Mark Payne 483968bac3
NIFI-6390, NIFI-1825: When we write to a FlowFile and that results in a 0-byte FlowFile, remove the content claim all together. This is more efficient to process, but far more importantly it prevents a 0-byte FlowFile from holding content in the Content Repository. Also fixed issue in which a Provenance Event cannot be replayed if there is no ContentClaim.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5810
2022-02-28 10:24:32 -05:00
Matthew Burgess bcc8d03314
NIFI-9585 Upgraded H2 from 1.4 to 2.1.210
- Added nifi-h2-database module shading H2 1.4.200
- Implemented version checking and migration

This closes #5724

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-25 19:20:48 -06:00
Mark Payne 6cea5ea520
NIFI-9729: When restarting components in the VersionedFlowSynchronizer, first filter out any components that are intended to be stopped.
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5806.
2022-02-25 14:29:38 -05:00
Paul Grey e74991e705
NIFI-9727 - IndexOutOfBoundsException in CorrelationAttributePartitioner
This closes #5804

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-25 11:42:02 -05:00
exceptionfactory 49d1c747ca
NIFI-9724 Added set-sensitive-properties-algorithm command
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5801.
2022-02-25 11:03:55 -05:00
Mark Payne 432f98714f
NIFI-9725: On shutdown, instead of spawning a background thread to shutdown Cluster Coordinator, do so in the calling thread. This avoids a race condition whereby the cluster coordinator cannot be determined because the other thread has shutdown the FlowController.
This closes #5800

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-24 22:16:01 -06:00
Mark Payne c453d2ba8f
NIFI-9723: When we add controller-level Controller Services on restart of NiFi, ensure that all Controller Services are updated to include their property values, etc. Also ensure that for these services and reporting tasks we decrypt the property values.
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5797.
2022-02-24 15:13:14 -05:00
Hsin-Ying Lee c331f9cb9a
NIFI-9227 Run Once not working when scheduling strategy is CRON or Event driven (#5445) 2022-02-24 12:27:01 -05:00
Mark Payne 9237b4e923
NIFI-9722: Do not throw an Exception from verifyCanUpdateProperties when property descriptor & parameter descriptor's sensitivities don't match - instead allow the set to happen and let processor become invalid. Also, allow values such as abc#{param} for ghost processors.
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5795.
2022-02-24 08:58:54 -05:00
Mark Payne 3511ce3d13
NIFI-9548: When disabling RPG transmission, wait for the ports to complete in a background thread instead of blocking the web thread. Also moved the RPG initialization logic into flow controller instead of flow service and added a delay in order to reduce likelihood of ConnectException happening when pointing to nodes in the same cluster
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5641.
2022-02-23 11:29:26 -05:00
Mark Payne ce0122bd25
NIFI-9691: Added ForkEnrichment, JoinEnrichment processors
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5772.
2022-02-22 18:54:32 -05:00
Mark Payne d0a23bc26b
NIFI-9704: Updated the ContentRepositoryScanTask to show details of how much content in the content repo is retained by each queue in the dataflow. Changed default for nifi.content.claim.max.appendable.size property from 1 MB to 50 KB. Updated docs to reflect the new default value and explain what the property does and how it's used.
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5780.
2022-02-22 12:06:54 -05:00
Nathan Gough 7ef2fd2986
NIFI-7333 Added OIDC trust store strategy property
This closes #5753

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-18 15:19:22 -05:00
Roberto Marturano a8fd5993eb NIFI-7192 Added systemd reload to nifi.sh install on systemd servers
This closes #4079

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2022-02-18 10:40:52 -08:00
Mark Payne 2aa6bd1e13
NIFI-9689: When all FlowFiles in a FlowFile Queue are penalized, do not schedule the destination to run. Also expose this fact via the ConnectionStatusSnapshotDTO, as this allows the front-end to render this information to the user in order to avoid confusion when it appears that the Processor has data but does nothing
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5771
2022-02-16 15:30:00 -05:00
exceptionfactory fe1139b8bb
NIFI-9692 Upgraded Apache Commons Lang3 to 3.12.0
- Moved commons-lang3 version management to root Maven configuration
- Refactored limited usage of StringUtils is nifi-reporting-utils to remove commons-lang3
- Refactored limited usage of StringUtils in nifi-websocket-processors to remove commons-lang3

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5773
2022-02-16 09:28:21 -05:00
timeabarna 63a543cd67
NIFI-9475 Provide Framework-Level Retries for NiFi Relationships (#5593) 2022-02-15 15:40:41 -05:00
tpalfy 84b2484fd4
NIFI-9684 Fix: When starting/stopping selected process group, it sends the parent process group id to the REST interface that is responsible to enable/disable transmission for all remote process groups within a process group. Need to send the id of the select process group instead. (#5764) 2022-02-15 14:55:17 -05:00
greyp9 87cfd43f6f
NIFI-9233 - Improve reliability of system integration tests (#5749)
* NIFI-9233 - Improve reliability of system integration tests
2022-02-15 13:14:01 -05:00
Steve Lawrence 4815df29db
NIFI-6740: Add configuration options to specify NiFi/Bootstrap communication ports
The NiFi and NiFi Bootstrap processes both bind to random ephemeral
ports to allow for inter-process communication (e.g. shutdown, port,
ping, etc.). However, the randomness of these ephemeral ports can pose
challenges for some security policies and firewall rules.

This adds two configuration options, nifi.bootstrap.listen.port and
nifi.listener.bootstrap.port, that allow an administrator to define
which ports the two processes should bind to for this communication,
making it easier to define security policies. The options default to
zero to maintain the current ephemeral port behavior.

NIFI-6740: Add configuration options to specify NiFi/Bootstrap communication ports

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5746
2022-02-15 11:46:21 -05:00
Scott Aslan b8ec6d38dc [NIFI-9554] upgrade node and npm
update lintin
update font awesome path
bump nifi-fds version
update nifi deps
update frontend maven plugin
change CI npm cache restore keys so that we will not use cached directories for older versions of node

This closes #5751.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-02-14 14:24:02 -05:00
exceptionfactory e584d3cf04
NIFI-9660 Upgraded Apache Tika to 2.3.0
- Upgraded tika-core from 1.27 to 2.3.0
- Upgraded tika-parsers to tika-parsers-standard-package in nifi-media-processors
- Updated Tika metadata property references

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5754.
2022-02-09 11:11:46 +01:00
Mark Payne 94668dee6e
NIFI-9639: Determine how long it takes to find cluster coordinator and perform DNS lookup when sending heartbeats and include in the logs
This closes #5748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-04 20:19:07 -06:00
markap14 230ed9c98d
NIFI-9628: Added a uiOnly flag when requesting Controller Service det… (#5712)
* NIFI-9628: Added a uiOnly flag when requesting Controller Service details and the list of Controller Services. This allows us to return much less data when retrieving these resources.

* NIFI-9628: Addressed review feedback; added uiOnly flag for controller service run-status and references also

* NIFI-9628: Fixed checkstyle issues by removing unused imports

This closes #5712
2022-02-03 15:53:23 -05:00
greyp9 9dbd066238
NIFI-9233 - Improve reliability of system integration tests (#5733) 2022-02-03 10:20:55 -05:00
exceptionfactory ba0bf2ede0
NIFI-9650 Upgraded OkHttp from 4.9.2 to 4.9.3
- Added okhttp-bom to root Maven configuration
- Removed repeated okhttp.version property from specific dependencies

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5737.
2022-02-02 11:45:18 +01:00
exceptionfactory 43748a5523 NIFI-9638 Refactored Google Guava references
- Refactored nifi-framework and nifi-standard modules
- Replaced Google Cache with Caffeine Cache
- Replaced Google collections classes with standard Java collections

This closes #5730.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-02-01 15:17:50 -05:00
greyp9 27ceda38bf
NIFI-9233 - Improve reliability of system integration tests (#5720) 2022-01-31 09:20:54 -05:00
Timea Barna 3ccc9d29b6
NIFI-9455 Added aggregated predictions to Prometheus Flow Metrics
This closes #5582

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-27 10:07:01 -06:00
Mark Payne 3ea9faccc6
NIFI-8040: When changing version of a flow, stop processors that have a state of Starting in addition to those with a state of Running
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5718.
2022-01-27 15:06:40 +01:00
Adam Kocsis 3eef7e0a3e
NIFI-9578 NiFi user list no longer breaks if a user and group have the same id (#5695)
- ids of the entities are prefixed by their types to avoid id conflict in 3rd party table library
   For some authorizers the UUID calculation for users and groups based only on the name of the entity and a global seed.
   This results the same UUID for a group and a user with the same name. The same ids are no longer causing any issue on the UI.
- group icon alignment is fixed for edit user dialog

This closes #5695
2022-01-25 14:52:07 -05:00
exceptionfactory e2243500d3
NIFI-9618 Upgraded Checkstyle to 9.2.1
- Corrected several missing return statements
- Increased Maven heap size to 3 GB for ci-workflow

This closes #5700

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-21 20:08:16 -06:00
Bryan Bende 6ef6e71d05
NIFI-9501 Added REST end-point to retrieve a RuntimeManifest
- Switch ExtensionManifestParser implementation to use JAXB instead of Jackson XML
- Fix handling of older NARs that don't have newer fields in ExtensionManifest
- Add response merging for runtime-manifest REST end-point, remove commons-lang3 from c2 dependencies

This closes #5630

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-21 15:37:04 -06:00
Timea Barna ccd47de6dc
NIFI-9587 Added JSON format for Prometheus Flow Metrics
This closes #5673

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-20 11:14:01 -06:00
Adam Kocsis 3c2793be09
[NIFI-8006] Additional options on UI to leave current process group (#5678)
- 'Leave group' action button is added to 'Navigation'
- 'Leave group' action works with 'esc' hotkey if no modal, context menu, etc. is open
- 'esc' key closes context menu if it is open
- user guide is updated with new navigation options

This closes #5678
2022-01-20 10:58:05 -05:00
exceptionfactory fc27b3138b
NIFI-9481 Excluded Data Transfer REST methods from DoSFilter
- Added DataTransferDoSFilter with request URI evaluation
- Added RequestFilterProvider and implementations to abstract Jetty Filter configuration

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5670.
2022-01-19 16:11:53 -05:00
Joe Witt 2f95eed8cb
NIFI-9575 This closes #5667. updating copyright year to 2022
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 09:14:09 -07:00
exceptionfactory dd7131b257
NIFI-9435 Added registries and names include parameters to Flow Metrics
- Added optional includedRegistries query parameter to Flow Metrics Resource method supporting one or more registries
- Added optional includedNames query parameter to Flow Metrics Resource method supporting one or more metric family names
- Added sampleName and sampleLabelValue optional pattern parameters
- Added FilteringMetricFamilySamplesEnumeration to support streamed filtering
- Added PrometheusMetricsWriter and TextFormat implementation

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5571.
2022-01-13 15:59:00 -05:00
exceptionfactory 2ffd4a5a9a
NIFI-9438 Refactored sensitive-property-provider to multiple modules
- Added nifi-property-protection-api with provider interfaces
- Added nifi-property-protection-factory with implementation references
- Added ProtectionSchemeResolver for abstracting conversion from command arguments
- Refactored PropertyProtectionScheme to package private visibility
- Refactored multiple unit test and removed provider integration tests
- Renamed AESSensitivePropertyProvider to AesGcmSensitivePropertyProvider
- Added getSupportedProtectionSchemes() to StandardProtectionSchemeResolver
- Updated command argument descriptions for protection schemes to include supported values

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5650.
2022-01-13 13:18:04 -05:00
exceptionfactory 5832dff25e
NIFI-9556 Upgraded Apache HttpClient to 4.5.13
- Upgraded Apache HttpCore to 4.4.15
- Added dependency management declarations in root Maven configuration for HttpClient and HttpCore
- Removed version numbers from multiple modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5647.
2022-01-08 11:06:07 +01:00
exceptionfactory 81e57c9651
NIFI-9535 Upgraded Spring Framework to 5.3.14
- Centralized Spring Framework and Spring Security versions using BOM dependencies
- Upgraded Spring Security from 5.5.2 to 5.6.1
- Upgraded Spring Boot from 2.5.5 to 2.5.8 in Registry
- Upgraded Spring Integration from 5.5.2 to 5.5.7

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5631.
2022-01-05 15:30:03 +01:00
Lehel Boér be138ab656
NIFI-9434: Added bulletin to alert FileSystemRepository backpressure (#5596) 2022-01-04 15:59:32 -05:00
Joe Gresock 66f36eaf5a NIFI-9461: Correcting equality comparison in Parameter update test
This closes #5609.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-12-17 18:05:35 +01:00
exceptionfactory 7c6bdcb035
NIFI-9491 Excluded commons-logging and added jcl-over-slf4j references
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5608
2021-12-17 07:21:03 -05:00
Joe Gresock 7d8f99a1f4
NIFI-9461: Allowing Parameter descriptions to be changed (#5603)
Merged #5603 into main.
2021-12-16 17:09:26 -08:00