2413 Commits

Author SHA1 Message Date
Emilio Setiadarma
2161d0fe9c
NIFI-10104 Refactored usage of PropertyEncryptor
This closes #6119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-16 16:38:34 -05:00
Mark Bean
0f5d8517b5
NIFI-5378 Prevent duplicate keys with different values in nifi.properties
This closes #6061

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 11:06:35 -05:00
exceptionfactory
f91d877043
NIFI-10114 This closes #6122. Removed Single Refresh from ShellUserGroupProvider
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-13 14:38:19 -07:00
Nandor Soma Abonyi
f99298f98e
NIFI-7535 add detailed error message when .nar file is not readable
This closes #6056
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-06-10 09:40:27 +02:00
exceptionfactory
c51f70b6e6
NIFI-10096 Corrected nested inherited Parameter Context loading
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6114.
2022-06-09 21:10:44 -04:00
exceptionfactory
a5bed1391e
NIFI-10098 Upgraded Apache Tika from 2.3.0 to 2.4.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6104.
2022-06-07 17:53:58 +01:00
exceptionfactory
e19efa6658
NIFI-10095 Use Allowable Value Display Name for Default Value when found
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6103.
2022-06-07 14:36:47 +01:00
exceptionfactory
2455ba2c45
NIFI-10094 Removed unused test HttpServer classes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6102.
2022-06-07 14:33:57 +01:00
exceptionfactory
e618e85da7
NIFI-10093 Set timeout to 5 seconds on SocketProtocolListenerTest (#6101) 2022-06-06 16:23:17 -04:00
Matthew Burgess
5591bec44b
NIFI-9742: Use dependent property Display Names in documentation
This closes #5820

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-06 13:43:02 -05:00
exceptionfactory
1342ea7025 NIFI-10079 Upgraded ZooKeeper from 3.5.9 to 3.8.0
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6096.
2022-06-03 19:05:21 -04:00
exceptionfactory
4b655ecb68
NIFI-9804 Added HTTP/2 support to Application Server
- Added nifi.web.https.application.protocols property
- Set default protocol to HTTP/1.1 and provided documentation for enabling HTTP/2
- Changed StandardALPNProcessor handshakeFailed log to debug

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6093.
2022-06-03 11:54:21 -04:00
exceptionfactory
5a2992c243
NIFI-9960 Add documentation for Sensitive Dynamic Properties (#6089)
* NIFI-9960 Added documentation for Sensitive Dynamic Properties

- Updated User Guide with Add Property details
- Updated Developer Guide with annotation configuration details
- Updated Document Writer to indicate Supports Sensitive Dynamic Properties status

* NIFI-9960 Adjusted User Guide wording based on feedback
2022-06-02 08:12:22 -04:00
Joe Gresock
48de70a568
NIFI-10071: Adding support for HashiCorp Vault K/V version 2 Secrets Engine (#6087) 2022-06-01 15:09:01 -04:00
Joe Gresock
314232ca6c
NIFI-10072: Adding LoadBalanceStatus to ConnectionStatus (#6086) 2022-05-31 16:27:23 -04:00
Bryan Bende
98ec2563e9
NIFI-10059 Remove incorrect removal of controller service from cache (#6082) 2022-05-26 17:13:28 -04:00
Mark Payne
35d8bb5ca9
NIFI-10051: Clear Controller Services' state in a background thread instead of the web thread.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6078
2022-05-26 10:31:55 -04:00
exceptionfactory
83316736f8
NIFI-9959 Add UI Support for Sensitive Dynamic Properties (#6073)
* NIFI-9959 Added UI Support for Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties to DBCPConnectionPool and ScriptedReportingTask

* NIFI-9959 Added sensitive parameter argument for Controller Service descriptors

* NIFI-9959 Adjusted sensitive property descriptor handling to support changing status

* NIFI-9959 Added info icon for Sensitive Value field

* NIFI-9959 Corrected handling of descriptor for existing dynamic properties

* NIFI-9959 Cleaning up dialog markup.

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

This closes #6073
2022-05-25 21:36:31 -04:00
Mark Payne
d664708dd3
NIFI-10049: When unscheduling reporting task, increment its concurrent task count until we've finished all shutdown logic and then decrement it, in much the same way that we do for processors
This closes #6076

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-24 17:54:17 -05:00
exceptionfactory
99be62be67
NIFI-9958 Add Framework Support for Sensitive Dynamic Properties (#6057)
* NIFI-9958 Implemented Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties annotation for components
- Added optional sensitive query parameter to Property Descriptor REST Resource methods
- Added system tests for components supporting sensitive dynamic properties
- Updated REST Resources to support Sensitive Dynamic Property Names
- Updated Documentation Writer to indicate component support for Sensitive Dynamic Properties
- Updated InvokeHTTP to support Sensitive Dynamic Properties
- Updated Auditor components to handle masking Sensitive Dynamic Properties

* Refactored Property Descriptor REST method handling

- Corrected AbstractDocumentationWriter evaluation of support for sensitive dynamic properties
- Refactored Controller Service Dynamic Properties system tests to new class

* Updated AbstractComponentNode.getProperties() to get canonical descriptor
2022-05-23 17:20:54 -04:00
Mark Payne
38b51b0dde
NIFI-10037: When system test fails to clean up flow, destroy the entire environment so that the next test starts in a healthy state. Name troubleshooting directories with the name of the test class to avoid ambiguity. Also added a log statement so that we know which test is running when looking at the log output from the tests themselves. Finally, found an issue in AbstractComponentNode in which we iterate over the elements in a Map and call setProperty, which can update the underlying Map - updated to first create a copy of the HashMap. Updated that in this Jira because I suspect it is causing one of the tests failures that I've been investigating.
This closes #6059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-19 13:14:30 -05:00
markap14
88e53eae8c
NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. (#6049)
* NIFI-10001: Fixed issue in which some components may fail to update the scheduled state when comparing flows

* NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. When comparing two flows, now allow specifying how to determine a VersionedComponent's ID for comparison. When comparing local flow against flow from registry, use Versioned Component ID. But when comparing two instantiated flows, such as local flow vs. cluster flow, use the VersionedComponent's Instance ID instead. This ensures that we can properly compare two components even if there are several instances of a given flow
2022-05-18 13:53:36 -04:00
exceptionfactory
fe424a2d42
NIFI-9805 Refactored Distributed Cache Servers using Netty
- Added Map and Set Cache Servers based on nifi-event-transport components
- Removed custom servers and unused socket stream components
- Reduced duplication on protocol classes
- Added checks for readable bytes
- Added mark and reset handling for buffer reads

This closes #6040
Signed-off-by: Paul Grey <greyp@apache.org>
2022-05-18 12:40:16 -04:00
tpalfy
2a8d07641e
NIFI-9895 Allow parameters to reference controller services (#5958)
* NIFI-9895 Allow parameter to reference controller service. Check read and write authorization for both previous and newly set controller service. Authorization done for both property or parameter change. Import/export handled by switching between instance id and versioned id.
2022-05-16 17:55:03 -04:00
Matthew Burgess
bd1e033d55 NIFI-9967: Added FlowSerializationStrategy to determine which flow formats (XML,JSON) to save
This closes #6001.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-05-16 16:22:19 -04:00
markap14
8031b62351
NIFI-10001: When enabling a collection of Controller Services, change… (#6042)
* NIFI-10001: When enabling a collection of Controller Services, changed logic. Instead of enabling dependent services and waiting for them to complete enablement before starting a given service, just start the services given. The previous logic was necessary long ago because we couldn't enable a service unless all dependent services were fully enabled. But that changed a while ago. Now, we can enable a service when it's invalid. It'll just keep trying to enable until it becomes valid. At that point, it will complete its transition from ENABLING to ENABLED.

* NIFI-10001: Restored previous implementation for StandardControllerServiceProvider, as the changes were not ultimately what we needed. Changed StandardProcessGroup to use a ConcurrentHashMap for controller services instead of a HashMap with readLock. This was causing a deadlock when we enable a Controller Service that references another service during flow synchronization. Flow Synchronization was happening within a write lock and enabling the service required a read lock on the group. Eventually the thread holding the write lock would timeout and release the write lock. But this caused significant delays on startup. By changing to a ConcurrentHashMap, we alleviate the need for the Read Lock. Also noticed in testing that the StandardNiFiServiceFacade did not save flow changes when enabling dependent services so added call to controllerFacade.save().
2022-05-13 15:09:23 -04:00
Chris Sampson
313d70520d
NIFI-9470 This closes #6027. Allow creation of Parameter Context without any Inherited Parameter Contexts
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-05-13 07:39:11 -07:00
Mark Payne
4a60d1673e
NIFI-10023: Ensure that any files that are archived upon startup properly increment the archival count in the content repo
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6037
2022-05-12 15:38:49 -04:00
Mark Payne
b25201dd22
NIFI-9993: Fixed bug in initialization in which the Content Repo did not properly increment the counter for how many files exist in the archive directories. This was causing the counter to become negative in some cases, which caused processors to incorrectly pause, waiting for content archive cleanup to occur when, in fact, there were no files archived
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6021.
2022-05-09 12:22:00 -04:00
exceptionfactory
0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
exceptionfactory
ea75a0a996 NIFI-9995 Replaced Custom Filters with Spring Security HeaderWriter
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6020.
2022-05-06 12:22:30 -04:00
Matt Gilman
e175b146cd NIFI-9978:
- Updating the condition under which we show the Download Flow menu items.

This closes #6008.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-02 19:40:48 +02:00
exceptionfactory
fc2f539c7d
NIFI-9976 Upgraded json-smart to 2.4.8
- Replaced nifi-framework-bundle managed dependency to root managed dependency

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6005.
2022-04-29 10:12:41 +02:00
exceptionfactory
4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries

This closes #5992

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
exceptionfactory
b288810316
NIFI-9943 Added Transform Provider to nifi-xml-processing
- Refactored TransformerFactory references using StandardTransformerProvider

This closes #5986
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 15:14:54 -04:00
Paul Grey
4450f4ce50
NIFI-9941 - fix handling of ReportingTask stop request
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5985
2022-04-21 14:18:09 -04:00
Mark Payne
5a3c7d1fbd
NIFI-9940: Renamed StandardProcessGroupSynchronizer to StandardVersionedComponentSynchronizer. Added synching for processors, input/output ports, connections, etc. Added unit tests.
This closes #5983
2022-04-21 10:28:21 -04:00
simonbence
285a8cbc3c
NIFI-9776 Adding the possibility to export flow definition with referenced services (#5859)
* NIFI-9776 Adding the possibility to export flow definition with referenced services

* NIFI-9776 Refining naming based on code review
2022-04-20 10:29:38 -04:00
exceptionfactory
18a4182cb0
NIFI-9883 Refactor Property Protection using Isolated ClassLoader (#5972)
* NIFI-9883 Refactored property protection to isolated ClassLoader

- Added nifi-property-protection-loader for abstracting access to implementation classes using ServiceLoader
- Updated Authorizer and Login Identity Provider configuration using isolated ClassLoader
- Updated NiFi Properties Loader using isolated ClassLoader
- Updated nifi-assembly to place property protection dependencies in lib/properties directory
- Updated and refactored unit tests
- Corrected LoginIdentityProviderFactoryBean getObject() Type
2022-04-19 11:08:04 -04:00
Joe Witt
84340962d4
NIFI-9927 Initial Commit to clean up all extraneous version/group declarations.
This closes #5969

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-16 12:05:07 -04:00
exceptionfactory
e76acabe9e
NIFI-9923 Corrected SimpleProcessLogger handling of Throwable causes
- Changed log methods that accept a String and Object array to replace the last Throwable argument with a formatted summary of causes when calling LogRepository.addLogMessage()

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5965.
2022-04-14 12:30:57 -04:00
exceptionfactory
15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services

This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
greyp9
3034f2637a
NIFI-9893 - Ensure orderly cluster node removal on node delete via UI (#5946) 2022-04-13 13:44:28 -04:00
dependabot[bot]
5ec02c3464
Bump moment (#5951)
Bumps [moment](https://github.com/moment/moment) from 2.29.1 to 2.29.2.
- [Release notes](https://github.com/moment/moment/releases)
- [Changelog](https://github.com/moment/moment/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/moment/moment/compare/2.29.1...2.29.2)

---
updated-dependencies:
- dependency-name: moment
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

This closes #5951
2022-04-12 11:45:13 -04:00
exceptionfactory
27e78c6f0c
NIFI-9871 Correct Component Stack Trace Logging (#5945)
- Refactored SimpleProcessLogger to avoid sending stack trace causes to SLF4J Logger
- Refactored SimpleProcessLogger to minimize duplication of component message formatting
- Updated ConnectableTask logging to avoid repeating Throwable class in message string
- Refactored TestSimpleProcessLogger to improve coverage and confirm consistent argument handling
- Corrected handling of exception strings in argument arrays
2022-04-12 11:14:36 -04:00
Mark Payne
0bd5f5f34e
NIFI-9874: Consider Flow Difference Type of PARAMETER_CONTEXT_CHANGED an environmental change
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5939
2022-04-11 19:26:02 -04:00
Mark Payne
c75fa3857e
NIFI-9885: This closes #5938. When creating ContainerState, ensure that we pass the correct value for the archiveEnabled flag.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-11 07:34:22 -07:00
tpalfy
1cf4e72084
NIFI-9875 In StandardProcessGroupSynchronizer.updateConnectionDestinations handle special case when output port is moved to a child process group while kept connected. (#5931) 2022-04-08 10:08:31 -04:00
exceptionfactory
74a4104259
NIFI-9882 Updated HtmlDocumentationWriter to avoid writing null characters
This closes #5935

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-06 14:37:38 -04:00
Bence Simon
9c71d83c5c NIFI-9615 Extending capabilities of NAR provider with restraining, conflict resolution strategy and refactors to make it more flexible 2022-04-06 11:54:31 -04:00