Commit Graph

2420 Commits

Author SHA1 Message Date
exceptionfactory bdff3abcd6
NIFI-11461 Improve User and Group Tenants Search (#7181)
* NIFI-11461 Improved User and Group Tenants Search

- Added searchTenants method to NiFiServiceFacade and removed unnecessary object creation
- Updated TenantsResource to use delegated NiFiServiceFacade.searchTenants method
- Changed autocomplete delay from default 300 ms to 500 ms

* NIFI-11461 Adjusted implementation to use EntityFactory.createTenantEntity

This closes #7181
2023-04-19 09:58:25 -04:00
Mark Payne 7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Bryan Bende ba93f60731
NIFI-11436 Fix NPE during updateFlow when called from a replace request for a PG that is not under version control (#7167) 2023-04-12 19:24:22 -04:00
Pierre Villard b0997f843d
NIFI-11416 Upgraded Caffeine from 2.8.1 to 3.1.6
This closes #7147

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:12 -05:00
Pierre Villard 4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
exceptionfactory e4f0508c90
NIFI-11370 Corrected JWK Set retrieval for NIFI Trust Strategy (#7108)
- Added StandardOidcIdTokenDecoderFactory based on Spring Security OidcIdTokenDecoderFactory with custom REST Operations

Merged #7108 into main.
2023-03-31 16:26:02 -07:00
Matthew Burgess 59eebb9906
NIFI-8710: Pass details instead of source ID for Provenance per the interface doc
This closes #5224

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-31 18:43:22 +02:00
exceptionfactory 75eb449a31
NIFI-11365 Corrected OIDC Redirect URI resolution for reverse proxies (#7104)
- Added Authorization Request Resolver with support for building the base redirect URI using allowed proxy headers

This closes #7104
2023-03-30 16:26:35 -04:00
Mark Payne 23d6d6ede4
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:30:18 -05:00
exceptionfactory 26400fcbe9
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 08:35:10 -04:00
Mark Payne 94ae926c42
NIFI-11333: Do not allow components to be removed while a node is disconnected
This closes #7085

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 17:43:38 -05:00
Mark Payne 969fc50778
NIFI-11341 Fixed OutputStream.close() handling for Content Claims
Fixed issue in StandardContentClaimWriteCache in which inner OutputStream class did not have an idempotent close() method; as a result, the stream could be written to while already in use for another active FlowFile; fixed bug in ContentClaimInputStream in which skip() method ignored its own BufferedInputStream - this was discovered because it was causing failures in StandardProcessSessionIT; fixed bug in StandardProcessSessionIT in which the length of StandardContentClaim was being doubled because the OutputStream was setting the claim length but that is already handled at a lower level.

This closes #7087

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:05:50 -05:00
Christian Wahl 6bd893da16
NIFI-11232 Fixed buffer handling in ContentClaimInputStream
This closes #6996

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:02:27 -05:00
Bryan Bende 5386095083
NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService
This closes #7079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 14:29:17 -05:00
Mark Payne 016d58612c
NIFI-11290 Run Component Primary Node State changes in background thread
- Ensure that components are notified that primary node has changed in a background thread instead of the Leader Election thread and activate/deactivate the thread in the case of Processors so that they can be viewed in the UI and terminated

- Fixed system tests that would fail intermittently because they did not wait for node disconnection to complete and did not properly switch the client to look at the connected node before checking cluster status

This closes #7052

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:20:37 -05:00
Joe Gresock 9de93f19a4
NIFI-11330: Restarting service referenced by parameter only when service is active (#7078) 2023-03-23 13:13:22 -04:00
exceptionfactory 8154fcce49
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:15 +01:00
Mark Payne 6adfb6131d
NIFI-11310: Provide appropriate classpath resources to the ReloadComponent when a processor is terminated
NIFI-11310: Fixed META-INF/services file that was mistakenly listing an extra extension point, due to rebase
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7061
2023-03-21 14:29:44 -04:00
simonbence 7954ff355c
NIFI-11213 Showing version change in older (pre 1.18.0) contained version flows properly (#7017) 2023-03-20 11:52:07 -04:00
Mark Payne 450a46bc58
NIFI-11289: Avoid obtaining read locks on queues when fetching Group Status, except in those few specific situations where it's needed.
This closes #7046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 14:18:22 -05:00
Matt Burgess 668d309c7e
NIFI-11279: Allow event stream processing to continue in CaptureChangeMySQL after sync issue (#7039) 2023-03-14 16:23:43 -04:00
exceptionfactory ccea9760f9
NIFI-11194 Remove gzip CSS and JS from nifi-web-ui (#6968)
* NIFI-11194 Removed gzip CSS and JS from nifi-web-ui

* NIFI-11194 Updated comment for static content aggregation

This closes #6968
2023-03-08 12:06:45 -05:00
exceptionfactory 512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
exceptionfactory d3908dede8
NIFI-11253 Removed H2 1.4 database migration modules
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7014
2023-03-07 10:35:21 -05:00
Joe Gresock 5cf909ccf6
NIFI-11247: Using parameterContextName instead of group name when fetching parameters (#7011)
Merged #7011.
2023-03-06 10:48:41 -08:00
Joe Gresock 5e3b93b2d6
NIFI-11238: Creating missing parameter providers when importing inherited provided contexts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7002.
2023-03-03 22:11:45 +01:00
exceptionfactory 44c70277ea
NIFI-11245 Corrected reducing Maximum Thread Count while running (#7005)
- Corrected implementation to allow reducing Maximum Thread Count below the default of 10
2023-03-03 11:35:34 -05:00
Mark Bean b08ae75be4
NIFI-11134 Added Label auditing to Flow Configuration History
This closes #6949

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-27 12:55:43 -06:00
exceptionfactory 48689a2567
NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-02-23 10:33:45 -05:00
Mark Payne 87e61c50ee
NIFI-11192: Ensure that if ports moved between parent/child group in between flow versions that we can properly handle that. Added system tests to verify.
NIFI-11192: If a failure is encountered when changing the version of a flow from 1 version to another, attempt to rollback the changes instead of just failing with the flow in a bad state
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6981
2023-02-22 15:38:00 -05:00
exceptionfactory 284804ac42
NIFI-11188 Removed ProcessContext encrypt and decrypt methods
- Removed unnecessary references to PropertyEncryptor from multiple framework components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6962.
2023-02-16 12:16:15 -05:00
Mark Payne fed175d46f NIFI-11189: When synchronizing a ProcessGroup to match a VersionedProcessGroup, do not remove the temporary funnel until the very end. This is important if the temporary funnel already exists in the flow on startup
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6963
2023-02-16 14:18:50 +01:00
Mark Payne 471cccbbda
NIFI-11176: This closes #6948. When comparing a VersionedConnection with an existing connection, we examined the source component's VersionedComponentId. But the existing component may not have a VersionedComponentId. We should only be comparing these if they are populated
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 18:52:15 -05:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Bence Simon b0ec28a452 NIFI-11159 Fixing connections with source having reassigned id 2023-02-10 11:12:51 -05:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
dan-s1 99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
Joe Witt 4f91420cc1
NIFI-11139 Updated multiple Maven Plugins
This closes #6925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 16:07:02 -06:00
Mark Payne 28b9f6fc02
NIFI-11118: This closes #6909. When changing version of a versioned flow, ensure that we properly set the Version Control Information's StorageLocation for the NiFi Registry client in order to maintain backward compatibility
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:02:38 -07:00
Joe Gresock 2609fd5f55
NIFI-11122 Corrected provided parameter context inheritance after creation
This closes #6913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-02 13:20:35 -06:00
Joe Gresock afdf49b3cd
NIFI-11100: Limiting scope of external controller services during version sync to services outside the versioning context (#6898) 2023-02-01 12:14:38 -05:00
simonbence ae66ebdc22
NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes (#6870)
* NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes
2023-01-31 10:58:42 -05:00
Mark Payne d9f35b8974
NIFI-11105: This closes #6895. When mapping Parameter Context to VersionedParameterContext, don't bother mapping those that have already been mapped, as it is redundant
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-26 15:35:18 -07:00
exceptionfactory d60f541d7e
NIFI-11098 Deprecated ProcessContext encrypt and decrypt methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6891.
2023-01-26 18:18:09 +01:00
Priyanka Awatramani b3f2d95092
NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes
- Updated TestAttributesToCSV with LinkedHashMap for deterministic test behavior
- Updated TestHttpFlowFileServerProtocol with adjusted checksums to match expectations from LinkedHashMap changes

This closes #6748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 16:19:20 -06:00
Joe Gresock 7d99521d4c
NIFI-11089: Resolving previously resolved parameter providers when possible on version sync (#6886) 2023-01-25 13:42:52 -05:00
Paul Grey 567e95aa28
NIFI-11047 - Issue when upgrading version of dataflow with external service
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6849
2023-01-25 12:52:52 -05:00
Mark Payne 228a3441b5
NIFI-11001: This closes #6836. When new components are added, track a mapping of its Versioned Compoenent ID to the component itself. Then, use this when creating connections. This is important because if a Process Group has multiple components with the same Versioned Component ID across multiple child groups, the Versioned Component ID may be changed upon adding the component. Maintaining this mapping allows us to still create the connection correctly.
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:55:16 -07:00
exceptionfactory 84f48b5e8c
NIFI-11090 This closes #6883. Removed unused Jasypt test dependency
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-24 08:42:33 -07:00
Bence Simon 0ab1fbccc8
NIFI-10934 Added uniqueness check for Registry Client creation
This closes #6750

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Chris Sampson <12159006+ChrisSamo632@users.noreply.github.com>
2023-01-23 14:57:17 -06:00
Joe Gresock bf871e0b8d
NIFI-11032: Addressing NPE when retrieving registry client info with unauthorized user (#6879) 2023-01-23 15:51:25 -05:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Joe Gresock 8640989ad7
NIFI-11039: Fixing bug when importing parameter providers from nifi-registry (#6868)
* NIFI-11039: Fixing NPE in registry retrieval
* NIFI-11039: Fixing bug when importing parameter providers from nifi registry
2023-01-23 11:59:34 -05:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Joe Gresock 29618ae5c6
NIFI-11076: Resolving deadlock issue in StandardParameterContext (#6865)
* NIFI-11076: Resolving deadlock issue in StandardParameterContext

* NIFI-11076: Resolving deadlock issue in StandardParameterContext
2023-01-23 10:54:38 -05:00
Timea Barna a9274c12c5
NIFI-11079 Extend QueryNifiReportingTask and ProcessGroup Summary Table
Correcting EmbeddedQuestDbStatusHistoryRepositoryForComponentsTest

Correcting TestQueryNiFiReportingTask

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6869
2023-01-20 15:22:20 -05:00
krisztina-zsihovszki 9ad1d8a7ae
NIFI-11028 Handle controller service 'Scheduled State' change (#6831) 2023-01-17 18:40:47 -05:00
Matthew Burgess 6adbc1aeb0
NIFI-11036: Add Cluster Summary Metrics to Prometheus endpoint
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6834.
2023-01-17 14:44:33 +01:00
Nissim Shiman 692e74e90d
NIFI-10241 Add comments tooltip for controller services, reporting tasks
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6768
2023-01-11 14:29:14 -05:00
Mark Payne d5c79fdcd1
NIFI-10887: Addressed performance concerned. Use String.indexOf() instead of Pattern.matcher() when using Literal Replace. Use a NonFlushableOutputStream when ProcessSession.write() is called. Implemented hashCode() on AbstractConnection. Updated default Run Schedule on ReplaceText from 0 ms to 25 ms. Added a Surround Replacement strategy that allows both prepending and appending text. Updated unit tests to account for this.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6724
2023-01-11 12:28:59 -05:00
exceptionfactory 0c0f7e87be
NIFI-11004 Added documentation for OIDC groups claim property
This closes #6802
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-10 17:20:23 -05:00
Nissim Shiman fe25424233
NIFI-10772 Clarify logs on shutdown where controller service and/or
processor were unable to properly start

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6829
2023-01-10 13:56:00 -05:00
exceptionfactory 0d9dc6c540
NIFI-9167 Converted remaining nifi-framework tests to JUnit 5
NIFI-9167 Addressed feedback and improved tests using TempDir

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6823
2023-01-10 13:53:51 -05:00
Paul Grey e97977d61f
NIFI-10997 Ensure auditing of process group / controller service operations
This closes #6800

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 13:25:04 -06:00
nathluu ea93dec079
NIFI-10481 Support disabling ZooKeeper Ensemble Tracking
This closes #6400

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 10:42:01 -06:00
greyp9 b69721cac9
NIFI-10980 - correct ordering of property descriptor allowable values (#6781)
NIFI-10980 - correct ordering of property descriptor allowable values
2023-01-05 14:11:03 -05:00
dan-s1 06c8225bbd [NIFI-11006] Upgraded from Junit4 to Junit5
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6813
2023-01-04 16:07:20 +00:00
Nissim Shiman d229f3fd11
NIFI-10608 Process Group copies include non-processor referenced
controller services

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6685
2023-01-03 12:09:01 -05:00
dan-s1 481cdaf3db
NIFI-11018 Upgraded nifi-web-security to JUnit 5
This closes #6814

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-02 12:16:37 -06:00
dan-s1 b74c5b423f
NIFI-10979 Additional nifi-framework upgrades from JUnit 4 to 5
This closes #6806

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:18:38 -06:00
exceptionfactory b556322749
NIFI-11005 Added Illegal and Redundant Import Modules to Checkstyle
- Updated impacted classes to remove redundant import lines
- Removed WebUtilsGroovyTest.groovy class due to use of internal sun.security classes

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6804.
2022-12-23 18:34:38 +01:00
Bryan Bende 5c3ca9d537
NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs,… (#6785)
- NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs, and ensure the auto-loader attempts to process any NARs available before starting to watch for new files
- Add system test with NAR Provider that copies NARs from a local directory and verifies the NARs were loaded and linked correctly
- Exclude new assembly from CI test-compile
2022-12-16 11:30:37 -05:00
Mark Payne 78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6725
2022-12-14 12:09:32 -05:00
dan-s1 e21f622643
NIFI-10877 Converted more nifi-framework-core tests from JUnit 4 to 5
This closes #6775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-13 11:37:59 -06:00
Bryan Bende 334c9db9c3
NIFI-10915 Add additionalDetails content to runtime manifest
- Update manifests assembly to include the additionaDetails.html files
- Update C2 ExtensionDefinition to add a new field for additional details content
- Update manifest generation to read the additional details and pass through to C2 runtime manifest
- Switch to boolean to indicate presence of additional details, instead of including content

Add additionalDetails files to nifi-runtime-manifest artifact, organized by group/artifact/version/type

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6767
2022-12-08 11:02:56 -05:00
exceptionfactory 45a31c7286 NIFI-10899 Added SameSite Policy to Application Cookies
- Added __Secure prefix to Application Cookie Names

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6735.
2022-12-05 14:09:39 -05:00
Paul Grey 3dc48f0894 NIFI-10916 - Controller Service allowable values dropdown list should be sorted
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6739.
2022-12-05 11:44:07 -05:00
exceptionfactory 87c583042e
NIFI-10941 Removed TestNG references
- Replaced TestNG assertions with JUnit 5
- Excluded testng transitive dependencies from groovy-all
- Added testng exclusion to Maven Enforcer configuration

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6753.
2022-12-05 13:11:59 +01:00
Mark Payne e1c8c96111 NIFI-10937, NIFI-10938, NIFI-10939: When restoring flow from XML, properly parse XML for registry clients, looking for 'id' tag instead of 'identifier' tag. Fixed typo in error message about Reporting Task for Registry Clients. Updated StandardFlowComparator so that we compare sub-process groups' contents only if the Flow Coordinates are different by more than their version
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6752.
2022-12-02 18:37:47 -05:00
Mark Payne 2473683ce5 NIFI-10918: When fetching a flow from a Flow Registry, if it references any 'internal versioned flows' instead of requiring that we have a client configured for the appropriate URL, attempt to fetch the flow from each client. We will start with the clients that do report that they can handle the URL but will try others as well. As soon as we successfully fetch the flow, we stop.
NIFI-10918: Fixed checkstyle violations

This closes #6736
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-12-02 14:24:40 +01:00
simonbence 570fc7f1fa
NIFI-10914 Adjusting input check for loading nested versioned flows (#6741) 2022-12-01 11:09:51 -05:00
exceptionfactory de296b5e65 NIFI-10897 Replaced Spring Security Base64 with java.util.Base64
This closes #6728

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-29 12:20:16 -05:00
exceptionfactory d55fb91b0f NIFI-10871 Skipped CSRF processing for replicated HTTP requests
- Updated Security Filter Configuration to avoid unnecessary CSRF Request Token generation for requests replicated between cluster nodes

This closes #6715.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-29 17:19:18 +01:00
dan-s1 e8d554d9b4
NIFI-10876 Converted some nifi-framework tests from JUnit 4 to JUnit 5
This closes #6720

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 14:47:17 -06:00
Bence Simon df21478297
NIFI-10874 Fixed issue with multiple levels of versioned flows
This closes #6719

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 10:44:12 -06:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
Shane Ardell aa6f6dd61d
NIFI-10814: Display description for selected flow (#6693)
* display description for selected flow

* NIFI-10814: add border when content overflows and increase height

* NIFI-10814: add padding to description

* NIFI-10814: remove duplicate CSS property from declaration block

* NIFI-10814: a few more CSS tweaks

This closes #6693
2022-11-22 17:01:38 -05:00
Paul Grey 620b7365c2
NIFI-10851 Corrected removal of Controller Service references on property updates
- Convert unit test to JUnit 5

This closes #6695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:45:54 -06:00
aksharau a861bab34d
NIFI-9920 Fetching all bulletins of a process group on update process group (#6335) 2022-11-21 11:24:47 -05:00
Bence Simon 4fe65f1b81
NIFI-10828 Adding new REST API endpoint for exposing versioned flow details
NIFI-10828 Fixing documentation

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6674
2022-11-20 17:05:50 -05:00
krisztina-zsihovszki dfdd86cff7 NIFI-10793 Comment is not populated when process group is created via API
This closes #6653.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-17 16:04:46 +01:00
sedadgn 009d641576 NIFI-10787 - Cannot commit flows to nifi registry after updating our nifi release to 1.18.0
NifiRegistryFlowRegistryClient defines the PropertyDescriptor PROPERTY_URL  name as small case "url". The map bases on the name property of the PropertyDescriptor object. Here searching with uppercase value of "URL" causes the map lookup to fail and cause a NPE later on. Therefore, it is changed as "url"

NIFI-10787 - Added constant for property descriptor "url" in NiFiRegistryFlowMapper to make it more clear.

NIFI-10787 - Added change to unit test.

NIFI-10787 - Updated unit test to validate that NiFi registry url is being set and retrieved.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6655.
2022-11-16 19:07:15 -05:00
Nathan Gough 1b8cd8349b
NIFI-10703 - Updated VersionedDataflow to support MaxEventDrivenThreadCount
NIFI-10703 - Also setting the maxEventDrivenThreadCount on the controller when using a versioned flow.
NIFI-10703 - Corrected to use getMaxEventDrivenThreadCount(), set a default value for event driven thread count in VersionedDataflow
NIFI-10703 - Updated log message for setMaxThreadCount in FlowController.java
NIFI-10703 - Updated default value for maxEventDrivenThreadCount
NIFI-10703 - Set private for DEFAULT_MAX_EVENT_DRIVEN_THREAD_COUNT

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6638
2022-11-15 21:08:48 -05:00
Mark Payne bda624823b
NIFI-10817: Moved the calls in StandardProcessSession to 'resetState()' and 'acknowledgeRecords()' from the outer commit(boolean) to the inner commit(Checkpoint, boolean). By moving the call here, the logic of StandardProcessSession is unaffected. But the StatelessProcessSession that inherits from it now has the benefit of having the state cleaned up when calling super.commit(Checkpoint, boolean).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6663
2022-11-15 15:47:32 -05:00
Paul Grey 25b6e2c9cd
NIFI-10815 Fixed initial internal yield duration when processor created
This closes #6664

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:14:50 -06:00
Bryan Bende 7de74ad3f0
NIFI-10802 Apply bundle updates before properties in component synchronizer (#6654)
This closes #6654
2022-11-14 09:09:44 -05:00
Bryan Bende 9c21e26e63
NIFI-10788 Ensure proposed service config is applied when component synchronizer adds a new service (#6640)
This closes #6640
2022-11-09 15:04:19 -05:00
Bryan Bende 83d4e5bd04
NIFI-10771 Add SINGLE_BATCH_PER_NODE to allowable values for flow file concurrency in ProcessGroupDTO
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6627
2022-11-07 13:58:49 -05:00
Joe Gresock c6dde491ec
NIFI-10770: Removing fetch parameters on startup
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6626
2022-11-07 13:46:01 -05:00