nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
..
nifi-administration NIFI-11735 Refactored Identity Provider Groups Handling (#7419) 2023-06-22 11:07:23 -04:00
nifi-authorizer NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies 2023-06-13 15:36:23 -04:00
nifi-client-dto NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-documentation NIFI-11241 Initial implementation of Python-based Processor API with Py4J 2023-04-14 15:03:34 -05:00
nifi-file-authorizer NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0 2023-06-23 18:27:36 -04:00
nifi-flowfile-repo-serialization NIFI-11895 Removed deprecated Repository Encryption configuration 2023-08-09 07:07:31 -04:00
nifi-framework-authorization NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-framework-authorization-providers NIFI-11492 Allow authorization to proceed based on request groups even if user does not exist 2023-06-22 15:50:23 -05:00
nifi-framework-cluster NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-framework-cluster-protocol NIFI-11165 This closes #6944. Removed optional jigsaw build profiles 2023-02-13 13:01:58 -05:00
nifi-framework-cluster-zookeeper NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779) 2023-03-07 14:14:24 -05:00
nifi-framework-components NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-framework-core NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-framework-core-api NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-framework-kubernetes-bundle NIFI-10976 Added Previous Cluster State Provider configuration (#7235) 2023-05-10 16:22:05 -04:00
nifi-framework-leader-election-shared NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779) 2023-03-07 14:14:24 -05:00
nifi-framework-nar-loading-utils NIFI-11513 Remove deprecated NarProvider and implementations (#7222) 2023-05-16 16:10:25 -04:00
nifi-framework-nar-utils NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed. 2023-05-23 14:29:29 -04:00
nifi-framework-zookeeper-leader-election NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779) 2023-03-07 14:14:24 -05:00
nifi-headless-server NIFI-11488 Removed Deprecated Sensitive Properties Algorithms 2023-04-27 20:16:26 +03:00
nifi-mock-authorizer NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-nar-utils NIFI-11513 Remove deprecated NarProvider and implementations (#7222) 2023-05-16 16:10:25 -04:00
nifi-properties-loader NIFI-11895 Removed deprecated Repository Encryption configuration 2023-08-09 07:07:31 -04:00
nifi-repository-models NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-resources NIFI-11383 Updated Java documentation links from 8 to 17 2023-08-09 09:17:48 -05:00
nifi-runtime NIFI-11491 Removed deprecated PersistentProvenanceRepository 2023-04-28 13:42:36 +03:00
nifi-shell-authorizer NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-site-to-site NIFI-11833 - remove deprecated classes in nifi-commons (#7503) 2023-07-20 11:58:51 -04:00
nifi-standard-prioritizers NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-user-actions NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-web NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
pom.xml NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779) 2023-03-07 14:14:24 -05:00