Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
nifi/nifi-nar-bundles
History
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow 
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 		2023-08-09 12:08:22 -05:00
..
nifi-accumulo-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-airtable-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-amqp-bundle NIFI-11801 Upgraded RabbitMQ AMQP Client from 5.17.0 to 5.18.0 2023-07-13 16:30:08 -05:00
nifi-asana-bundle NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies 2023-06-13 15:36:23 -04:00
nifi-asn1-bundle NIFI-11885 Upgraded asn1bean from 1.13.0 to 1.14.0 2023-07-31 19:57:48 -05:00
nifi-atlas-bundle NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1 2023-06-20 16:22:00 -04:00
nifi-avro-bundle NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0 2023-03-23 12:28:40 -05:00
nifi-aws-bundle NIFI-11910: Clarified some points in docs 2023-08-08 08:10:49 +01:00
nifi-azure-bundle NIFI-11910: Clarified some points in docs 2023-08-08 08:10:49 +01:00
nifi-beats-bundle NIFI-11603 Refactored Socket-based tests to use Dynamic Ports 2023-06-01 13:33:06 -05:00
nifi-box-bundle NIFI-11843 Upgraded Box SDK from 4.1.0 to 4.2.0 2023-07-21 17:21:46 -05:00
nifi-cassandra-bundle NIFI-11868 Upgraded Cassandra Driver from 3.11.3 to 3.11.4 2023-07-31 19:45:39 -05:00
nifi-cdc NIFI-11855 Upgraded mysql-binlog-connector-java from 0.28.0 to 0.28.1 2023-07-25 09:50:40 -05:00
nifi-cipher-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-compress-bundle NIFI-11910: Clarified some points in docs 2023-08-08 08:10:49 +01:00
nifi-confluent-platform-bundle NIFI-11828 - Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID (#7495) 2023-07-25 09:42:50 -04:00
nifi-couchbase-bundle NIFI-11355 Upgraded Couchbase Client from 2.5.8 to 2.7.23 2023-03-28 22:05:55 +02:00
nifi-cybersecurity-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-datadog-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-dropbox-bundle NIFI-10803 - Upgrade Dropbox SDK to 5.4.4 2023-02-21 11:09:29 +01:00
nifi-easyrules-bundle NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3 2023-05-16 15:48:57 -05:00
nifi-elasticsearch-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-email-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-enrich-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-evtx-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-extension-utils NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation 2023-08-09 13:00:55 -04:00
nifi-flow-registry-client-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-framework-bundle NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-gcp-bundle NIFI-11910: Clarified some points in docs 2023-08-08 08:10:49 +01:00
nifi-geohash-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-graph-bundle NIFI-11867 Upgraded Neo4j Driver from 4.4.11 to 4.4.12 2023-07-31 19:42:27 -05:00
nifi-groovyx-bundle NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1 2023-07-18 18:29:20 -04:00
nifi-grpc-bundle NIFI-11918 Used java.security.cert in ListenGRPC 2023-08-08 10:04:52 -05:00
nifi-hadoop-bundle NIFI-11902: Fix ListHDFS closes FileSystem in first run 2023-08-03 16:02:42 +02:00
nifi-hadoop-libraries-bundle NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1 2023-06-20 16:22:00 -04:00
nifi-hashicorp-vault-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-hazelcast-bundle NIFI-11687 Upgraded Hazelcast from 5.3.0 to 5.3.1 2023-06-14 14:28:45 -05:00
nifi-hbase-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-hive-bundle NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0 2023-07-31 18:21:48 +02:00
nifi-hl7-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-html-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-hubspot-bundle NIFI-11190: Added provenance events to GetHubSpot and GetShopify 2023-02-20 22:13:29 +01:00
nifi-iceberg-bundle NIFI-11916 Iceberg processor extensibility improvement 2023-08-08 22:31:52 +02:00
nifi-influxdb-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-iotdb-bundle NIFI-11635 Upgraded IoTDB from 1.0.1 to 1.1.1 2023-06-15 13:39:11 +02:00
nifi-jetty-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-jms-bundle NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation 2023-08-09 13:00:55 -04:00
nifi-jolt-record-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-jslt-bundle NIFI-11830 Added Transformation Strategy property to JSLTTransformJSON 2023-07-24 15:04:17 -05:00
nifi-kafka-bundle NIFI-11840 Add Kafka Partition and Topic Attributes before handoff to RecordReader 2023-07-24 13:40:22 -05:00
nifi-kerberos-iaa-providers-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-kudu-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-language-translation-bundle NIFI-11165 This closes #6944. Removed optional jigsaw build profiles 2023-02-13 13:01:58 -05:00
nifi-ldap-iaa-providers-bundle NIFI-11730 Upgraded UnboundID LDAP SDK from 6.0.8 to 6.0.9 2023-06-20 17:12:05 -05:00
nifi-media-bundle NIFI-11900 Catch RuntimeException in ResizeImage failures 2023-08-02 14:02:56 -05:00
nifi-metrics-reporting-bundle NIFI-11405 Upgraded multiple drivers and test dependencies 2023-04-07 15:54:51 -05:00
nifi-mongodb-bundle NIFI-11383 Updated Java documentation links from 8 to 17 2023-08-09 09:17:48 -05:00
nifi-mqtt-bundle NIFI-11501 Upgraded Hive MQTT client from 1.3.0 to 1.3.1 2023-04-28 15:14:19 -05:00
nifi-network-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-parquet-bundle NIFI-11724 Upgraded parquet-avro from 1.13.0 to 1.13.1 2023-06-19 16:04:15 -05:00
nifi-pgp-bundle NIFI-11425 Removed Compression from EncryptContentPGP and SignContentPGP 2023-04-19 15:27:54 +03:00
nifi-poi-bundle NIFI-11804 Upgraded excel-streaming-reader from 4.0.5 to 4.1.0 2023-07-13 16:32:48 -05:00
nifi-prometheus-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-provenance-repository-bundle NIFI-11895 Removed deprecated Repository Encryption configuration 2023-08-09 07:07:31 -04:00
nifi-py4j-bundle NIFI-11793 Added Python debugging properties and documentation 2023-07-24 13:23:19 -05:00
nifi-ranger-bundle NIFI-11762 Upgraded Hadoop dependencies from 3.3.5 to 3.3.6 2023-06-28 19:35:38 +02:00
nifi-redis-bundle NIFI-8128 Added Sentinel Password to Redis Service 2023-07-15 19:53:24 -05:00
nifi-registry-bundle NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0 2023-03-23 12:28:40 -05:00
nifi-riemann-bundle NIFI-11760 Upgraded Riemann Client from 0.4.1 to 0.5.3 2023-06-28 09:55:45 +02:00
nifi-rules-action-handler-bundle NIFI-11866 Upgraded mvel2 from 2.4.15 to 2.5.0 2023-07-31 19:37:13 -05:00
nifi-salesforce-bundle NIFI-11224: Refactor and FF attribute support in WHERE in QuerySalesforceObject. 2023-04-26 14:27:40 +02:00
nifi-scripting-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-shopify-bundle NIFI-11190: Added provenance events to GetHubSpot and GetShopify 2023-02-20 22:13:29 +01:00
nifi-single-user-iaa-providers-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-site-to-site-reporting-bundle NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0 2023-03-23 12:28:40 -05:00
nifi-slack-bundle NIFI-11824 Upgraded JAX-RS API from 2.1 to 2.1.1 2023-07-18 10:50:30 -05:00
nifi-smb-bundle NIFI-11798 Update smbj to 0.12.1 2023-07-14 20:30:51 +02:00
nifi-snmp-bundle NIFI-11603 Refactored Socket-based tests to use Dynamic Ports 2023-06-01 13:33:06 -05:00
nifi-snowflake-bundle NIFI-11905 Update snowflake-jdbc to 3.14.0 2023-08-03 17:33:59 +02:00
nifi-social-media-bundle NIFI-11185 Removed GetTwitter Processor 2023-02-21 09:21:12 -05:00
nifi-solr-bundle NIFI-11725 Upgraded Woodstox from 6.5.0 to 6.5.1 2023-06-19 16:05:01 -05:00
nifi-spark-bundle NIFI-11659 Removed unnecessary Jackson 1 dependencies 2023-06-07 15:04:43 -05:00
nifi-splunk-bundle NIFI-11603 Refactored Socket-based tests to use Dynamic Ports 2023-06-01 13:33:06 -05:00
nifi-spring-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-sql-reporting-bundle NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0 2023-07-31 18:21:48 +02:00
nifi-standard-bundle NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-standard-services NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation 2023-08-09 13:00:55 -04:00
nifi-stateful-analysis-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-stateless-processor-bundle NIFI-11556: Added ability to use a Process Group as a Stateless Flow 2023-08-09 12:08:22 -05:00
nifi-tcp-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-update-attribute-bundle NIFI-11813 Removed Event Driven Scheduling Strategy 2023-07-18 12:22:52 -05:00
nifi-websocket-bundle NIFI-11603 Refactored Socket-based tests to use Dynamic Ports 2023-06-01 13:33:06 -05:00
nifi-windows-event-log-bundle NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies 2023-06-13 15:36:23 -04:00
nifi-workday-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
nifi-zendesk-bundle NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
pom.xml NIFI-11758: Added FileResourceService and used it in PutAzure*Storage processors for local file upload 2023-07-14 23:48:27 +02:00