Commit Graph

6142 Commits

Author SHA1 Message Date
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
dan-s1 8c045268ba
NIFI-11778 refactored Groovy tests in nifi-elasticsearch-restapi-processors to Java (and JUnit 5)
This closes #7537

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-29 05:56:15 +01:00
Emilio Setiadarma af365414e9
NIFI-11519 Fixed DBCPConnectionPool Sensitive Dynamic Properties
- Added handling for property names marked as sensitive but not having the SENSITIVE prefix for backward compatibility

This closes #7646

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:37:23 -05:00
mr1716 a5ca73b2da
NIFI-12005 Upgraded Apache Ant from 1.10.13 to 1.10.14
This closes #7656

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:16:28 -05:00
mr1716 88a5ac6f0d
NIFI-12003 Upgraded Solr from 9.2.1 to 9.3.0
This closes #7657

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:43 -05:00
mr1716 77ed641ee2
NIFI-12002 Upgraded javax.servlet.jsp-api from 2.3.1 to 2.3.3
This closes #7653

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:00 -05:00
mr1716 5d961eafce
NIFI-12000 Upgraded Hazelcast from 5.3.1 to 5.3.2
This closes #7649

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:13:18 -05:00
mr1716 49dd9ec03f
NIFI-11993 Upgraded Groovy from 3.0.18 to 3.0.19
This closes #7654

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:12:34 -05:00
mr1716 eb6a5a2f47
NIFI-11998 Update spring.data.redis.version to 2.7.15
This closes #7648

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-08-25 23:36:05 +02:00
Mark Bean d1b77018b2
NIFI-11934 Allow FlowFile filename to be sent in header for InvokeHTTP
This closes #7639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:21:28 -05:00
mr1716 bf3c9ed4cb
NIFI-11994 Upgraded socketbroker from 1.0.2 to 1.1.0
This closes #7645

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:15:12 -05:00
Peter Turcsanyi 68983cef42
NIFI-11987: Set read buffer size in PutAzureBlobStorage_v12
Increased the read buffer size in order to avoid OOME due to too many buffer allocations (exceeding vm.max_map_count on Linux).

This closes #7640

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-08-24 15:55:55 +02:00
Nandor Soma Abonyi e9b62f7b83
NIFI-11912 Added Proxy support to StandardOauth2AccessTokenProvider
This closes #7609

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 16:22:42 -05:00
Chris Sampson fb502cdf9a NIFI-11480 add option to group PutElasticsearchRecord errors by Elasticsearch _bulk error type
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7441
2023-08-23 16:00:28 -04:00
Tamas Palfy 1e12800912
NIFI-11978 Fix: NPE when trying to disable Management Controller Service
This closes #7637

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 13:58:58 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
Paul Grey c0c1b386f6 NIFI-11981 - PublishGCPubSub failure / Record-based processing / AVRO
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7638
2023-08-23 14:29:19 -04:00
exceptionfactory 016834efaa NIFI-11976 Removed error log check in TestListenTCPRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7635
2023-08-22 15:16:25 -04:00
dependabot[bot] 680acf89ed
NIFI-11980 Upgraded Apache Ivy from 2.5.1 to 2.5.2
This closes #7633
This closes #7632

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 11:52:48 -05:00
Mark Bean 9432f302c6
NIFI-11877 Added Comments field for Rules in UpdateAttribute
This closes #7541

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 09:49:19 -05:00
Bence Simon 7340bb8153
NIFI-11924 Closing FileSystem after using in HDFSExternalResourceProvider
This closes #7588.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-22 13:18:10 +02:00
Mark Payne baea7ffee9
NIFI-11971: Ensure that when creating a new content claim that we always treat an existing claim length of -1 as 0, to ensure that we never add -1 to our offset
This closes #7631

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 12:07:16 -05:00
Freedom9339 52cc831a2a
NIFI-11303 Added a go-to entry on the right click context menu for th… (#7461)
* NIFI-11303 Added a go-to entry on the right click context menu for the provenance lineage tree to take you to the specified component in the graph

* nifi-11303 Removed unused variable.

Merged #7461 into main.
2023-08-21 09:23:38 -07:00
Emilio Setiadarma 5d90c9c14b
NIFI-9164 Refactored tests in nifi-windows-event-log to JUnit 5
- Used LauncherInterceptor to handle custom class loading

This closes #7623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:12:29 -05:00
mr1716 96ae5252f5
NIFI-11970 Upgraded gRPC from 1.57.1 to 1.57.2
This closes #7628

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:04:11 -05:00
mr1716 83cba2c5ad
NIFI-11969 Upgraded excel-streaming-reader from 4.1.0 to 4.1.1
This closes #7627

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:03:37 -05:00
mr1716 e83fc230ac
NIFI-11968 Upgraded zstd-jni to 1.5.5-5 for compress-processors
This closes #7626

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:02:00 -05:00
Mark Payne 5e2a10c328
NIFI-11971: Ensure that if we do not write any bytes to a file after calling ProcessSession.write() that we set content claim's length to 0 when closing OutputStream; otherwise it remains -1, which causes issues, since the length will later be added to the offset to determine the position in the ste stream
This closes #7629

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 07:56:57 -05:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
mr1716 a9f29f209e NIFI-11928 Update gremlin.version to 3.7.0
This closes #7592

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-18 09:04:10 -04:00
Ferenc Kis 3aa02a022e
NIFI-11514 Flow JSON support and deprecating YAML format. Revised parameter generation. Generic refactors.
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #7344
2023-08-18 11:33:23 +02:00
mr1716 0d119f6f39
NIFI-11955 Upgraded maven-clean-plugin from 3.2.0 to 3.3.1
This closes #7616

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:05:01 -05:00
mr1716 46cdcf9dac
NIFI-11954 Upgraded license-maven-plugin from 2.0.0 to 2.2.0
This closes #7614

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:04:26 -05:00
mr1716 70c756ff78
NIFI-11953 Upgraded download-maven-plugin from 1.6.8 to 1.7.1
This closes #7613

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:03:41 -05:00
exceptionfactory 71abd77727 NIFI-11944 Removed validation warning from ExecuteStreamCommand
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7607
2023-08-14 16:34:49 -04:00
mr1716 b55b712b38
NIFI-11949 Upgraded Spring Integration from 5.5.15 to 5.5.18
This closes #7605

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-14 12:20:58 -05:00
mr1716 12f736a6b0 NIFI-11943 Update activemq-client and broker to 5.18.2
This closes #7602

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 21:51:30 -04:00
mr1716 b78dc5ca57 NIFI-11942 Update zstd-jni to 1.5.5-5
This closes #7601

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
mr1716 c0156e3429 NIFI-11936 Update msal4j.version to 1.13.10
This closes #7599

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:48:41 -04:00
mr1716 99a590ec0c NIFI-11935 Update Redis spring.data.redis.version to 2.7.14
This closes #7598

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:47:33 -04:00
mr1716 0c03521676 NIFI-11933 Update spring.integration.version For Email Bundle To 5.5.18
This closes #7597

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:46:06 -04:00
mr1716 53f64badbf NIFI-11931 Update iotdb.sdk.version to 1.1.2
This closes #7595

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:43:55 -04:00
mr1716 c878310e36 NIFI-11930 Update aws-kinesis-client-library-version to 1.15.0
This closes #7594

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:42:14 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Peter Turcsanyi 2e6eaaeb38
NIFI-11926: Added proxy handling in Azure Storage Credentials Services
Added Proxy Configuration Service property in AzureStorageCredentialsControllerService_v12 and ADLSCredentialsControllerService used by Service Principal and Managed Identity authentication modes.

This closes #7590

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:46:31 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
mr1716 0643e1db96
NIFI-11925 Upgraded smbj from 0.12.1 to 0.12.2
This closes #7589

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 14:46:17 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
exceptionfactory 84326ba4b2 NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7586
2023-08-09 13:00:55 -04:00
Mike Thomsen cba6b00271
NIFI-11383 Updated Java documentation links from 8 to 17
This closes #7581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 09:17:48 -05:00