Commit Graph

1529 Commits

Author SHA1 Message Date
Bence Simon 3f13604c36
NIFI-11772 Removed flow.xml.gz support
- Created NIFI-12203 to evaluate issues with flow comparison surfaced in JoinClusterWithDifferentFlow

This closes #7661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 13:53:01 -05:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852)
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
2023-10-10 13:55:22 -04:00
dan-s1 66b68140e2
NIFI-12116 Documented lack of NDJSON support in ValidateJson
This closes #7782

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:12:02 -05:00
Chris Sampson 099ceec7ed
NIFI-12153 Added Allow Comments and Max String Length to JSON Readers
This closes #7823

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 10:43:08 -05:00
exceptionfactory 457973d133
NIFI-12188 Upgraded Commons Net from 3.9.0 to 3.10.0
- Removed ProxyFTPClient extension of standard FTPClient no longer required following changes implemented in NET-650

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7855.
2023-10-09 12:21:23 +02:00
mr1716 a8b56949d7
NIFI-12183 Upgraded zstd-jni from 1.5.5-5 to 1.5.5-6
This closes #7850

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
exceptionfactory da4c6f6e25
NIFI-12163 This closes #7835. Improved Syslog 5424 Line Handling
- Eliminated unused parseEvent method signatures from StrictSyslog5424Parser in favor of a single String line method
- Eliminated intermediate conversion from String to byte array and back to String for Syslog Parser

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:26:06 -07:00
Mark Payne 342fb0d876
NIFI-12143: This closes #7820. Introduced a new nifi-calcite-utils module and refactored the nifi-sql-reporting-tasks to mamke use of it. This uses the newer calcite api instead of deprecated classes/methods
- Refactored QueryRecord / JoinEnrichment to use new nifi-calcite-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 13:28:03 -07:00
Mike Moser e93586df11
NIFI-12038 This closes #7760. introduce PackageFlowFile processor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 08:51:46 -07:00
exceptionfactory c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:56:53 -07:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Arpad Boda dbcc223b40 NIFI-12134 - Disable Directory Listing property is duplicated on PutSFTP processor
Signed-off-by: Bejan Csaba <bejan.csaba@gmail.com>

This closes #7798.
2023-09-27 17:44:24 +02:00
Bryan Bende 1ac833654b NIFI-12127 Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath
This closes #7794

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-27 08:48:11 -04:00
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
2023-09-26 13:01:13 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-09-23 14:02:09 +01:00
Mark Payne 140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 10:47:47 -07:00
Joseph Witt 4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:38:22 -05:00
exceptionfactory 2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 13:54:44 -07:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
Joe Witt 019e16c728
NIFI-12069 removed nifi grpc bundle and build related config. Cleaned up brittle test check for command line text which varies. (#7739) 2023-09-15 18:15:02 -04:00
Joseph Witt bd2276260e
NIFI-12051 Upgraded Groovy from 3.0.19 to 4.0.15
- Adjusted Groovy Maven coordinates to org.apache.groovy
- Adjusted build configuration and tests for Groovy 4

This closes #7692

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:38:24 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:21:17 -07:00
Joseph Witt 4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
Matt Burgess 24736f6276
NIFI-12011 Added MIME Type to ExecuteStreamCommand and ExecuteProcess
This closes #7660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 16:39:41 -05:00
dan-s1 0280497c62
NIFI-11959 Corrected single-line comment handling for Jolt JSON
Added new lines back to the read in JSON spec to allow for single line comments to be parsed correctly and ignored.

This closes #7678

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 17:00:12 -05:00
Timea Barna c30fd9b66d
NIFI-12006 Removed Templates from Framework and UI
This closes #7658

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 14:52:41 -05:00
Matt Burgess 932cfe22a3
NIFI-12010: Handle auto-commit and commit based on driver capabilities in SQL components
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #7663
2023-09-09 11:13:31 +02:00
krisztina-zsihovszki 75cfe21e4c
NIFI-12014 NullPointerException in PutSQL when adding error attributes
This closes #7666.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-05 11:38:14 +02:00
p-kimberley a9ac8fb707
NIFI-11945 Add Cache Entry Identifier property to DeduplicateRecord
This closes #7603

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-30 16:59:05 -05:00
exceptionfactory 5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
mr1716 77ed641ee2
NIFI-12002 Upgraded javax.servlet.jsp-api from 2.3.1 to 2.3.3
This closes #7653

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:00 -05:00
Mark Bean d1b77018b2
NIFI-11934 Allow FlowFile filename to be sent in header for InvokeHTTP
This closes #7639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:21:28 -05:00
mr1716 bf3c9ed4cb
NIFI-11994 Upgraded socketbroker from 1.0.2 to 1.1.0
This closes #7645

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:15:12 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
exceptionfactory 016834efaa NIFI-11976 Removed error log check in TestListenTCPRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7635
2023-08-22 15:16:25 -04:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
exceptionfactory 71abd77727 NIFI-11944 Removed validation warning from ExecuteStreamCommand
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7607
2023-08-14 16:34:49 -04:00
mr1716 b78dc5ca57 NIFI-11942 Update zstd-jni to 1.5.5-5
This closes #7601

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
exceptionfactory 5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
Matt Burgess 63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
This closes #7561

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
mr1716 5a8519ebd1
NIFI-11888 Upgraded Saxon-HE from 12.2 to 12.3
This closes #7553

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 20:31:56 -05:00