Commit Graph

1516 Commits

Author SHA1 Message Date
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
2023-09-26 13:01:13 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-09-23 14:02:09 +01:00
Mark Payne 140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 10:47:47 -07:00
Joseph Witt 4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:38:22 -05:00
exceptionfactory 2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 13:54:44 -07:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
Joe Witt 019e16c728
NIFI-12069 removed nifi grpc bundle and build related config. Cleaned up brittle test check for command line text which varies. (#7739) 2023-09-15 18:15:02 -04:00
Joseph Witt bd2276260e
NIFI-12051 Upgraded Groovy from 3.0.19 to 4.0.15
- Adjusted Groovy Maven coordinates to org.apache.groovy
- Adjusted build configuration and tests for Groovy 4

This closes #7692

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:38:24 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:21:17 -07:00
Joseph Witt 4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
Matt Burgess 24736f6276
NIFI-12011 Added MIME Type to ExecuteStreamCommand and ExecuteProcess
This closes #7660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 16:39:41 -05:00
dan-s1 0280497c62
NIFI-11959 Corrected single-line comment handling for Jolt JSON
Added new lines back to the read in JSON spec to allow for single line comments to be parsed correctly and ignored.

This closes #7678

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 17:00:12 -05:00
Timea Barna c30fd9b66d
NIFI-12006 Removed Templates from Framework and UI
This closes #7658

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 14:52:41 -05:00
Matt Burgess 932cfe22a3
NIFI-12010: Handle auto-commit and commit based on driver capabilities in SQL components
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #7663
2023-09-09 11:13:31 +02:00
krisztina-zsihovszki 75cfe21e4c
NIFI-12014 NullPointerException in PutSQL when adding error attributes
This closes #7666.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-05 11:38:14 +02:00
p-kimberley a9ac8fb707
NIFI-11945 Add Cache Entry Identifier property to DeduplicateRecord
This closes #7603

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-30 16:59:05 -05:00
exceptionfactory 5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
mr1716 77ed641ee2
NIFI-12002 Upgraded javax.servlet.jsp-api from 2.3.1 to 2.3.3
This closes #7653

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:00 -05:00
Mark Bean d1b77018b2
NIFI-11934 Allow FlowFile filename to be sent in header for InvokeHTTP
This closes #7639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:21:28 -05:00
mr1716 bf3c9ed4cb
NIFI-11994 Upgraded socketbroker from 1.0.2 to 1.1.0
This closes #7645

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:15:12 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
exceptionfactory 016834efaa NIFI-11976 Removed error log check in TestListenTCPRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7635
2023-08-22 15:16:25 -04:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
exceptionfactory 71abd77727 NIFI-11944 Removed validation warning from ExecuteStreamCommand
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7607
2023-08-14 16:34:49 -04:00
mr1716 b78dc5ca57 NIFI-11942 Update zstd-jni to 1.5.5-5
This closes #7601

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
exceptionfactory 5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
Matt Burgess 63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
This closes #7561

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
mr1716 5a8519ebd1
NIFI-11888 Upgraded Saxon-HE from 12.2 to 12.3
This closes #7553

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 20:31:56 -05:00
exceptionfactory 118ee0d00e
NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7531.
2023-07-31 18:21:48 +02:00
exceptionfactory 3a078c0c31
NIFI-11780 Added Certificate SAN Attributes to HandleHttpRequest
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7521.
2023-07-25 16:09:25 +02:00
exceptionfactory 8d5a6ce8d2
NIFI-11807 Reverted inadvertent changes to HandleHttpRequest
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:08 -05:00
mr1716 0a774f231a
NIFI-11835 Upgraded json-schema-validator from 1.0.84 to 1.0.86
This closes #7505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:45:57 -05:00
Paul Grey 7db956fea7
NIFI-11825 Fixed QueryRecord closing of resources
This closes #7496

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:48:15 -05:00
Matt Burgess f6a14bc475
NIFI-11807 Added ExtractRecordSchema Processor
This closes #7482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:32:59 -05:00
exceptionfactory 16c4004d58 NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7497
2023-07-18 18:29:20 -04:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
mr1716 779eea6453
NIFI-11824 Upgraded JAX-RS API from 2.1 to 2.1.1
This closes #7490

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 10:50:30 -05:00
exceptionfactory e812951c57
NIFI-11810 Removed unused JSTL and EL API libraries
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7479.
2023-07-14 10:30:27 +02:00
Joe Witt d2c70d1d2f
NIFI-11434 added support for optionally allowing zip entries with dat… (#7462)
* NIFI-11434 added support for optionally allowing zip entries with data descriptors
* set default value and ensured all zip tests use various configs
2023-07-12 17:09:03 -04:00
Matt Burgess f69b457757
NIFI-11770: Replace java-faker with Data Faker for GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7454.
2023-07-03 11:33:50 +02:00
Chris Sampson 3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
This closes #6816

Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00