Commit Graph

1618 Commits

Author SHA1 Message Date
Arpad Boda dbcc223b40 NIFI-12134 - Disable Directory Listing property is duplicated on PutSFTP processor
Signed-off-by: Bejan Csaba <bejan.csaba@gmail.com>

This closes #7798.
2023-09-27 17:44:24 +02:00
Bryan Bende 1ac833654b NIFI-12127 Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath
This closes #7794

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-27 08:48:11 -04:00
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
2023-09-26 13:01:13 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-09-23 14:02:09 +01:00
Mark Payne 140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 10:47:47 -07:00
Joseph Witt 4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:38:22 -05:00
exceptionfactory 2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 13:54:44 -07:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
Joe Witt 019e16c728
NIFI-12069 removed nifi grpc bundle and build related config. Cleaned up brittle test check for command line text which varies. (#7739) 2023-09-15 18:15:02 -04:00
Joseph Witt bd2276260e
NIFI-12051 Upgraded Groovy from 3.0.19 to 4.0.15
- Adjusted Groovy Maven coordinates to org.apache.groovy
- Adjusted build configuration and tests for Groovy 4

This closes #7692

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:38:24 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:21:17 -07:00
Joseph Witt 4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
Matt Burgess 24736f6276
NIFI-12011 Added MIME Type to ExecuteStreamCommand and ExecuteProcess
This closes #7660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 16:39:41 -05:00
dan-s1 0280497c62
NIFI-11959 Corrected single-line comment handling for Jolt JSON
Added new lines back to the read in JSON spec to allow for single line comments to be parsed correctly and ignored.

This closes #7678

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 17:00:12 -05:00
Timea Barna c30fd9b66d
NIFI-12006 Removed Templates from Framework and UI
This closes #7658

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 14:52:41 -05:00
Matt Burgess 932cfe22a3
NIFI-12010: Handle auto-commit and commit based on driver capabilities in SQL components
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #7663
2023-09-09 11:13:31 +02:00
krisztina-zsihovszki 75cfe21e4c
NIFI-12014 NullPointerException in PutSQL when adding error attributes
This closes #7666.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-05 11:38:14 +02:00
p-kimberley a9ac8fb707
NIFI-11945 Add Cache Entry Identifier property to DeduplicateRecord
This closes #7603

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-30 16:59:05 -05:00
exceptionfactory 5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
mr1716 77ed641ee2
NIFI-12002 Upgraded javax.servlet.jsp-api from 2.3.1 to 2.3.3
This closes #7653

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:00 -05:00
Mark Bean d1b77018b2
NIFI-11934 Allow FlowFile filename to be sent in header for InvokeHTTP
This closes #7639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:21:28 -05:00
mr1716 bf3c9ed4cb
NIFI-11994 Upgraded socketbroker from 1.0.2 to 1.1.0
This closes #7645

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:15:12 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
exceptionfactory 016834efaa NIFI-11976 Removed error log check in TestListenTCPRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7635
2023-08-22 15:16:25 -04:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
exceptionfactory 71abd77727 NIFI-11944 Removed validation warning from ExecuteStreamCommand
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7607
2023-08-14 16:34:49 -04:00
mr1716 b78dc5ca57 NIFI-11942 Update zstd-jni to 1.5.5-5
This closes #7601

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
exceptionfactory 5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
Matt Burgess 63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
This closes #7561

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
mr1716 5a8519ebd1
NIFI-11888 Upgraded Saxon-HE from 12.2 to 12.3
This closes #7553

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 20:31:56 -05:00
exceptionfactory 118ee0d00e
NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7531.
2023-07-31 18:21:48 +02:00
exceptionfactory 3a078c0c31
NIFI-11780 Added Certificate SAN Attributes to HandleHttpRequest
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7521.
2023-07-25 16:09:25 +02:00
exceptionfactory 8d5a6ce8d2
NIFI-11807 Reverted inadvertent changes to HandleHttpRequest
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:08 -05:00
mr1716 0a774f231a
NIFI-11835 Upgraded json-schema-validator from 1.0.84 to 1.0.86
This closes #7505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:45:57 -05:00
Paul Grey 7db956fea7
NIFI-11825 Fixed QueryRecord closing of resources
This closes #7496

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:48:15 -05:00
Matt Burgess f6a14bc475
NIFI-11807 Added ExtractRecordSchema Processor
This closes #7482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:32:59 -05:00
exceptionfactory 16c4004d58 NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7497
2023-07-18 18:29:20 -04:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
mr1716 779eea6453
NIFI-11824 Upgraded JAX-RS API from 2.1 to 2.1.1
This closes #7490

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 10:50:30 -05:00
exceptionfactory e812951c57
NIFI-11810 Removed unused JSTL and EL API libraries
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7479.
2023-07-14 10:30:27 +02:00
Joe Witt d2c70d1d2f
NIFI-11434 added support for optionally allowing zip entries with dat… (#7462)
* NIFI-11434 added support for optionally allowing zip entries with data descriptors
* set default value and ensured all zip tests use various configs
2023-07-12 17:09:03 -04:00
Matt Burgess f69b457757
NIFI-11770: Replace java-faker with Data Faker for GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7454.
2023-07-03 11:33:50 +02:00
Chris Sampson 3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
This closes #6816

Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00
exceptionfactory 1f1c5df5a3
NIFI-11673 Removed Legacy TLS Configuration Versions
This closes #7367

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-26 11:10:39 +02:00
exceptionfactory 7d6af0dbb0 NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7428
2023-06-23 18:27:36 -04:00
exceptionfactory bdd7ef3671 NIFI-11744 Added Required Permission to Reference Remote Resources
- Applied Required Permission to components supporting URL Resource References

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7426
2023-06-23 18:07:16 -04:00
mr1716 f62e1eb1e9
NIFI-11732 Upgraded Saxon from 12.1 to 12.2
- Adjusted spacing in test HTML to match Saxon 12.2 serialization

This closes #7414

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-21 11:01:45 -05:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
mr1716 3ac1876ecb NIFI-11731 Update json-schema-validator to 1.0.84
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7413
2023-06-20 12:52:50 -04:00
Matt Burgess 8a696c1dfa
NIFI-11715 Removed unused user-defined property support from PutDatabaseRecord and DistributedMapCacheLookupService
This closes #7395

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 16:23:43 -05:00
Matt Burgess bc6ac4b700
NIFI-11682 Correct Quoting for UPSERT and INSERT_IGNORE keys in PutDatabaseRecord
This closes #7385

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:05:03 -05:00
Matt Burgess 760949922c
NIFI-11691 Support VARBINARY and LONGVARBINARY in PutDatabaseRecord
This closes #7380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 21:01:02 -05:00
Matthew Burgess 991e5e24de
NIFI-4957 Add Resource File Support for Jolt Specifications
This closes #4044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 16:01:02 -05:00
mr1716 8cd1b4b76c
NIFI-11685 Upgraded zstd-jni from 1.5.5-3 to 1.5.5-4
This closes #7376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:07 -05:00
mr1716 4b6209ed20
NIFI-11684 Upgraded Brotli4j from 1.11.0 to 1.12.0
This closes #7377

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:27:26 -05:00
Jeyassri Balchandran 8382b0a7a3
NIFI-11540 Removed legacy segment attributes from MergeContent
This closes #7305

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 18:37:48 -05:00
exceptionfactory ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
2023-06-13 15:36:23 -04:00
Paul Grey 45e8226f89
NIFI-11672 Adjusted ListSFTP to handle incomplete File Types
- Modified file handling to include both REGULAR and UNKNOWN File Types returned from an SFTP server

This closes #7365

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 11:25:22 -05:00
Matt Burgess 5e6f3abdd2
NIFI-11655 Fixed float and double handling in GenerateRecord
This closes #7356

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
Matt Burgess f3e8651522 NIFI-11647: Support UUID type in DataTypeUtils.getSQLTypeValue
This closes #7355

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-08 11:13:07 -04:00
mr1716 e6c2c7c7ee
NIFI-11652 Upgraded Jolt from 0.1.7 to 0.1.8
This closes #7348

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:30:36 -05:00
exceptionfactory c5c711c91d
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
- Added selective overrides to upgrade transitive dependencies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
exceptionfactory ec525b0437
NIFI-11629 This closes #7327. Added Socket Write Timeout to InvokeHTTP
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-02 08:04:25 -07:00
Mark Payne 50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
Peter Turcsanyi 3bd4b49abe NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 16:25:28 +02:00
Mark Bathori cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
Peter Turcsanyi de62c6261f Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
This reverts commit 4e304ac586.
2023-05-26 11:07:45 +02:00
Mark Bathori 4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
dan-s1 d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
mr1716 4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
mr1716 8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
Mark Payne ca2a829d47
NIFI-11584 Improved MergeContent stream handling
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
Pierre Villard 0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
Lehel Boér 6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7263
2023-05-18 15:54:08 -04:00
exceptionfactory bec6ceda1f
NIFI-11548 Upgraded Apache Tika from 2.7.0 to 2.8.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7247.
2023-05-15 20:41:22 +02:00
Nandor Soma Abonyi 2049d5068b
NIFI-11524 Improved ExecuteStreamCommand documentation and configuration
This closes #7228

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-11 14:52:21 -05:00
dan-s1 e4cdb90a75 [NIFI-11509] Added configuration to allow for parsing comments in JSON.
This closes #7220

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:18:47 -04:00
dan-s1 71c7d38c75 [NIFI-11511] Added Provenance route events for all the relationships.
This closes #7221

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:03:49 -04:00
Pierre Villard 01d1be3215
NIFI-11507 Upgraded Calcite from 1.32 to 1.34
This closes #7216

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:11:38 -05:00
Pierre Villard 7fb2468f4b NIFI-11502 - Upgrade json-path to 2.8.0
NIFI-11502 fixing unit tests
NIFI-11502 review

This closes #7208

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 16:03:16 -04:00
Chris Sampson 9274d0c9b0 NIFI-10865 allow RecordPath's unescapeJson to convert de-serialised JSON Objects into Records
NIFI-10865 allow UpdateRecord to replace the Record root for relative paths, e.g. when a RecordPath function is used to modify selected field(s)

This closes #6708

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 12:26:07 -04:00
Aakash Chauhan afdbed5749
NIFI-8971 Removed legacy FlowFile name and path attributes
This closes #6003

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 16:37:48 -05:00
Daniel Aaron Salwerowicz d3f2bf1c16
NIFI-11472 Check working directory after making directory in PutFTP
- Multiple threads can attempt to create a remote directory when PutFTP has multiple concurrent tasks.

This closes #7184

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-24 11:33:09 -05:00
mr1716 29bb652623
NIFI-11456 Upgraded brotli4j from 1.8.0 to 1.11.0
This closes #7178

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:08:27 -05:00
Pierre Villard 21e4c665dc
NIFI-11421 Upgraded Parquet from 1.12.3 to 1.13.0
- Upgraded MockFtpServer from 2.7.1 to 3.1.0

This closes #7152

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:50:13 -05:00
Pierre Villard 2b06306b07
NIFI-11418 Upgraded bcrypt from 0.9.0 to 0.10.2
This closes #7149

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:55 -05:00
Pierre Villard 0b2deb94de
NIFI-11415 Upgraded Saxon-HE from 10.6 to 12.1
This closes #7146

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:44:12 -05:00
Pierre Villard 0160d6d6b9
NIFI-11410 Upgraded multiple integration dependencies
- Upgraded Spring Boot from 2.7.9 to 2.7.10

This closes #7141

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:40:09 -05:00
Pierre Villard 4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
Matt Burgess 1a9acb1f4b
NIFI-11337: Update PutDatabaseRecord's Max Batch Size property documentation to reflect actual behavior (#7081) 2023-03-24 10:22:56 -04:00
Emilio Setiadarma cac76e339d
NIFI-9196 Corrected FetchSFTP Move File destination formatting
- Changed FetchSFTP to use String.format() instead of  File.getAbsolutePath() for defining the destination path as part of the Move File completion strategy

This closes #7072

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:23 -05:00
Joe Witt 58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
krisztina-zsihovszki 63e9365449
NIFI-4651 Add error message and code to PutSQL FlowFile attributes
NIFI-4651 Review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2023-03-21 11:19:33 -04:00
Nandor Soma Abonyi 4e602ce40f
NIFI-11264 Added debug logs for List Processor yielding
- Corrected ListFile Processor description

This closes #7027

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-21 08:04:59 -05:00
Dustin Rodrigues cb6e530a3c
NIFI-11301 Fixed typos in ISPEnrichIP and DistributeLoad
This closes #7056

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-20 08:54:01 -05:00
exceptionfactory 665b1696ef
NIFI-11268 Removed deprecated OpenPGP support from EncryptContent
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7030.
2023-03-13 09:20:33 +01:00
exceptionfactory 512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
Nissim Shiman 5350b02923
NIFI-4718 Improved detection of FlowFile V3 in IdentityMimeType
This closes #7009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-07 09:22:27 -06:00
Pierre Villard 169b53feaa
NIFI-11157 - Doc update for scheduling strategy for MergeContent/Record
This closes #6999.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-06 12:01:34 +01:00
Matthew Burgess 61b87e007b
NIFI-11209: Include newly-added columns in output for UpdateTable processors when Update Field Names is true
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6986.
2023-02-27 14:08:48 +01:00
Lehel 7e97c1ce19
NIFI-11045: Sensitive dynamic property support for parameterized queries in ExecuteSQL and ExecuteSQLRecord
This closes #6853.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-22 12:37:07 +01:00
exceptionfactory 57a1144f34
NIFI-11187 Removed ActiveMQ from Standard Processors
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6961
2023-02-21 16:54:37 -05:00
dan-s1 22a4bce1ed
NIFI-11156 Updated SchemaValidator to include error message for ValidateXml
- Restores behavior so that XML parsing failure details will be included in FlowFile error attribute from ValidateXml

This closes #6970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-18 10:28:50 -06:00
exceptionfactory 4f11550e97
NIFI-11174 Removed deprecated Standard Processors
- Base64EncodeContent
- GetHTTP
- GetJMSQueue
- GetJMSTopic
- HashAttribute
- HashContent
- PostHTTP
- PutJMS

Removed deprecated Proxy properties from InvokeHTTP

- Proxy Host
- Proxy Port
- Proxy Type
- Proxy Username
- Proxy Password

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6953.
2023-02-15 13:14:56 -05:00
Nissim Shiman dbef536ebd
NIFI-10950 DistributeLoad processor - this closes #6924. removed Load Distribution
Service

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 19:18:57 -05:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
exceptionfactory a66727c4d1
NIFI-11160 Upgraded Apache Tika from 2.6.0 to 2.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6938.
2023-02-10 11:38:25 +01:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
dan-s1 99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
Joe Witt 4f91420cc1
NIFI-11139 Updated multiple Maven Plugins
This closes #6925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 16:07:02 -06:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
exceptionfactory 8bc7593d34
NIFI-11126 Delete MultiPart files in ListenHTTP after processing
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6915
2023-02-02 12:23:44 +00:00
exceptionfactory 5daf01e760
NIFI-11120 This closes #6912. Upgraded Zip4j from 2.11.2 to 2.11.3
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 11:49:12 -07:00
exceptionfactory bdede27447
NIFI-11119 This closes #6911. Excluded snakeyaml:android from javafaker
- Added direct dependency on standard snakeyaml version to nifi-standard-processors

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 10:05:23 -07:00
exceptionfactory a7206f187b
NIFI-9989 This closes #6908. Upgraded SSHJ from 0.34.0 to 0.35.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 09:18:54 -07:00
exceptionfactory d913f8046a
NIFI-10581 Upgraded Apache Tika from 2.4.1 to 2.6.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6894.
2023-01-26 19:52:17 +01:00
Mark Bathori c3dd2569db NIFI-10974: Incorrect warning message on memory usage from MonitorMemory 2023-01-26 13:25:07 +01:00
Priyanka Awatramani b3f2d95092
NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes
- Updated TestAttributesToCSV with LinkedHashMap for deterministic test behavior
- Updated TestHttpFlowFileServerProtocol with adjusted checksums to match expectations from LinkedHashMap changes

This closes #6748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 16:19:20 -06:00
exceptionfactory 5101db2ab7
NIFI-11096 This closes #6889. Added EncodeContent to Processor services definition
- Deprecated Base64EncodeContent in favor of EncodeContent
- Updated EncodeContent to use Commons Codec for Hexadecimal encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 15:01:38 -07:00
exceptionfactory f32a60af33
NIFI-11064 Removed unstable TestPutSFTP.testRunTransitUriDifferentHosts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6885.
2023-01-25 11:07:13 +01:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
mr1716 78a2c4e14a
NIFI-11072 Updated xz from 1.8 to 1.9
This closes #6871

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-20 16:18:03 -06:00
exceptionfactory 7db6f17350
NIFI-11064 Changed TestPutSFTP run iterations based on files queued
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6863.
2023-01-19 21:20:43 +01:00
Tamas Palfy 464e0a96ee
NIFI-11050 In PutEmail added OAuth authorization option. StandardOauth2AccessTokenProvider can be used with refresh_token grant type.
This closes #6845.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 16:05:28 +01:00
mr1716 4518740da5
NIFI-11071 Update json-flattener to 0.16.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6860.
2023-01-19 10:56:01 +01:00
mr1716 b4f6aace53
NIFI-11070 Update json-schema-validator to 1.0.76
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6857.
2023-01-19 10:53:36 +01:00
Chris Sampson 1d7ee542b1
NIFI-2161 add option to skip attribute output for unmatched JSON path expressions in EvaluateJsonPath
This closes #6817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 14:06:15 -06:00
Mark Payne d5c79fdcd1
NIFI-10887: Addressed performance concerned. Use String.indexOf() instead of Pattern.matcher() when using Literal Replace. Use a NonFlushableOutputStream when ProcessSession.write() is called. Implemented hashCode() on AbstractConnection. Updated default Run Schedule on ReplaceText from 0 ms to 25 ms. Added a Surround Replacement strategy that allows both prepending and appending text. Updated unit tests to account for this.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6724
2023-01-11 12:28:59 -05:00
Matthew Burgess 4f77a17d19
NIFI-11031: Fix logic error in GenerateRecord for nullPercentage
This closes #6830

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-06 21:01:01 -06:00
exceptionfactory 53faecdcf6
NIFI-11027 Removed direct dependency on Joda Time
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6825.
2023-01-05 11:56:42 +01:00
Matthew Burgess c11092b2b4
NIFI-10998 Fixed SplitJson to always compile new JsonPath when property changes
This closes #6803

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-04 13:58:06 -06:00
exceptionfactory b556322749
NIFI-11005 Added Illegal and Redundant Import Modules to Checkstyle
- Updated impacted classes to remove redundant import lines
- Removed WebUtilsGroovyTest.groovy class due to use of internal sun.security classes

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6804.
2022-12-23 18:34:38 +01:00
Matthew Burgess f38f14b363
NIFI-10585 Added GenerateRecord Processor
This closes #6480

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 19:30:05 -06:00
dan-s1 dde821cf71
NIFI-6498 Update TransformXml to send errors to Component Log
This closes #6798

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 11:15:37 -06:00
exceptionfactory a8974253ce
NIFI-10989 Removed SHA-1 and MD5 from TestHashContent
- Removed methods to avoid intermittent failures due to lack of Bouncy Castle Security Provider registration

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6790
2022-12-15 22:06:52 -05:00
hj28 ac8e3dae58
NIFI-10637 Deterministic TestGenerateTableFetch testMultipleColumnTypeMissing
This closes #6754

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-09 10:41:36 -06:00
exceptionfactory ab7ce58fb1
NIFI-10947 This closes #6758. Upgraded Apache Commons Net to 3.9.0
- Added Commons Net to managed dependencies in root Maven configuration
- Removed version references to 3.3 in MiNiFi and 3.6 in NiFi standard modules

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-05 09:01:29 -07:00
exceptionfactory 47fc3ae77d
NIFI-10898 This closes #6729. Removed unused test HTTP Servlets
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-04 21:08:14 -07:00
exceptionfactory c51411d360
NIFI-10925 Refactored TestPutSFTP with discrete test methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6746.
2022-12-02 10:08:18 +01:00
exceptionfactory 3399d09c46
NIFI-10923 This closes #6745. Upgraded Apache SSHD to 2.9.2
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-01 12:02:01 -07:00
Joe Witt 1046b2c308
Merge branch 'NIFI-10854-RC1' 2022-11-28 08:43:56 -07:00