Commit Graph

1500 Commits

Author SHA1 Message Date
Timea Barna c30fd9b66d
NIFI-12006 Removed Templates from Framework and UI
This closes #7658

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 14:52:41 -05:00
Matt Burgess 932cfe22a3
NIFI-12010: Handle auto-commit and commit based on driver capabilities in SQL components
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #7663
2023-09-09 11:13:31 +02:00
krisztina-zsihovszki 75cfe21e4c
NIFI-12014 NullPointerException in PutSQL when adding error attributes
This closes #7666.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-05 11:38:14 +02:00
p-kimberley a9ac8fb707
NIFI-11945 Add Cache Entry Identifier property to DeduplicateRecord
This closes #7603

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-30 16:59:05 -05:00
exceptionfactory 5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
mr1716 77ed641ee2
NIFI-12002 Upgraded javax.servlet.jsp-api from 2.3.1 to 2.3.3
This closes #7653

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:00 -05:00
Mark Bean d1b77018b2
NIFI-11934 Allow FlowFile filename to be sent in header for InvokeHTTP
This closes #7639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:21:28 -05:00
mr1716 bf3c9ed4cb
NIFI-11994 Upgraded socketbroker from 1.0.2 to 1.1.0
This closes #7645

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:15:12 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
exceptionfactory 016834efaa NIFI-11976 Removed error log check in TestListenTCPRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7635
2023-08-22 15:16:25 -04:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
exceptionfactory 71abd77727 NIFI-11944 Removed validation warning from ExecuteStreamCommand
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7607
2023-08-14 16:34:49 -04:00
mr1716 b78dc5ca57 NIFI-11942 Update zstd-jni to 1.5.5-5
This closes #7601

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
exceptionfactory 5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
Matt Burgess 63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
This closes #7561

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
mr1716 5a8519ebd1
NIFI-11888 Upgraded Saxon-HE from 12.2 to 12.3
This closes #7553

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 20:31:56 -05:00
exceptionfactory 118ee0d00e
NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7531.
2023-07-31 18:21:48 +02:00
exceptionfactory 3a078c0c31
NIFI-11780 Added Certificate SAN Attributes to HandleHttpRequest
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7521.
2023-07-25 16:09:25 +02:00
exceptionfactory 8d5a6ce8d2
NIFI-11807 Reverted inadvertent changes to HandleHttpRequest
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:08 -05:00
mr1716 0a774f231a
NIFI-11835 Upgraded json-schema-validator from 1.0.84 to 1.0.86
This closes #7505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:45:57 -05:00
Paul Grey 7db956fea7
NIFI-11825 Fixed QueryRecord closing of resources
This closes #7496

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:48:15 -05:00
Matt Burgess f6a14bc475
NIFI-11807 Added ExtractRecordSchema Processor
This closes #7482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:32:59 -05:00
exceptionfactory 16c4004d58 NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7497
2023-07-18 18:29:20 -04:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
mr1716 779eea6453
NIFI-11824 Upgraded JAX-RS API from 2.1 to 2.1.1
This closes #7490

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 10:50:30 -05:00
exceptionfactory e812951c57
NIFI-11810 Removed unused JSTL and EL API libraries
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7479.
2023-07-14 10:30:27 +02:00
Joe Witt d2c70d1d2f
NIFI-11434 added support for optionally allowing zip entries with dat… (#7462)
* NIFI-11434 added support for optionally allowing zip entries with data descriptors
* set default value and ensured all zip tests use various configs
2023-07-12 17:09:03 -04:00
Matt Burgess f69b457757
NIFI-11770: Replace java-faker with Data Faker for GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7454.
2023-07-03 11:33:50 +02:00
Chris Sampson 3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
This closes #6816

Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00
exceptionfactory 1f1c5df5a3
NIFI-11673 Removed Legacy TLS Configuration Versions
This closes #7367

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-26 11:10:39 +02:00
exceptionfactory 7d6af0dbb0 NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7428
2023-06-23 18:27:36 -04:00
exceptionfactory bdd7ef3671 NIFI-11744 Added Required Permission to Reference Remote Resources
- Applied Required Permission to components supporting URL Resource References

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7426
2023-06-23 18:07:16 -04:00
mr1716 f62e1eb1e9
NIFI-11732 Upgraded Saxon from 12.1 to 12.2
- Adjusted spacing in test HTML to match Saxon 12.2 serialization

This closes #7414

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-21 11:01:45 -05:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
mr1716 3ac1876ecb NIFI-11731 Update json-schema-validator to 1.0.84
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7413
2023-06-20 12:52:50 -04:00
Matt Burgess 8a696c1dfa
NIFI-11715 Removed unused user-defined property support from PutDatabaseRecord and DistributedMapCacheLookupService
This closes #7395

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 16:23:43 -05:00
Matt Burgess bc6ac4b700
NIFI-11682 Correct Quoting for UPSERT and INSERT_IGNORE keys in PutDatabaseRecord
This closes #7385

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:05:03 -05:00
Matt Burgess 760949922c
NIFI-11691 Support VARBINARY and LONGVARBINARY in PutDatabaseRecord
This closes #7380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 21:01:02 -05:00
Matthew Burgess 991e5e24de
NIFI-4957 Add Resource File Support for Jolt Specifications
This closes #4044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 16:01:02 -05:00
mr1716 8cd1b4b76c
NIFI-11685 Upgraded zstd-jni from 1.5.5-3 to 1.5.5-4
This closes #7376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:07 -05:00
mr1716 4b6209ed20
NIFI-11684 Upgraded Brotli4j from 1.11.0 to 1.12.0
This closes #7377

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:27:26 -05:00
Jeyassri Balchandran 8382b0a7a3
NIFI-11540 Removed legacy segment attributes from MergeContent
This closes #7305

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 18:37:48 -05:00
exceptionfactory ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
2023-06-13 15:36:23 -04:00
Paul Grey 45e8226f89
NIFI-11672 Adjusted ListSFTP to handle incomplete File Types
- Modified file handling to include both REGULAR and UNKNOWN File Types returned from an SFTP server

This closes #7365

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 11:25:22 -05:00
Matt Burgess 5e6f3abdd2
NIFI-11655 Fixed float and double handling in GenerateRecord
This closes #7356

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00