Commit Graph

215 Commits

Author SHA1 Message Date
Mark Payne 6b4daa2ec2
NIFI-13801: Fixed counter for ConsumeKafka to correctly indicate number of messages received using using a demarcator
This closes #9311.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-24 21:31:14 -04:00
Pierre Villard 150cba8bef
NIFI-13712 Added Receive Channel Join Events to ListenSlack (#9230)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-23 10:35:07 -05:00
Mark Bathori 07611ded2b
NIFI-13722: Kerberos ticket renewal issue due static thread pool in Iceberg library
This closes #9258.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 12:08:19 +02:00
Peter Gyori e5a80e6ba6
NIFI-13771 Python source processor default Run Duration 0 ms and Run Schedule 1 min
This closes #9282.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 11:50:39 +02:00
Mark Payne 1b525aef0c
NIFI-13791 Added Counters to PublishKafka and ConsumeKafka for Records per Topic (#9300)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 20:58:03 -05:00
Mark Payne d04d38fc44
NIFI-13787 Fixed error and record handling in ConsumeKafka
Eliminated unnecessary connection pooling at the service layer so that a single Consumer is made available to the processor. This allows the processor to rollback offsets and provides a simpler API.

This closes #9298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 17:33:54 -05:00
Mark Payne 6ddae78b6f
NIFI-13784 Fixed Kafka Publishing Behavior creating multiple Producers (#9297)
Fixed error handling in several situations. Cleaned up leaky abstraction. Some code cleanup, fixed default values for time-based properties to use 'sec' instead of 's' to adhere to typical conventions.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-21 16:45:36 -05:00
exceptionfactory a43135ce0c
NIFI-13783 Removed commons-codec from Kafka Processors
This closes #9295

- Replaced Commons Codec Hex with Java HexFormat

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-21 10:06:33 -07:00
Joe Witt 29307dbf71
NIFI-13775 Fixed NoClassDefFoundError with ArrayUtils in ConsumeKafka (#9287)
- Upgraded Kafka Clients from 3.7.1 to 3.8.0
- Inheriting from the correct base services-api instead of shared-bundle then identifying missing explicit dependencies of Kafka processors commons-lang3 and commons-codec

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-20 13:39:26 -05:00
Joseph Witt e155e6bb26
NIFI-13769 bump various deps for logback, amazon, spring, and more
ch.qos.logback 1.5.7 1.5.8
com.amazonaws 1.12.770 1.12.772
com.github.luben 1.5.6-4 1.5.6-5
commons-io 2.16.1 2.17.0
io.netty 4.1.112.Final 4.1.113.Final
org.apache.ant 1.10.14 1.10.15
org.apache.logging.log4j 2.23.1 2.24.0  (why is this here!?)
org.eclipse.jetty 12.0.12 12.0.13
org.springframework 6.1.12 6.1.13
org.xerial.snappy 1.1.10.6 1.1.10.7
software.amazon.awssdk 2.27.14 2.28.4
com.google.apis v3-rev20240730-2.0.0	 v3-rev20240903-2.0.0
com.slack.api bolt-socket-mode 1.42.0 1.42.1
com.squareup.wire wire-schema-jvm 5.0.0 5.1.0
io.projectreactor (core/test) 3.6.9 3.6.10
net.java.dev.jna (jna/jna-platform) 5.14.0 5.15.0
org.apache.groovy 4.0.22 4.0.23
org.apache.maven maven-artifact 3.9.8 3.9.9
org.eclipse.jgit 6.10.0.202406032230-r	 7.0.0.202409031743-r
org.flywaydb 10.17.2 10.18.0
org.kosuke 1.324 1.326
org.mongodb 4.11.3 4.11.4
org.neo4j.driver 5.23.0 5.24.0
org.postgresql 42.7.3 42.7.4
org.springframework.boot 3.3.3 3.3.4
org.springframework.integration 6.3.3 6.3.4
org.springframework.retry 2.0.8 2.0.9

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9280.
2024-09-20 13:46:02 +01:00
Lucas c71c13ce31
NIFI-13750 Abort SFTP listing once maxResults is reached (#9267)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 16:16:10 -05:00
timeabarna e125d8cdbb
NIFI-13763 Fixed HashSet Filtering for DeduplicateRecord (#9277)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:57:44 -05:00
Peter Turcsanyi 58184683df
NIFI-13758 Upgraded Google Cloud Libraries to 26.46.0 (#9275)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:54:03 -05:00
dependabot[bot] d455c00387
NIFI-13768 Upgraded protobuf from 3.25.3 to 3.25.5
This closes #9278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:06:28 -05:00
Lucas 00c7a78119
NIFI-13751 Upgraded SSHJ from 0.38.0 to 0.39.0 (#9266)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 14:59:29 -05:00
Peter Turcsanyi 6355812a77
NIFI-13733 Migrated FTP and SFTP processors' Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9252.
2024-09-12 11:54:04 +02:00
David Handermann 1101d4d995
NIFI-13734 Removed getTook assertions from Elasticsearch Test (#9254) 2024-09-10 17:21:25 -04:00
Lucas c4d11feda5
NIFI-13730 Refactor TestUpdateAttribute using current API methods (#9249)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-10 13:58:23 -05:00
EndzeitBegins 821e5d23c9
NIFI-13372 Add processor DeleteSFTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9012.
2024-09-09 16:03:24 +02:00
EndzeitBegins bb7cce50d2
NIFI-13703 Remove deprecated property DISTRIBUTED_CACHE_SERVICE in AbstractListProcessor
This closes #9246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 14:09:25 +02:00
Chris Sampson 2ead001d14
NIFI-13719 allow Elasticsearch response to contain Long values for the took field
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9244.
2024-09-09 14:00:23 +02:00
EndzeitBegins 657e75c667
NIFI-13729 Remove deprecated property MAX_RECV_THREAD_POOL_SIZE from ListenTCP
This closes #9248.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 10:17:07 +02:00
EndzeitBegins 61aeb7af39
NIFI-13728 Remove deprecated property KERBEROS_RELOGIN_PERIOD in AbstractHadoopProcessor
This closes #9247.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 09:42:09 +02:00
David Handermann fafdb96a50
NIFI-13725 Disabled Spring Logging System in Content Viewer (#9240)
This closes #9240
2024-09-06 18:34:49 -04:00
Peter Turcsanyi a7112a60ec
NIFI-13583 Overrode google-auth-library-oauth2-http version to 1.25.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9235.
2024-09-06 17:42:33 +02:00
Matt Gilman 39ab3129f0
NIFI-13632: Updating content access. (#9221)
* NIFI-13632: Updating content access.
- Removing existing content viewer application.
- Introduced new front end based content viewer applicaiton.
- Introduced new bundled content viewers for hex and images.
- Deleted previous image content viewer.
- Migrated existing standard content viewer (which handles json, xml, yaml, csv, and text) to utilize new content access interface.
- Moved standard content viewer into its own NAR.
- Moved and renamed custom ui utils and content viewer utils into nifi-common.
- Added mime type to FlowFileSummary response payload to help drive the initially opened content viewer.

* NIFI-13632: Fixing rat issue.

* NIFI-13632: Fixing CI issue.

* NIFI-13632: Removing standard content viewer war from code coverage.

* NIFI-13632: Addressing review feedback.

* NIFI-13632: Fixing import.

* NIFI-13632: Further simplification of content viewer state.

* NIFI-13632: Removing unneeded code.

* NIFI-13632: Adding a min height around codemirror.

* NIFI-13632: Addressing review feedback.
- Rendering mime type in the content viewer.
- Preventing additions to the browser history as the user changes how the content is viewed.
- Appending forward slash to content viewer UIs to prevent unnecessary redirect.
- Removing Standard Content Viewer title based on review feedback.
- Fixing double scroll bar in the Standard Content Viewer on small browser heights.
- Removed unnecessary application.yml.
- Bumping spring boot version.

This closes #9221
2024-09-06 09:12:38 -04:00
dan-s1 727b0ba106
NIFI-13709 Added more meaningful message when validation fails with non-compliant XML is validated and no schema is provided.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9229.
2024-09-05 12:06:23 +02:00
EndzeitBegins d1432d6be9
NIFI-13702 Remove deprecated property STATE_UPDATE_INTERVAL from CaptureChangeMySQL
This closes #9225

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:30 -05:00
EndzeitBegins 1ad9d86a26
NIFI-13701 Remove deprecated property CACHE_SCHEMA from QueryRecord
This closes #9224

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:07 -05:00
Juldrixx f92f6f1def
NIFI-13578 Add Schema Branch Name and Schema Version in ValidateRecord (#9108)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 10:54:26 -05:00
Pierre Villard f828907df5
NIFI-12080 Added support for KV_2 in HashiCorp Parameter Provider
This closes #9209

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 09:12:12 -05:00
Mike 2fc0ca1b7b
NIFI-13692 Catch All Exceptions in ResizeImage (#9213)
Widening the scope of caught Exceptions for routing to failure ensures that the Processor can catch pretty much everything a user could throw at this processor.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-29 09:29:15 -05:00
Joseph Witt a8e204aceb
NIFI-13690 Upgraded AWS SDK to 2.27.14 and other dependencies
- Upgraded Logback from 1.5.6 to 1.5.7
- Upgraded brotli4j from 1.16.0 to 1.17.0
- Upgraded AWS SDK from 1.12.767 to 1.12.770
- Upgraded AWS SDK from 2.27.1 to 2.27.14
- Upgraded H2 from 2.3.230 to 2.3.232
- Upgraded Commons CLI from 1.8.0 to 1.9.0
- Upgraded Dropwizard Metrics from 4.2.26 to 4.2.27
- Upgraded Kubernetes Client from 6.13.2 to 6.13.3
- Upgraded Reactor Netty from 1.1.21 to 1.1.22
- Upgraded Commons Compress from 1.27.0 to 1.27.1
- Upgraded Mockito from 5.12.0 to 5.13.0
- Upgraded Slack API from 1.40.3 to 1.42.0
- Upgraded Project Reactor Core from 3.6.8 to 3.6.9
- Upgraded Iceberg from 1.6.0 to 1.6.1
- Upgraded FlywayDB from 10.17.0 to 10.17.2
- Upgraded GitHub API 1.323 to 1.324
- Upgraded PostgreSQL from 42.7.3 to 42.7.4
- Upgraded Spring Integration from 6.3.2 to 6.3.3
- Upgraded Spring Retry 2.0.7 to 2.0.8
- Upgraded Spring Vault from 3.1.1 to 3.1.2

This closes #9206

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-28 14:17:37 -05:00
Jim Steinebrey 1d1cf92b16
NIFI-13686 Make TestListFile.testFilterAge more resilient to work with time delays during execution
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #9204.
2024-08-28 09:38:31 -04:00
Jim Steinebrey cbdc53a565 NIFI-13543 Add HttpRecordSink
NIFI-13543 Changed default batch size to 0 and changed to throw IOException from sendHttpRequest()

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9185
2024-08-23 15:53:38 -04:00
Mark Bathori f31f803282 NIFI-12078: Add JDBC Catalog Controller Service for Iceberg processors
Disable jdbc catalog tests on Windows OS

Fix review comments

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9145
2024-08-23 15:05:25 -04:00
lehelb 81bb78cef7
NIFI-13671 - QuerySalesforceObject fails to parse DateTime fields
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9193.
2024-08-23 11:42:05 +02:00
Mike Thomsen 31e5afc9b8 NIFI-13666 Added a catch for IllegalArgumentException in FetchS3Object
NIFI-13666 Added the same try/catch to a few other processors

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9188
2024-08-20 18:45:05 -04:00
Scott Aslan 8919955bfc
[NIFI-13656] allow enter button to submit create PG and create Port form (#9181)
* [NIFI-13656] allow enter button to submit create PG and create Port form

* restore scrolling for hints in codemirrors in update attribute

* fix unit tests

* update unit test

* remove duplicate imports

This closes #9181
2024-08-20 12:50:03 -04:00
sullis c2dd939e3c NIFI-13576: Upgrade Iceberg from 1.5.2 to 1.6.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9105
2024-08-19 16:23:54 -04:00
Juldrixx 9fbe6aab74
NIFI-13630 Handle Map Avro Type in PutBigQuery
This closes #9151

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 21:12:46 -05:00
Rajmund Takacs d4344a3140
NIFI-13642 Added Delete Keys Property to PutDatabaseRecord
- Delete Keys property enables targeted deletes for databases that do not support primary keys

This closes #9162

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 20:58:14 -05:00
Umar Hussain abe41ff649
NIFI-12411 Update PublishAMQP with configurable Header Source Property
This closes #8105

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 17:16:24 -05:00
dan-s1 9d51c675cb
NIFI-12709 Added New FlowFlow Attributes for Zip and Tar in UnpackContent
This closes #9122

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 15:57:16 -05:00
Matt Gilman 38f4110521
NIFI-13650: Fixing condition when including References Parameter... o… (#9174)
* NIFI-13650: Fixing condition when including References Parameter option.
- Updating property editors to better convey different parameter states.
- Updating hint tooltip to indicate that parameters are supported but no parameter context is bound.
- Fixing minor layout issue in Processor schedule tab.
- Fix combo editor unit tests.

* NIFI-13650: Fixing track warning errors when editing Parameter Contexts.

* NIFI-13650: Fixing z-index autocomplete issue.

This closes #9174
2024-08-16 16:20:01 -04:00
Joseph Witt e4ec0cb20d
NIFI-13651 Moved framework-related modules under framework-bundle
- Removed references to nifi-property-utils under nifi-extension-bundles

This closes #9169

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 13:44:13 -05:00
Mike Thomsen 99f3717f13
NIFI-13430 Added CopyS3Object and GetS3ObjectMetadata
This closes #8992

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-14 20:23:20 -05:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
Michael Akinyemi 39a1ccc191
NIFI-11977 Set UTF-8 Character Set in Subject for PutEmail (#9170)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:03:41 -05:00
Joseph Witt 3096c983f5
NIFI-13648 Upgraded Jetty to 12.0.12 along with other common dependencies
- Upgraded AWS SDK from 1.12.762 to 1.12.767
- Upgraded AWSK SDK from 2.26.21 to 2.27.1
- Upgraded zstd-jni from 1.5.6-3 to 1.5.6-4
- Upgraded excel-streaming-reader from 4.4.0 to 5.0.2
- Upgraded azure-sdk-bom from 1.2.25 to 1.2.26
- Upgraded json-schema-validator from 1.5.0 to 1.5.1
- Upgraded oauth2-oidc-sdk from 11.13 to 11.14
- Upgraded Fabric8 Kubernetes Client from 6.13.1 to 6.13.2
- Upgraded commons-compress from 1.26.2 to 1.27.0
- Upgraded commons-lang3 from 3.15.0 to 3.16.0
- Upgraded Apache SSHD from 2.13.1 to 2.13.2
- Upgraded Jetty from 12.0.11 to 12.0.12
- Upgraded Elasticsearch Client from 8.14.3 to 8.15.0
- Upgraded Jersey from 3.1.7 to 3.1.8
- Upgraded SLF4J from 2.0.13 to 2.0.15
- Upgraded Testcontainers from 1.20.0 to 1.20.1
- Upgraded org.tukaani xz from 1.9 to 1.10
- Upgraded snappy-java from 1.1.10.5 to 1.1.10.6
- Upgraded google-api-services-drive from v3-rev20240628-2.0.0 to v3-rev20240730-2.0.0
- Upgraded Hazelcast from 5.4.0 to 5.5.0
- Upgraded Azure Kusto from 5.1.0 to 5.1.1
- Upgraded ActiveMQ from 6.1.2 to 6.1.3
- Upgraded Clojure from 1.11.3 to 1.11.4
- Upgraded FlywayDB from 10.16.0 to 10.17.0
- Upgraded MongoDB from 4.11.2 to 4.11.3
- Upgraded Neo4j from 5.22.0 to 5.23.0

This closes #9167

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-12 13:03:46 -05:00