Commit Graph

184 Commits

Author SHA1 Message Date
Mike 2fc0ca1b7b
NIFI-13692 Catch All Exceptions in ResizeImage (#9213)
Widening the scope of caught Exceptions for routing to failure ensures that the Processor can catch pretty much everything a user could throw at this processor.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-29 09:29:15 -05:00
Joseph Witt a8e204aceb
NIFI-13690 Upgraded AWS SDK to 2.27.14 and other dependencies
- Upgraded Logback from 1.5.6 to 1.5.7
- Upgraded brotli4j from 1.16.0 to 1.17.0
- Upgraded AWS SDK from 1.12.767 to 1.12.770
- Upgraded AWS SDK from 2.27.1 to 2.27.14
- Upgraded H2 from 2.3.230 to 2.3.232
- Upgraded Commons CLI from 1.8.0 to 1.9.0
- Upgraded Dropwizard Metrics from 4.2.26 to 4.2.27
- Upgraded Kubernetes Client from 6.13.2 to 6.13.3
- Upgraded Reactor Netty from 1.1.21 to 1.1.22
- Upgraded Commons Compress from 1.27.0 to 1.27.1
- Upgraded Mockito from 5.12.0 to 5.13.0
- Upgraded Slack API from 1.40.3 to 1.42.0
- Upgraded Project Reactor Core from 3.6.8 to 3.6.9
- Upgraded Iceberg from 1.6.0 to 1.6.1
- Upgraded FlywayDB from 10.17.0 to 10.17.2
- Upgraded GitHub API 1.323 to 1.324
- Upgraded PostgreSQL from 42.7.3 to 42.7.4
- Upgraded Spring Integration from 6.3.2 to 6.3.3
- Upgraded Spring Retry 2.0.7 to 2.0.8
- Upgraded Spring Vault from 3.1.1 to 3.1.2

This closes #9206

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-28 14:17:37 -05:00
Jim Steinebrey 1d1cf92b16
NIFI-13686 Make TestListFile.testFilterAge more resilient to work with time delays during execution
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #9204.
2024-08-28 09:38:31 -04:00
Jim Steinebrey cbdc53a565 NIFI-13543 Add HttpRecordSink
NIFI-13543 Changed default batch size to 0 and changed to throw IOException from sendHttpRequest()

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9185
2024-08-23 15:53:38 -04:00
Mark Bathori f31f803282 NIFI-12078: Add JDBC Catalog Controller Service for Iceberg processors
Disable jdbc catalog tests on Windows OS

Fix review comments

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9145
2024-08-23 15:05:25 -04:00
lehelb 81bb78cef7
NIFI-13671 - QuerySalesforceObject fails to parse DateTime fields
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9193.
2024-08-23 11:42:05 +02:00
Mike Thomsen 31e5afc9b8 NIFI-13666 Added a catch for IllegalArgumentException in FetchS3Object
NIFI-13666 Added the same try/catch to a few other processors

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9188
2024-08-20 18:45:05 -04:00
Scott Aslan 8919955bfc
[NIFI-13656] allow enter button to submit create PG and create Port form (#9181)
* [NIFI-13656] allow enter button to submit create PG and create Port form

* restore scrolling for hints in codemirrors in update attribute

* fix unit tests

* update unit test

* remove duplicate imports

This closes #9181
2024-08-20 12:50:03 -04:00
sullis c2dd939e3c NIFI-13576: Upgrade Iceberg from 1.5.2 to 1.6.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9105
2024-08-19 16:23:54 -04:00
Juldrixx 9fbe6aab74
NIFI-13630 Handle Map Avro Type in PutBigQuery
This closes #9151

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 21:12:46 -05:00
Rajmund Takacs d4344a3140
NIFI-13642 Added Delete Keys Property to PutDatabaseRecord
- Delete Keys property enables targeted deletes for databases that do not support primary keys

This closes #9162

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 20:58:14 -05:00
Umar Hussain abe41ff649
NIFI-12411 Update PublishAMQP with configurable Header Source Property
This closes #8105

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 17:16:24 -05:00
dan-s1 9d51c675cb
NIFI-12709 Added New FlowFlow Attributes for Zip and Tar in UnpackContent
This closes #9122

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 15:57:16 -05:00
Matt Gilman 38f4110521
NIFI-13650: Fixing condition when including References Parameter... o… (#9174)
* NIFI-13650: Fixing condition when including References Parameter option.
- Updating property editors to better convey different parameter states.
- Updating hint tooltip to indicate that parameters are supported but no parameter context is bound.
- Fixing minor layout issue in Processor schedule tab.
- Fix combo editor unit tests.

* NIFI-13650: Fixing track warning errors when editing Parameter Contexts.

* NIFI-13650: Fixing z-index autocomplete issue.

This closes #9174
2024-08-16 16:20:01 -04:00
Joseph Witt e4ec0cb20d
NIFI-13651 Moved framework-related modules under framework-bundle
- Removed references to nifi-property-utils under nifi-extension-bundles

This closes #9169

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 13:44:13 -05:00
Mike Thomsen 99f3717f13
NIFI-13430 Added CopyS3Object and GetS3ObjectMetadata
This closes #8992

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-14 20:23:20 -05:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
Michael Akinyemi 39a1ccc191
NIFI-11977 Set UTF-8 Character Set in Subject for PutEmail (#9170)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:03:41 -05:00
Joseph Witt 3096c983f5
NIFI-13648 Upgraded Jetty to 12.0.12 along with other common dependencies
- Upgraded AWS SDK from 1.12.762 to 1.12.767
- Upgraded AWSK SDK from 2.26.21 to 2.27.1
- Upgraded zstd-jni from 1.5.6-3 to 1.5.6-4
- Upgraded excel-streaming-reader from 4.4.0 to 5.0.2
- Upgraded azure-sdk-bom from 1.2.25 to 1.2.26
- Upgraded json-schema-validator from 1.5.0 to 1.5.1
- Upgraded oauth2-oidc-sdk from 11.13 to 11.14
- Upgraded Fabric8 Kubernetes Client from 6.13.1 to 6.13.2
- Upgraded commons-compress from 1.26.2 to 1.27.0
- Upgraded commons-lang3 from 3.15.0 to 3.16.0
- Upgraded Apache SSHD from 2.13.1 to 2.13.2
- Upgraded Jetty from 12.0.11 to 12.0.12
- Upgraded Elasticsearch Client from 8.14.3 to 8.15.0
- Upgraded Jersey from 3.1.7 to 3.1.8
- Upgraded SLF4J from 2.0.13 to 2.0.15
- Upgraded Testcontainers from 1.20.0 to 1.20.1
- Upgraded org.tukaani xz from 1.9 to 1.10
- Upgraded snappy-java from 1.1.10.5 to 1.1.10.6
- Upgraded google-api-services-drive from v3-rev20240628-2.0.0 to v3-rev20240730-2.0.0
- Upgraded Hazelcast from 5.4.0 to 5.5.0
- Upgraded Azure Kusto from 5.1.0 to 5.1.1
- Upgraded ActiveMQ from 6.1.2 to 6.1.3
- Upgraded Clojure from 1.11.3 to 1.11.4
- Upgraded FlywayDB from 10.16.0 to 10.17.0
- Upgraded MongoDB from 4.11.2 to 4.11.3
- Upgraded Neo4j from 5.22.0 to 5.23.0

This closes #9167

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-12 13:03:46 -05:00
David Handermann 920edfc022
NIFI-13647 Removed Socket Close from ListenOTLP Error Responses (#9166) 2024-08-09 10:00:34 -04:00
Peter Gyori 4f262dc7ea
NIFI-13604 Python Source processors can be triggered without creating new FlowFiles
Closes #9159

Signed-off-by: Marton Szasz <szaszm@apache.org>
2024-08-08 22:49:05 +02:00
Matt Gilman 38292762bd
NIFI-13638: Limiting the maximum number of provenance events to return when fetching the latest events. (#9156) 2024-08-06 17:26:34 -04:00
David Handermann 8ba7d7805a
NIFI-13619 Switch web-client from OkHttp to Java HttpClient (#9140)
* NIFI-13619 Switched web-client from OkHttp to Java HttpClient
* NIFI-13619 Corrected comments to removed OkHttp references.
* NIFI-13619 Added writeTimeout handling and close method
* NIFI-13619 Added onDisabled to Service Provider
2024-08-06 15:46:54 -04:00
Matt Burgess fd8acd57b8
NIFI-13555 Added Verification to HikariDBCPConnectionPool (#9085)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-06 13:26:19 -05:00
Matt Gilman da6c9c4791
NIFI-13017: Replace JoltTransformJSON custom UI (#9117)
* NIFI-13017:
- Remove old JoltTransformJSON custom UI.
- Update build to use new JoltTransformJSON custom UI.
- Fix revision query parameter.

* NIFI-13017:
- Excluding jolt transform json ui in workflow ci.

* NIFI-13017:
- Excluding jolt nar in workflow ci.

* NIFI-13017:
- Excluding jolt ui war from code coverage.

* NIFI-13017:
- Incorporating nifi-web-servlet-shared.
- Moving QueryStringToFragmentFilter to nifi-web-servlet-shared.

This closes #9117
2024-08-06 13:51:41 -04:00
dan-s1 f64e68b23c
NIFI-13625 Removed or Replaced System.out.println in Tests (#9150)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 20:35:40 -05:00
Umar Hussain c5ed5c51e9
NIFI-12224 Added Support for updateMany Method in PutMongo
This closes #8610

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 12:38:07 -05:00
EndzeitBegins 458844909b
NIFI-13590 Refactored Standard Processors using current API methods
This closes #9119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-02 09:37:37 -05:00
Paul Grey febde9d281
NIFI-13553 Upgraded msal4j from 1.15.1 to 1.16.1
This closes #9106

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-31 11:14:44 -05:00
tpalfy b7faf8c84a
NIFI-13605 Make AbstractHadoopProcessor.KERBEROS_USER_SERVICE public
This closes #9129.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-07-31 16:37:08 +02:00
Krisztina Zsihovszki b3c6d8d98a
NIFI-13593 PutIceberg issue with decimal scale
This closes #9121

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-07-31 14:38:07 +02:00
David Handermann 33da3463b6
NIFI-13594 Added web-servlet-shared abstracted from web-utils (#9123)
- Moved RequestUriBuilder from web-utils to web-servlet-shared
- Refactored proxy header parsing from WebUtils to StandardRequestUriProvider
- Renamed WebUtils to WebClientUtils

This closes #9123
2024-07-30 15:41:49 -04:00
Timea Barna f262e74170
NIFI-13439 Added Performance Status to Group Status responses
- Added ProcessingPerformanceStatus to nifi-api
- Added Performance Status to Process Group and Processor Sources for Query NiFi Reporting Task

This closes #9014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-30 12:56:55 -05:00
dan-s1 b0d402d146
NIFI-13595 Replaced test method random string with repeated string (#9124)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-30 08:12:02 -05:00
Joseph Witt bacc30b05b NIFI-13567 bump various deps
google libraries-bom 26.42.0 26.43.0
com.amazonaws 1.12.756 1.12.762
com.box 4.10.0 4.11.1
com.exceptionfactory.jagged 0.3.2 0.4.0
com.fasterxml.jackson.core 2.17.1 2.17.2
com.fasterxml.jackson.dataformat 2.17.1 2.17.2
com.fasterxml.jackson.datatype 2.17.1 2.17.2
com.fasterxml.jackson.jakarta.rs 2.17.1 2.17.2
com.fasterxml.jackson.jaxrs 2.17.1 2.17.2
com.fasterxml.jackson.jr 2.17.1 2.17.2
com.fasterxml.jackson.module 2.17.1 2.17.2
com.github.pjfanning 4.3.1 4.4.0
com.h2database 2.2.224 2.3.230
com.networknt 1.4.2 1.5.0
commons-codec 1.17.0 1.17.1
io.netty 4.1.111.Final 4.1.112.Final
io.projectreactor.netty 1.1.20 1.1.21
net.sf.saxon Saxon-HE 12.4 12.5
org.apache.commons commons-lang3 3.14.0 3.15.0
org.elasticsearch.client 8.14.2 8.14.3
org.jetbrains.kotlin 1.9.24 1.9.25
org.jsoup 1.17.2 1.18.1
org.springframework 6.1.10 6.1.11
org.testcontainers 1.19.8 1.20.0
software.amazon.awssdk 2.26.15 2.26.21
com.github.docker-java 3.3.6 3.4.0
google-api-services-drive v3-rev20240521-2.0.0	 v3-rev20240628-2.0.0
com.slack.api bolt-socket-mode 1.40.2 1.40.3
wire-schema-jvm 4.9.9 5.0.0
io.projectreactor reactor-core/test 3.6.7 3.6.8
net.datafaker 2.3.0 2.3.1
org.flywaydb 10.15.2 10.16.0
org.jline 3.26.2 3.26.3
org.mariadb.jdbc 3.4.0 3.4.1
org.springframework.boot 3.3.1 3.3.2
org.springframework.integration 6.3.1 6.3.2
org.springframework.retry 2.0.6 2.0.7

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9097
2024-07-22 13:39:17 -04:00
Mark Payne 6dd83b7034 NIFI-13563: Updated Provenance Repository so that instead of returning the single latest event for a component, we return the events from the latest invocation / session. Added system tests to verify the behavior. Also, when replaying latest event, attempt all of those events until one succeeds or all fail
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9095
2024-07-22 12:44:35 -04:00
dan-s1 f50fce5344
NIFI-13565 Updated Record Date Time Properties to mention DateTimeFormatter
This closes #9096

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-19 17:00:50 -05:00
Mark Bathori 36fb6f109f NIFI-13528: fixed Python processor's customValidate function
This closes #9061.

Signed-off-by: Peter Gyori <pgyori@apache.org>
2024-07-16 18:05:33 +02:00
dan-s1 1ff5ebd6fc
NIFI-13550 Added documentation about the ExcelReader Starting Row Strategy
This closes #9082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-15 15:33:49 -05:00
Mark Bathori 730b9c693e
NIFI-13542 Added missing Max String Length property for JSON Readers
This closes #9074

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-15 15:05:35 -05:00
dan-s1 a424c0eac3
NIFI-12491 Added Starting Row Schema Strategy to ExcelReader
This closes #9064

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-13 15:17:03 -05:00
Mike Moser 3c7b262619
NIFI-13159 Moved Remote Delete after Put for PutFTP/PutSFTP REPLACE Strategy
This closes #8914

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 15:14:31 -05:00
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Bryan Bende cbdabccd6b
NIFI-13485 Use readBlob when reading content in GitHubRepositoryClient
- The readBlob method avoids issues with 1 MB limits on alternative getContent requests

This closes #9067

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-11 09:32:47 -05:00
EndzeitBegins 3b2120e6c6 NIFI-13537 Do not include exception details in FlowFile attributes in DeleteFile
This closes #9069

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-07-10 21:48:11 -04:00
dan-s1 90c58a88a7
NIFI-13418 Updated ExcelReader to handle spreadsheets with shared formulas
This closes #9063

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 16:18:27 -05:00
Joseph Witt 3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
exceptionfactory 4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
tpalfy 057e02e698
NIFI-13484 Fix HBase_2_ClientService.getResults methods, so they properly return a single row when startRow and endRow/stopRow are the same.
This closes #9029.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-07-08 17:20:35 +02:00