Commit Graph

169 Commits

Author SHA1 Message Date
Mike Thomsen 99f3717f13
NIFI-13430 Added CopyS3Object and GetS3ObjectMetadata
This closes #8992

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-14 20:23:20 -05:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
Michael Akinyemi 39a1ccc191
NIFI-11977 Set UTF-8 Character Set in Subject for PutEmail (#9170)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:03:41 -05:00
Joseph Witt 3096c983f5
NIFI-13648 Upgraded Jetty to 12.0.12 along with other common dependencies
- Upgraded AWS SDK from 1.12.762 to 1.12.767
- Upgraded AWSK SDK from 2.26.21 to 2.27.1
- Upgraded zstd-jni from 1.5.6-3 to 1.5.6-4
- Upgraded excel-streaming-reader from 4.4.0 to 5.0.2
- Upgraded azure-sdk-bom from 1.2.25 to 1.2.26
- Upgraded json-schema-validator from 1.5.0 to 1.5.1
- Upgraded oauth2-oidc-sdk from 11.13 to 11.14
- Upgraded Fabric8 Kubernetes Client from 6.13.1 to 6.13.2
- Upgraded commons-compress from 1.26.2 to 1.27.0
- Upgraded commons-lang3 from 3.15.0 to 3.16.0
- Upgraded Apache SSHD from 2.13.1 to 2.13.2
- Upgraded Jetty from 12.0.11 to 12.0.12
- Upgraded Elasticsearch Client from 8.14.3 to 8.15.0
- Upgraded Jersey from 3.1.7 to 3.1.8
- Upgraded SLF4J from 2.0.13 to 2.0.15
- Upgraded Testcontainers from 1.20.0 to 1.20.1
- Upgraded org.tukaani xz from 1.9 to 1.10
- Upgraded snappy-java from 1.1.10.5 to 1.1.10.6
- Upgraded google-api-services-drive from v3-rev20240628-2.0.0 to v3-rev20240730-2.0.0
- Upgraded Hazelcast from 5.4.0 to 5.5.0
- Upgraded Azure Kusto from 5.1.0 to 5.1.1
- Upgraded ActiveMQ from 6.1.2 to 6.1.3
- Upgraded Clojure from 1.11.3 to 1.11.4
- Upgraded FlywayDB from 10.16.0 to 10.17.0
- Upgraded MongoDB from 4.11.2 to 4.11.3
- Upgraded Neo4j from 5.22.0 to 5.23.0

This closes #9167

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-12 13:03:46 -05:00
David Handermann 920edfc022
NIFI-13647 Removed Socket Close from ListenOTLP Error Responses (#9166) 2024-08-09 10:00:34 -04:00
Peter Gyori 4f262dc7ea
NIFI-13604 Python Source processors can be triggered without creating new FlowFiles
Closes #9159

Signed-off-by: Marton Szasz <szaszm@apache.org>
2024-08-08 22:49:05 +02:00
Matt Gilman 38292762bd
NIFI-13638: Limiting the maximum number of provenance events to return when fetching the latest events. (#9156) 2024-08-06 17:26:34 -04:00
David Handermann 8ba7d7805a
NIFI-13619 Switch web-client from OkHttp to Java HttpClient (#9140)
* NIFI-13619 Switched web-client from OkHttp to Java HttpClient
* NIFI-13619 Corrected comments to removed OkHttp references.
* NIFI-13619 Added writeTimeout handling and close method
* NIFI-13619 Added onDisabled to Service Provider
2024-08-06 15:46:54 -04:00
Matt Burgess fd8acd57b8
NIFI-13555 Added Verification to HikariDBCPConnectionPool (#9085)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-06 13:26:19 -05:00
Matt Gilman da6c9c4791
NIFI-13017: Replace JoltTransformJSON custom UI (#9117)
* NIFI-13017:
- Remove old JoltTransformJSON custom UI.
- Update build to use new JoltTransformJSON custom UI.
- Fix revision query parameter.

* NIFI-13017:
- Excluding jolt transform json ui in workflow ci.

* NIFI-13017:
- Excluding jolt nar in workflow ci.

* NIFI-13017:
- Excluding jolt ui war from code coverage.

* NIFI-13017:
- Incorporating nifi-web-servlet-shared.
- Moving QueryStringToFragmentFilter to nifi-web-servlet-shared.

This closes #9117
2024-08-06 13:51:41 -04:00
dan-s1 f64e68b23c
NIFI-13625 Removed or Replaced System.out.println in Tests (#9150)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 20:35:40 -05:00
Umar Hussain c5ed5c51e9
NIFI-12224 Added Support for updateMany Method in PutMongo
This closes #8610

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 12:38:07 -05:00
EndzeitBegins 458844909b
NIFI-13590 Refactored Standard Processors using current API methods
This closes #9119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-02 09:37:37 -05:00
Paul Grey febde9d281
NIFI-13553 Upgraded msal4j from 1.15.1 to 1.16.1
This closes #9106

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-31 11:14:44 -05:00
tpalfy b7faf8c84a
NIFI-13605 Make AbstractHadoopProcessor.KERBEROS_USER_SERVICE public
This closes #9129.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-07-31 16:37:08 +02:00
Krisztina Zsihovszki b3c6d8d98a
NIFI-13593 PutIceberg issue with decimal scale
This closes #9121

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-07-31 14:38:07 +02:00
David Handermann 33da3463b6
NIFI-13594 Added web-servlet-shared abstracted from web-utils (#9123)
- Moved RequestUriBuilder from web-utils to web-servlet-shared
- Refactored proxy header parsing from WebUtils to StandardRequestUriProvider
- Renamed WebUtils to WebClientUtils

This closes #9123
2024-07-30 15:41:49 -04:00
Timea Barna f262e74170
NIFI-13439 Added Performance Status to Group Status responses
- Added ProcessingPerformanceStatus to nifi-api
- Added Performance Status to Process Group and Processor Sources for Query NiFi Reporting Task

This closes #9014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-30 12:56:55 -05:00
dan-s1 b0d402d146
NIFI-13595 Replaced test method random string with repeated string (#9124)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-30 08:12:02 -05:00
Joseph Witt bacc30b05b NIFI-13567 bump various deps
google libraries-bom 26.42.0 26.43.0
com.amazonaws 1.12.756 1.12.762
com.box 4.10.0 4.11.1
com.exceptionfactory.jagged 0.3.2 0.4.0
com.fasterxml.jackson.core 2.17.1 2.17.2
com.fasterxml.jackson.dataformat 2.17.1 2.17.2
com.fasterxml.jackson.datatype 2.17.1 2.17.2
com.fasterxml.jackson.jakarta.rs 2.17.1 2.17.2
com.fasterxml.jackson.jaxrs 2.17.1 2.17.2
com.fasterxml.jackson.jr 2.17.1 2.17.2
com.fasterxml.jackson.module 2.17.1 2.17.2
com.github.pjfanning 4.3.1 4.4.0
com.h2database 2.2.224 2.3.230
com.networknt 1.4.2 1.5.0
commons-codec 1.17.0 1.17.1
io.netty 4.1.111.Final 4.1.112.Final
io.projectreactor.netty 1.1.20 1.1.21
net.sf.saxon Saxon-HE 12.4 12.5
org.apache.commons commons-lang3 3.14.0 3.15.0
org.elasticsearch.client 8.14.2 8.14.3
org.jetbrains.kotlin 1.9.24 1.9.25
org.jsoup 1.17.2 1.18.1
org.springframework 6.1.10 6.1.11
org.testcontainers 1.19.8 1.20.0
software.amazon.awssdk 2.26.15 2.26.21
com.github.docker-java 3.3.6 3.4.0
google-api-services-drive v3-rev20240521-2.0.0	 v3-rev20240628-2.0.0
com.slack.api bolt-socket-mode 1.40.2 1.40.3
wire-schema-jvm 4.9.9 5.0.0
io.projectreactor reactor-core/test 3.6.7 3.6.8
net.datafaker 2.3.0 2.3.1
org.flywaydb 10.15.2 10.16.0
org.jline 3.26.2 3.26.3
org.mariadb.jdbc 3.4.0 3.4.1
org.springframework.boot 3.3.1 3.3.2
org.springframework.integration 6.3.1 6.3.2
org.springframework.retry 2.0.6 2.0.7

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9097
2024-07-22 13:39:17 -04:00
Mark Payne 6dd83b7034 NIFI-13563: Updated Provenance Repository so that instead of returning the single latest event for a component, we return the events from the latest invocation / session. Added system tests to verify the behavior. Also, when replaying latest event, attempt all of those events until one succeeds or all fail
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9095
2024-07-22 12:44:35 -04:00
dan-s1 f50fce5344
NIFI-13565 Updated Record Date Time Properties to mention DateTimeFormatter
This closes #9096

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-19 17:00:50 -05:00
Mark Bathori 36fb6f109f NIFI-13528: fixed Python processor's customValidate function
This closes #9061.

Signed-off-by: Peter Gyori <pgyori@apache.org>
2024-07-16 18:05:33 +02:00
dan-s1 1ff5ebd6fc
NIFI-13550 Added documentation about the ExcelReader Starting Row Strategy
This closes #9082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-15 15:33:49 -05:00
Mark Bathori 730b9c693e
NIFI-13542 Added missing Max String Length property for JSON Readers
This closes #9074

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-15 15:05:35 -05:00
dan-s1 a424c0eac3
NIFI-12491 Added Starting Row Schema Strategy to ExcelReader
This closes #9064

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-13 15:17:03 -05:00
Mike Moser 3c7b262619
NIFI-13159 Moved Remote Delete after Put for PutFTP/PutSFTP REPLACE Strategy
This closes #8914

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 15:14:31 -05:00
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Bryan Bende cbdabccd6b
NIFI-13485 Use readBlob when reading content in GitHubRepositoryClient
- The readBlob method avoids issues with 1 MB limits on alternative getContent requests

This closes #9067

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-11 09:32:47 -05:00
EndzeitBegins 3b2120e6c6 NIFI-13537 Do not include exception details in FlowFile attributes in DeleteFile
This closes #9069

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-07-10 21:48:11 -04:00
dan-s1 90c58a88a7
NIFI-13418 Updated ExcelReader to handle spreadsheets with shared formulas
This closes #9063

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 16:18:27 -05:00
Joseph Witt 3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
exceptionfactory 4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
tpalfy 057e02e698
NIFI-13484 Fix HBase_2_ClientService.getResults methods, so they properly return a single row when startRow and endRow/stopRow are the same.
This closes #9029.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-07-08 17:20:35 +02:00
exceptionfactory 62c66a12d1
NIFI-13525 Removed unused classes from nifi-security-crypto-key
This closes #9057

- Removed Derived Key Parameter Reader and implementations
- Removed bcrypt and scrypt Derived Key Providers
- Removed unused dependency from nifi-cipher-processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-06 09:33:32 -07:00
dan-s1 b2840bd851
NIFI-13466 Catch IllegalStateException in SplitExcel
This closes #9033

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:04:47 -05:00
Joseph Witt 15e5193099
NIFI-13517 Upgraded Jetty from 12.0.10 to 12.0.11 and others
- Upgraded AWS SDK 1 from 1.12.755 to 1.12.756
- Upgraded AWS SDK 2 from 2.26.14 to 2.26.15
- Upgraded Azure SDK BOM from 1.2.24 to 1.2.25
- Upgraded Elasticsearch Client from 8.14.1 to 8.14.2
- Upgraded GitHub Client from 1.322 to 1.323
- Upgraded mysql-connector-j from 8.4.0 to 9.0.0
- Upgraded Azure Kusto from 5.0.5 to 5.1.0
- Upgraded Datafaker from 2.2.2 to 2.3.0
- Upgraded nimbus-jose-jwt from 9.37.3 to 9.40
- Upgraded oauth2-oidc-sdk from 11.10.1 to 11.13

This closes #9051

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:00:13 -05:00
Joseph Witt 6783420897
NIFI-13513 Removed ListenSMTP
This closes #9047

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:51:18 -05:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00
Joseph Witt 4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
Joseph Witt 396c8450d0
NIFI-13505 Removed QueryDNS and QueryWhois
This closes #9043

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:46:21 -05:00
Joseph Witt b2f19aa0a8
NIFI-13501 Removed DecryptContent and DecryptContentCompatibility
This closes #9041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:45:36 -05:00
exceptionfactory 7cb6684801
NIFI-13494 Removed support for Repository Encryption
This closes #9039

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:48:40 -07:00
exceptionfactory 449ada0863
NIFI-13489 Removed Kafka 2.6 Processors
This closes #9034

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:42:35 -07:00
Joseph Witt 89741f6160
NIFI-13516 Removed YandexTranslate and nifi-language-translation-nar
This closes #9049

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 14:26:08 -05:00
Joseph Witt b1da7322e8
NIFI-13515 Removed PutKudu and nifi-kudu-bundle
This closes #9048

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:22:44 -05:00
Joseph Witt ad7375a3be
NIFI-13503 Removed ExtractTNEFAttachments from nifi-email-processors
This closes #9042

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:20:12 -05:00
Joseph Witt db6bac21bf
NIFI-13499 Removed ListenBeats and nifi-beats-bundle
This closes #9040

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:18:28 -05:00
Peter Turcsanyi f57a96dbfb
NIFI-13496 Included Hadoop configuration file paths in the classloader isolation key of HDFS processors
Signed-off-by: Mark Bathori <mbathori@apache.org>

This closes #9038
2024-07-05 13:52:17 +02:00