Commit Graph

161 Commits

Author SHA1 Message Date
Balázs Gerner bce14f573b
NIFI-12643 Added support for FileResourceService in PutGCSObject
This closes #8281.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-01-26 14:38:41 +01:00
Mark Bathori 69df3f0f66
NIFI-12334 Added GCSFileResourceService
This closes #7999

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-22 13:33:11 -06:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925)
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
2023-10-25 13:22:26 -04:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852)
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
2023-10-10 13:55:22 -04:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
Joseph Witt 4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
Paul Grey c0c1b386f6 NIFI-11981 - PublishGCPubSub failure / Record-based processing / AVRO
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7638
2023-08-23 14:29:19 -04:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
Pierre Villard 62487f575a
NIFI-11891 Added No Tracking listing strategy to ListGCS
This closes #7570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 14:06:17 -05:00
Pierre Villard b056bf8f7b
NIFI-11823 - fix NUMERIC support in PutBigQuery
This closes #7489.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-05 23:21:48 +02:00
Mark Payne 485112e54f
NIFI-11911 Updated FetchGoogleDrive to support Export Types
- Export API support includes Google Docs, Presentations, Spreadsheets, Drawings, and AppScripts

This closes #7575

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 16:28:44 -05:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
Pierre Villard a04cbe7f07 NIFI-11779 - Override endpoint in PutBigQuery
review

use default from code instead of hardcoding

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7460
2023-07-10 12:15:24 -04:00
exceptionfactory 09e36f4d3e NIFI-11757 Upgraded Google Cloud Libraries from 26.15.0 to 26.17.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7439
2023-06-27 12:48:51 -04:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
exceptionfactory 6b19ab8eaa NIFI-11696 Upgraded Bouncy Castle from 1.71 to 1.74
- Adjusted nifi-repository-encryption to remove dependency on Bouncy Castle Provider
- Updated Google Cloud Provider dependencies to remove exclusions and dependencies on Bouncy Castle that no longer apply to current versions

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7384
2023-06-15 16:33:20 -04:00
Paul Grey 336b857442
NIFI-11553 Add Record handling and more Properties for GCP PubSub
- Added Message Derivation Strategy to PublishGCPubSub with FlowFile and Record options
- Added API Endpoint property to PublishGCPPubSub and ConsumeGCPubSub
- Added Batch configuration properties

This closes #7274

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 11:00:51 -05:00
exceptionfactory 7485687d4b
NIFI-11657 Removed Deprecated PutBigQueryBatch and PutBigQueryStreaming
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7351.
2023-06-11 15:49:42 +02:00
exceptionfactory c5c711c91d
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
- Added selective overrides to upgrade transitive dependencies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
Pierre Villard d4f301f473
NIFI-11620 Upgraded Google libraries-bom from 26.12.0 to 26.15.0
This closes #7321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:44 -05:00
Steven Matison 645618a609
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery
This closes #7316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 14:32:01 -05:00
Pierre Villard bdcd4fcfda
NIFI-11402 - PutBigQuery fix for case sensitivity and error handling
This closes #7140.

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2023-04-19 21:07:23 +02:00
Paul Grey cff7808543
NIFI-11439 Corrected GCS Transit URI for custom Storage API URL
This closes #7173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 10:09:27 -05:00
Paul Grey cd685671c8
NIFI-11439 Corrected Checkstyle violation on GCS Property
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 14:25:54 -05:00
Paul Grey ee24df2830
NIFI-11439 Added Storage API URL property to GCS Processors
- Included Host Header override with Storage API URL based on Google Private Service Connect documentation

This closes #7172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 13:56:23 -05:00
Joe Witt 4414793f2a
NIFI-11408 enable user to disable gzip compression with PutGCSObject
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7139.
2023-04-10 19:57:16 +03:00
Pierre Villard 9149bd47c4
NIFI-11406 Upgraded Google GCP from 26.4.0 to 26.12.0
- Upgraded Google Drive from Revision 20221219 to 20230306

This closes #7135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:47:15 -05:00
krisztina-zsihovszki fe2721786c
NIFI-11266 PutGoogleDrive, ListGoogleDrive, FetchGoogleDrive can't access a SharedDrive
This closes #7058

Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-27 16:01:04 +02:00
exceptionfactory 512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
exceptionfactory 48689a2567
NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-02-23 10:33:45 -05:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
Robert Kalmar 9906f0a952
NIFI-11150 Add Service Account JSON credentials support to Google Pub/Sub Lite procesors
This closes #6933.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-09 12:53:27 +01:00
Kalman Jantner 027e2b9bc1 NIFI-11123: fix default value and update docs
This closes #6899.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-02 18:48:47 +01:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
krisztina-zsihovszki 92ccb79670
NIFI-11117 Remove folder creation from PutGoogleDrive
This closes #6910.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-31 19:58:44 +01:00
exceptionfactory 4fe2c318e6
NIFI-11091 This closes #6884. Upgraded Google libraries-bom from 25.4.0 to 26.4.0
- Upgraded Google Drive library to v3-rev20221219-2.0.0
- Corrected test encryption keys to match expected encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 10:00:00 -07:00
krisztina-zsihovszki 4700fed249
NIFI-10965 PutGoogleDrive
This closes #6832.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 22:20:33 +01:00
Kalman Jantner 67925b171a NIFI-10953: Implement GCP Vision AI processors
This closes #6762.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-01-19 16:20:58 +01:00
Eric Bernard b65431564d
NIFI-10988 - Fix ConsumeGCPubSubLite processors delivering incorrect messages
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6788.
2022-12-23 18:26:13 +01:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
Csaba Bejan ac7306f582
NIFI-10693 Remove proxy configuration properties from PutBigQuery
This closes #6580.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-27 16:57:11 +02:00
Lehel Boér feb3148b68
NIFI-10628: Added Default Schedule Time and Run Duration to processors
This closes #6512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 14:57:46 -05:00
Joe Witt c155d29658
NIFI-10614 Upgraded Bouncy Castle from 1.70 to 1.71
- Blocked Bouncy Castle jdk15on dependencies
- Forced jdk18on dependencies and validated across entire build

This closes #6498

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 19:35:02 -05:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00