Commit Graph

258 Commits

Author SHA1 Message Date
exceptionfactory 640b7bdfbb NIFI-12646-RC4 prepare release nifi-2.0.0-M2-RC4 2024-01-25 18:11:28 -06:00
EndzeitBegins 53bb995e4e
NIFI-12613 Renamed asDescribedValue() to asAllowableValue()
This closes #8260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-17 22:16:29 -06:00
Peter Turcsanyi 2a3a7d9379
NIFI-11294 Support Component State Checkpoints in ConsumeAzureEventHub
This closes #8013

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Peter Turcsanyi <turcsanyip@apache.org>
Co-authored-by: Malthe Borch <mborch@gmail.com>
2024-01-17 20:08:14 -06:00
Peter Turcsanyi e1f920cd2b
NIFI-8278 Fixed Proxy Service property in Azure Storage processors
This closes #8259

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-16 20:23:05 -06:00
Tanmaya Panda a613c52437
NIFI-11958 Added PutAzureDataExplorer and StandardKustoQueryService
This closes #7624

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-16 19:55:33 -06:00
David Handermann 250fe90b34
NIFI-9458 Replaced SimpleDateFormat with DateTimeFormatter (#8248)
- Added FieldConverterRegistry and Standard implementation
- Moved DateTypeUtils methods to FieldConverter implementations
2024-01-16 16:39:40 -05:00
exceptionfactory c6f5f534cb
NIFI-12618 Upgraded Azure SDK BOM from 1.2.18 to 1.2.19
- Suppressed CVE-2023-36052 not applicable to Java Azure libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8254.
2024-01-16 23:08:52 +04:00
Peter Turcsanyi e8783f3325
NIFI-8278 Added Credentials Type to ADLSCredentialsControllerService
Used migrateProperties() for migrating old flows to the new property structure.
Moved common properties to AzureStorageUtils and also updated/consolidated some property descriptions

This closes #8205

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-15 11:24:01 -06:00
EndzeitBegins dd5854d324
NIFI-12572 Updated nifi-azure-bundle using current API methods
This closes #8210

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-10 14:20:48 -06:00
Peter Turcsanyi 02d563eefc
NIFI-12525: Added property migration for the removed Consumer Hostname property in ConsumeAzureEventHub
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8171.
2023-12-21 13:23:35 +01:00
EndzeitBegins c272574dcc
NIFI-12452 Improved support for DescribedValue in Descriptors
- Removed calls to Builder.defaultValue(null) in several Components

This closes #8102

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:45:45 -06:00
Peter Turcsanyi 8645088e1d
NIFI-12412 Support Proxies for Blob Checkpoints in ConsumeAzureEventHub
This closes #8107

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 08:23:59 -06:00
exceptionfactory 456cf7d88d
NIFI-12451 This closes #8104. Removed Bootstrap Notification Services
- Refactored Security Property handling and bootstrap certificate generation
- Removed unnecessary dependencies from nifi-bootstrap
- Removed unnecessary and unused settings from bootstrap.conf

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-04 15:09:45 -07:00
exceptionfactory e5e76d0161
NIFI-12393 Upgraded OWASP Check from 8.4.2 to 8.4.3
- Upgraded Azure SDK BOM from 1.2.17 to 1.2.18
- Upgraded Reactor Netty HTTP from 1.0.34 to 1.0.39 for Azure Identity
- Upgraded MSAL4J from 1.13.10 to 1.14.0
- Upgraded Box Java SDK from 4.4.0 to 4.6.1
- Relocated Apache Ant managed versions to bundle parent modules
- Added okio-fakefilesystem to managed dependencies
- Suppressed vulnerability for Picocli misidentified as LINE library
- Added managed dependencies to nifi-code-coverage to avoid false positives due to different parent modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8054.
2023-11-21 12:16:12 +01:00
Malthe Borch 0fe9d2b56f
NIFI-9972 Added CopyAzureBlobStorage_v12 Processor
This closes #6941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 13:13:25 -06:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
lehelb a3e4f89fe3
NIFI-12271 Fix PutAzureBlobStorage_v12 rollback on failure with FileResourceService
This closes #7930

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 14:52:15 -05:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925)
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
2023-10-25 13:22:26 -04:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852)
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
2023-10-10 13:55:22 -04:00
mkalavala 2b41b07489
NIFI-6240 Added Proxy Support for WebSocket Transport in Azure EventHubs
This closes #7740

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:19:24 -05:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
Justin 7a79e8c01f
NIFI-12037 Update AzureUserGroupProvider to allow configuration of the graph endpoint and API scope to support regional clouds.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7675.
2023-09-14 19:39:03 +02:00
Joseph Witt 4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
Peter Turcsanyi 68983cef42
NIFI-11987: Set read buffer size in PutAzureBlobStorage_v12
Increased the read buffer size in order to avoid OOME due to too many buffer allocations (exceeding vm.max_map_count on Linux).

This closes #7640

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-08-24 15:55:55 +02:00
mr1716 c0156e3429 NIFI-11936 Update msal4j.version to 1.13.10
This closes #7599

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:48:41 -04:00
Peter Turcsanyi 2e6eaaeb38
NIFI-11926: Added proxy handling in Azure Storage Credentials Services
Added Proxy Configuration Service property in AzureStorageCredentialsControllerService_v12 and ADLSCredentialsControllerService used by Service Principal and Managed Identity authentication modes.

This closes #7590

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:46:31 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
Peter Turcsanyi 437995b75a
NIFI-11758: Added FileResourceService and used it in PutAzure*Storage processors for local file upload
- Renamed classes from DataUpload to ResourceTransfer and updated references
- Disabled testNonReadableFile() on Windows due to Posix permissions
- Replaced utility methods with functional handling of FileResource
- Corrected FlowFile InputStream access using Optional.orElseGet()

This closes: #7458

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-07-14 23:48:27 +02:00
Tanmaya Panda bd33f2c911
NIFI-8294 Added QueryAzureDataExplorer and StandardKustoQueryService
This closes #7122

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 15:26:47 -05:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
exceptionfactory 9195b586e5
NIFI-11656 Removed deprecated Azure Queue Storage Processors
- Removed AzureStorageCredentialsControllerService and related implementations
- Removed com.micrsoft.azure:azure-storage dependencies

This closes #7350

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-07 16:19:38 +02:00
exceptionfactory c5c711c91d
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
- Added selective overrides to upgrade transitive dependencies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
Emilio Setiadarma b11373af7b
NIFI-11549 Added AzureQueueStorage_v12 Processors
- Deprecated GetAzureQueueStorage and PutAzureQueueStorage

This closes #7269

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 16:26:02 -05:00
Peter Turcsanyi 963518d943
NIFI-11586 Added AzureStorageCredentialsControllerServiceLookup_v12
Also added client caching in blob v_12 processors which was needed to support multiple credentials provided by the new lookup service

This closes #7300

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-05 13:07:02 +02:00
Pierre Villard 06b49cbc32
NIFI-11619 Upgraded Azure BOM from 1.2.11 to 1.2.13
This closes #7320

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:04 -05:00
Peter Turcsanyi e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
mr1716 141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
exceptionfactory f7e36a07ac
NIFI-11228 Removed deprecated Azure Blob Storage Processors
This closes #7234

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-12 17:33:28 +02:00
mkalavala aad7b40bd9
NIFI-11360 Added Client-Side Encryption for Azure Blob v12 Processors
This closes #7182

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-02 20:37:33 -05:00
Peter Turcsanyi 8586ac594e
NIFI-11475 Fixed missing jackson-dataformat-xml in nifi-azure-services-api
This closes #7186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-21 08:55:26 -05:00
exceptionfactory d382b378a8
NIFI-11387 Added Transport Type property to Azure Event Hub Components
- Transport Type defaults to AMQP and also supports AMQP with WebSockets

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7126.
2023-04-19 15:04:56 +03:00
Pierre Villard a148b6f348
NIFI-11407 Upgraded Azure BOM from 1.2.9 to 1.2.11
- Added Woodstox Core to nifi-toolkit-encrypt-config

This closes #7136

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 14:36:48 -05:00