Commit Graph

194 Commits

Author SHA1 Message Date
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
exceptionfactory 6062f16667
NIFI-10861 This closes #6705. Deprecated Azure Storage Processors using legacy Microsoft SDK
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:34:06 -07:00
Nandor Soma Abonyi 4ea425e235
NIFI-10656 Log ignored event with info instead of warning
This closes #6540.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-22 22:13:56 +01:00
mr1716 c63a668ac5
NIFI-10808 Upgraded Guava from 31.0.1 to 31.1
This closes #6683

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:18:13 -06:00
Malthe Borch a71556f115
NIFI-10491 Added Conflict Resolution Strategy to PutAzureBlobStorage_v12
This closes #6443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:40:23 -06:00
Emilio Setiadarma d06c19180a
NIFI-9697: Implemented AzureKeyVaultSecretsParameterProvider and AzureKeyVaultCredentialsService; Implemented unit tests as well as the documentation for the Parameter Provider
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6545.
2022-11-14 13:25:47 -05:00
Emilio Setiadarma 08bc44715e
NIFI-10789 Set FlowFile attributes for errors fetching from Azure Data Lake Storage
This closes #6644

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:27:59 -06:00
Seokwon Yang 0643f336e8
NIFI-10130 AzureGraphUserGroupProvider handles group with transitive members
This closes #6135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 15:47:03 -06:00
Lehel Boér feb3148b68
NIFI-10628: Added Default Schedule Time and Run Duration to processors
This closes #6512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 14:57:46 -05:00
exceptionfactory 0dc02e26d2 NIFI-10648 Upgraded Apache Commons Text to 1.10.0
- Added org.apache.commons.text.version property in root Maven configuration
- Removed direct version references in favor of managed dependency version

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6531.
2022-10-14 14:07:23 -04:00
dan-s1 5da9ce525c
NIFI-10565 Removed duplicated test dependencies
This closes #6482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 09:07:51 -05:00
Joe Witt c6a9d70814
Merge branch 'NIFI-10521-RC4' 2022-10-06 14:13:30 -07:00
Yanni bcec883344
NIFI-10592 This closes #6486. fix flaky tests using wrong map impl.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-10-05 14:49:07 -07:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Peter Turcsanyi 271c773ee4
NIFI-10574: Fixed PutAzureDataLakeStorage fails with HTTP 412 error
This closes #6470

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-02 16:44:53 -05:00
exceptionfactory 6461061e8f
NIFI-10381 Refactored Azure Event Hubs components with current SDK
- Upgraded Azure Event Hubs components from legacy version 3 to current version 5
- Refactored Azure dependencies using azure-sdk-bom
- Merged nifi-azure-record-sink-nar with nifi-azure-nar
- Refactored PutAzureCosmosDBRecordTest to use Jackson instead of Gson

This closes #6319.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-28 18:22:01 +02:00
Nandor Soma Abonyi 320aed024f
NIFI-10152 Storage client caching in Azure ADLS processors
This closes #6158.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 08:26:44 +02:00
Timea Barna 22e8901fce NIFI-8248 Modified PutAzureDataLakeStorage processor to use temp file instead of inline replacement
This closes #6159

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2022-08-19 17:10:32 +00:00
royalfork2 eb419b6e40
NIFI-10300 Added AzureEventHubRecordSink
This closes #6296

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-15 15:57:08 -05:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Nandor Soma Abonyi f66540eb6d NIFI-9951 Add proxy support to Azure ADLS and Blob v12 processors
This closes #5990.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-25 20:33:14 +02:00
exceptionfactory e5203db960
NIFI-10046 Upgraded Gson to 2.9.0
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6072
2022-05-25 14:14:44 -04:00
Timea Barna 205c58230b NIFI-9879 Add min/max age and min/max size properties to ListAzure processors
This closes #5933.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-24 17:22:52 +02:00
exceptionfactory 0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
Malthe Borch 83a9e965d2 NIFI-9888 Fix Azure header datetime format
This fixes the occasional "403 Forbidden" bug that we have seen, simply because
the signature ends up being invalid due to an invalid datetime format used.

Issue: NIFI-9888
Reference: https://stackoverflow.com/a/51636763/647151

Use statically defined formatter and explain why

This closes #5943.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-04-23 22:11:40 -04:00
exceptionfactory 4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries

This closes #5992

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
Timea Barna 39a08025c3 NIFI-8677 Added endpoint suffix for Azure EventHub Processors
This closes #5303

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2022-04-06 13:22:29 -07:00
Joe Witt 873d25585c
NIFI-9780 Merge branch 'NIFI-9780-RC3' 2022-04-04 08:35:23 -07:00
Timea Barna 4a90334728 NIFI-9846 Implement pagination listing for Azure List processors
NIFI-9846 removing paging from ListAzureBlobStorage_v12 and ListAzureDataLakeStorage, adding = to filtering

This closes #5916.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-04-04 15:18:49 +02:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Joe Witt 72fadf9e51
NIFI-9780 fixing many inconsistent pom project declarations and updated org apache parent version 2022-03-10 11:15:16 -07:00
Peter Turcsanyi 3219c105eb
NIFI-9728: Added support for User Assigned Managed Identity authentication for Azure ADLS and Blob_v12 processors
Also bumped Azure dependencies.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5846.
2022-03-09 16:50:38 +01:00
Mike Thomsen f35f010deb
NIFI-9085 Refactored the Elasticsearch bundle to use JUnit 5
- NIFI-9086 Refactored nifi-accumulo-bundle to use JUnit 5
- NIFI-9087 Updated nifi-ambari-bundle to use JUnit 5
- NIFI-9088 Refactored nifi-amqp-bundle to use JUnit 5
- NIFI-9089 Updated nifi-asn1-bundle to use JUnit 5
- NIFI-9090 Refactored nifi-atlas-bundle to use JUnit 5
- NIFI-9091 Refactored nifi-avro-bundle to use JUnit 5
- NIFI-9092 Refactored nifi-aws-bundle to use JUnit 5
- NIFI-9095 Refactored nifi-azure-bundle to use JUnit 5
- NIFI-9145 Refactored nifi-rethinkdb-bundle to use JUnit 5
- NIFI-9143 Refactored nifi-redis-bundle to use JUnit 5

This closes #5350

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-07 21:49:23 -06:00
Timea Barna a3e1f32cae NIFI-9657 Create MoveADLS processor
This closes #5752.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-02-23 16:09:31 +01:00
exceptionfactory fe1139b8bb
NIFI-9692 Upgraded Apache Commons Lang3 to 3.12.0
- Moved commons-lang3 version management to root Maven configuration
- Refactored limited usage of StringUtils is nifi-reporting-utils to remove commons-lang3
- Refactored limited usage of StringUtils in nifi-websocket-processors to remove commons-lang3

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5773
2022-02-16 09:28:21 -05:00
exceptionfactory a2f6420f43
NIFI-9638 Refactored Google Guava usage in extensions
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5742
2022-02-09 16:39:53 -05:00
exceptionfactory dc7d9510cd NIFI-9610 Refactored nifi-processor-utils to separate modules
- Added nifi-bin-manager
- Added nifi-event-listen
- Added nifi-event-put
- Added nifi-listed-entity
- Added nifi-put-pattern
- Removed nifi-processor-utils

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5729.
2022-02-01 12:59:16 -05:00
exceptionfactory 5832dff25e
NIFI-9556 Upgraded Apache HttpClient to 4.5.13
- Upgraded Apache HttpCore to 4.4.15
- Added dependency management declarations in root Maven configuration for HttpClient and HttpCore
- Removed version numbers from multiple modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5647.
2022-01-08 11:06:07 +01:00
exceptionfactory 7c6bdcb035
NIFI-9491 Excluded commons-logging and added jcl-over-slf4j references
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5608
2021-12-17 07:21:03 -05:00
Peter Turcsanyi 01f9d59ee3
NIFI-9338 - Add Azure Blob processors using Azure Blob Storage client library v12 for Java
- changed default credential type to SAS Token
- added endpointSuffix property in integration tests
- added AzureServiceEndpoints to provide endpoint suffix constants and methods to get endpoint urls
- fixed typos, validators
- downgraded azure-identity to 1.3.7 due to a bug in the latest version
- added Access Token credential type (similar to the existing Blob/ADLS processors)
- used JUnit 5 in tests

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5486.
2021-11-09 11:38:36 +01:00
Joe Witt c055895952
NIFI-9344-RC3 prepare for next development iteration 2021-11-03 08:53:37 -07:00
Joe Witt 7fdc07cccd
NIFI-9344-RC3 prepare release nifi-1.15.0-RC3 2021-11-03 08:53:32 -07:00
Joe Gresock d2f8f97b10
NIFI-9276: Adding config verification to AbstractListProcessor subclasses (#5453) 2021-10-21 12:22:50 -04:00
Peter Turcsanyi 1e2783ba63
NIFI-9305: Upgraded Azure dependencies
Also fixed ITPutAzureDataLakeStorage (was broken due to a former dependency upgrade).

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5472.
2021-10-21 10:55:54 +02:00
Timea Barna 462306369f NIFI-8668 ConsumeAzureEventHub NiFi processors need to support storage SAS token authentication
This closes #5136.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-08-09 12:57:56 +02:00
Lehel Boér 9bf3b55034 NIFI-7947: Add directory deletion functionality in DeleteAzureDataLakeStorage
This closes #5190.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-08-05 13:21:44 +02:00