22fcb594d9
NIFI-8346 Route to failure in PutAzureBlobStorage for auth, IO exceptions
...
This closes #4917
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-03-23 11:28:04 -07:00
07a4966d10
NIFI-8329 - Updated dependencies with no build failures
...
NIFI-8329 - Removed unnecessary jackson.version from azure bundle to use the global property instead.
NIFI-8329 - Updated jackson/jackson-databind version and removed the 'jackson-databind.version' pom property in favor of 'jackson.version'
Updated dependencies include the following:
- jackson-core
- jackson-databind
- icu4j
- snakeyaml
- spring-integration-mail
- spring-core and framework modules
- activemq-client
- activemq-broker
- xercesImpl
This closes #4911
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-19 14:46:33 -05:00
7876f412fb
NIFI-8258: Add support for Service Principal authentication in ADLS processors
...
- Removed Expression Language support indicators from sensitive properties
This closes #4843
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-01 22:34:59 -06:00
59ad21fbaa
NIFI-8200 Modified PutAzureDataLakeStorage to delete temp file if exception was thrown in uploadContent()
...
This closes #4815
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-02-21 13:35:28 -08:00
88fab00e29
NIFI-7873 merging release branch to latest and updating to 1.14.0-SNAPSHOT
2021-02-15 12:09:32 -07:00
4afb2ba743
NIFI-7873-RC4 prepare for next development iteration
2021-02-15 12:09:31 -07:00
487280bee9
NIFI-7873-RC4 prepare release nifi-1.13.0-RC4
2021-02-15 12:09:30 -07:00
1e227ca643
NIFI-7964 Force PutAzureBlobStorage to stream writes
...
NIFI-7964 Remove unused import
NIFI-7964 Reverted to using BufferedInputStream along with unmarkable
NIFI-7964 Made UnmarkableInputStream static and added factory method
NIFI-7964 Remove unnecessary factory method from UnmarkableInputStream
This closes #4632 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-06 13:47:05 +01:00
942030579a
NIFI-7386 Added Azure Azurite emulator credentials service
...
This closes #4286
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-12-16 18:11:06 -06:00
1d31434c48
NIFI-8055 Fix validation message class-name for AzureCosmosDBClientService
...
This closes #4695
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-12-09 17:13:25 -06:00
80f49eb7bd
NIFI-7406 Added PutAzureCosmosRecord processor for Azure Cosmos DB
...
This closes #4253
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-11-03 01:54:33 -06:00
9a11d23c83
NIFI-7943 - Add application properties to GetAzureEventHub
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4617 .
2020-10-26 19:36:27 +01:00
f9ae3bb9c9
NIFI-7830: Support large files in PutAzureDataLakeStorage
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4556 .
2020-09-30 11:16:31 +02:00
73df6f1edf
NIFI-7794 Adding a property to PutAzureStorageBlob to determine whether to check the existence of a container and create it if necessary.
...
This closes #4535 .
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-09-21 14:18:56 -05:00
8baa5c9940
NIFI-7692 updating for next dev release 1.13.0
2020-08-18 14:48:02 -07:00
fb57bcbc11
NIFI-7692-RC1 prepare for next development iteration
2020-08-13 09:20:39 -07:00
303d6c59ba
NIFI-7692-RC1 prepare release nifi-1.12.0-RC1
2020-08-13 09:20:36 -07:00
5cc7c0485a
NIFI-7708: Add Azure SDK for Java (and transitive dependencies) to LICENCE and NOTICE files
...
This closes #4452
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-08-06 10:55:31 -07:00
c980b64bf5
NIFI-7340: Adding ListAzureDataLakeStorage
...
Also added validator for Directory Name property in AbstractAzureDataLakeStorageProcessor
Fix Tracking Entities strategy: use milliseconds for lastModified
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4438 .
2020-08-03 19:27:21 +02:00
19a84dd3dd
NIFI-7581 Added ControllerService-based credential settings support for ADLS processors
...
NIFI-7581 Separated Controller Service for providing Azure credentials for ADLS (ADLSCredentialsControllerService) form the one that does the same for Blob storages (AzureStorageCredentialsDetails). (This was done due to the considerable difference in the APIs of the libraries used to connect to both.)
NIFI-7581 Fix: Register controller service in META-INF. Minor fixes.
NIFI-7581 Minor changes (documentation, type etc.)
NIFI-7581 Updated integration tests.
NIFI-7581 Minor changes (renaming).
This closes #4369 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-07-12 11:56:31 +02:00
0a16002076
NIFI-7509: Added optional Record Writer property to all List* Processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4315 .
2020-06-19 17:30:40 +02:00
73008451d4
NIFI-7434: Add endpoint suffix to Azure storage processors
...
This closes #4265 .
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-06-10 09:45:04 -05:00
1dd0e92040
NIFI-7445: Add Conflict Resolution property to PutAzureDataLakeStorage processor
...
NIFI-7445: Add Conflict Resolution property to PutAzureDataLakeStorage processor
Made warning and error messages more informative.
Refactored flowFile assertion in the tests.
This closes #4287 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-05-27 09:13:41 +02:00
5826a09a83
NIFI-6911 Removed default Blob value for PutAzureBlobStorage
...
This closes #3906
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-05-19 13:47:08 -05:00
d6240a1074
NIFI-7336: Add tests for DeleteAzureDataLakeStorage
...
DeleteAzureDataLakeStorage now throws exception if fileSystem or fileName is empty string
NIFI-7336: Add tests for DeleteAzureDataLakeStorage - typos fixed
NIFI-7336: Add tests for DeleteAzureDataLakeStorage - fixed a test case
This closes #4272 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-05-19 18:35:33 +02:00
852715aadd
NIFI-7409: Azure managed identity support to Azure Datalake processors
...
NIFI-7409: review changes
NIFI-7409: ordering import statements
NIFI-7409: changed validateCredentialProperties logic
This closes #4249 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-05-19 11:50:08 +02:00
9aae58f117
NIFI-7446: FetchAzureDataLakeStorage processor now throws exception when the specified path points to a directory
...
A newer version (12.1.1) of azure-storage-file-datalake is imported.
This closes #4273 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-05-18 23:50:05 +02:00
9608fe33fa
NIFI-7367: Add tests for FetchAzureDataLakeStorage
...
NIFI-7367: Negative test cases for expression language in FetchAzureDataLakeStorage
FetchAzureDataLakeStorage throws exception when filesystem or filename is blank.
Fixed logged error messages in all 3 of the Delete, Fetch and Put ADLS processors.
testFetchDirectory test case marked as ignored.
This closes #4257 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-05-13 14:50:31 +02:00
851359c1fc
NIFI-6913: PutAzureBlobStorage processor will create container if not exists
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4237 .
2020-05-09 15:37:14 +02:00
2a44f0ff2f
NIFI-7412: Fixed provenance event types in Azure Fetch/Delete processors
...
This closes #4245 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-05-01 22:57:02 +02:00
aa1e272052
NIFI-6149: Azure EventHub Managed identities support patch
...
review changes
additional review changes
NIFI-6149: typo fixes
This closes #4226 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-04-30 23:17:20 +02:00
a7008903ed
NIFI-7298: PutAzureDataLakeStorage tests.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4227 .
2020-04-28 19:03:56 +02:00
58118cf904
NIFI-7334 Adding FetchDataLakeStorage Processor to provide native support for Azure Data lake Gen 2 Storage.
...
NIFI-7334 Update to FetchDataLakeStorage Processor
This closes #4212 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-04-16 11:49:44 +02:00
9df53e7204
NIFI-6977 - Change the reporting behavior of Azure Reporting task to report report the time when metrics are generated
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4211 .
2020-04-15 12:53:18 +02:00
63379c3520
NIFI-7259 Adding DeleteDataLakeStorage Processor to provide native support for Azure Data lake Gen 2 Storage.
...
Updated to remove unused variables
NIFI-7259 import and property description changes
This closes #4189 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-04-08 10:58:48 +02:00
daddf400a2
NIFI-7103 Adding PutDataLakeStorage Processor to provide native support for Azure Data Lake Storage Gen 2 Storage.
...
added data-lake dependency
NIFI-7103 fixed indentation
Update to add IllegalArgumentException
Fixed indentation and logging
nifi-7103 review changes
nifi-7103 root directory and exception change
This closes #4126 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-03-31 11:15:07 +02:00
71bf12976f
NIFI-7258 - fix overflow in PutAzureEventHub when not configured correctly
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4146 .
2020-03-16 21:28:12 +01:00
3de77ebacc
NIFI-7021-RC3 prepare for next development iteration
2020-01-19 14:14:40 -05:00
633408bce7
NIFI-7021-RC3 prepare release nifi-1.11.0-RC3
2020-01-19 14:14:38 -05:00
f8057d0c2f
NIFI-7042: This closes #3996.Azure Reporting Tasking throwing NullReferenceException
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2020-01-17 15:29:40 -05:00
23c8234586
NIFI-7031 updating copyright year on NOTICES
2020-01-15 16:10:31 -05:00
2601f722b3
NIFI-6998 This closes #3972 . Batch & Partitioning key
...
+ Asynchronous sending in limited batches
+ Property to determine attribute name carrying partitioning key
+ Maximum batch size property
+ Carrier object
- Unit test fakery
NIFI-6998 Attributes to User Defined properties
NIFI-6998 Unit tests
NIFI-6998 Review corrections
+ Interruption propagation (& test)
+ Final carrier members
+ Unnecessary generic modifiers removed from generic container
NIFI-6998 checkstyle corrections
+ Tabs to spaces, trailnig spaces
+ Absolute Imports
+ Braces locations
NIFI-6998 imports & license
Signed-off-by: Joe Witt <joewitt@apache.org>
2020-01-13 22:37:46 -05:00
65ca8e6c8d
NIFI-6942 This closes #3934 . Added a reporting task to push provenance data to azure log analytics.
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2020-01-06 15:42:15 -05:00
bed3dd2fff
NIFI-6583: Fixed erroneous references to 1.10.0-SNAPSHOT nifi artifacts that should now be 1.11.0-SNAPSHOT
2019-11-22 10:55:08 -05:00
0acdde827e
NIFI-6583: adding azure log analytics reporting task to nifi-azure-bundle
...
This closes #3817 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2019-11-21 13:01:38 -05:00
c72a5618c0
NIFI-4012 Azure Event Hub UI typos and cleanup
...
This closes #3749 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-11-18 17:29:24 +09:00
84a05c8595
NIFI-6729 - Created AbstractSingleAttributeBasedControllerServiceLookup and updated DBCPConnectionPoolLookup and AzureStorageCredentialsControllerServiceLookup to inherit from it.
...
This closes #3774 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2019-11-05 14:02:03 +01:00
f8c3d877cf
NIFI-6733 updating to next release version for master branch
2019-11-04 13:31:39 -05:00
418179f5b2
NIFI-6733-RC3 prepare for next development iteration
2019-10-28 15:13:13 -07:00
b217ae20ad
NIFI-6733-RC3 prepare release nifi-1.10.0-RC3
2019-10-28 15:12:57 -07:00
Denes Arvay
Nathan Gough
Peter Turcsanyi
Timea Barna
Joe Witt
Joey Frazee
sjyang18
Sushil Kumar
Fabio Torchetti
Paul Kelly
Peter Gyori
Tamas Palfy
Mark Payne
muazmaz
Pierre Villard
bahlulh
Martin Šimek
Ubuntu
Shayne Burgess
Tamas Palfy