Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,934 Commits 143 Branches 197 Tags 390 MiB
Commit Graph

72 Commits

Author SHA1 Message Date
Christopher Currie c894246e03 NIFI-3950 Refactor AWS bundle 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2140.
 2017-10-21 12:58:40 -07:00
kwydler e89512e744 NIFI-4161: Adding expression evaluation to AWS PROXY_HOST and PROXY_HOST_PORT property usage 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1990.
 2017-07-07 13:28:33 +02:00
kwydler c37aed4de2 NIFI-4128 Added "All" MessageAttributeNames to GetSQS processor ReceiveMessageRequest 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1949.
 2017-06-26 22:25:16 -07:00
James Wing 9238fdb493 NIFI-3903 Unit Tests for AWS Processors 
* Added non-integration unit tests for Lambda, S3, SNS, and SQS processors
* Moved non-integration tests out of integration test files
* Moved SQS integration tests to IT* files for clarification

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1814.
 2017-05-23 19:25:55 +02:00
Tim Reardon 20a1fc24d7 NIFI-3885 DynamoDB Processor EL Support 
Add EL support to remaining Dynamo processor properties

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1793.
 2017-05-15 10:13:53 -07:00
Tim Reardon dc44e30698 NIFI-3856 PutCloudWatchMetric Stats, Dimensions 
PutCloudWatchMetric support for StatisticSets and Dimensions

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1775.
 2017-05-10 12:07:04 -07:00
Tim Reardon 361a58c531 NIFI-3851 Support EL in AWS Endpoint Override URL 
Add expression language support to AWS Endpoint Override URL property

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1769.
 2017-05-10 10:37:39 -07:00
Andy LoPresto 4f40eca16c
NIFI-3788 Switched Amazon HTTP client instantiation from using null HostnameVerifier (which defaulted to Strict, which cannot handle wildcard certificate hostnames) to DefaultHostnameVerifier, which is fine. 
I still want to add unit tests and integration tests, but I ran a flow which had previously caused the reproducible exception and this worked fine (flow showed objects were put in S3, no exceptions, and I verified through AWS Web Console that new objects were present).

This closes #1753.

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2017-05-04 12:09:52 -04:00
James Wing 1195d4c186 NIFI-3153 Updating AWS SDK Version 
This closes #1341.
 2017-01-09 17:49:17 +01:00
Pierre Villard 16898668c2 NIFI-3228 added s3.contenttype in PutS3Object 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1362.
 2016-12-28 10:54:21 -08:00
James Wing 50010fb340 NIFI-2948 Fix DynamoDB Cached Credentials 
This closes #1182
 2016-11-04 07:04:25 -04:00
James Wing b9a940bbd1 NIFI-2902 Fix for S3 Signer v4 Override 
This closes #1140.
 2016-10-17 22:51:45 +02:00
Edgardo 7107616420 NIFI-2872 Create PutCloudWatchMetric Processor 
This closes #1125.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-13 19:53:53 -07:00
Keren Tseytlin 6dc2f14198 NIFI-2799 AWS Assume Role Credentials With Proxy 
This closes #1112.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-12 17:19:13 -07:00
mans2singh af27179322 Nifi-1540 - AWS Kinesis Streams put processor 
This closes #239.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-11 20:21:29 -07:00
Andre F de Miranda 3b408f5601 NIFI-2816 - Clean typos across the code - Part 2. This closes #1085 2016-10-05 13:07:57 -04:00
d810146 cfc738ec19 NIFI-2763: S3 processors do not work with older S3-compatible object stores 
This closes #1076.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-09-28 10:32:11 -07:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code 
This closes #1057.
 2016-09-26 17:47:31 +02:00
Edgardo b34de74db2 NIFI-2810 Allow Content Type to be set in PutS3Object processor 
This closes #1034.
 2016-09-23 17:12:30 +02:00
Joe Gresock 0e64c3ed30 NIFI-2631: Adding page commits and 'Use Versions' to ListS3 
This closes #916 and closes #917.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-09-03 16:04:42 -07:00
Tim Reardon 45c31c8305 NIFI-2507 Added Canned ACL support to PutS3Object 
This closes #801

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-08-09 13:20:52 -07:00
Joe Gresock b67c9b6f76 NIFI-2250: Enabling EL on GetSQS Queue URL 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:59:37 -04:00
James Wing a7c5b88a47
NIFI-2062 AWS SDK Update: 
* Updated the AWS SDK dependency version to 1.11.8
* Removed GetDynamoDBTest references to JsonObject class dropped from AWS SDK
* Fixed integration test ITPutSNS.testPublish() - exception from not evaluating expressions
* Ignored integration test ITPutS3Object.testS3MultipartAgeoff() - did not work before or after SDK update

This closes #562.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-07-14 15:27:26 -04:00
James Wing 9bb6dcb5e5 NIFI-786 AWS credential refactoring and enhancements 
Signed-off-by: Joe Skora <jskora@gmail.com>
This closes #244.
 2016-05-24 00:27:13 -04:00
Adam Lamar ddf8c6f8fa NIFI-840: Create ListS3 processor 
This closes #238

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-05-04 12:15:45 -04:00
ijokarumawak dfa27263d2
NIFI-1180 Adding more IT tests. 
This closes #336.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-12 17:44:29 -07:00
Aldrin Piri e76a75c26b NIFI-1749 This closes #342. Adjusting tests that fail without a connection to the Internet and removing attributable elements from test resources. 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-11 13:22:00 -04:00
mans2singh e3155a8a4b NIFI-1516 Provide AWS DynamoDB Delete/Put/Get processors 
This closes #224.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-08 11:23:04 -04:00
Adam Lamar 2bcc31330c
NIFI-1180: Modify PutS3Object to enable encryption 
This closes #246.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-07 11:19:22 -07:00
mans2singh 19bc5ba999 NIFI-1495 Adding support for AWS Kinesis Firehose 
This closes #213

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-03-16 09:56:08 -04:00
Mark Payne 0f9b55afb6 Merge branch 'nifi-1509' of https://github.com/mans2singh/nifi into NIFI-1509 2016-03-09 08:19:45 -05:00
mans2singh 1211996d35 updated attributes using hashmap rather than individually 2016-03-08 21:12:49 -08:00
mans2singh 6138b0332e corrected contrib failure 2016-02-22 20:12:24 -08:00
mans2singh 50da696cda updated capability documentation based on comments 2016-02-22 19:56:12 -08:00
Joe Skora 5ee83574d8 NIFI-1545: Adjust integration tests ITDeleteS3Object, ITFetchS3Object, and ITPutS3Object to account for AWS new proxy properties. Correct typo in AbstractS3Processor.createClient() log message. 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #243
 2016-02-22 19:16:55 -05:00
Joe Skora 4c5263220c NIFI-1542: Update how PutS3Object handles a 403 AccessDenied response to a S3 ListMultipartUploads request. 
* Change log message from error to warning and added note about S3 permissions.
 * Advance the ageoff check time by the check interval as if the request succeeded to prevent re-checking on every upload when permission does not exist.

Reviewed by Tony Kurc (tkurc@apache.org) (with minor amendments for whitespace and error message consistency). This closes #240
 2016-02-21 18:11:23 -05:00
mans2singh bdc1ef1f8c corrected discription 2016-02-17 21:36:53 -08:00
mans2singh b921bf602e updated comment 2016-02-16 13:33:48 -08:00
mans2singh ad39b1c41f renamed class and removed unused imports 2016-02-16 13:25:28 -08:00
mans2singh 36f1caad33 Adding support for using an HTTP proxy with AWS processors. 
This closes #209

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-02-16 14:51:06 -05:00
mans2singh 528c4bc591 nifi-1509 catch recoverable service exceptions explicity 2016-02-12 09:22:41 -08:00
mans2singh cd05bedda8 Nifi-1509 - commented out integration test 2016-02-11 21:14:28 -08:00
mans2singh 180a90d12b first commit for aws lambda 
corrected attributes of flow file

added shutdown + provenence calls

minor formatting and unused imports correction

removed unused property

updated to populate exception attributes in flow file

updated write attributes
 2016-02-11 20:59:54 -08:00
Joe Skora 769b044e30 NIFI-1107: Re-integrate Multipart Upload changes into PutS3Object. 1. add Multipart upload logic to allow resuming an upload after process/instance restart, 2. add local state management to track the part uploaded for a flowfile, 3. add configurable AWS S3 state management to abort orphaned uploads, and 4. adapt to IT test naming. 
Pull request updates: * Cleanup property description to reflect processor details, not code specifics. * Only resume an upload from local state if uploadID still exists in S3, otherwise delete local state and start a new upload. * Check that local state from was actually created before trying to delete it.

Re-integrate Multipart Upload changes into PutS3Object.
1. add Multipart upload logic to allow resuming an upload after process/instance restart,
2. add local state management to track the part uploaded for a flowfile,
3. add configurable AWS S3 state management to abort orphaned uploads, and
4. adapt to IT test naming.

Fixed test issues
 * added mock client for testing local state without matching S3 state,
 * updated regex for multipart etag pattern.

Reviewed by Tony Kurc (tkurc@apache.org). This closes #192
 2016-02-03 20:54:32 -05:00
Jeremy Dyer 7d73ae77f8 NIFI-1358 Enable expression language support for AWS processor SECRET_KEY and ACCESS_KEY properties 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-21 00:28:42 -08:00
mans2singh 704c333b0d NIFI-1325 migrating AWS processors to use AWSCredentialsProvider controller service and role based access and allow default credentials to assume role. 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-19 10:17:25 -08:00
Aldrin Piri f53aaed122 NIFI-569 Introducing the maven-failsafe-plugin to the root pom.xml. Refactoring AWS integration level tests to make use of the IT* prefix and removing @Ignore from these classes. This closes #173 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-19 09:09:24 -05:00
Tony Kurc 3a7ddc6a35 NIFI-1054: Fixed DOS line endings in xml, java and js source files 
Signed-off-by: joewitt <joewitt@apache.org>
 2015-12-01 22:49:51 -05:00
Tony Kurc 8f92ac9931 NIFI-1225: When ENDPOINT_OVERRIDE is set, use PathStyleAccess 
Reviewed by Mark Payne <markap14@hotmail.com>
 2015-12-01 20:33:21 -05:00
Joe Skora 55352ae5b1 NIFI-1225: Changes for ENDPOINT_OVERRIDE and SSL Context Service from pr for NIFI-1107 
Reviewed by Mark Payne <markap14@hotmail.com> and Tony Kurc (tkurc@apache.org)
 2015-12-01 20:32:00 -05:00