James Wing
9bb6dcb5e5
NIFI-786 AWS credential refactoring and enhancements
...
Signed-off-by: Joe Skora <jskora@gmail.com>
This closes #244 .
2016-05-24 00:27:13 -04:00
Adam Lamar
ddf8c6f8fa
NIFI-840: Create ListS3 processor
...
This closes #238
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-04 12:15:45 -04:00
ijokarumawak
dfa27263d2
NIFI-1180 Adding more IT tests.
...
This closes #336 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-04-12 17:44:29 -07:00
Aldrin Piri
e76a75c26b
NIFI-1749 This closes #342 . Adjusting tests that fail without a connection to the Internet and removing attributable elements from test resources.
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-11 13:22:00 -04:00
mans2singh
e3155a8a4b
NIFI-1516 Provide AWS DynamoDB Delete/Put/Get processors
...
This closes #224 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-08 11:23:04 -04:00
Adam Lamar
2bcc31330c
NIFI-1180: Modify PutS3Object to enable encryption
...
This closes #246 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-04-07 11:19:22 -07:00
Matt Gilman
2de7f3f884
Updating versions to 1.0.0-SNAPSHOT.
2016-04-04 11:36:20 -04:00
Aldrin Piri
e977729b56
NIFI-1634-rc2 prepare for next development iteration
2016-03-23 18:56:34 -04:00
Aldrin Piri
0b9bd20d31
NIFI-1634-rc2 prepare release nifi-0.6.0-RC2
2016-03-23 18:56:22 -04:00
mans2singh
19bc5ba999
NIFI-1495 Adding support for AWS Kinesis Firehose
...
This closes #213
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-03-16 09:56:08 -04:00
Mark Payne
0f9b55afb6
Merge branch 'nifi-1509' of https://github.com/mans2singh/nifi into NIFI-1509
2016-03-09 08:19:45 -05:00
mans2singh
1211996d35
updated attributes using hashmap rather than individually
2016-03-08 21:12:49 -08:00
mans2singh
6138b0332e
corrected contrib failure
2016-02-22 20:12:24 -08:00
mans2singh
50da696cda
updated capability documentation based on comments
2016-02-22 19:56:12 -08:00
Joe Skora
5ee83574d8
NIFI-1545: Adjust integration tests ITDeleteS3Object, ITFetchS3Object, and ITPutS3Object to account for AWS new proxy properties. Correct typo in AbstractS3Processor.createClient() log message.
...
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #243
2016-02-22 19:16:55 -05:00
Joe Skora
4c5263220c
NIFI-1542: Update how PutS3Object handles a 403 AccessDenied response to a S3 ListMultipartUploads request.
...
* Change log message from error to warning and added note about S3 permissions.
* Advance the ageoff check time by the check interval as if the request succeeded to prevent re-checking on every upload when permission does not exist.
Reviewed by Tony Kurc (tkurc@apache.org ) (with minor amendments for whitespace and error message consistency). This closes #240
2016-02-21 18:11:23 -05:00
mans2singh
bdc1ef1f8c
corrected discription
2016-02-17 21:36:53 -08:00
Tony Kurc
6c2ba997a0
Merge branch 'NIFI-1379-RC3'
2016-02-16 20:13:41 -05:00
mans2singh
b921bf602e
updated comment
2016-02-16 13:33:48 -08:00
mans2singh
ad39b1c41f
renamed class and removed unused imports
2016-02-16 13:25:28 -08:00
mans2singh
36f1caad33
Adding support for using an HTTP proxy with AWS processors.
...
This closes #209
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-02-16 14:51:06 -05:00
Tony Kurc
ad73b5c9d9
NIFI-1379-RC3 prepare for next development iteration
2016-02-12 17:28:10 -05:00
Tony Kurc
8309dba80b
NIFI-1379-RC3 prepare release nifi-0.5.0-RC3
2016-02-12 17:27:59 -05:00
mans2singh
528c4bc591
nifi-1509 catch recoverable service exceptions explicity
2016-02-12 09:22:41 -08:00
mans2singh
cd05bedda8
Nifi-1509 - commented out integration test
2016-02-11 21:14:28 -08:00
mans2singh
180a90d12b
first commit for aws lambda
...
corrected attributes of flow file
added shutdown + provenence calls
minor formatting and unused imports correction
removed unused property
updated to populate exception attributes in flow file
updated write attributes
2016-02-11 20:59:54 -08:00
Tony Kurc
303f8eabf1
NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys
2016-02-06 08:49:48 -05:00
Joe Skora
769b044e30
NIFI-1107: Re-integrate Multipart Upload changes into PutS3Object. 1. add Multipart upload logic to allow resuming an upload after process/instance restart, 2. add local state management to track the part uploaded for a flowfile, 3. add configurable AWS S3 state management to abort orphaned uploads, and 4. adapt to IT test naming.
...
Pull request updates: * Cleanup property description to reflect processor details, not code specifics. * Only resume an upload from local state if uploadID still exists in S3, otherwise delete local state and start a new upload. * Check that local state from was actually created before trying to delete it.
Re-integrate Multipart Upload changes into PutS3Object.
1. add Multipart upload logic to allow resuming an upload after process/instance restart,
2. add local state management to track the part uploaded for a flowfile,
3. add configurable AWS S3 state management to abort orphaned uploads, and
4. adapt to IT test naming.
Fixed test issues
* added mock client for testing local state without matching S3 state,
* updated regex for multipart etag pattern.
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #192
2016-02-03 20:54:32 -05:00
Jeremy Dyer
7d73ae77f8
NIFI-1358 Enable expression language support for AWS processor SECRET_KEY and ACCESS_KEY properties
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-21 00:28:42 -08:00
mans2singh
704c333b0d
NIFI-1325 migrating AWS processors to use AWSCredentialsProvider controller service and role based access and allow default credentials to assume role.
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-19 10:17:25 -08:00
Aldrin Piri
f53aaed122
NIFI-569 Introducing the maven-failsafe-plugin to the root pom.xml. Refactoring AWS integration level tests to make use of the IT* prefix and removing @Ignore from these classes. This closes #173
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-19 09:09:24 -05:00
joewitt
f4ac8d75c5
NIFI-1312-RC1 prepare for next development iteration
2015-12-19 00:41:04 -05:00
joewitt
d624ea4866
NIFI-1312-RC1 prepare release nifi-0.4.1-RC1
2015-12-19 00:40:53 -05:00
joewitt
d755e43ec8
NIFI-1122_nifi-0.4.0-RC2prepare for next development iteration
2015-12-08 13:00:10 -05:00
joewitt
b66c029090
NIFI-1122_nifi-0.4.0-RC2prepare release nifi-0.4.0-RC2
2015-12-08 12:59:59 -05:00
Tony Kurc
3a7ddc6a35
NIFI-1054: Fixed DOS line endings in xml, java and js source files
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-01 22:49:51 -05:00
Tony Kurc
8f92ac9931
NIFI-1225: When ENDPOINT_OVERRIDE is set, use PathStyleAccess
...
Reviewed by Mark Payne <markap14@hotmail.com>
2015-12-01 20:33:21 -05:00
Joe Skora
55352ae5b1
NIFI-1225: Changes for ENDPOINT_OVERRIDE and SSL Context Service from pr for NIFI-1107
...
Reviewed by Mark Payne <markap14@hotmail.com> and Tony Kurc (tkurc@apache.org )
2015-12-01 20:32:00 -05:00
Mark Payne
9dafe2db6a
NIFI-1103: Fixed checkstyle violation
2015-12-01 15:56:59 -05:00
Mark Payne
307189d15b
Merge branch 'NIFI-1103' of https://github.com/adamonduty/nifi
2015-12-01 15:45:51 -05:00
Aldrin Piri
773576e041
NIFI-1108 Providing additional annotations on processors to ensure utilization of the InputRequirement annotation.
2015-11-18 13:56:21 -05:00
Adam Lamar
428b20fc25
NIFI-1103: Add support for long polling in GetSQS processor
2015-11-12 22:03:36 -07:00
Tony Kurc
6ed5f28f26
NIFI-965 penalized failed flowfiles in S3 Processors. Also discovered a typo in a static final that I corrected
...
Signed-off-by: Mike Moser <mosermw@apache.org>
2015-11-10 15:14:28 -05:00
Tony Kurc
2a90bd501b
NIFI-797 Corrected URL for PutS3 to include correct protocol and endpoint by region.
...
- corrected a missed 'final' on org.apache.nifi.processors.aws.AbstractAWSProcessor.relationships
- added protected method org.apache.nifi.processors.aws.AbstractAWSProcessor.getRegion()
- added protected method org.apache.nifi.processors.aws.s3.AbstractS3Processor.getUrlForObject(String, String)
- explicitly set AWS client protocol to HTTPS, and created a static final field with comments if other protocols may be considered
- added a static final field for the UserAgent
Reviewed by Aldrin Piri <aldrin@apache.org>
2015-11-10 06:37:56 -05:00
Venkatesh Sellappa
77de51df19
NIFI-1025 Updated aws-sdk and joda-time to resolve AWS issues with Java 1.8 update 60.
...
- Refactored tests - created AbstractS3Test for common utility methods
- Corrected incorrect unit test in TestDeleteS3Object, and adjusted processor documentation to reflect behavior
- moved aws dependency management to root pom
This closes #107
Tested, Reviewed and Amended by Tony Kurc (<tkurc@apache.org>)
2015-11-07 21:09:18 -05:00
joewitt
99629646fe
NIFI-1122 moved to 0.4.0-SNAPSHOT
2015-11-06 23:41:15 -05:00
Mark Payne
51f564024a
NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type
2015-10-26 14:58:50 -04:00
Mark Payne
0636f0e731
NIFI-810: Merged master into branch
2015-10-25 11:02:40 -04:00
danbress
49ee06b0a2
NIFI-774 Ignore integration style test
2015-10-12 19:59:46 -04:00
danbress
fad81d872d
Merge remote-tracking branch 'yu/NIFI-774'
2015-10-12 09:55:52 -04:00