769b044e30
NIFI-1107: Re-integrate Multipart Upload changes into PutS3Object. 1. add Multipart upload logic to allow resuming an upload after process/instance restart, 2. add local state management to track the part uploaded for a flowfile, 3. add configurable AWS S3 state management to abort orphaned uploads, and 4. adapt to IT test naming.
...
Pull request updates: * Cleanup property description to reflect processor details, not code specifics. * Only resume an upload from local state if uploadID still exists in S3, otherwise delete local state and start a new upload. * Check that local state from was actually created before trying to delete it.
Re-integrate Multipart Upload changes into PutS3Object.
1. add Multipart upload logic to allow resuming an upload after process/instance restart,
2. add local state management to track the part uploaded for a flowfile,
3. add configurable AWS S3 state management to abort orphaned uploads, and
4. adapt to IT test naming.
Fixed test issues
* added mock client for testing local state without matching S3 state,
* updated regex for multipart etag pattern.
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #192
2016-02-03 20:54:32 -05:00
7d73ae77f8
NIFI-1358 Enable expression language support for AWS processor SECRET_KEY and ACCESS_KEY properties
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-21 00:28:42 -08:00
704c333b0d
NIFI-1325 migrating AWS processors to use AWSCredentialsProvider controller service and role based access and allow default credentials to assume role.
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-19 10:17:25 -08:00
f53aaed122
NIFI-569 Introducing the maven-failsafe-plugin to the root pom.xml. Refactoring AWS integration level tests to make use of the IT* prefix and removing @Ignore from these classes. This closes #173
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-19 09:09:24 -05:00
f4ac8d75c5
NIFI-1312-RC1 prepare for next development iteration
2015-12-19 00:41:04 -05:00
d624ea4866
NIFI-1312-RC1 prepare release nifi-0.4.1-RC1
2015-12-19 00:40:53 -05:00
d755e43ec8
NIFI-1122_nifi-0.4.0-RC2prepare for next development iteration
2015-12-08 13:00:10 -05:00
b66c029090
NIFI-1122_nifi-0.4.0-RC2prepare release nifi-0.4.0-RC2
2015-12-08 12:59:59 -05:00
3a7ddc6a35
NIFI-1054: Fixed DOS line endings in xml, java and js source files
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-01 22:49:51 -05:00
8f92ac9931
NIFI-1225: When ENDPOINT_OVERRIDE is set, use PathStyleAccess
...
Reviewed by Mark Payne <markap14@hotmail.com>
2015-12-01 20:33:21 -05:00
fcc032c7fd
NIFI-1225: adding standard services nar
...
Reviewed by Mark Payne <markap14@hotmail.com>
2015-12-01 20:33:07 -05:00
55352ae5b1
NIFI-1225: Changes for ENDPOINT_OVERRIDE and SSL Context Service from pr for NIFI-1107
...
Reviewed by Mark Payne <markap14@hotmail.com> and Tony Kurc (tkurc@apache.org )
2015-12-01 20:32:00 -05:00
9dafe2db6a
NIFI-1103: Fixed checkstyle violation
2015-12-01 15:56:59 -05:00
307189d15b
Merge branch 'NIFI-1103' of https://github.com/adamonduty/nifi
2015-12-01 15:45:51 -05:00
773576e041
NIFI-1108 Providing additional annotations on processors to ensure utilization of the InputRequirement annotation.
2015-11-18 13:56:21 -05:00
428b20fc25
NIFI-1103: Add support for long polling in GetSQS processor
2015-11-12 22:03:36 -07:00
6ed5f28f26
NIFI-965 penalized failed flowfiles in S3 Processors. Also discovered a typo in a static final that I corrected
...
Signed-off-by: Mike Moser <mosermw@apache.org>
2015-11-10 15:14:28 -05:00
2a90bd501b
NIFI-797 Corrected URL for PutS3 to include correct protocol and endpoint by region.
...
- corrected a missed 'final' on org.apache.nifi.processors.aws.AbstractAWSProcessor.relationships
- added protected method org.apache.nifi.processors.aws.AbstractAWSProcessor.getRegion()
- added protected method org.apache.nifi.processors.aws.s3.AbstractS3Processor.getUrlForObject(String, String)
- explicitly set AWS client protocol to HTTPS, and created a static final field with comments if other protocols may be considered
- added a static final field for the UserAgent
Reviewed by Aldrin Piri <aldrin@apache.org>
2015-11-10 06:37:56 -05:00
77de51df19
NIFI-1025 Updated aws-sdk and joda-time to resolve AWS issues with Java 1.8 update 60.
...
- Refactored tests - created AbstractS3Test for common utility methods
- Corrected incorrect unit test in TestDeleteS3Object, and adjusted processor documentation to reflect behavior
- moved aws dependency management to root pom
This closes #107
Tested, Reviewed and Amended by Tony Kurc (<tkurc@apache.org>)
2015-11-07 21:09:18 -05:00
99629646fe
NIFI-1122 moved to 0.4.0-SNAPSHOT
2015-11-06 23:41:15 -05:00
51f564024a
NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type
2015-10-26 14:58:50 -04:00
0636f0e731
NIFI-810: Merged master into branch
2015-10-25 11:02:40 -04:00
49ee06b0a2
NIFI-774 Ignore integration style test
2015-10-12 19:59:46 -04:00
fad81d872d
Merge remote-tracking branch 'yu/NIFI-774'
2015-10-12 09:55:52 -04:00
ccfb57fe9f
NIFI-810: Addressed several checkstyle violations
2015-10-07 17:48:51 -04:00
4afd8f88f8
NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree
2015-10-07 17:26:14 -04:00
ded74ec94c
NIFI-876 prepare for next development iteration
2015-09-14 21:48:11 -04:00
2ec735e350
NIFI-876 prepare release nifi-0.3.0-RC1
2015-09-14 21:48:00 -04:00
eb1d6b554c
Remove `REL_NOT_FOUND`
2015-09-11 18:05:20 +09:00
f718b4bf46
Modify an error message
2015-09-07 23:34:22 +09:00
d32a32a92d
Remove the process to check if the target key exists or not
2015-09-07 23:32:48 +09:00
c492a1aaae
Fix a type and modify an error message
2015-09-02 21:54:02 +09:00
0334f04640
Add a relation for "not found" and that is transfered if a target key doesn't exist on S3
2015-09-02 13:48:39 +09:00
213f507f53
Add @Override annotations
2015-09-02 13:02:39 +09:00
6cbc6db860
Remove `getSupportedDynamicPropertyDescriptor`
2015-09-02 06:49:46 +09:00
7e6834937b
Ignore the test suite
2015-09-01 22:36:50 +09:00
d1dbd37629
[NIFI-774] Create a DeleteS3Object Processor
2015-09-01 22:35:11 +09:00
aa99884782
NIFI-850 removed nifi parent, updated nifi pom, moved all nifi subdirs up one level, fixed readme.
2015-08-15 13:12:22 -04:00
Joe Skora
Jeremy Dyer
mans2singh
Aldrin Piri
joewitt
Tony Kurc
Mark Payne
Adam Lamar
Venkatesh Sellappa
danbress
Matt Gilman
Yu ISHIKAWA