19bc5ba999
NIFI-1495 Adding support for AWS Kinesis Firehose
...
This closes #213
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-03-16 09:56:08 -04:00
0f9b55afb6
Merge branch 'nifi-1509' of https://github.com/mans2singh/nifi into NIFI-1509
2016-03-09 08:19:45 -05:00
1211996d35
updated attributes using hashmap rather than individually
2016-03-08 21:12:49 -08:00
6138b0332e
corrected contrib failure
2016-02-22 20:12:24 -08:00
50da696cda
updated capability documentation based on comments
2016-02-22 19:56:12 -08:00
5ee83574d8
NIFI-1545: Adjust integration tests ITDeleteS3Object, ITFetchS3Object, and ITPutS3Object to account for AWS new proxy properties. Correct typo in AbstractS3Processor.createClient() log message.
...
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #243
2016-02-22 19:16:55 -05:00
4c5263220c
NIFI-1542: Update how PutS3Object handles a 403 AccessDenied response to a S3 ListMultipartUploads request.
...
* Change log message from error to warning and added note about S3 permissions.
* Advance the ageoff check time by the check interval as if the request succeeded to prevent re-checking on every upload when permission does not exist.
Reviewed by Tony Kurc (tkurc@apache.org ) (with minor amendments for whitespace and error message consistency). This closes #240
2016-02-21 18:11:23 -05:00
bdc1ef1f8c
corrected discription
2016-02-17 21:36:53 -08:00
6c2ba997a0
Merge branch 'NIFI-1379-RC3'
2016-02-16 20:13:41 -05:00
b921bf602e
updated comment
2016-02-16 13:33:48 -08:00
ad39b1c41f
renamed class and removed unused imports
2016-02-16 13:25:28 -08:00
36f1caad33
Adding support for using an HTTP proxy with AWS processors.
...
This closes #209
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-02-16 14:51:06 -05:00
ad73b5c9d9
NIFI-1379-RC3 prepare for next development iteration
2016-02-12 17:28:10 -05:00
8309dba80b
NIFI-1379-RC3 prepare release nifi-0.5.0-RC3
2016-02-12 17:27:59 -05:00
528c4bc591
nifi-1509 catch recoverable service exceptions explicity
2016-02-12 09:22:41 -08:00
cd05bedda8
Nifi-1509 - commented out integration test
2016-02-11 21:14:28 -08:00
180a90d12b
first commit for aws lambda
...
corrected attributes of flow file
added shutdown + provenence calls
minor formatting and unused imports correction
removed unused property
updated to populate exception attributes in flow file
updated write attributes
2016-02-11 20:59:54 -08:00
303f8eabf1
NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys
2016-02-06 08:49:48 -05:00
769b044e30
NIFI-1107: Re-integrate Multipart Upload changes into PutS3Object. 1. add Multipart upload logic to allow resuming an upload after process/instance restart, 2. add local state management to track the part uploaded for a flowfile, 3. add configurable AWS S3 state management to abort orphaned uploads, and 4. adapt to IT test naming.
...
Pull request updates: * Cleanup property description to reflect processor details, not code specifics. * Only resume an upload from local state if uploadID still exists in S3, otherwise delete local state and start a new upload. * Check that local state from was actually created before trying to delete it.
Re-integrate Multipart Upload changes into PutS3Object.
1. add Multipart upload logic to allow resuming an upload after process/instance restart,
2. add local state management to track the part uploaded for a flowfile,
3. add configurable AWS S3 state management to abort orphaned uploads, and
4. adapt to IT test naming.
Fixed test issues
* added mock client for testing local state without matching S3 state,
* updated regex for multipart etag pattern.
Reviewed by Tony Kurc (tkurc@apache.org ). This closes #192
2016-02-03 20:54:32 -05:00
7d73ae77f8
NIFI-1358 Enable expression language support for AWS processor SECRET_KEY and ACCESS_KEY properties
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-21 00:28:42 -08:00
704c333b0d
NIFI-1325 migrating AWS processors to use AWSCredentialsProvider controller service and role based access and allow default credentials to assume role.
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-19 10:17:25 -08:00
f53aaed122
NIFI-569 Introducing the maven-failsafe-plugin to the root pom.xml. Refactoring AWS integration level tests to make use of the IT* prefix and removing @Ignore from these classes. This closes #173
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-01-19 09:09:24 -05:00
f4ac8d75c5
NIFI-1312-RC1 prepare for next development iteration
2015-12-19 00:41:04 -05:00
d624ea4866
NIFI-1312-RC1 prepare release nifi-0.4.1-RC1
2015-12-19 00:40:53 -05:00
d755e43ec8
NIFI-1122_nifi-0.4.0-RC2prepare for next development iteration
2015-12-08 13:00:10 -05:00
b66c029090
NIFI-1122_nifi-0.4.0-RC2prepare release nifi-0.4.0-RC2
2015-12-08 12:59:59 -05:00
3a7ddc6a35
NIFI-1054: Fixed DOS line endings in xml, java and js source files
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-01 22:49:51 -05:00
8f92ac9931
NIFI-1225: When ENDPOINT_OVERRIDE is set, use PathStyleAccess
...
Reviewed by Mark Payne <markap14@hotmail.com>
2015-12-01 20:33:21 -05:00
55352ae5b1
NIFI-1225: Changes for ENDPOINT_OVERRIDE and SSL Context Service from pr for NIFI-1107
...
Reviewed by Mark Payne <markap14@hotmail.com> and Tony Kurc (tkurc@apache.org )
2015-12-01 20:32:00 -05:00
9dafe2db6a
NIFI-1103: Fixed checkstyle violation
2015-12-01 15:56:59 -05:00
307189d15b
Merge branch 'NIFI-1103' of https://github.com/adamonduty/nifi
2015-12-01 15:45:51 -05:00
773576e041
NIFI-1108 Providing additional annotations on processors to ensure utilization of the InputRequirement annotation.
2015-11-18 13:56:21 -05:00
428b20fc25
NIFI-1103: Add support for long polling in GetSQS processor
2015-11-12 22:03:36 -07:00
6ed5f28f26
NIFI-965 penalized failed flowfiles in S3 Processors. Also discovered a typo in a static final that I corrected
...
Signed-off-by: Mike Moser <mosermw@apache.org>
2015-11-10 15:14:28 -05:00
2a90bd501b
NIFI-797 Corrected URL for PutS3 to include correct protocol and endpoint by region.
...
- corrected a missed 'final' on org.apache.nifi.processors.aws.AbstractAWSProcessor.relationships
- added protected method org.apache.nifi.processors.aws.AbstractAWSProcessor.getRegion()
- added protected method org.apache.nifi.processors.aws.s3.AbstractS3Processor.getUrlForObject(String, String)
- explicitly set AWS client protocol to HTTPS, and created a static final field with comments if other protocols may be considered
- added a static final field for the UserAgent
Reviewed by Aldrin Piri <aldrin@apache.org>
2015-11-10 06:37:56 -05:00
77de51df19
NIFI-1025 Updated aws-sdk and joda-time to resolve AWS issues with Java 1.8 update 60.
...
- Refactored tests - created AbstractS3Test for common utility methods
- Corrected incorrect unit test in TestDeleteS3Object, and adjusted processor documentation to reflect behavior
- moved aws dependency management to root pom
This closes #107
Tested, Reviewed and Amended by Tony Kurc (<tkurc@apache.org>)
2015-11-07 21:09:18 -05:00
99629646fe
NIFI-1122 moved to 0.4.0-SNAPSHOT
2015-11-06 23:41:15 -05:00
51f564024a
NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type
2015-10-26 14:58:50 -04:00
0636f0e731
NIFI-810: Merged master into branch
2015-10-25 11:02:40 -04:00
49ee06b0a2
NIFI-774 Ignore integration style test
2015-10-12 19:59:46 -04:00
fad81d872d
Merge remote-tracking branch 'yu/NIFI-774'
2015-10-12 09:55:52 -04:00
ccfb57fe9f
NIFI-810: Addressed several checkstyle violations
2015-10-07 17:48:51 -04:00
4afd8f88f8
NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree
2015-10-07 17:26:14 -04:00
ded74ec94c
NIFI-876 prepare for next development iteration
2015-09-14 21:48:11 -04:00
2ec735e350
NIFI-876 prepare release nifi-0.3.0-RC1
2015-09-14 21:48:00 -04:00
eb1d6b554c
Remove `REL_NOT_FOUND`
2015-09-11 18:05:20 +09:00
f718b4bf46
Modify an error message
2015-09-07 23:34:22 +09:00
d32a32a92d
Remove the process to check if the target key exists or not
2015-09-07 23:32:48 +09:00
c492a1aaae
Fix a type and modify an error message
2015-09-02 21:54:02 +09:00
0334f04640
Add a relation for "not found" and that is transfered if a target key doesn't exist on S3
2015-09-02 13:48:39 +09:00
mans2singh
Mark Payne
Joe Skora
Tony Kurc
Jeremy Dyer
Aldrin Piri
joewitt
Adam Lamar
Venkatesh Sellappa
danbress
Matt Gilman
Yu ISHIKAWA