Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,224 Commits 146 Branches 200 Tags 402 MiB
Commit Graph

66 Commits

Author SHA1 Message Date
Adam Lamar ddf8c6f8fa NIFI-840: Create ListS3 processor 
This closes #238

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-05-04 12:15:45 -04:00
ijokarumawak dfa27263d2
NIFI-1180 Adding more IT tests. 
This closes #336.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-12 17:44:29 -07:00
Aldrin Piri e76a75c26b NIFI-1749 This closes #342. Adjusting tests that fail without a connection to the Internet and removing attributable elements from test resources. 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-11 13:22:00 -04:00
mans2singh e3155a8a4b NIFI-1516 Provide AWS DynamoDB Delete/Put/Get processors 
This closes #224.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-08 11:23:04 -04:00
Adam Lamar 2bcc31330c
NIFI-1180: Modify PutS3Object to enable encryption 
This closes #246.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-07 11:19:22 -07:00
Matt Gilman 2de7f3f884 Updating versions to 1.0.0-SNAPSHOT. 2016-04-04 11:36:20 -04:00
Aldrin Piri e977729b56 NIFI-1634-rc2 prepare for next development iteration 2016-03-23 18:56:34 -04:00
Aldrin Piri 0b9bd20d31 NIFI-1634-rc2 prepare release nifi-0.6.0-RC2 2016-03-23 18:56:22 -04:00
mans2singh 19bc5ba999 NIFI-1495 Adding support for AWS Kinesis Firehose 
This closes #213

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-03-16 09:56:08 -04:00
Mark Payne 0f9b55afb6 Merge branch 'nifi-1509' of https://github.com/mans2singh/nifi into NIFI-1509 2016-03-09 08:19:45 -05:00
mans2singh 1211996d35 updated attributes using hashmap rather than individually 2016-03-08 21:12:49 -08:00
mans2singh 6138b0332e corrected contrib failure 2016-02-22 20:12:24 -08:00
mans2singh 50da696cda updated capability documentation based on comments 2016-02-22 19:56:12 -08:00
Joe Skora 5ee83574d8 NIFI-1545: Adjust integration tests ITDeleteS3Object, ITFetchS3Object, and ITPutS3Object to account for AWS new proxy properties. Correct typo in AbstractS3Processor.createClient() log message. 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #243
 2016-02-22 19:16:55 -05:00
Joe Skora 4c5263220c NIFI-1542: Update how PutS3Object handles a 403 AccessDenied response to a S3 ListMultipartUploads request. 
* Change log message from error to warning and added note about S3 permissions.
 * Advance the ageoff check time by the check interval as if the request succeeded to prevent re-checking on every upload when permission does not exist.

Reviewed by Tony Kurc (tkurc@apache.org) (with minor amendments for whitespace and error message consistency). This closes #240
 2016-02-21 18:11:23 -05:00
joewitt 86ab4428f0 NIFI-1520 by default skip javadoc and source jar generation in nars and wars 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #234
 2016-02-18 18:45:26 -05:00
mans2singh bdc1ef1f8c corrected discription 2016-02-17 21:36:53 -08:00
Tony Kurc 6c2ba997a0 Merge branch 'NIFI-1379-RC3' 2016-02-16 20:13:41 -05:00
mans2singh b921bf602e updated comment 2016-02-16 13:33:48 -08:00
mans2singh ad39b1c41f renamed class and removed unused imports 2016-02-16 13:25:28 -08:00
mans2singh 36f1caad33 Adding support for using an HTTP proxy with AWS processors. 
This closes #209

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-02-16 14:51:06 -05:00
Tony Kurc ad73b5c9d9 NIFI-1379-RC3 prepare for next development iteration 2016-02-12 17:28:10 -05:00
Tony Kurc 8309dba80b NIFI-1379-RC3 prepare release nifi-0.5.0-RC3 2016-02-12 17:27:59 -05:00
mans2singh 528c4bc591 nifi-1509 catch recoverable service exceptions explicity 2016-02-12 09:22:41 -08:00
mans2singh cd05bedda8 Nifi-1509 - commented out integration test 2016-02-11 21:14:28 -08:00
mans2singh 180a90d12b first commit for aws lambda 
corrected attributes of flow file

added shutdown + provenence calls

minor formatting and unused imports correction

removed unused property

updated to populate exception attributes in flow file

updated write attributes
 2016-02-11 20:59:54 -08:00
Tony Kurc 5be83166ee NIFI-1485: Updated 'header' section of NiFi NOTICE files 2016-02-07 13:52:00 -05:00
Tony Kurc 303f8eabf1 NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys 2016-02-06 08:49:48 -05:00
Joe Skora 769b044e30 NIFI-1107: Re-integrate Multipart Upload changes into PutS3Object. 1. add Multipart upload logic to allow resuming an upload after process/instance restart, 2. add local state management to track the part uploaded for a flowfile, 3. add configurable AWS S3 state management to abort orphaned uploads, and 4. adapt to IT test naming. 
Pull request updates: * Cleanup property description to reflect processor details, not code specifics. * Only resume an upload from local state if uploadID still exists in S3, otherwise delete local state and start a new upload. * Check that local state from was actually created before trying to delete it.

Re-integrate Multipart Upload changes into PutS3Object.
1. add Multipart upload logic to allow resuming an upload after process/instance restart,
2. add local state management to track the part uploaded for a flowfile,
3. add configurable AWS S3 state management to abort orphaned uploads, and
4. adapt to IT test naming.

Fixed test issues
 * added mock client for testing local state without matching S3 state,
 * updated regex for multipart etag pattern.

Reviewed by Tony Kurc (tkurc@apache.org). This closes #192
 2016-02-03 20:54:32 -05:00
Jeremy Dyer 7d73ae77f8 NIFI-1358 Enable expression language support for AWS processor SECRET_KEY and ACCESS_KEY properties 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-21 00:28:42 -08:00
mans2singh 704c333b0d NIFI-1325 migrating AWS processors to use AWSCredentialsProvider controller service and role based access and allow default credentials to assume role. 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-19 10:17:25 -08:00
Aldrin Piri f53aaed122 NIFI-569 Introducing the maven-failsafe-plugin to the root pom.xml. Refactoring AWS integration level tests to make use of the IT* prefix and removing @Ignore from these classes. This closes #173 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-19 09:09:24 -05:00
joewitt f4ac8d75c5 NIFI-1312-RC1 prepare for next development iteration 2015-12-19 00:41:04 -05:00
joewitt d624ea4866 NIFI-1312-RC1 prepare release nifi-0.4.1-RC1 2015-12-19 00:40:53 -05:00
joewitt d755e43ec8 NIFI-1122_nifi-0.4.0-RC2prepare for next development iteration 2015-12-08 13:00:10 -05:00
joewitt b66c029090 NIFI-1122_nifi-0.4.0-RC2prepare release nifi-0.4.0-RC2 2015-12-08 12:59:59 -05:00
Tony Kurc 3a7ddc6a35 NIFI-1054: Fixed DOS line endings in xml, java and js source files 
Signed-off-by: joewitt <joewitt@apache.org>
 2015-12-01 22:49:51 -05:00
Tony Kurc 8f92ac9931 NIFI-1225: When ENDPOINT_OVERRIDE is set, use PathStyleAccess 
Reviewed by Mark Payne <markap14@hotmail.com>
 2015-12-01 20:33:21 -05:00
Tony Kurc fcc032c7fd NIFI-1225: adding standard services nar 
Reviewed by Mark Payne <markap14@hotmail.com>
 2015-12-01 20:33:07 -05:00
Joe Skora 55352ae5b1 NIFI-1225: Changes for ENDPOINT_OVERRIDE and SSL Context Service from pr for NIFI-1107 
Reviewed by Mark Payne <markap14@hotmail.com> and Tony Kurc (tkurc@apache.org)
 2015-12-01 20:32:00 -05:00
Mark Payne 9dafe2db6a NIFI-1103: Fixed checkstyle violation 2015-12-01 15:56:59 -05:00
Mark Payne 307189d15b Merge branch 'NIFI-1103' of https://github.com/adamonduty/nifi 2015-12-01 15:45:51 -05:00
Aldrin Piri 773576e041 NIFI-1108 Providing additional annotations on processors to ensure utilization of the InputRequirement annotation. 2015-11-18 13:56:21 -05:00
Adam Lamar 428b20fc25 NIFI-1103: Add support for long polling in GetSQS processor 2015-11-12 22:03:36 -07:00
Tony Kurc 6ed5f28f26 NIFI-965 penalized failed flowfiles in S3 Processors. Also discovered a typo in a static final that I corrected 
Signed-off-by: Mike Moser <mosermw@apache.org>
 2015-11-10 15:14:28 -05:00
Tony Kurc 2a90bd501b NIFI-797 Corrected URL for PutS3 to include correct protocol and endpoint by region. 
- corrected a missed 'final' on org.apache.nifi.processors.aws.AbstractAWSProcessor.relationships
 - added protected method org.apache.nifi.processors.aws.AbstractAWSProcessor.getRegion()
 - added protected method org.apache.nifi.processors.aws.s3.AbstractS3Processor.getUrlForObject(String, String)
 - explicitly set AWS client protocol to HTTPS, and created a static final field with comments if other protocols may be considered
 - added a static final field for the UserAgent

Reviewed by Aldrin Piri <aldrin@apache.org>
 2015-11-10 06:37:56 -05:00
Venkatesh Sellappa 77de51df19 NIFI-1025 Updated aws-sdk and joda-time to resolve AWS issues with Java 1.8 update 60. 
- Refactored tests - created AbstractS3Test for common utility methods
 - Corrected incorrect unit test in TestDeleteS3Object, and adjusted processor documentation to reflect behavior
 - moved aws dependency management to root pom

This closes #107

Tested, Reviewed and Amended by Tony Kurc (<tkurc@apache.org>)
 2015-11-07 21:09:18 -05:00
joewitt 99629646fe NIFI-1122 moved to 0.4.0-SNAPSHOT 2015-11-06 23:41:15 -05:00
Mark Payne 51f564024a NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type 2015-10-26 14:58:50 -04:00
Mark Payne 0636f0e731 NIFI-810: Merged master into branch 2015-10-25 11:02:40 -04:00