Naveen Madhire
03a54bf2d5
Changes after review
2015-11-16 13:32:17 -06:00
Naveen Madhire
b954ca620e
NIFI-1146 Allow GetKafka to be configured with auto.offset.reset to largest or smallest
2015-11-16 11:59:52 -06:00
Matt Gilman
64369f67f9
NIFI-1160:
...
- Addressing possible NPE when removing a drop request.
- Only updating a connection status once it's been retrieved for the first time.
2015-11-16 08:34:04 -05:00
Mark Payne
da9f40b3f0
NIFI-973: Updated main Help page to provide a link to the Getting Started Guide.
...
Reviewed by Aldrin Piri (aldrin@apache.org )
2015-11-15 08:38:51 -05:00
Tony Kurc
528dab78d6
NIFI-1073: Fixing coverity discovered errors. Resource leaks, and statics
...
Reviewed by Bryan Bende (bbende@apache.org )
2015-11-14 18:56:43 -05:00
Aldrin Piri
01539ed323
NIFI-1163: Providing handling of SSLContext creation in GetHTTP in case of only performing a one-way SSL request and accompanying test to verify the configuration/usage.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-14 18:47:50 -05:00
Mark Payne
90f6830003
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-13 10:47:05 -05:00
Mark Payne
22de23baa6
NIFI-1097: Rewrite PutKafka to use the new producer api
2015-11-13 10:46:46 -05:00
joewitt
36d00a60f5
NIFI-1155 fixed contrib-check violation
2015-11-13 00:06:12 -05:00
Mark Payne
37d6b7350e
NIFI-1155: Refactored StandardFlowFileQueue to update member variables more intelligently, using CAS operations instead of locks. This reduces code complexities because other optimizations that previously existed are no longer needed
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-11-13 00:06:12 -05:00
Mark Payne
3ed0949c55
NIFI-1155: Ensure that when poll(FlowFileFilter, Set) is called, we properly update the indicator for whether or not queue is full
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-11-13 00:06:12 -05:00
Tony Kurc
e6086420aa
NIFI-1158 Default timestamp based on now
2015-11-12 23:11:43 -05:00
Mark Payne
0900fb80c9
NIFI-1153: If no incoming FlowFile, don't try to transfer null
...
Reviewed by Bryan Bende (bbende@apache.org )
Amended based on review (change to a log message) by Tony Kurc (tkurc@apache.org )
2015-11-12 22:41:57 -05:00
Bryan Bende
33ef59c5ba
NIFI-1127 Adding Kerberos properties to FetchHDFS and ListHDFS.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-12 22:14:12 -05:00
Tony Kurc
db7b94b804
NIFI-696 Deprecated org.apache.nifi.flowfile.FlowFile.getId()
2015-11-12 21:26:48 -05:00
Mark Payne
65bd8c0b1f
NIFI-1109 Updated documentation and cleaned up code
...
Reviewed by Bryan Bende (bbende@apache.org ).
Committed with amendments (for whitespace, a couple misspellings and to change a test method name based on review) by Tony Kurc (tkurc@apache.org )
2015-11-12 21:07:01 -05:00
joewitt
02102ea1c2
Revert "NIFI-1134". This was removed because they looked like floating classes. But in reality they are used to make jars which we use to test the build. However, we really need the test to work differently but until that is fixed these must stay.
...
This reverts commit 41f3875347
.
2015-11-12 18:00:40 -05:00
Mark Payne
56ad22aea6
NIFI-900: Created Processors for interacting with Microsoft Azure EventHubs
...
Reviewed (with amendments needed for clean merge, whitespace and NOTICEs) by Tony Kurc (tkurc@apache.org )
2015-11-11 23:06:04 -05:00
Mark Payne
7a165b62cc
Merge branch 'NIFI-994'
2015-11-11 16:05:40 -05:00
Mark Payne
854d203982
Merge branch 'NIFI-1143' of https://github.com/olegz/nifi into NIFI-1143
2015-11-11 14:14:54 -05:00
Oleg Zhurakousky
5baafa156a
NIFI-1143 Fixed race condition which caused intermittent failures
...
Fixed the order of service state check in PropertyDescriptor
Encapsulated the check into private method for readability
Modified and documented test to validate correct behavior.
For more details please see comment in https://issues.apache.org/jira/browse/NIFI-1143
2015-11-11 14:06:08 -05:00
Mark Payne
11fcad90d1
Merge branch 'NIFI-1083'
2015-11-11 12:07:15 -05:00
Mark Payne
054774fe7b
Merge branch 'NIFI-1061' of https://github.com/olegz/nifi into NIFI-1061
2015-11-11 11:17:25 -05:00
Mark Payne
e7c6c7cae9
NIFI-1083: Added a Grouping Regular Expression property for grouping lines of text
2015-11-11 10:19:07 -05:00
Bryan Bende
429f6a42bb
Previous commits address NIFI-1124 and NIFI-1062 as described in the tickets. This closes #119
2015-11-11 10:17:45 -05:00
Oleg Zhurakousky
a65a29921a
NIFI-1124, NIFI-1062 addressed more PR comments
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-11-11 10:12:30 -05:00
Oleg Zhurakousky
70cc61bb53
NIFI-1124, NIFI-1062 addressed PR comments
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-11-11 10:12:30 -05:00
Oleg Zhurakousky
62e3cfc629
NIFI-1024 NIFI-1062 Fixed PutHDFS processor to properly route failures. Ensured that during put failures the FlowFile is routed to 'failure' relationship. Added validation test Re-enabled previously ignored test.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-11-11 10:12:30 -05:00
Joseph Percivall
3e538d9007
NIFI-1083 Created a processor that routes lines of text based on different matching and routing strategies
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-11 09:12:47 -05:00
Oleg Zhurakousky
76690a8ee9
NIFI-1061 fixed deadlock caused by DBCPConnectionPool.onConfigured()
...
Current implementation of DBCPConnectionPool was attempting to test if connection could be obtained via dataSource.getConnection().
Such call is naturally a blocking call and the duration of the block is dependent on driver implementation. Some drivers (e.g., Phoenix - https://phoenix.apache.org/installation.html )
attempts numerous retries before failing creating a deadlock when attempt was made to disable DBCPConnectionPool which was still being enabled.
This fix removes the connection test from DBCPConnectionPool.onConfigured() operation returning successfully upon creation of DataSource.
For more details see comments in https://issues.apache.org/jira/browse/NIFI-1061
2015-11-11 08:33:51 -05:00
Mark Payne
6c510fae80
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-11 08:16:38 -05:00
Joseph Percivall
d887d8fdf0
NIFI-993 added expression language support to GetHTTP for the filename and URL properties
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-11 08:05:23 -05:00
Tony Kurc
ba5b1d837c
NIFI-1117 Changed line endings to unix line endings in java source
2015-11-10 18:50:57 -05:00
Tony Kurc
9756e9f126
NIFI-1117 Added unit tests and default behavior for avro files with no records. Also fixed a findbugs warning in SplitAvro (made inner classes static)
2015-11-10 18:46:17 -05:00
Mark Payne
a031fb3dc6
Merge branch 'NIFI-1142'
2015-11-10 17:17:59 -05:00
Mark Payne
e6644b3747
Merge branch 'NIFI-1141'
2015-11-10 17:17:55 -05:00
Mark Payne
7b9c8df6c5
NIFI-994: Fixed issue that could result in data duplication if more than 1 rollover of tailed file has occurred on restart of Processor
2015-11-10 16:53:29 -05:00
Tony Kurc
6ed5f28f26
NIFI-965 penalized failed flowfiles in S3 Processors. Also discovered a typo in a static final that I corrected
...
Signed-off-by: Mike Moser <mosermw@apache.org>
2015-11-10 15:14:28 -05:00
Mark Payne
cf7bfe9e1c
NIFI-1147: Fixed checkstyle violations
2015-11-10 15:04:37 -05:00
Mark Payne
72008035b1
Merge branch 'NIFI-1000'
2015-11-10 15:02:02 -05:00
Mark Payne
8f942fcdcc
NIFI-1000: Fixed checkstyle violation in TestGetJSMQueue use activemq-broker with test scope and activemq-client with default scope rather than pulling in activemq-all; this reduces size of standard nar from 30 MB to 18 MB
2015-11-10 14:31:20 -05:00
Mark Payne
53725b5c72
Merge branch 'NIFI-1000' of https://github.com/olegz/nifi into NIFI-1000
2015-11-10 13:34:56 -05:00
Oleg Zhurakousky
8699e35108
NIFI-1000 addressed PR comments
2015-11-10 12:13:16 -05:00
Mark Payne
11768cc388
NIFI-1141: Fixed the order of the arguments to the setCurrentContentClaim method
2015-11-10 11:35:14 -05:00
Bryan Bende
e748fd5848
NIFI-817 Processors for interacting with HBase
...
- Refactoring PutHBaseCell to batch Puts by table
- Adding optional Columns property to GetHBase to return only selected column families or columns
- Making GetHBase cluster friendly by storing state in the distributed cache and a local file
- Adding Initial Time Range property to GetHBase
- Adding Filter Expression property and custom validate to prevent using columns and a filter at the same time
- Creating an HBaseClientService controller service to isolate the HBase client and support multiple versions
- Creating appropriate LICENSE/NOTICE files
- Adding @InputRequirement to processors
- Addressing comments from review, moving hbase client services under standard services
- Making sure result of session.penalize() is assinged to FlowFile variable before transferring
2015-11-10 11:13:51 -05:00
Mark Payne
358cabafa3
NIFI-1142: Added typo that referenced the wrong function name when indicating that isEmpty has the wrong number of arguments
2015-11-10 10:55:08 -05:00
Tony Kurc
2a90bd501b
NIFI-797 Corrected URL for PutS3 to include correct protocol and endpoint by region.
...
- corrected a missed 'final' on org.apache.nifi.processors.aws.AbstractAWSProcessor.relationships
- added protected method org.apache.nifi.processors.aws.AbstractAWSProcessor.getRegion()
- added protected method org.apache.nifi.processors.aws.s3.AbstractS3Processor.getUrlForObject(String, String)
- explicitly set AWS client protocol to HTTPS, and created a static final field with comments if other protocols may be considered
- added a static final field for the UserAgent
Reviewed by Aldrin Piri <aldrin@apache.org>
2015-11-10 06:37:56 -05:00
Oleg Zhurakousky
ef0be5a5d6
NIFI-1000 Fixed JmsFactory to properly obtain destiniation name
...
Re-enabled JMS Tests that were annotated with @Ignore
2015-11-09 18:35:31 -05:00
Mike Moser
b75af5b344
Merge branch 'NIFI-1085'
2015-11-09 16:13:12 -05:00
joewitt
41f3875347
NIFI-1134
2015-11-09 15:37:40 -05:00