Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-06 01:58:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,685 Commits 147 Branches 203 Tags
Commit Graph

108 Commits

Author SHA1 Message Date
Mark Payne
e5281f1fc1 NIFI-1221: Support batching of Syslog messages 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-11-30 17:32:49 -05:00
Mark Payne
c59087bc3a Merge branch 'NIFI-1049' 2015-11-30 16:02:36 -05:00
Mark Payne
07c619cf40 NIFI-1049: Added unit test to verify that reported bug was fixed; corrected a typo in log message 2015-11-30 15:37:58 -05:00
joewitt
67aed5eb92 NIFI-1224: made TestExecuteSQL about 25 seconds faster. Same logic just less to process 
Reviewed and Amended (removed trailing whitespace) by Tony Kurc (tkurc@apache.org)
 2015-11-26 00:33:54 -05:00
joewitt
a3cb803147 NIFI-1224: reduced size of test set produced and removed ignored memory test 
Reviewed and amended (removed unused imports for checkstyle) by Tony Kurc (tkurc@apache.org)
 2015-11-25 23:09:49 -05:00
joewitt
6692645209 NIFI-631: addressed environment specific unit test problems 
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-11-25 22:06:45 -05:00
Joe Skora
226ac64ef9 NIFI-631: Correct the WritesAttributes descriptions. 
Reviewed and Ammended (based on comments from dev list) by Tony Kurc (tkurc@apache.org)
 2015-11-25 18:03:19 -05:00
Mark Payne
ba83bf9c05 NIFI-631: Initial implementation of FetchFile processor 
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-11-25 18:03:19 -05:00
Joe Skora
4c4d62c61f NIFI-631: Added ListFile processor. 
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-11-25 18:03:19 -05:00
Bryan Bende
4281a51c83 Merge branch 'NIFI-1208' 2015-11-23 21:35:57 -05:00
Mark Payne
4e2c94d659 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-11-23 14:18:50 -05:00
Mark Payne
2516b1dad2 NIFI-1171: Ensure that we pick up changes when files roll over and ensure that we don't pick up the rolled over file multiple times 2015-11-23 14:11:14 -05:00
Bryan Bende
3ffb455903 NIFI-1208 Adding context.yield() to Listen and Put syslog when there is nothing to do in onTrigger() 2015-11-23 10:30:33 -05:00
Joseph Percivall
cdd2c4f22c NIFI-1086: Changed behavior on retrieval with no input file to RETRIEVE events, removed @TriggerWhenEmpty 
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-11-21 19:20:33 -05:00
Bryan Bende
f1f67f6395 Fixing one-character typo in syslog attribute name 2015-11-20 10:45:21 -05:00
Joseph Percivall
8c2323dc8d NIFI-1086 Provide refactoring of InvokeHTTP 
NIFI-980 Add support for HTTP Digest authentication to InvokeHttp
NIFI-1080 Provide additional InvokeHttp unit tests
NIFI-1133 InvokeHTTP Processor does not save Location header for 3xx responses
NIFI-1009 InvokeHTTP should be able to be scheduled without any incoming connection for GET operations
NIFI-61 Multiple improvements for InvokeHTTP inclusive of providing unique tx.id across clusters, dynamic HTTP header properties

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-11-19 01:40:21 -05:00
Joe Percivall
fb335ea282 NIFI-1165: Fix for tests TestRouteText and PutHDFS which did not succeed on Windows 
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-11-19 01:01:34 -05:00
Mark Payne
e862f7ff03 NIFI-1165: Use FileChannel instead of RandomAccessFile in order to avoid locking files in Windows 
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-11-19 01:01:28 -05:00
Joseph Percivall
1e5cc070a3 NIFI-1081 Adding option to ExecuteStreamCommand to put output value to an attribute 
Reviewed and amended (comments,whitespace,and some code readability (discussed in ticket)) by Tony Kurc (tkurc@apache.org)
 2015-11-18 23:23:10 -05:00
Mark Payne
69bce2c2db NIFI-1168: Ensure that processors with only looping 
connections are scheduled to run, even if the connections have no FlowFiles;
 expose these details to processor developers; update documentation

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-11-18 14:53:30 -05:00
Aldrin Piri
773576e041 NIFI-1108 Providing additional annotations on processors to ensure utilization of the InputRequirement annotation. 2015-11-18 13:56:21 -05:00
Mark Payne
911e1c5412 NIFI-1108: Updated processors to include the @InputRequirement annotation 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-11-18 13:47:59 -05:00
Tony Kurc
528dab78d6 NIFI-1073: Fixing coverity discovered errors. Resource leaks, and statics 
Reviewed by Bryan Bende (bbende@apache.org)
 2015-11-14 18:56:43 -05:00
Aldrin Piri
01539ed323 NIFI-1163: Providing handling of SSLContext creation in GetHTTP in case of only performing a one-way SSL request and accompanying test to verify the configuration/usage. 
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-11-14 18:47:50 -05:00
Tony Kurc
e6086420aa NIFI-1158 Default timestamp based on now 2015-11-12 23:11:43 -05:00
Mark Payne
0900fb80c9 NIFI-1153: If no incoming FlowFile, don't try to transfer null 
Reviewed by Bryan Bende (bbende@apache.org)
Amended based on review (change to a log message) by Tony Kurc (tkurc@apache.org)
 2015-11-12 22:41:57 -05:00
joewitt
02102ea1c2 Revert "NIFI-1134". This was removed because they looked like floating classes. But in reality they are used to make jars which we use to test the build. However, we really need the test to work differently but until that is fixed these must stay. 
This reverts commit 41f3875347a6ff7c87e35665019c35e99e78eecb.
 2015-11-12 18:00:40 -05:00
Mark Payne
7a165b62cc Merge branch 'NIFI-994' 2015-11-11 16:05:40 -05:00
Mark Payne
e7c6c7cae9 NIFI-1083: Added a Grouping Regular Expression property for grouping lines of text 2015-11-11 10:19:07 -05:00
Joseph Percivall
3e538d9007 NIFI-1083 Created a processor that routes lines of text based on different matching and routing strategies 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-11-11 09:12:47 -05:00
Joseph Percivall
d887d8fdf0 NIFI-993 added expression language support to GetHTTP for the filename and URL properties 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-11-11 08:05:23 -05:00
Mark Payne
7b9c8df6c5 NIFI-994: Fixed issue that could result in data duplication if more than 1 rollover of tailed file has occurred on restart of Processor 2015-11-10 16:53:29 -05:00
Mark Payne
72008035b1 Merge branch 'NIFI-1000' 2015-11-10 15:02:02 -05:00
Mark Payne
8f942fcdcc NIFI-1000: Fixed checkstyle violation in TestGetJSMQueue use activemq-broker with test scope and activemq-client with default scope rather than pulling in activemq-all; this reduces size of standard nar from 30 MB to 18 MB 2015-11-10 14:31:20 -05:00
Oleg Zhurakousky
8699e35108 NIFI-1000 addressed PR comments 2015-11-10 12:13:16 -05:00
Oleg Zhurakousky
ef0be5a5d6 NIFI-1000 Fixed JmsFactory to properly obtain destiniation name 
Re-enabled JMS Tests that were annotated with @Ignore
 2015-11-09 18:35:31 -05:00
joewitt
41f3875347 NIFI-1134 2015-11-09 15:37:40 -05:00
joewitt
99629646fe NIFI-1122 moved to 0.4.0-SNAPSHOT 2015-11-06 23:41:15 -05:00
Bryan Bende
618f22e110 NIFI-274 - Fixing TestListenSyslog, fixing default buffer size to be bytes, adding syslog.protocol to attributes 
- Adding syslog.port to ListenSyslog attributes, logging at warn level when rejecting tcp connections
         - Adding @InputRequirement to processors and adding appropriate send and receive provenance events
 2015-11-04 18:01:59 -05:00
Tony Kurc
5611dac3f8 NIFI-274 - added use of Selectors for TCP and UDP connections. Added a max connections to the TCP thread 
- Added comments and code review changes
         - fixed fixbugs bug
 2015-11-04 18:00:18 -05:00
Bryan Bende
9c542432da NIFI-274 Adding ListenSyslog and PutSyslog to standard processors. 
- Refactoring connection handling on put side, removing number of buffers from properties and basing it off concurrent tasks for the processor.
- Refactoring some of the TCP handling so it keeps reading from a connection until the client closes it
- Adding an error queue
- Adding a sender field on the syslog event to record the system that sent the message
 2015-11-04 17:56:13 -05:00
Mark Payne
fedbe40313 NIFI-1103: Added InputRequirement annotation 2015-11-04 11:11:33 -05:00
Joseph Percivall
a549621267 NIFI-1077 enabling expression language on ConvertCharacterSet input and output 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-11-02 11:46:17 -05:00
Joseph Percivall
2ae49026e8 NIFI-883 Fixing issue HandleHttpRequest had with PrimaryNodeOnly scheduling 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-11-02 10:32:14 -05:00
Joseph Percivall
cef7b6c736 NIFI-1080 fleshed out InvokeHttp unit tests 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-10-31 00:19:36 -04:00
Jeremy Dyer
eb389cf84c NIFI-1079 Replacing Name for NULL_VALUE_FOR_EMPTY_STRING as I had accidentally removed it. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:30:56 -04:00
Jeremy Dyer
aef0d8fe9b NIFI-1079 Check style and documentation based updates recommended by user bbende on Github pull request 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:30:42 -04:00
Jeremy Dyer
217b1049cf NIFI-1079 Added Destination Property to control if JSON goes to Attribute or 
Content of FlowFile. Added Include Core Attributes Property to control
if FlowFile CoreAttributes are included in the JSON output or not.
Added Null value for Empty String flag to control if empty values in
the JSON are empty string or true NULL values. Added more tests and
minor text refactoring per Github comments

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:30:25 -04:00
Jeremy Dyer
19b7a4cc7d NIFI-1079 Create a new Attribute from the existing FlowFile attributes by taking 
either all of the existing attributes or a user defined list. The
existing Attributes are converted to JSON and placed in a new Attribute
on the existing FlowFile as Attribute “JSONAttributes”

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:29:29 -04:00
Mark Payne
bfa9e45079 NIFI-994: Ensure that processor is not valid due to the tail file not yet existing 2015-10-30 11:44:51 -04:00