Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-07 18:48:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
8,329 Commits 147 Branches 203 Tags
Commit Graph

1420 Commits

Author SHA1 Message Date
Bryan Bende
618f22e110 NIFI-274 - Fixing TestListenSyslog, fixing default buffer size to be bytes, adding syslog.protocol to attributes 
- Adding syslog.port to ListenSyslog attributes, logging at warn level when rejecting tcp connections
         - Adding @InputRequirement to processors and adding appropriate send and receive provenance events
 2015-11-04 18:01:59 -05:00
Tony Kurc
5611dac3f8 NIFI-274 - added use of Selectors for TCP and UDP connections. Added a max connections to the TCP thread 
- Added comments and code review changes
         - fixed fixbugs bug
 2015-11-04 18:00:18 -05:00
Bryan Bende
9c542432da NIFI-274 Adding ListenSyslog and PutSyslog to standard processors. 
- Refactoring connection handling on put side, removing number of buffers from properties and basing it off concurrent tasks for the processor.
- Refactoring some of the TCP handling so it keeps reading from a connection until the client closes it
- Adding an error queue
- Adding a sender field on the syslog event to record the system that sent the message
 2015-11-04 17:56:13 -05:00
Mark Payne
fedbe40313 NIFI-1103: Added InputRequirement annotation 2015-11-04 11:11:33 -05:00
Joseph Percivall
a549621267 NIFI-1077 enabling expression language on ConvertCharacterSet input and output 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-11-02 11:46:17 -05:00
Joseph Percivall
2ae49026e8 NIFI-883 Fixing issue HandleHttpRequest had with PrimaryNodeOnly scheduling 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-11-02 10:32:14 -05:00
Joseph Percivall
cef7b6c736 NIFI-1080 fleshed out InvokeHttp unit tests 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-10-31 00:19:36 -04:00
Jeremy Dyer
eb389cf84c NIFI-1079 Replacing Name for NULL_VALUE_FOR_EMPTY_STRING as I had accidentally removed it. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:30:56 -04:00
Jeremy Dyer
aef0d8fe9b NIFI-1079 Check style and documentation based updates recommended by user bbende on Github pull request 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:30:42 -04:00
Jeremy Dyer
217b1049cf NIFI-1079 Added Destination Property to control if JSON goes to Attribute or 
Content of FlowFile. Added Include Core Attributes Property to control
if FlowFile CoreAttributes are included in the JSON output or not.
Added Null value for Empty String flag to control if empty values in
the JSON are empty string or true NULL values. Added more tests and
minor text refactoring per Github comments

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:30:25 -04:00
Jeremy Dyer
19b7a4cc7d NIFI-1079 Create a new Attribute from the existing FlowFile attributes by taking 
either all of the existing attributes or a user defined list. The
existing Attributes are converted to JSON and placed in a new Attribute
on the existing FlowFile as Attribute “JSONAttributes”

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-30 14:29:29 -04:00
Mark Payne
bfa9e45079 NIFI-994: Ensure that processor is not valid due to the tail file not yet existing 2015-10-30 11:44:51 -04:00
Mark Payne
dc4004de64 Merge branch 'NIFI-977' 2015-10-27 16:53:38 -04:00
Mark Payne
af19053a7f Merge branch 'NIFI-447' 2015-10-27 10:42:46 -04:00
Joseph Percivall
07238c7913 NIFI-447 adding replacement strategy to ReplaceText processor 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-27 10:37:43 -04:00
Joseph Percivall
b885f955f4 NIFI-516 adding option to StandardProcessSession.read to close stream 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-26 20:23:13 -04:00
Mark Payne
1c1738670c NIFI-10: Updated FetchHDFS, FetchFileTransfer to use new FETCH provenance event 2015-10-26 17:14:29 -04:00
Mark Payne
51f564024a NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type 2015-10-26 14:58:50 -04:00
Luke Williamson
26edab3185 NIFI-908 Added support for SSL in JMS connections. 
- Added SSL context to JMS producer and consumer processors
 - Tony Kurc Amended patch to check SSL need by scheme and exception consistency
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-10-26 00:29:05 -04:00
Mark Payne
8d2f9bc64b NIFI-1056: Do not treat BigDecimal, BigInteger the same way we treat Number's when serializing to Avro because Avro Java Library doesn't support them 
Reviewed and Unit Test Amended by Tony Kurc (tkurc@apache.org)
 2015-10-25 11:31:30 -04:00
Mark Payne
385bfbb2c6 NIFI-673: Rebased from master; Added InputRequirement annotation, as it is now merged into master 2015-10-25 11:14:11 -04:00
Mark Payne
4e38288062 NIFI-673: Added sftp.listing.user attribute to FlowFiles created by ListSFTP; ensure that FetchSFTP indicates that the username supports Expression Language 2015-10-25 11:13:02 -04:00
Mark Payne
b0322d9ffe NIFI-673: Added Completion Strategy to FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne
d1d57931bf NIFI-673: Initial implementation of ListSFTP, FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne
0636f0e731 NIFI-810: Merged master into branch 2015-10-25 11:02:40 -04:00
Mark Payne
d63cd6bd2f Merge branch 'NIFI-1010' 2015-10-23 14:39:16 -04:00
Mark Payne
88fc8d28a0 NIFI-1010: If database driver does not support getting table name for column from ResultSetMetadata, then just use a default name 2015-10-23 10:25:59 -04:00
Mark Payne
0fc5d30461 NIFI-1055: Fixed checkstyle violations 2015-10-23 10:08:44 -04:00
Mark Payne
bd506b1e10 NIFI-972: Added additional unit test; deleted lines that were commented out 2015-10-23 09:52:09 -04:00
Toivo Adams
a9e5325047 NIFI-972 attribute to indicate rows count and cleanup 
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-23 09:28:03 -04:00
Toivo Adams
ba3225fe92 NIFI-972 ExecuteSQL bug in createSchema() create Arvo Schema 1 
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-23 09:28:03 -04:00
Mark Payne
da28b81eec Merge branch 'NIFI-988' 2015-10-21 10:44:06 -04:00
Mark Payne
97441ea0c2 Merge branch 'NIFI-988' of https://github.com/ImpressTV/nifi into NIFI-988 2015-10-21 10:18:05 -04:00
Andre F de Miranda
518670dbf6 NIFI-1042 Adds restlistener.remote.source.ip attribute to ListenHTTPServlet. This closes #105 2015-10-19 23:43:44 -04:00
Tony Kurc
9200542298 NIFI-1016 Naive fix so org.apache.nifi.prioritizer.PriorityAttributePrioritizerTest builds 2015-10-18 20:34:36 -04:00
Tony Kurc
88b1b844fb NIFI-747 This closes #104. PR from Venkatesh Sellappa <VS186031@outlook.com> was modified, then code reviewed by Joe Witt (comments in ticket) 2015-10-18 20:04:24 -04:00
Joe
ad73a23aff NIFI-1016: Use centralized priority attribute name in PriorityAttributePrioritizer. closes #98. 
Signed-off-by: joewitt <joewitt@apache.org>
 2015-10-18 19:42:46 -04:00
Mark Payne
31f0909bd3 NIFI-994: Initial import of TailFile 2015-10-18 19:00:24 -04:00
Joe
22924c656b NIFI-995 TestGetFile.testAttributes() failed in case of a NTFS partition in Linux, because Files.setPosixFilePermissions() did not have any effect on the files and did not throw Exception. closes #95. Signed off by Tony Kurc (tkurc@apache.org) 2015-10-17 10:46:49 -04:00
Mark Payne
84db372538 NIFI-977: Allow SQL Data Types with numerals that are negative 2015-10-14 13:12:10 -04:00
Joseph Percivall
b4bfcc1f21 NIFI-1030 made InvokeHttp basic auth password a sensitive value 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-10-08 15:46:12 -04:00
Mark Payne
ccfb57fe9f NIFI-810: Addressed several checkstyle violations 2015-10-07 17:48:51 -04:00
Mark Payne
4afd8f88f8 NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree 2015-10-07 17:26:14 -04:00
Mark Payne
96764ed6a1 Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi 2015-09-25 09:15:34 -04:00
Mark Payne
eb94dab00c NIFI-604: Fixed checkstyle violation 2015-09-24 11:51:44 -04:00
Joe
e12da7c9a3 NIFI-985: Custom log prefix for LogAttribute processor 
The LogAttribute processor evaluates the log prefix EL using the current flow file.

Log prefix helps to distinguish the log output of multiple LogAttribute processors and identify the right processor. Log prefix appears in the first and the last log line, followed by the original 50 dashes. If you configure log prefix 'STEP 1: ' the log output looks like this:

STEP 1 :  --------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'lineageStartDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'fileSize'
        Value: '9'
FlowFile Attribute Map Content
Key: 'customAttribute'
        Value: 'custom value'
STEP 1 :  --------------------------------------------------

flow file content...

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-09-24 10:31:04 -04:00
Mark Payne
24c080788f NIFI-604: Removed unused import, as it caused checkstyle violation 2015-09-24 10:06:39 -04:00
Mark Payne
193dbe6533 Merge branch 'NIFI-604' of https://github.com/rickysaltzer/nifi into NIFI-604 2015-09-23 16:03:46 -04:00
Joe
ee7d89cb01 NIFI-988: Test cases for PutDistributedMapCache 2015-09-23 14:32:37 +02:00
Joe
6b1328f3f1 NIFI-988: PutDisributedMapCache processor implementation 2015-09-23 14:31:13 +02:00