Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,427 Commits 143 Branches 197 Tags 390 MiB
Commit Graph

147 Commits

Author SHA1 Message Date
Mark Payne af19053a7f Merge branch 'NIFI-447' 2015-10-27 10:42:46 -04:00
Joseph Percivall 07238c7913 NIFI-447 adding replacement strategy to ReplaceText processor 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-27 10:37:43 -04:00
Joseph Percivall b885f955f4 NIFI-516 adding option to StandardProcessSession.read to close stream 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-26 20:23:13 -04:00
Mark Payne 1c1738670c NIFI-10: Updated FetchHDFS, FetchFileTransfer to use new FETCH provenance event 2015-10-26 17:14:29 -04:00
Mark Payne fc2aa2764c NIFI-10: Added FETCH and DOWNLOAD Provenance Events; updated FlowController to use DOWNLOAD event instead of SEND whenever a user downloads/views content via Provenance Event 2015-10-26 14:58:50 -04:00
Mark Payne 51f564024a NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type 2015-10-26 14:58:50 -04:00
Mark Payne aec32a277c NIFI-1070: Added detailed debug-level logging about how FileSystemRepository is choosing to expire archived data 2015-10-26 14:36:03 -04:00
Matt Gilman f8c3377c84 NIFI-820: 
- Creating a context menu item for accessing provenance directly for a selected component.
 2015-10-26 10:16:01 -04:00
Luke Williamson 26edab3185 NIFI-908 Added support for SSL in JMS connections. 
- Added SSL context to JMS producer and consumer processors
 - Tony Kurc Amended patch to check SSL need by scheme and exception consistency
Reviewed by Tony Kurc (tkurc@apache.org)
 2015-10-26 00:29:05 -04:00
Mark Payne 8d2f9bc64b NIFI-1056: Do not treat BigDecimal, BigInteger the same way we treat Number's when serializing to Avro because Avro Java Library doesn't support them 
Reviewed and Unit Test Amended by Tony Kurc (tkurc@apache.org)
 2015-10-25 11:31:30 -04:00
Mark Payne 385bfbb2c6 NIFI-673: Rebased from master; Added InputRequirement annotation, as it is now merged into master 2015-10-25 11:14:11 -04:00
Mark Payne 4e38288062 NIFI-673: Added sftp.listing.user attribute to FlowFiles created by ListSFTP; ensure that FetchSFTP indicates that the username supports Expression Language 2015-10-25 11:13:02 -04:00
Mark Payne b0322d9ffe NIFI-673: Added Completion Strategy to FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne d1d57931bf NIFI-673: Initial implementation of ListSFTP, FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne 8a80060851 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-10-25 11:11:49 -04:00
Mark Payne 0636f0e731 NIFI-810: Merged master into branch 2015-10-25 11:02:40 -04:00
ricky f2c4f2d2a1 [PATCH] NIFI-997 Periodically attempt a kerberos relogin in AbstractHadoopProcessor 
- attempt a relogin based on an interval specified in the processor configuration
 - use hadoop's UserGroupInformation.checkTGTAndReloginFromKeytab to determine if a relogin is necessary based on the ticket and do so if needed
 - improve code readability with HdfsResources object in AbstractHadoopProcessor

Reviewed and Amended by Tony Kurc (tkurc@apache.org). This closes #97
 2015-10-25 00:49:58 -04:00
Mark Payne d63cd6bd2f Merge branch 'NIFI-1010' 2015-10-23 14:39:16 -04:00
Mark Payne 88fc8d28a0 NIFI-1010: If database driver does not support getting table name for column from ResultSetMetadata, then just use a default name 2015-10-23 10:25:59 -04:00
Mark Payne 0fc5d30461 NIFI-1055: Fixed checkstyle violations 2015-10-23 10:08:44 -04:00
Mark Payne 5d90c9be07 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-10-23 09:52:33 -04:00
Mark Payne bd506b1e10 NIFI-972: Added additional unit test; deleted lines that were commented out 2015-10-23 09:52:09 -04:00
Toivo Adams a9e5325047 NIFI-972 attribute to indicate rows count and cleanup 
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-23 09:28:03 -04:00
Toivo Adams ba3225fe92 NIFI-972 ExecuteSQL bug in createSchema() create Arvo Schema 1 
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-23 09:28:03 -04:00
Joe a5a5badb88 NIFI-945 Create a new property (JSON Container) in ConvertAvroToJson, which determines how stream of records is exposed: either as a sequence of single Objects ("none"), 
writing every Object to a new line, or as an array of Objects.

Let's assume you have an Avro content as stream of records (record1, record2, ...). If JSON container is "none", the converter will expose the records as sequence of
single JSON objects:

record1
record2
...
recordN

Please bear in mind, that the final output is not a valid JSON content. You can then forward this content e.g. to Kafka, where every record will be a single Kafka message.

If JSON container is "array", the output looks like this:

[record1,record2,...,recordN]

It is useful when you want to convert your Avro content to a valid JSON array.

This closes #88

Reviewed and Amended (amendments reviewed by original patch author on github) by Tony Kurc (tkurc@apache.org)
 2015-10-21 20:15:29 -04:00
Mark Payne da28b81eec Merge branch 'NIFI-988' 2015-10-21 10:44:06 -04:00
Mark Payne 97441ea0c2 Merge branch 'NIFI-988' of https://github.com/ImpressTV/nifi into NIFI-988 2015-10-21 10:18:05 -04:00
Joe e68fdca517 NIFI-944 Added support and unit tests for escaped characters in ConvertCSVtoAvro processor properties. This closes #87. Reviewed by Tony Kurc <tkurc@apache.org> 2015-10-21 00:01:38 -04:00
Andre F de Miranda 518670dbf6 NIFI-1042 Adds restlistener.remote.source.ip attribute to ListenHTTPServlet. This closes #105 2015-10-19 23:43:44 -04:00
Alex Moundalexis b809031195 NIFI-1046 shell clean up: +variable braces for consistency. Reviewed by Tony Kurc (tkurc@apache.org). This closes #106 2015-10-19 20:36:58 -04:00
Alex Moundalexis 9aa716b059 NIFI-1046 shell clean up: quoting prevents globbing & word splitting. 
Ignoring the unquoted array expansions on L188/190; suspect they ought to be quoted per [SC2068](https://github.com/koalaman/shellcheck/wiki/SC2068), but need to confirm desired arguments.

Reviewed by Tony Kurc (tkurc@apache.org)
 2015-10-19 20:36:07 -04:00
Alex Moundalexis 58d9b02517 NIFI-1046 shell clean up: remove backticks from nifi.sh. Reviewed by Tony Kurc (tkurc@apache.org) 2015-10-19 20:33:52 -04:00
Tony Kurc 9200542298 NIFI-1016 Naive fix so org.apache.nifi.prioritizer.PriorityAttributePrioritizerTest builds 2015-10-18 20:34:36 -04:00
Tony Kurc 88b1b844fb NIFI-747 This closes #104. PR from Venkatesh Sellappa <VS186031@outlook.com> was modified, then code reviewed by Joe Witt (comments in ticket) 2015-10-18 20:04:24 -04:00
Joe ad73a23aff NIFI-1016: Use centralized priority attribute name in PriorityAttributePrioritizer. closes #98. 
Signed-off-by: joewitt <joewitt@apache.org>
 2015-10-18 19:42:46 -04:00
Alan Jackoway 943ccfedef NIFI-1035 AbstractKiteProcessor.getSchema leaks file handles. closes #101. 
Close file handles when reading schema from resources or paths in AbstractKiteProcessor.getSchema

Signed-off-by: joewitt <joewitt@apache.org>
 2015-10-18 18:56:26 -04:00
Joe 22924c656b NIFI-995 TestGetFile.testAttributes() failed in case of a NTFS partition in Linux, because Files.setPosixFilePermissions() did not have any effect on the files and did not throw Exception. closes #95. Signed off by Tony Kurc (tkurc@apache.org) 2015-10-17 10:46:49 -04:00
Venkatesh Sellappa 9a8d763d8d NIFI-612 Remove FlowUnmarshaller. Builds, runs, could not find any latent references using reflection or other ways of loading classes without direct references. This closes #103. Signed off by Tony Kurc <tkurc@apache.org> 2015-10-17 09:43:10 -04:00
danbress 49ee06b0a2 NIFI-774 Ignore integration style test 2015-10-12 19:59:46 -04:00
danbress fad81d872d Merge remote-tracking branch 'yu/NIFI-774' 2015-10-12 09:55:52 -04:00
Mike Moser f798127290 NIFI-1031 resolve reporting task error in flow.xml 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-10-09 10:53:23 -04:00
Joseph Percivall b4bfcc1f21 NIFI-1030 made InvokeHttp basic auth password a sensitive value 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-10-08 15:46:12 -04:00
Matt Gilman 2583d7869a NIFI-442: 
NIFI-828:
- Always selecting the first item in the new component table.
- Enabling adding the selected component by typing Enter.
- Removing the 'filter by' in the new component dialogs and instead just searching every field.
 2015-10-07 19:11:55 -04:00
Mark Payne 8e2308b78d NIFI-810: Reworded validation errors pertaining ot upstream connections 2015-10-07 17:53:04 -04:00
Mark Payne ccfb57fe9f NIFI-810: Addressed several checkstyle violations 2015-10-07 17:48:51 -04:00
Mark Payne b974445ddd NIFI-810: rebased from master 2015-10-07 17:28:39 -04:00
Mark Payne 5ecdb1858e NIFI-810: Updated the wording on validation errors due to upstream connections 2015-10-07 17:26:14 -04:00
Matt Gilman 13edcfda2e NIFI-810: 
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
 2015-10-07 17:26:14 -04:00
Mark Payne 4afd8f88f8 NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree 2015-10-07 17:26:14 -04:00
Randy Gelhausen 31fba6b333 Bumped nifi-kafka-processors Kafka version 
This closes #99.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-10-05 10:39:22 -04:00