ricky
f2c4f2d2a1
[PATCH] NIFI-997 Periodically attempt a kerberos relogin in AbstractHadoopProcessor
...
- attempt a relogin based on an interval specified in the processor configuration
- use hadoop's UserGroupInformation.checkTGTAndReloginFromKeytab to determine if a relogin is necessary based on the ticket and do so if needed
- improve code readability with HdfsResources object in AbstractHadoopProcessor
Reviewed and Amended by Tony Kurc (tkurc@apache.org ). This closes #97
2015-10-25 00:49:58 -04:00
Mark Payne
d63cd6bd2f
Merge branch 'NIFI-1010'
2015-10-23 14:39:16 -04:00
Mark Payne
88fc8d28a0
NIFI-1010: If database driver does not support getting table name for column from ResultSetMetadata, then just use a default name
2015-10-23 10:25:59 -04:00
Mark Payne
0fc5d30461
NIFI-1055: Fixed checkstyle violations
2015-10-23 10:08:44 -04:00
Mark Payne
5d90c9be07
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-10-23 09:52:33 -04:00
Mark Payne
bd506b1e10
NIFI-972: Added additional unit test; deleted lines that were commented out
2015-10-23 09:52:09 -04:00
Toivo Adams
a9e5325047
NIFI-972 attribute to indicate rows count and cleanup
...
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
Toivo Adams
ba3225fe92
NIFI-972 ExecuteSQL bug in createSchema() create Arvo Schema 1
...
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
Joe
a5a5badb88
NIFI-945 Create a new property (JSON Container) in ConvertAvroToJson, which determines how stream of records is exposed: either as a sequence of single Objects ("none"),
...
writing every Object to a new line, or as an array of Objects.
Let's assume you have an Avro content as stream of records (record1, record2, ...). If JSON container is "none", the converter will expose the records as sequence of
single JSON objects:
record1
record2
...
recordN
Please bear in mind, that the final output is not a valid JSON content. You can then forward this content e.g. to Kafka, where every record will be a single Kafka message.
If JSON container is "array", the output looks like this:
[record1,record2,...,recordN]
It is useful when you want to convert your Avro content to a valid JSON array.
This closes #88
Reviewed and Amended (amendments reviewed by original patch author on github) by Tony Kurc (tkurc@apache.org )
2015-10-21 20:15:29 -04:00
Mark Payne
da28b81eec
Merge branch 'NIFI-988'
2015-10-21 10:44:06 -04:00
Mark Payne
97441ea0c2
Merge branch 'NIFI-988' of https://github.com/ImpressTV/nifi into NIFI-988
2015-10-21 10:18:05 -04:00
Joe
e68fdca517
NIFI-944 Added support and unit tests for escaped characters in ConvertCSVtoAvro processor properties. This closes #87 . Reviewed by Tony Kurc <tkurc@apache.org>
2015-10-21 00:01:38 -04:00
Andre F de Miranda
518670dbf6
NIFI-1042 Adds restlistener.remote.source.ip attribute to ListenHTTPServlet. This closes #105
2015-10-19 23:43:44 -04:00
Alex Moundalexis
b809031195
NIFI-1046 shell clean up: +variable braces for consistency. Reviewed by Tony Kurc (tkurc@apache.org). This closes #106
2015-10-19 20:36:58 -04:00
Alex Moundalexis
9aa716b059
NIFI-1046 shell clean up: quoting prevents globbing & word splitting.
...
Ignoring the unquoted array expansions on L188/190; suspect they ought to be quoted per [SC2068](https://github.com/koalaman/shellcheck/wiki/SC2068 ), but need to confirm desired arguments.
Reviewed by Tony Kurc (tkurc@apache.org )
2015-10-19 20:36:07 -04:00
Alex Moundalexis
58d9b02517
NIFI-1046 shell clean up: remove backticks from nifi.sh. Reviewed by Tony Kurc (tkurc@apache.org)
2015-10-19 20:33:52 -04:00
Tony Kurc
9200542298
NIFI-1016 Naive fix so org.apache.nifi.prioritizer.PriorityAttributePrioritizerTest builds
2015-10-18 20:34:36 -04:00
Tony Kurc
88b1b844fb
NIFI-747 This closes #104 . PR from Venkatesh Sellappa <VS186031@outlook.com> was modified, then code reviewed by Joe Witt (comments in ticket)
2015-10-18 20:04:24 -04:00
Joe
ad73a23aff
NIFI-1016: Use centralized priority attribute name in PriorityAttributePrioritizer. closes #98 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 19:42:46 -04:00
Mark Payne
31f0909bd3
NIFI-994: Initial import of TailFile
2015-10-18 19:00:24 -04:00
Alan Jackoway
943ccfedef
NIFI-1035 AbstractKiteProcessor.getSchema leaks file handles. closes #101 .
...
Close file handles when reading schema from resources or paths in AbstractKiteProcessor.getSchema
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 18:56:26 -04:00
Joe
22924c656b
NIFI-995 TestGetFile.testAttributes() failed in case of a NTFS partition in Linux, because Files.setPosixFilePermissions() did not have any effect on the files and did not throw Exception. closes #95 . Signed off by Tony Kurc (tkurc@apache.org)
2015-10-17 10:46:49 -04:00
Venkatesh Sellappa
9a8d763d8d
NIFI-612 Remove FlowUnmarshaller. Builds, runs, could not find any latent references using reflection or other ways of loading classes without direct references. This closes #103 . Signed off by Tony Kurc <tkurc@apache.org>
2015-10-17 09:43:10 -04:00
Matt Gilman
570202eb30
NIFI-730:
...
- Fixing capitalization to remain consistent.
2015-10-16 10:47:02 -04:00
Matt Gilman
a872403831
NIFI-730:
...
- Updating the styling of the drop request status dialog.
- Rendering any errors that may have occurred.
2015-10-16 09:37:57 -04:00
Mark Payne
2b4999c018
NIFI-730: do not interrupt swap thread if drop flowfiles is canceled
2015-10-16 09:06:13 -04:00
Mark Payne
b8dbd1018c
NIFI-730: Updated details of Provenance Event for when a queue is emptied
2015-10-16 08:53:40 -04:00
Matt Gilman
39a050d2fd
NIFI-730:
...
- Adding emptying a queue when clustered.
2015-10-14 17:47:06 -04:00
Mark Payne
09a3f6dadd
NIFI-730: reordered states for drop flowfile request
2015-10-14 16:32:39 -04:00
Mark Payne
98a04eec74
NIFI-730: Set current queue size on drop flowfile request immediately when creating request
2015-10-14 13:48:59 -04:00
Mark Payne
84db372538
NIFI-977: Allow SQL Data Types with numerals that are negative
2015-10-14 13:12:10 -04:00
Matt Gilman
cad0e7cf0f
NIFI-730:
...
- Adding progress bar for showing current status of drop request.
- Allowing the user to cancel the current drop request.
2015-10-14 12:39:19 -04:00
Mark Payne
a2ae99f899
NIFI-730: Make cancel request actually cancel
2015-10-14 11:11:48 -04:00
Mark Payne
5867193bc1
NIFI-730: Added additional testing logic to unit tests
2015-10-14 09:56:52 -04:00
Mark Payne
0af1acaafa
NIFI-730: Return DropFlowFileStatus object when calling cancel
2015-10-14 09:46:21 -04:00
Mark Payne
77f7d7524c
NIFI-730: bug fixes and code cleanup for swap manager and flowfile queue
2015-10-14 09:14:15 -04:00
Mark Payne
afb76afcd0
NIFI-730: Added error messages if we fail to drop FlowFiles from queue
2015-10-13 15:57:18 -04:00
Mark Payne
72ff2a25d5
NIFI-730: Updated queue sizes appropriately during dropping of flowfiles
2015-10-13 15:46:56 -04:00
Matt Gilman
4b41aaab02
NIFI-730:
...
- Fixing checkstyle violations.
- Wiring endpoints and framework model.
- Lowering the max delay while polling from 8 seconds to 4 seconds.
2015-10-13 13:43:10 -04:00
Mark Payne
af78354d84
NIFI-730: Added additional parameters to dropFlowFiles
2015-10-13 12:20:18 -04:00
Matt Gilman
09d6fe5cdb
NIFI-730:
...
- Fixing checkstyle violations.
- Renaming context menu item for emptying a queue.
2015-10-13 10:12:58 -04:00
Mark Payne
ad6af95d07
NIFI-730: Fixed checkstyle violations
2015-10-13 10:09:21 -04:00
Mark Payne
9be37914dd
Merge branch 'NIFI-730' of https://git-wip-us.apache.org/repos/asf/nifi into NIFI-730
2015-10-13 10:03:31 -04:00
Mark Payne
49a781df2d
NIFI-730: Implemented swapping in and out on-demand by the FlowFileQueue rather than in a background thread
2015-10-13 10:03:03 -04:00
danbress
49ee06b0a2
NIFI-774 Ignore integration style test
2015-10-12 19:59:46 -04:00
Matt Gilman
e0ac7cde37
NIFI-730:
...
- Starting to add support for deleting flow files from a queue by creating endpoints and starting to wire everything together.
- Adding context menu item for initiating the request to drop flow files.
2015-10-12 10:00:54 -04:00
danbress
fad81d872d
Merge remote-tracking branch 'yu/NIFI-774'
2015-10-12 09:55:52 -04:00
Mark Payne
b8c51dc35d
NIFI-730: Added methods for dropping queued flowfiles; refactored swap manager but have not yet started swapping flowfiles in or out from within the flowfile queue
2015-10-11 10:27:07 -04:00
Mike Moser
f798127290
NIFI-1031 resolve reporting task error in flow.xml
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-09 10:53:23 -04:00
Joseph Percivall
b4bfcc1f21
NIFI-1030 made InvokeHttp basic auth password a sensitive value
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-08 15:46:12 -04:00
