ricky
f2c4f2d2a1
[PATCH] NIFI-997 Periodically attempt a kerberos relogin in AbstractHadoopProcessor
...
- attempt a relogin based on an interval specified in the processor configuration
- use hadoop's UserGroupInformation.checkTGTAndReloginFromKeytab to determine if a relogin is necessary based on the ticket and do so if needed
- improve code readability with HdfsResources object in AbstractHadoopProcessor
Reviewed and Amended by Tony Kurc (tkurc@apache.org ). This closes #97
2015-10-25 00:49:58 -04:00
Mark Payne
d63cd6bd2f
Merge branch 'NIFI-1010'
2015-10-23 14:39:16 -04:00
Mark Payne
88fc8d28a0
NIFI-1010: If database driver does not support getting table name for column from ResultSetMetadata, then just use a default name
2015-10-23 10:25:59 -04:00
Mark Payne
0fc5d30461
NIFI-1055: Fixed checkstyle violations
2015-10-23 10:08:44 -04:00
Mark Payne
5d90c9be07
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-10-23 09:52:33 -04:00
Mark Payne
bd506b1e10
NIFI-972: Added additional unit test; deleted lines that were commented out
2015-10-23 09:52:09 -04:00
Toivo Adams
a9e5325047
NIFI-972 attribute to indicate rows count and cleanup
...
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
Toivo Adams
ba3225fe92
NIFI-972 ExecuteSQL bug in createSchema() create Arvo Schema 1
...
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
Joe
a5a5badb88
NIFI-945 Create a new property (JSON Container) in ConvertAvroToJson, which determines how stream of records is exposed: either as a sequence of single Objects ("none"),
...
writing every Object to a new line, or as an array of Objects.
Let's assume you have an Avro content as stream of records (record1, record2, ...). If JSON container is "none", the converter will expose the records as sequence of
single JSON objects:
record1
record2
...
recordN
Please bear in mind, that the final output is not a valid JSON content. You can then forward this content e.g. to Kafka, where every record will be a single Kafka message.
If JSON container is "array", the output looks like this:
[record1,record2,...,recordN]
It is useful when you want to convert your Avro content to a valid JSON array.
This closes #88
Reviewed and Amended (amendments reviewed by original patch author on github) by Tony Kurc (tkurc@apache.org )
2015-10-21 20:15:29 -04:00
Mark Payne
da28b81eec
Merge branch 'NIFI-988'
2015-10-21 10:44:06 -04:00
Mark Payne
97441ea0c2
Merge branch 'NIFI-988' of https://github.com/ImpressTV/nifi into NIFI-988
2015-10-21 10:18:05 -04:00
Joe
e68fdca517
NIFI-944 Added support and unit tests for escaped characters in ConvertCSVtoAvro processor properties. This closes #87 . Reviewed by Tony Kurc <tkurc@apache.org>
2015-10-21 00:01:38 -04:00
Andre F de Miranda
518670dbf6
NIFI-1042 Adds restlistener.remote.source.ip attribute to ListenHTTPServlet. This closes #105
2015-10-19 23:43:44 -04:00
Alex Moundalexis
b809031195
NIFI-1046 shell clean up: +variable braces for consistency. Reviewed by Tony Kurc (tkurc@apache.org). This closes #106
2015-10-19 20:36:58 -04:00
Alex Moundalexis
9aa716b059
NIFI-1046 shell clean up: quoting prevents globbing & word splitting.
...
Ignoring the unquoted array expansions on L188/190; suspect they ought to be quoted per [SC2068](https://github.com/koalaman/shellcheck/wiki/SC2068 ), but need to confirm desired arguments.
Reviewed by Tony Kurc (tkurc@apache.org )
2015-10-19 20:36:07 -04:00
Alex Moundalexis
58d9b02517
NIFI-1046 shell clean up: remove backticks from nifi.sh. Reviewed by Tony Kurc (tkurc@apache.org)
2015-10-19 20:33:52 -04:00
Tony Kurc
9200542298
NIFI-1016 Naive fix so org.apache.nifi.prioritizer.PriorityAttributePrioritizerTest builds
2015-10-18 20:34:36 -04:00
Tony Kurc
88b1b844fb
NIFI-747 This closes #104 . PR from Venkatesh Sellappa <VS186031@outlook.com> was modified, then code reviewed by Joe Witt (comments in ticket)
2015-10-18 20:04:24 -04:00
Joe
ad73a23aff
NIFI-1016: Use centralized priority attribute name in PriorityAttributePrioritizer. closes #98 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 19:42:46 -04:00
Jean-Baptiste Onofré
bd47f36c06
NIFI-922: Upgrade to ActiveMQ 5.12.0. closes #81 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 19:13:26 -04:00
Alan Jackoway
943ccfedef
NIFI-1035 AbstractKiteProcessor.getSchema leaks file handles. closes #101 .
...
Close file handles when reading schema from resources or paths in AbstractKiteProcessor.getSchema
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 18:56:26 -04:00
Joe
22924c656b
NIFI-995 TestGetFile.testAttributes() failed in case of a NTFS partition in Linux, because Files.setPosixFilePermissions() did not have any effect on the files and did not throw Exception. closes #95 . Signed off by Tony Kurc (tkurc@apache.org)
2015-10-17 10:46:49 -04:00
Venkatesh Sellappa
9a8d763d8d
NIFI-612 Remove FlowUnmarshaller. Builds, runs, could not find any latent references using reflection or other ways of loading classes without direct references. This closes #103 . Signed off by Tony Kurc <tkurc@apache.org>
2015-10-17 09:43:10 -04:00
Wouter de Bie
ce7d098a48
NIFI-1043 fix for erroneous whitespace in maven archetype. This closes #100 . Signed off by Tony Kurc <tkurc@apache.org>
2015-10-17 09:00:18 -04:00
danbress
49ee06b0a2
NIFI-774 Ignore integration style test
2015-10-12 19:59:46 -04:00
danbress
fad81d872d
Merge remote-tracking branch 'yu/NIFI-774'
2015-10-12 09:55:52 -04:00
Aldrin Piri
f6d3427955
NIFI-1024 Correcting references to nifi.cluster.manager.protocol.port
2015-10-09 14:22:00 -04:00
Mike Moser
f798127290
NIFI-1031 resolve reporting task error in flow.xml
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-09 10:53:23 -04:00
Joseph Percivall
b4bfcc1f21
NIFI-1030 made InvokeHttp basic auth password a sensitive value
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-08 15:46:12 -04:00
Matt Gilman
2583d7869a
NIFI-442:
...
NIFI-828:
- Always selecting the first item in the new component table.
- Enabling adding the selected component by typing Enter.
- Removing the 'filter by' in the new component dialogs and instead just searching every field.
2015-10-07 19:11:55 -04:00
Randy Gelhausen
31fba6b333
Bumped nifi-kafka-processors Kafka version
...
This closes #99 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-05 10:39:22 -04:00
Bryan Bende
6b2f5ad1f5
NIFI-992 Adding NOTICE to nifi-couchbase-nar
2015-10-01 16:56:49 -04:00
Bryan Bende
883333cb00
Previous commits for NIFI-992 provide the functionality as specified in Github PR.
...
This closes #96 .
2015-10-01 15:12:22 -04:00
ijokarumawak
033a1553ab
nifi-992 Improvements based on code review part II.
...
- Penalize or Yield based on ErrorHandlingStrategy.Penalty
- Add Retry relationship to PutCouchbaseKey
- Remove unnecessary try/catch and let the framework handle it
- Change CouchbaseException relation mapping for Fatal from Failure to Retry
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-01 14:13:20 -04:00
ijokarumawak
72eb64e8a4
nifi-992 Improvements based on code review.
...
- Removed checkstyle and contrib-check profile since it's inherit from
top-level pom.
- Consolidate DOC_ID and DOC_ID_EXP into a single DOC_ID property.
- Add capability description on GetCouchbaseKey.
- Fixed documentation spell misses.
- Handle Exceptions accordingly.
- Add 'retry' relationship.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-29 13:48:13 -04:00
ijokarumawak
2466a24530
nifi-992 Adding nifi-couchbase-bundle.
...
- new CouchbaseClusterControllerService
- new Processors
- GetCouchbaseKey
- PutCouchbaseKey
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-28 11:21:42 -04:00
Mark Payne
96764ed6a1
Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi
2015-09-25 09:15:34 -04:00
Mark Payne
eb94dab00c
NIFI-604: Fixed checkstyle violation
2015-09-24 11:51:44 -04:00
Joe Skora
e53ab391fa
NIFI-641 Add delete capability to the UpdateAttributes processor.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-24 10:46:10 -04:00
Aldrin Piri
a414f1d514
Previous commit for NIFI-985 provides the functionality as specified in Github PR.
...
This closes #90 .
2015-09-24 10:37:08 -04:00
Joe
e12da7c9a3
NIFI-985: Custom log prefix for LogAttribute processor
...
The LogAttribute processor evaluates the log prefix EL using the current flow file.
Log prefix helps to distinguish the log output of multiple LogAttribute processors and identify the right processor. Log prefix appears in the first and the last log line, followed by the original 50 dashes. If you configure log prefix 'STEP 1: ' the log output looks like this:
STEP 1 : --------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'lineageStartDate'
Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'fileSize'
Value: '9'
FlowFile Attribute Map Content
Key: 'customAttribute'
Value: 'custom value'
STEP 1 : --------------------------------------------------
flow file content...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-09-24 10:31:04 -04:00
Mark Payne
24c080788f
NIFI-604: Removed unused import, as it caused checkstyle violation
2015-09-24 10:06:39 -04:00
Mark Payne
193dbe6533
Merge branch 'NIFI-604' of https://github.com/rickysaltzer/nifi into NIFI-604
2015-09-23 16:03:46 -04:00
Mark Payne
26f80095b7
Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi
2015-09-23 15:31:19 -04:00
Mark Payne
f884086fc2
NIFI-713: Fixed checkstyle issue
2015-09-23 15:20:25 -04:00
Mark Payne
da56b49b88
Merge branch 'NIFI-713' of https://github.com/rickysaltzer/nifi into NIFI-713
2015-09-23 12:06:50 -04:00
Joe
ee7d89cb01
NIFI-988: Test cases for PutDistributedMapCache
2015-09-23 14:32:37 +02:00
Joe
6b1328f3f1
NIFI-988: PutDisributedMapCache processor implementation
2015-09-23 14:31:13 +02:00
Bryan Bende
8615941c89
NIFI-959 Fixing incorrect evaluation for getting the collection and adding a unit test to prevent regression
2015-09-22 15:38:53 -04:00
Bryan Bende
5764e89293
NIFI-975 Fixing NullPointerException when one of the delimiters is not provided when using the Text strategy
2015-09-22 13:19:15 -04:00