ricky
c72fb201d5
NIFI-713: Infer Hadoop Compression Automatically
...
- Three main types of compression options:
NONE : no compression
AUTOMATIC : infers codec by extension
SPECIFIED : specified codec (e.g. snappy, gzip, bzip, or lz4)
2015-08-31 14:38:15 -04:00
Mark Payne
2bb7853001
Merge branch 'NIFI-905'
2015-08-31 11:14:17 -04:00
Mark Payne
f8c216b061
NIFI-903: Check for null value before trying to close 'out' OutputStream on StandardRecordWriter.close
2015-08-31 10:50:00 -04:00
Mark Payne
c68da68dc2
Merge branch 'NIFI-902'
2015-08-30 19:48:27 -04:00
Mark Payne
a8b063d61b
NIFI-902: Ensure that we close the underlying file stream when we roll over a partition instead of the bufferedoutputstream, which could cause corruption of there was a failure to flush the entire buffer previously.
2015-08-30 19:48:19 -04:00
Mark Payne
3159cec782
NIFI-905: Ensure that when archive threshold is hit, archived data is destroyed and if no archived data exists that Processors aren't blocked from updating content repo
2015-08-28 14:15:35 -04:00
Mark Payne
5de37f63d9
NIFI-902: Ensure that if we get an IOException during rollover of WAL, we are able to recover
2015-08-28 10:04:58 -04:00
Mike Moser
85cb5dd1e7
NIFI-904 mock controller service fix
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-08-27 23:22:41 -04:00
Mark Payne
76b5b38cc4
Merge branch 'NIFI-893'
2015-08-27 17:34:27 -04:00
ricky
9cefc4a5a5
NIFI-604: Custom Argument Delimiters ExecuteStreamCommand / ExecuteProcess
...
- Unified the way ExecuteStreamCommand and ExecuteProcess handle arguments
- Argument delimiters can now be specified. Their default being what they were using before (; and space)
2015-08-27 15:26:56 -04:00
Mark Payne
fbec28bad9
NIFI-893: Ensure that if session.commit fails, previously 'checkpointed' sessions are rolled back
2015-08-27 15:17:55 -04:00
Bryan Bende
d39848f06e
NIFI-894 Introducing a lock file to communicate from boostrap to NiFi that a shutdown is in progress.
2015-08-27 10:06:02 -04:00
Bryan Bende
f34d73e73e
NIFI-895 ensuring the session factory is re-set in the onTrigger method in the case where the runner needed to be stopped
2015-08-26 11:21:08 -04:00
Mark Payne
4baffacc42
NIFI-892: If nifi.flowfile.repository.partitions property is changed, but repository already exists, just previous value
2015-08-25 09:58:37 -04:00
Bryan Bende
310347fd66
Merge branch 'NIFI-842'
2015-08-24 18:58:56 -04:00
Bryan Bende
58aedd785d
This closes #75 Feedback on the PR has been provided in NIFI-866
2015-08-24 15:38:30 -04:00
ricky
7fb6e884a7
NIFI-866: Add Kerberos Support for Hadoop
...
- Add krb5.conf to nifi.properties
nifi.kerberos.krb5.file | path to krb5.conf
- Connections to secure Hadoop clusters will be determined by their config,
that is, hadoop.security.authentication should be set to kerberos.
- Added two optional arguments to AbstractHadoopProcessor (principal and keytab),
these are only required if the cluster you're connecting to is secured. Both of
these options require the krb5.conf to be present in nifi.properties.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-24 15:36:22 -04:00
Bryan Bende
3bfe830afc
NIFI-842 Updating org.apache.nifi.NiFi so it sends a started signal to bootstrap which can then be used to make retsart decisions
2015-08-24 12:00:21 -04:00
Alan Jackoway
c7f7704220
Changed line wrap length to 200 and combined adjacent imports into single try-with-resources blocks.
...
This closes #76
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-23 23:07:50 -04:00
Alan Jackoway
b30fbe1f3b
NIFI-888 EncryptContent for PGP Leaks File Handles.
...
Closes InputStreams created to read the public keys for PGP encryption and several other
streams involved in PGP encryptiong. This prevents NiFi from leaking file handles on
every validate call or encryption attempt in the EncryptContent processor.
2015-08-23 23:07:26 -04:00
joewitt
df1066d2ed
NIFI-875 more incubator references - argh
2015-08-23 22:42:32 -04:00
Matt Gilman
6f8eb9f5e3
NIFI-876:
...
- Updating the version of the nifi-nar-maven-plugin.
- Updating the minimum version of maven.
2015-08-23 12:32:52 -04:00
Mark Payne
4d4f74cf05
NIFI-889: Return the failure relationshp in the set of allowed relationships
2015-08-22 20:47:45 -04:00
Mark Payne
671445f10a
Merge branch 'NIFI-844'
2015-08-21 17:15:39 -04:00
Mark Payne
e8248353df
Merge branch 'NIFI-882'
2015-08-21 17:13:43 -04:00
Mark Payne
a9c2bf58b8
NIFI-844: Initial import of the ConvertAvroToJSON processor
2015-08-21 17:11:56 -04:00
Bryan Bende
0931c6b0d6
NIFI-884 Moving deletion of pid file from beginning of stop() to after a successful stop
2015-08-21 16:40:37 -04:00
Mark Payne
d351f3ed1b
NIFI-882: When a ProcessGroup is removed from the graph, ensure that the removeXYZ method is called for each component in that Process Group so that resources are appropriately cleaned up
2015-08-21 15:55:04 -04:00
joewitt
1f6805f06d
NIFI-886 purging old events much more frequently
2015-08-21 15:40:26 -04:00
Mark Payne
1ddd736558
NIFI-854: Ensure that controller services are included in template if any processor (or other service) in the template references it, regardless of how many levels deep the component's ProcessGroup is
2015-08-21 14:46:20 -04:00
Mark Payne
82d32230e6
NIFI-881: Added support for Proxy Host and Proxy Port properties to InvokeHTTP
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-21 11:35:30 -04:00
Mark Payne
4f6c1cfff3
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-08-21 11:29:20 -04:00
Mark Payne
15a8699dc4
NIFI-744: Addressed feedback from review, mostly adding documentation to a few points in the code
2015-08-21 11:08:34 -04:00
Mark Payne
68d94cc01b
NIFI-744: Refactored ContentClaim into ContentClaim and ResourceClaim and allowed resource claim to be reused across sessions
2015-08-21 11:08:34 -04:00
Bryan Bende
d421e3c242
NIFI-846 MonitorActivity not setting start of evaluation period correctly
2015-08-21 11:06:20 -04:00
Joe Percivall
b17be66a10
Fixing contrib check and addressing comments
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:42 -04:00
Joe Percivall
dedff148ca
Making metadata extractor max tags property optional
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Joe Percivall
d992730fb7
NIFI-864 first contrib to nifi supports working with images and addressing comments
...
Committing modified files
Addressing code review comments
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Bryan Bende
706edeb01f
NIFI-855 Adding support for filtering on multiple locations
2015-08-19 20:57:57 -04:00
Chris Mangold
3cca046550
NIFI-855 Add location bounding bix filter to twitter processor.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-19 20:42:27 -04:00
Mark Payne
4f92193159
NIFI-787: Ensure that Mock Framework passes a ProcessContext to methods using the @OnStopped annotation (if the method takes a ProcessContext object as an argument); updated developer guide to reflect that the object is allowed as an argument
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-08-19 20:11:01 -04:00
Mark Payne
d94f7f0b58
Merge branch 'NIFI-824'
2015-08-19 19:56:56 -04:00
Mark Payne
0410c1b7aa
NIFI-824: When calling TestRunner.removeProperty with a required property, the property's value should be set to the default, or null if no default exists
2015-08-19 19:56:46 -04:00
Mark Payne
28549c2b1e
NIFI-853: Made updates to processors
2015-08-19 17:36:29 -04:00
Mark Payne
1a37c95f58
NIFI-293: Added processors ConvertFlatJSONToSQL, PutSQL
2015-08-19 17:36:29 -04:00
Mark Payne
16dc5d5fd9
NIFI-756: Do not remove documents from a Lucene Index; instead, wait until the entire index is 'expired' and delete the index's directory
2015-08-19 13:53:13 -04:00
Mark Payne
8ebf1f03c2
Merge branch 'nifi-868' of https://github.com/pukkaone/nifi into NIFI-868
2015-08-19 12:56:26 -04:00
Mark Payne
e345218eaa
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-08-19 12:27:41 -04:00
Mark Payne
19f7db6986
NIFI-793: Added multi-threading to the indexing in the Persistent Provenance Repository
2015-08-19 12:24:25 -04:00
Aldrin Piri
f044ba5d45
NIFI-808 Providing property to allow exclusion of capture group 0 for any regex expressions as an attribute.
2015-08-19 12:00:25 -04:00