Commit Graph

1500 Commits

Author SHA1 Message Date
ricky 7fb6e884a7 NIFI-866: Add Kerberos Support for Hadoop
- Add krb5.conf to nifi.properties

	nifi.kerberos.krb5.file | path to krb5.conf

- Connections to secure Hadoop clusters will be determined by their config,
  that is, hadoop.security.authentication should be set to kerberos.

- Added two optional arguments to AbstractHadoopProcessor (principal and keytab),
  these are only required if the cluster you're connecting to is secured. Both of
  these options require the krb5.conf to be present in nifi.properties.

Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-24 15:36:22 -04:00
Bryan Bende 3bfe830afc NIFI-842 Updating org.apache.nifi.NiFi so it sends a started signal to bootstrap which can then be used to make retsart decisions 2015-08-24 12:00:21 -04:00
Alan Jackoway c7f7704220 Changed line wrap length to 200 and combined adjacent imports into single try-with-resources blocks.
This closes #76

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-23 23:07:50 -04:00
Alan Jackoway b30fbe1f3b NIFI-888 EncryptContent for PGP Leaks File Handles.
Closes InputStreams created to read the public keys for PGP encryption and several other
streams involved in PGP encryptiong. This prevents NiFi from leaking file handles on
every validate call or encryption attempt in the EncryptContent processor.
2015-08-23 23:07:26 -04:00
joewitt df1066d2ed NIFI-875 more incubator references - argh 2015-08-23 22:42:32 -04:00
Matt Gilman 6f8eb9f5e3 NIFI-876:
- Updating the version of the nifi-nar-maven-plugin.
- Updating the minimum version of maven.
2015-08-23 12:32:52 -04:00
Mark Payne 4d4f74cf05 NIFI-889: Return the failure relationshp in the set of allowed relationships 2015-08-22 20:47:45 -04:00
Mark Payne 671445f10a Merge branch 'NIFI-844' 2015-08-21 17:15:39 -04:00
Mark Payne e8248353df Merge branch 'NIFI-882' 2015-08-21 17:13:43 -04:00
Mark Payne a9c2bf58b8 NIFI-844: Initial import of the ConvertAvroToJSON processor 2015-08-21 17:11:56 -04:00
Bryan Bende 0931c6b0d6 NIFI-884 Moving deletion of pid file from beginning of stop() to after a successful stop 2015-08-21 16:40:37 -04:00
Mark Payne d351f3ed1b NIFI-882: When a ProcessGroup is removed from the graph, ensure that the removeXYZ method is called for each component in that Process Group so that resources are appropriately cleaned up 2015-08-21 15:55:04 -04:00
joewitt 1f6805f06d NIFI-886 purging old events much more frequently 2015-08-21 15:40:26 -04:00
Mark Payne 1ddd736558 NIFI-854: Ensure that controller services are included in template if any processor (or other service) in the template references it, regardless of how many levels deep the component's ProcessGroup is 2015-08-21 14:46:20 -04:00
Mark Payne 82d32230e6 NIFI-881: Added support for Proxy Host and Proxy Port properties to InvokeHTTP
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-21 11:35:30 -04:00
Mark Payne 4f6c1cfff3 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-08-21 11:29:20 -04:00
Mark Payne 15a8699dc4 NIFI-744: Addressed feedback from review, mostly adding documentation to a few points in the code 2015-08-21 11:08:34 -04:00
Mark Payne 68d94cc01b NIFI-744: Refactored ContentClaim into ContentClaim and ResourceClaim and allowed resource claim to be reused across sessions 2015-08-21 11:08:34 -04:00
Bryan Bende d421e3c242 NIFI-846 MonitorActivity not setting start of evaluation period correctly 2015-08-21 11:06:20 -04:00
Joe Percivall b17be66a10 Fixing contrib check and addressing comments
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:42 -04:00
Joe Percivall dedff148ca Making metadata extractor max tags property optional
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Joe Percivall d992730fb7 NIFI-864 first contrib to nifi supports working with images and addressing comments
Committing modified files

Addressing code review comments

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Bryan Bende 706edeb01f NIFI-855 Adding support for filtering on multiple locations 2015-08-19 20:57:57 -04:00
Chris Mangold 3cca046550 NIFI-855 Add location bounding bix filter to twitter processor.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-19 20:42:27 -04:00
Mark Payne 4f92193159 NIFI-787: Ensure that Mock Framework passes a ProcessContext to methods using the @OnStopped annotation (if the method takes a ProcessContext object as an argument); updated developer guide to reflect that the object is allowed as an argument
Signed-off-by: joewitt <joewitt@apache.org>
2015-08-19 20:11:01 -04:00
Mark Payne d94f7f0b58 Merge branch 'NIFI-824' 2015-08-19 19:56:56 -04:00
Mark Payne 0410c1b7aa NIFI-824: When calling TestRunner.removeProperty with a required property, the property's value should be set to the default, or null if no default exists 2015-08-19 19:56:46 -04:00
Mark Payne 28549c2b1e NIFI-853: Made updates to processors 2015-08-19 17:36:29 -04:00
Mark Payne 1a37c95f58 NIFI-293: Added processors ConvertFlatJSONToSQL, PutSQL 2015-08-19 17:36:29 -04:00
Mark Payne 16dc5d5fd9 NIFI-756: Do not remove documents from a Lucene Index; instead, wait until the entire index is 'expired' and delete the index's directory 2015-08-19 13:53:13 -04:00
Mark Payne 8ebf1f03c2 Merge branch 'nifi-868' of https://github.com/pukkaone/nifi into NIFI-868 2015-08-19 12:56:26 -04:00
Mark Payne e345218eaa Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-08-19 12:27:41 -04:00
Mark Payne 19f7db6986 NIFI-793: Added multi-threading to the indexing in the Persistent Provenance Repository 2015-08-19 12:24:25 -04:00
Aldrin Piri f044ba5d45 NIFI-808 Providing property to allow exclusion of capture group 0 for any regex expressions as an attribute. 2015-08-19 12:00:25 -04:00
Mark Payne f171756a88 NIFI-862: Ensure that if we are unable to stop a controller service, we can still stop processors referencing it and the service itself 2015-08-19 10:12:57 -04:00
Mark Payne e409b6c5c1 NIFI-839: When disabling controller services, do so one-at-a-time in the process scheduler, so that we can ensure that all are disable-able and then disable them atomically 2015-08-19 08:55:15 -04:00
Chin Huang 8f98f80938 NIFI-868 Configure advertised host name of Remote Process Group Input Port
Before this change, the host given out to clients to connect to a Remote
Process Group Input Port is the host where the NiFi instance runs.
However, sometimes the binding host is different from the host that
clients connect to. For example, when a NiFi instance runs inside a
Docker container, a client on a separate machine must connect to the
Docker host which forwards the connection to the container.

Add a configuration property to specify the host name to give out to
clients to connect to a Remote Process Group Input Port. If the property
is not configured, then give out the name of host running the NiFi
instance.
2015-08-18 21:35:28 -07:00
joewitt 8e5347156f NIFI-841 fixed contrib check issues
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-08-18 20:06:42 -04:00
joewitt c3731703f3 NIFI-841 correct patch paths and fixed formatting issues
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-08-18 20:06:42 -04:00
Mark Payne 35439db347 NIFI-841: Ensure that IOExceptions on session commit are handled properly
Signed-off-by: joewitt <joewitt@apache.org>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-08-18 20:06:41 -04:00
Bryan Bende a264c49d80 Merge branch 'NIFI-790-NEW' 2015-08-17 17:33:26 -04:00
Bryan Bende 1c34478eb8 NIFI-790 Create reporting task to deliver metrics to Apache Ambari
- Adding NOTICE for nifi-ambari-nar, and fixing formatting issues in nifi-ambari-reporting-task pom
- Addressing review feedback: updating assembly NOTICE, fixing unit test, and minor clean up
- Adding additionalDetails.html
2015-08-17 15:47:49 -04:00
Matt Gilman ffa7ceb2b1 NIFI-861:
- Addressing issue with blank processor names when attempting to generate ellipsis on the canvas.
2015-08-17 15:23:36 -04:00
Aldrin Piri 740b09b182 NIFI-796 Adjusting ControlRate documentation to reflect that a long is used instead of an integer. 2015-08-17 11:51:10 -04:00
Aldrin Piri c0dad8d1d8 NIFI-848 Extending the Administrator Guide to include guidance on providing multiple provenance and content repositories. 2015-08-17 10:46:13 -04:00
joewitt 6066557e66 NIFI-827 added headless entry
Signed-off-by: joewitt <joewitt@apache.org>
2015-08-17 09:16:34 -04:00
joewitt a837fa5f38 NIFI-801 fixed reference to BSD and name of NOTICE 2015-08-16 22:42:28 -04:00
joewitt 3e7fe93fdb NIFI-857 fixing gitignore list 2015-08-16 16:25:56 -04:00
joewitt cd74519133 NIFI-857 merged develop into master in preparation for the removal of develop branch 2015-08-16 15:56:46 -04:00
joewitt aa99884782 NIFI-850 removed nifi parent, updated nifi pom, moved all nifi subdirs up one level, fixed readme. 2015-08-15 13:12:22 -04:00