Commit Graph

68 Commits

Author SHA1 Message Date
Joe 6b1328f3f1 NIFI-988: PutDisributedMapCache processor implementation 2015-09-23 14:31:13 +02:00
Joe 14eaeeb1ee NIFI-984: Bad class used for logging in TestDetectDuplicate
Using TestListenUDP instead of TestDetectDuplicate when creating the logger.

This closes #89

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-09-22 08:51:58 -04:00
Matt Gilman d75c7b54e8 NIFI-934:
- Added a content viewer for image files.
2015-09-18 18:17:12 -04:00
Bryan Bende 600f91a262 NIFI-932 Adding hasIncomingConnection() and hasConnection(Relationship) to ProcessContext and updating ExecuteSQL 2015-09-18 17:05:31 -04:00
Matt Gilman 1fd45958d3 NIFI-876:
- Merge branch 'release-nifi-0.3.0-rc1'
2015-09-18 08:48:48 -04:00
Matt Gilman 624bb5dd74 NIFI-876:
- Merge branch 'release-nifi-0.3.0-rc1'
2015-09-18 08:48:40 -04:00
Bryan Bende b36841e213 NIFI-919 Adding SplitAvro processor that splits binary datafiles into smaller datafiles, or bare records.
- Adding documentation about bare record use, renaming Split Size to Output Size, and adding a test case with 0 records
- Removing validators on properties that have allowable values, using positive integer validator for Output Size, and fixing type on processor description
2015-09-16 10:11:30 -04:00
Bryan Bende 1007999415 NIFI-912 Initial version of ExtractAvroMetadata processor.
- Adding optional ability to extract record count
- Renaming record.count to item.count for clarity, and updating documentation
- Adding a test case with 0 records
- Removing validators from properties that use allowable values
2015-09-16 09:59:50 -04:00
Matt Gilman ded74ec94c NIFI-876 prepare for next development iteration 2015-09-14 21:48:11 -04:00
Matt Gilman 2ec735e350 NIFI-876 prepare release nifi-0.3.0-RC1 2015-09-14 21:48:00 -04:00
Mark Payne 3d4ce34529 NIFI-938: If ResourceClaim is removed while a process has access to its stream, don't delete the claim 2015-09-14 11:47:02 -04:00
Mark Payne 992e841027 NIFI-948: Provide capability to register notifications for nifi lifecycle events 2015-09-13 19:55:12 -04:00
Mark Payne 4a7d1fe618 NIFI-936: Ensure that if we fail to write a record to the repository that we do not write to that log file again 2015-09-11 14:55:48 -04:00
Mark Payne 3780159d01 NIFI-939: Fixed bug in equals and hashCode methods of StandardContentClaim; added unit test to TestStandardProcessSession in order to verify behavior of append() method 2015-09-11 12:50:39 -04:00
Joseph Percivall a83ed34f91 Commit for NIFI-836 to fix broken javadoc @link elements
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-09-10 12:05:47 -04:00
Matt Gilman d1206fe074 NIFI-926:
- Ensuring that nodes are not disconnected when the user attempts to reset a counter that does not exist on that node. This can happen when/if counters are adjusted conditionally.
2015-09-07 08:41:47 -04:00
Bryan Bende 85534ca860 NIFI-916 Refactoring how the closed flag is used in PersistentProvenanceRepository to ensure proper shutdown 2015-09-06 13:22:07 -04:00
Matt Gilman cd2e1424cb NIFI-911:
- Updating default value for Regex so it matches once (?s:^.*$) instead of twice (.*). Matching on .* results in matching for every character and then again for 0 characters.
2015-08-31 14:58:38 -04:00
Mark Payne 2bb7853001 Merge branch 'NIFI-905' 2015-08-31 11:14:17 -04:00
Mark Payne f8c216b061 NIFI-903: Check for null value before trying to close 'out' OutputStream on StandardRecordWriter.close 2015-08-31 10:50:00 -04:00
Mark Payne 3159cec782 NIFI-905: Ensure that when archive threshold is hit, archived data is destroyed and if no archived data exists that Processors aren't blocked from updating content repo 2015-08-28 14:15:35 -04:00
Mark Payne 5de37f63d9 NIFI-902: Ensure that if we get an IOException during rollover of WAL, we are able to recover 2015-08-28 10:04:58 -04:00
Mark Payne 76b5b38cc4 Merge branch 'NIFI-893' 2015-08-27 17:34:27 -04:00
Mark Payne fbec28bad9 NIFI-893: Ensure that if session.commit fails, previously 'checkpointed' sessions are rolled back 2015-08-27 15:17:55 -04:00
Bryan Bende f34d73e73e NIFI-895 ensuring the session factory is re-set in the onTrigger method in the case where the runner needed to be stopped 2015-08-26 11:21:08 -04:00
Bryan Bende 310347fd66 Merge branch 'NIFI-842' 2015-08-24 18:58:56 -04:00
ricky 7fb6e884a7 NIFI-866: Add Kerberos Support for Hadoop
- Add krb5.conf to nifi.properties

	nifi.kerberos.krb5.file | path to krb5.conf

- Connections to secure Hadoop clusters will be determined by their config,
  that is, hadoop.security.authentication should be set to kerberos.

- Added two optional arguments to AbstractHadoopProcessor (principal and keytab),
  these are only required if the cluster you're connecting to is secured. Both of
  these options require the krb5.conf to be present in nifi.properties.

Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-24 15:36:22 -04:00
Bryan Bende 3bfe830afc NIFI-842 Updating org.apache.nifi.NiFi so it sends a started signal to bootstrap which can then be used to make retsart decisions 2015-08-24 12:00:21 -04:00
Alan Jackoway c7f7704220 Changed line wrap length to 200 and combined adjacent imports into single try-with-resources blocks.
This closes #76

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-23 23:07:50 -04:00
Alan Jackoway b30fbe1f3b NIFI-888 EncryptContent for PGP Leaks File Handles.
Closes InputStreams created to read the public keys for PGP encryption and several other
streams involved in PGP encryptiong. This prevents NiFi from leaking file handles on
every validate call or encryption attempt in the EncryptContent processor.
2015-08-23 23:07:26 -04:00
Mark Payne 4d4f74cf05 NIFI-889: Return the failure relationshp in the set of allowed relationships 2015-08-22 20:47:45 -04:00
Mark Payne 671445f10a Merge branch 'NIFI-844' 2015-08-21 17:15:39 -04:00
Mark Payne e8248353df Merge branch 'NIFI-882' 2015-08-21 17:13:43 -04:00
Mark Payne a9c2bf58b8 NIFI-844: Initial import of the ConvertAvroToJSON processor 2015-08-21 17:11:56 -04:00
Mark Payne d351f3ed1b NIFI-882: When a ProcessGroup is removed from the graph, ensure that the removeXYZ method is called for each component in that Process Group so that resources are appropriately cleaned up 2015-08-21 15:55:04 -04:00
joewitt 1f6805f06d NIFI-886 purging old events much more frequently 2015-08-21 15:40:26 -04:00
Mark Payne 1ddd736558 NIFI-854: Ensure that controller services are included in template if any processor (or other service) in the template references it, regardless of how many levels deep the component's ProcessGroup is 2015-08-21 14:46:20 -04:00
Mark Payne 82d32230e6 NIFI-881: Added support for Proxy Host and Proxy Port properties to InvokeHTTP
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-21 11:35:30 -04:00
Mark Payne 4f6c1cfff3 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-08-21 11:29:20 -04:00
Mark Payne 15a8699dc4 NIFI-744: Addressed feedback from review, mostly adding documentation to a few points in the code 2015-08-21 11:08:34 -04:00
Mark Payne 68d94cc01b NIFI-744: Refactored ContentClaim into ContentClaim and ResourceClaim and allowed resource claim to be reused across sessions 2015-08-21 11:08:34 -04:00
Bryan Bende d421e3c242 NIFI-846 MonitorActivity not setting start of evaluation period correctly 2015-08-21 11:06:20 -04:00
Joe Percivall b17be66a10 Fixing contrib check and addressing comments
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:42 -04:00
Joe Percivall dedff148ca Making metadata extractor max tags property optional
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Joe Percivall d992730fb7 NIFI-864 first contrib to nifi supports working with images and addressing comments
Committing modified files

Addressing code review comments

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Bryan Bende 706edeb01f NIFI-855 Adding support for filtering on multiple locations 2015-08-19 20:57:57 -04:00
Chris Mangold 3cca046550 NIFI-855 Add location bounding bix filter to twitter processor.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-19 20:42:27 -04:00
Mark Payne 28549c2b1e NIFI-853: Made updates to processors 2015-08-19 17:36:29 -04:00
Mark Payne 1a37c95f58 NIFI-293: Added processors ConvertFlatJSONToSQL, PutSQL 2015-08-19 17:36:29 -04:00
Mark Payne 16dc5d5fd9 NIFI-756: Do not remove documents from a Lucene Index; instead, wait until the entire index is 'expired' and delete the index's directory 2015-08-19 13:53:13 -04:00