Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,552 Commits 146 Branches 201 Tags 403 MiB
Commit Graph

260 Commits

Author SHA1 Message Date
Mark Payne 4e38288062 NIFI-673: Added sftp.listing.user attribute to FlowFiles created by ListSFTP; ensure that FetchSFTP indicates that the username supports Expression Language 2015-10-25 11:13:02 -04:00
Mark Payne b0322d9ffe NIFI-673: Added Completion Strategy to FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne d1d57931bf NIFI-673: Initial implementation of ListSFTP, FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne 8a80060851 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-10-25 11:11:49 -04:00
Mark Payne 0636f0e731 NIFI-810: Merged master into branch 2015-10-25 11:02:40 -04:00
ricky f2c4f2d2a1 [PATCH] NIFI-997 Periodically attempt a kerberos relogin in AbstractHadoopProcessor 
- attempt a relogin based on an interval specified in the processor configuration
 - use hadoop's UserGroupInformation.checkTGTAndReloginFromKeytab to determine if a relogin is necessary based on the ticket and do so if needed
 - improve code readability with HdfsResources object in AbstractHadoopProcessor

Reviewed and Amended by Tony Kurc (tkurc@apache.org). This closes #97
 2015-10-25 00:49:58 -04:00
Mark Payne d63cd6bd2f Merge branch 'NIFI-1010' 2015-10-23 14:39:16 -04:00
Mark Payne 88fc8d28a0 NIFI-1010: If database driver does not support getting table name for column from ResultSetMetadata, then just use a default name 2015-10-23 10:25:59 -04:00
Mark Payne 0fc5d30461 NIFI-1055: Fixed checkstyle violations 2015-10-23 10:08:44 -04:00
Mark Payne 5d90c9be07 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-10-23 09:52:33 -04:00
Mark Payne bd506b1e10 NIFI-972: Added additional unit test; deleted lines that were commented out 2015-10-23 09:52:09 -04:00
Toivo Adams a9e5325047 NIFI-972 attribute to indicate rows count and cleanup 
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-23 09:28:03 -04:00
Toivo Adams ba3225fe92 NIFI-972 ExecuteSQL bug in createSchema() create Arvo Schema 1 
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-10-23 09:28:03 -04:00
Joe a5a5badb88 NIFI-945 Create a new property (JSON Container) in ConvertAvroToJson, which determines how stream of records is exposed: either as a sequence of single Objects ("none"), 
writing every Object to a new line, or as an array of Objects.

Let's assume you have an Avro content as stream of records (record1, record2, ...). If JSON container is "none", the converter will expose the records as sequence of
single JSON objects:

record1
record2
...
recordN

Please bear in mind, that the final output is not a valid JSON content. You can then forward this content e.g. to Kafka, where every record will be a single Kafka message.

If JSON container is "array", the output looks like this:

[record1,record2,...,recordN]

It is useful when you want to convert your Avro content to a valid JSON array.

This closes #88

Reviewed and Amended (amendments reviewed by original patch author on github) by Tony Kurc (tkurc@apache.org)
 2015-10-21 20:15:29 -04:00
Mark Payne da28b81eec Merge branch 'NIFI-988' 2015-10-21 10:44:06 -04:00
Mark Payne 97441ea0c2 Merge branch 'NIFI-988' of https://github.com/ImpressTV/nifi into NIFI-988 2015-10-21 10:18:05 -04:00
Joe e68fdca517 NIFI-944 Added support and unit tests for escaped characters in ConvertCSVtoAvro processor properties. This closes #87. Reviewed by Tony Kurc <tkurc@apache.org> 2015-10-21 00:01:38 -04:00
Andre F de Miranda 518670dbf6 NIFI-1042 Adds restlistener.remote.source.ip attribute to ListenHTTPServlet. This closes #105 2015-10-19 23:43:44 -04:00
Alex Moundalexis b809031195 NIFI-1046 shell clean up: +variable braces for consistency. Reviewed by Tony Kurc (tkurc@apache.org). This closes #106 2015-10-19 20:36:58 -04:00
Alex Moundalexis 9aa716b059 NIFI-1046 shell clean up: quoting prevents globbing & word splitting. 
Ignoring the unquoted array expansions on L188/190; suspect they ought to be quoted per [SC2068](https://github.com/koalaman/shellcheck/wiki/SC2068), but need to confirm desired arguments.

Reviewed by Tony Kurc (tkurc@apache.org)
 2015-10-19 20:36:07 -04:00
Alex Moundalexis 58d9b02517 NIFI-1046 shell clean up: remove backticks from nifi.sh. Reviewed by Tony Kurc (tkurc@apache.org) 2015-10-19 20:33:52 -04:00
Tony Kurc 9200542298 NIFI-1016 Naive fix so org.apache.nifi.prioritizer.PriorityAttributePrioritizerTest builds 2015-10-18 20:34:36 -04:00
Tony Kurc 88b1b844fb NIFI-747 This closes #104. PR from Venkatesh Sellappa <VS186031@outlook.com> was modified, then code reviewed by Joe Witt (comments in ticket) 2015-10-18 20:04:24 -04:00
Joe ad73a23aff NIFI-1016: Use centralized priority attribute name in PriorityAttributePrioritizer. closes #98. 
Signed-off-by: joewitt <joewitt@apache.org>
 2015-10-18 19:42:46 -04:00
Mark Payne 31f0909bd3 NIFI-994: Initial import of TailFile 2015-10-18 19:00:24 -04:00
Alan Jackoway 943ccfedef NIFI-1035 AbstractKiteProcessor.getSchema leaks file handles. closes #101. 
Close file handles when reading schema from resources or paths in AbstractKiteProcessor.getSchema

Signed-off-by: joewitt <joewitt@apache.org>
 2015-10-18 18:56:26 -04:00
Joe 22924c656b NIFI-995 TestGetFile.testAttributes() failed in case of a NTFS partition in Linux, because Files.setPosixFilePermissions() did not have any effect on the files and did not throw Exception. closes #95. Signed off by Tony Kurc (tkurc@apache.org) 2015-10-17 10:46:49 -04:00
Venkatesh Sellappa 9a8d763d8d NIFI-612 Remove FlowUnmarshaller. Builds, runs, could not find any latent references using reflection or other ways of loading classes without direct references. This closes #103. Signed off by Tony Kurc <tkurc@apache.org> 2015-10-17 09:43:10 -04:00
Matt Gilman 570202eb30 NIFI-730: 
- Fixing capitalization to remain consistent.
 2015-10-16 10:47:02 -04:00
Matt Gilman a872403831 NIFI-730: 
- Updating the styling of the drop request status dialog.
- Rendering any errors that may have occurred.
 2015-10-16 09:37:57 -04:00
Mark Payne 2b4999c018 NIFI-730: do not interrupt swap thread if drop flowfiles is canceled 2015-10-16 09:06:13 -04:00
Mark Payne b8dbd1018c NIFI-730: Updated details of Provenance Event for when a queue is emptied 2015-10-16 08:53:40 -04:00
Matt Gilman 39a050d2fd NIFI-730: 
- Adding emptying a queue when clustered.
 2015-10-14 17:47:06 -04:00
Mark Payne 09a3f6dadd NIFI-730: reordered states for drop flowfile request 2015-10-14 16:32:39 -04:00
Mark Payne 98a04eec74 NIFI-730: Set current queue size on drop flowfile request immediately when creating request 2015-10-14 13:48:59 -04:00
Mark Payne 84db372538 NIFI-977: Allow SQL Data Types with numerals that are negative 2015-10-14 13:12:10 -04:00
Matt Gilman cad0e7cf0f NIFI-730: 
- Adding progress bar for showing current status of drop request.
- Allowing the user to cancel the current drop request.
 2015-10-14 12:39:19 -04:00
Mark Payne a2ae99f899 NIFI-730: Make cancel request actually cancel 2015-10-14 11:11:48 -04:00
Mark Payne 5867193bc1 NIFI-730: Added additional testing logic to unit tests 2015-10-14 09:56:52 -04:00
Mark Payne 0af1acaafa NIFI-730: Return DropFlowFileStatus object when calling cancel 2015-10-14 09:46:21 -04:00
Mark Payne 77f7d7524c NIFI-730: bug fixes and code cleanup for swap manager and flowfile queue 2015-10-14 09:14:15 -04:00
Mark Payne afb76afcd0 NIFI-730: Added error messages if we fail to drop FlowFiles from queue 2015-10-13 15:57:18 -04:00
Mark Payne 72ff2a25d5 NIFI-730: Updated queue sizes appropriately during dropping of flowfiles 2015-10-13 15:46:56 -04:00
Matt Gilman 4b41aaab02 NIFI-730: 
- Fixing checkstyle violations.
- Wiring endpoints and framework model.
- Lowering the max delay while polling from 8 seconds to 4 seconds.
 2015-10-13 13:43:10 -04:00
Mark Payne af78354d84 NIFI-730: Added additional parameters to dropFlowFiles 2015-10-13 12:20:18 -04:00
Matt Gilman 09d6fe5cdb NIFI-730: 
- Fixing checkstyle violations.
- Renaming context menu item for emptying a queue.
 2015-10-13 10:12:58 -04:00
Mark Payne ad6af95d07 NIFI-730: Fixed checkstyle violations 2015-10-13 10:09:21 -04:00
Mark Payne 9be37914dd Merge branch 'NIFI-730' of https://git-wip-us.apache.org/repos/asf/nifi into NIFI-730 2015-10-13 10:03:31 -04:00
Mark Payne 49a781df2d NIFI-730: Implemented swapping in and out on-demand by the FlowFileQueue rather than in a background thread 2015-10-13 10:03:03 -04:00
danbress 49ee06b0a2 NIFI-774 Ignore integration style test 2015-10-12 19:59:46 -04:00
Matt Gilman e0ac7cde37 NIFI-730: 
- Starting to add support for deleting flow files from a queue by creating endpoints and starting to wire everything together.
- Adding context menu item for initiating the request to drop flow files.
 2015-10-12 10:00:54 -04:00
danbress fad81d872d Merge remote-tracking branch 'yu/NIFI-774' 2015-10-12 09:55:52 -04:00
Mark Payne b8c51dc35d NIFI-730: Added methods for dropping queued flowfiles; refactored swap manager but have not yet started swapping flowfiles in or out from within the flowfile queue 2015-10-11 10:27:07 -04:00
Mike Moser f798127290 NIFI-1031 resolve reporting task error in flow.xml 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-10-09 10:53:23 -04:00
Joseph Percivall b4bfcc1f21 NIFI-1030 made InvokeHttp basic auth password a sensitive value 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-10-08 15:46:12 -04:00
Matt Gilman 2583d7869a NIFI-442: 
NIFI-828:
- Always selecting the first item in the new component table.
- Enabling adding the selected component by typing Enter.
- Removing the 'filter by' in the new component dialogs and instead just searching every field.
 2015-10-07 19:11:55 -04:00
Mark Payne 8e2308b78d NIFI-810: Reworded validation errors pertaining ot upstream connections 2015-10-07 17:53:04 -04:00
Mark Payne ccfb57fe9f NIFI-810: Addressed several checkstyle violations 2015-10-07 17:48:51 -04:00
Mark Payne b974445ddd NIFI-810: rebased from master 2015-10-07 17:28:39 -04:00
Mark Payne 5ecdb1858e NIFI-810: Updated the wording on validation errors due to upstream connections 2015-10-07 17:26:14 -04:00
Matt Gilman 13edcfda2e NIFI-810: 
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
 2015-10-07 17:26:14 -04:00
Mark Payne 4afd8f88f8 NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree 2015-10-07 17:26:14 -04:00
Randy Gelhausen 31fba6b333 Bumped nifi-kafka-processors Kafka version 
This closes #99.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-10-05 10:39:22 -04:00
Bryan Bende 6b2f5ad1f5 NIFI-992 Adding NOTICE to nifi-couchbase-nar 2015-10-01 16:56:49 -04:00
ijokarumawak 033a1553ab nifi-992 Improvements based on code review part II. 
- Penalize or Yield based on ErrorHandlingStrategy.Penalty
- Add Retry relationship to PutCouchbaseKey
- Remove unnecessary try/catch and let the framework handle it
- Change CouchbaseException relation mapping for Fatal from Failure to Retry

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-10-01 14:13:20 -04:00
ijokarumawak 72eb64e8a4 nifi-992 Improvements based on code review. 
- Removed checkstyle and contrib-check profile since it's inherit from
  top-level pom.
- Consolidate DOC_ID and DOC_ID_EXP into a single DOC_ID property.
- Add capability description on GetCouchbaseKey.
- Fixed documentation spell misses.
- Handle Exceptions accordingly.
- Add 'retry' relationship.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-09-29 13:48:13 -04:00
ijokarumawak 2466a24530 nifi-992 Adding nifi-couchbase-bundle. 
- new CouchbaseClusterControllerService
- new Processors
  - GetCouchbaseKey
  - PutCouchbaseKey

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-09-28 11:21:42 -04:00
Matt Gilman 2215bc848b NIFI-810: 
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
 2015-09-25 17:46:58 -04:00
Mark Payne 034ee6de6b NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree 2015-09-25 11:39:58 -04:00
Mark Payne 96764ed6a1 Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi 2015-09-25 09:15:34 -04:00
Mark Payne eb94dab00c NIFI-604: Fixed checkstyle violation 2015-09-24 11:51:44 -04:00
Joe Skora e53ab391fa NIFI-641 Add delete capability to the UpdateAttributes processor. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-09-24 10:46:10 -04:00
Joe e12da7c9a3 NIFI-985: Custom log prefix for LogAttribute processor 
The LogAttribute processor evaluates the log prefix EL using the current flow file.

Log prefix helps to distinguish the log output of multiple LogAttribute processors and identify the right processor. Log prefix appears in the first and the last log line, followed by the original 50 dashes. If you configure log prefix 'STEP 1: ' the log output looks like this:

STEP 1 :  --------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'lineageStartDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'fileSize'
        Value: '9'
FlowFile Attribute Map Content
Key: 'customAttribute'
        Value: 'custom value'
STEP 1 :  --------------------------------------------------

flow file content...

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-09-24 10:31:04 -04:00
Mark Payne 24c080788f NIFI-604: Removed unused import, as it caused checkstyle violation 2015-09-24 10:06:39 -04:00
Mark Payne 193dbe6533 Merge branch 'NIFI-604' of https://github.com/rickysaltzer/nifi into NIFI-604 2015-09-23 16:03:46 -04:00
Mark Payne 26f80095b7 Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi 2015-09-23 15:31:19 -04:00
Mark Payne f884086fc2 NIFI-713: Fixed checkstyle issue 2015-09-23 15:20:25 -04:00
Mark Payne da56b49b88 Merge branch 'NIFI-713' of https://github.com/rickysaltzer/nifi into NIFI-713 2015-09-23 12:06:50 -04:00
Joe ee7d89cb01 NIFI-988: Test cases for PutDistributedMapCache 2015-09-23 14:32:37 +02:00
Joe 6b1328f3f1 NIFI-988: PutDisributedMapCache processor implementation 2015-09-23 14:31:13 +02:00
Bryan Bende 8615941c89 NIFI-959 Fixing incorrect evaluation for getting the collection and adding a unit test to prevent regression 2015-09-22 15:38:53 -04:00
Bryan Bende 5764e89293 NIFI-975 Fixing NullPointerException when one of the delimiters is not provided when using the Text strategy 2015-09-22 13:19:15 -04:00
Joe 14eaeeb1ee NIFI-984: Bad class used for logging in TestDetectDuplicate 
Using TestListenUDP instead of TestDetectDuplicate when creating the logger.

This closes #89

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-09-22 08:51:58 -04:00
Matt Gilman d75c7b54e8 NIFI-934: 
- Added a content viewer for image files.
 2015-09-18 18:17:12 -04:00
Bryan Bende 600f91a262 NIFI-932 Adding hasIncomingConnection() and hasConnection(Relationship) to ProcessContext and updating ExecuteSQL 2015-09-18 17:05:31 -04:00
Matt Gilman 1fd45958d3 NIFI-876: 
- Merge branch 'release-nifi-0.3.0-rc1'
 2015-09-18 08:48:48 -04:00
Matt Gilman 624bb5dd74 NIFI-876: 
- Merge branch 'release-nifi-0.3.0-rc1'
 2015-09-18 08:48:40 -04:00
Bryan Bende b36841e213 NIFI-919 Adding SplitAvro processor that splits binary datafiles into smaller datafiles, or bare records. 
- Adding documentation about bare record use, renaming Split Size to Output Size, and adding a test case with 0 records
- Removing validators on properties that have allowable values, using positive integer validator for Output Size, and fixing type on processor description
 2015-09-16 10:11:30 -04:00
Bryan Bende 1007999415 NIFI-912 Initial version of ExtractAvroMetadata processor. 
- Adding optional ability to extract record count
- Renaming record.count to item.count for clarity, and updating documentation
- Adding a test case with 0 records
- Removing validators from properties that use allowable values
 2015-09-16 09:59:50 -04:00
Matt Gilman ded74ec94c NIFI-876 prepare for next development iteration 2015-09-14 21:48:11 -04:00
Matt Gilman 2ec735e350 NIFI-876 prepare release nifi-0.3.0-RC1 2015-09-14 21:48:00 -04:00
Mark Payne 3d4ce34529 NIFI-938: If ResourceClaim is removed while a process has access to its stream, don't delete the claim 2015-09-14 11:47:02 -04:00
Mark Payne 992e841027 NIFI-948: Provide capability to register notifications for nifi lifecycle events 2015-09-13 19:55:12 -04:00
Mark Payne 4a7d1fe618 NIFI-936: Ensure that if we fail to write a record to the repository that we do not write to that log file again 2015-09-11 14:55:48 -04:00
Mark Payne 3780159d01 NIFI-939: Fixed bug in equals and hashCode methods of StandardContentClaim; added unit test to TestStandardProcessSession in order to verify behavior of append() method 2015-09-11 12:50:39 -04:00
Yu ISHIKAWA eb1d6b554c Remove `REL_NOT_FOUND` 2015-09-11 18:05:20 +09:00
Joseph Percivall a83ed34f91 Commit for NIFI-836 to fix broken javadoc @link elements 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-10 12:05:47 -04:00
Yu ISHIKAWA f718b4bf46 Modify an error message 2015-09-07 23:34:22 +09:00
Yu ISHIKAWA d32a32a92d Remove the process to check if the target key exists or not 2015-09-07 23:32:48 +09:00
Matt Gilman d1206fe074 NIFI-926: 
- Ensuring that nodes are not disconnected when the user attempts to reset a counter that does not exist on that node. This can happen when/if counters are adjusted conditionally.
 2015-09-07 08:41:47 -04:00
Bryan Bende 85534ca860 NIFI-916 Refactoring how the closed flag is used in PersistentProvenanceRepository to ensure proper shutdown 2015-09-06 13:22:07 -04:00
Yuu ISHIKAWA c492a1aaae Fix a type and modify an error message 2015-09-02 21:54:02 +09:00
Yu ISHIKAWA 0334f04640 Add a relation for "not found" and that is transfered if a target key doesn't exist on S3 2015-09-02 13:48:39 +09:00
Yu ISHIKAWA 213f507f53 Add @Override annotations 2015-09-02 13:02:39 +09:00
Yuu ISHIKAWA 6cbc6db860 Remove `getSupportedDynamicPropertyDescriptor` 2015-09-02 06:49:46 +09:00
Yuu ISHIKAWA 7e6834937b Ignore the test suite 2015-09-01 22:36:50 +09:00
Yu ISHIKAWA d1dbd37629 [NIFI-774] Create a DeleteS3Object Processor 2015-09-01 22:35:11 +09:00
Matt Gilman cd2e1424cb NIFI-911: 
- Updating default value for Regex so it matches once (?s:^.*$) instead of twice (.*). Matching on .* results in matching for every character and then again for 0 characters.
 2015-08-31 14:58:38 -04:00
ricky c72fb201d5 NIFI-713: Infer Hadoop Compression Automatically 
- Three main types of compression options:
	NONE 		: no compression
	AUTOMATIC 	: infers codec by extension
	SPECIFIED	: specified codec (e.g. snappy, gzip, bzip, or lz4)
 2015-08-31 14:38:15 -04:00
Mark Payne 2bb7853001 Merge branch 'NIFI-905' 2015-08-31 11:14:17 -04:00
Mark Payne f8c216b061 NIFI-903: Check for null value before trying to close 'out' OutputStream on StandardRecordWriter.close 2015-08-31 10:50:00 -04:00
Mark Payne 3159cec782 NIFI-905: Ensure that when archive threshold is hit, archived data is destroyed and if no archived data exists that Processors aren't blocked from updating content repo 2015-08-28 14:15:35 -04:00
Mark Payne 5de37f63d9 NIFI-902: Ensure that if we get an IOException during rollover of WAL, we are able to recover 2015-08-28 10:04:58 -04:00
Mark Payne 76b5b38cc4 Merge branch 'NIFI-893' 2015-08-27 17:34:27 -04:00
ricky 9cefc4a5a5 NIFI-604: Custom Argument Delimiters ExecuteStreamCommand / ExecuteProcess 
- Unified the way ExecuteStreamCommand and ExecuteProcess handle arguments
- Argument delimiters can now be specified. Their default being what they were using before (; and space)
 2015-08-27 15:26:56 -04:00
Mark Payne fbec28bad9 NIFI-893: Ensure that if session.commit fails, previously 'checkpointed' sessions are rolled back 2015-08-27 15:17:55 -04:00
Bryan Bende f34d73e73e NIFI-895 ensuring the session factory is re-set in the onTrigger method in the case where the runner needed to be stopped 2015-08-26 11:21:08 -04:00
Bryan Bende 310347fd66 Merge branch 'NIFI-842' 2015-08-24 18:58:56 -04:00
ricky 7fb6e884a7 NIFI-866: Add Kerberos Support for Hadoop 
- Add krb5.conf to nifi.properties

	nifi.kerberos.krb5.file | path to krb5.conf

- Connections to secure Hadoop clusters will be determined by their config,
  that is, hadoop.security.authentication should be set to kerberos.

- Added two optional arguments to AbstractHadoopProcessor (principal and keytab),
  these are only required if the cluster you're connecting to is secured. Both of
  these options require the krb5.conf to be present in nifi.properties.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-08-24 15:36:22 -04:00
Bryan Bende 3bfe830afc NIFI-842 Updating org.apache.nifi.NiFi so it sends a started signal to bootstrap which can then be used to make retsart decisions 2015-08-24 12:00:21 -04:00
Alan Jackoway c7f7704220 Changed line wrap length to 200 and combined adjacent imports into single try-with-resources blocks. 
This closes #76

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-08-23 23:07:50 -04:00
Alan Jackoway b30fbe1f3b NIFI-888 EncryptContent for PGP Leaks File Handles. 
Closes InputStreams created to read the public keys for PGP encryption and several other
streams involved in PGP encryptiong. This prevents NiFi from leaking file handles on
every validate call or encryption attempt in the EncryptContent processor.
 2015-08-23 23:07:26 -04:00
Mark Payne 4d4f74cf05 NIFI-889: Return the failure relationshp in the set of allowed relationships 2015-08-22 20:47:45 -04:00
Mark Payne 671445f10a Merge branch 'NIFI-844' 2015-08-21 17:15:39 -04:00
Mark Payne e8248353df Merge branch 'NIFI-882' 2015-08-21 17:13:43 -04:00
Mark Payne a9c2bf58b8 NIFI-844: Initial import of the ConvertAvroToJSON processor 2015-08-21 17:11:56 -04:00
Mark Payne d351f3ed1b NIFI-882: When a ProcessGroup is removed from the graph, ensure that the removeXYZ method is called for each component in that Process Group so that resources are appropriately cleaned up 2015-08-21 15:55:04 -04:00
joewitt 1f6805f06d NIFI-886 purging old events much more frequently 2015-08-21 15:40:26 -04:00
Mark Payne 1ddd736558 NIFI-854: Ensure that controller services are included in template if any processor (or other service) in the template references it, regardless of how many levels deep the component's ProcessGroup is 2015-08-21 14:46:20 -04:00
Mark Payne 82d32230e6 NIFI-881: Added support for Proxy Host and Proxy Port properties to InvokeHTTP 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-08-21 11:35:30 -04:00
Mark Payne 4f6c1cfff3 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-08-21 11:29:20 -04:00
Mark Payne 15a8699dc4 NIFI-744: Addressed feedback from review, mostly adding documentation to a few points in the code 2015-08-21 11:08:34 -04:00
Mark Payne 68d94cc01b NIFI-744: Refactored ContentClaim into ContentClaim and ResourceClaim and allowed resource claim to be reused across sessions 2015-08-21 11:08:34 -04:00
Bryan Bende d421e3c242 NIFI-846 MonitorActivity not setting start of evaluation period correctly 2015-08-21 11:06:20 -04:00
Joe Percivall b17be66a10 Fixing contrib check and addressing comments 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-08-21 08:56:42 -04:00
Joe Percivall dedff148ca Making metadata extractor max tags property optional 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-08-21 08:56:41 -04:00
Joe Percivall d992730fb7 NIFI-864 first contrib to nifi supports working with images and addressing comments 
Committing modified files

Addressing code review comments

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-08-21 08:56:41 -04:00
Bryan Bende 706edeb01f NIFI-855 Adding support for filtering on multiple locations 2015-08-19 20:57:57 -04:00
Chris Mangold 3cca046550 NIFI-855 Add location bounding bix filter to twitter processor. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-08-19 20:42:27 -04:00
Mark Payne 28549c2b1e NIFI-853: Made updates to processors 2015-08-19 17:36:29 -04:00
Mark Payne 1a37c95f58 NIFI-293: Added processors ConvertFlatJSONToSQL, PutSQL 2015-08-19 17:36:29 -04:00
Mark Payne 16dc5d5fd9 NIFI-756: Do not remove documents from a Lucene Index; instead, wait until the entire index is 'expired' and delete the index's directory 2015-08-19 13:53:13 -04:00
Mark Payne 8ebf1f03c2 Merge branch 'nifi-868' of https://github.com/pukkaone/nifi into NIFI-868 2015-08-19 12:56:26 -04:00
Mark Payne e345218eaa Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-08-19 12:27:41 -04:00
Mark Payne 19f7db6986 NIFI-793: Added multi-threading to the indexing in the Persistent Provenance Repository 2015-08-19 12:24:25 -04:00
Aldrin Piri f044ba5d45 NIFI-808 Providing property to allow exclusion of capture group 0 for any regex expressions as an attribute. 2015-08-19 12:00:25 -04:00
Mark Payne f171756a88 NIFI-862: Ensure that if we are unable to stop a controller service, we can still stop processors referencing it and the service itself 2015-08-19 10:12:57 -04:00
Mark Payne e409b6c5c1 NIFI-839: When disabling controller services, do so one-at-a-time in the process scheduler, so that we can ensure that all are disable-able and then disable them atomically 2015-08-19 08:55:15 -04:00
Chin Huang 8f98f80938 NIFI-868 Configure advertised host name of Remote Process Group Input Port 
Before this change, the host given out to clients to connect to a Remote
Process Group Input Port is the host where the NiFi instance runs.
However, sometimes the binding host is different from the host that
clients connect to. For example, when a NiFi instance runs inside a
Docker container, a client on a separate machine must connect to the
Docker host which forwards the connection to the container.

Add a configuration property to specify the host name to give out to
clients to connect to a Remote Process Group Input Port. If the property
is not configured, then give out the name of host running the NiFi
instance.
 2015-08-18 21:35:28 -07:00
joewitt 8e5347156f NIFI-841 fixed contrib check issues 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2015-08-18 20:06:42 -04:00