Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,356 Commits 146 Branches 200 Tags 402 MiB
Commit Graph

1356 Commits

Author SHA1 Message Date
Matt Gilman 2215bc848b NIFI-810: 
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
 2015-09-25 17:46:58 -04:00
Mark Payne 034ee6de6b NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree 2015-09-25 11:39:58 -04:00
Mark Payne 96764ed6a1 Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi 2015-09-25 09:15:34 -04:00
Mark Payne eb94dab00c NIFI-604: Fixed checkstyle violation 2015-09-24 11:51:44 -04:00
Joe Skora e53ab391fa NIFI-641 Add delete capability to the UpdateAttributes processor. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-09-24 10:46:10 -04:00
Aldrin Piri a414f1d514 Previous commit for NIFI-985 provides the functionality as specified in Github PR. 
This closes #90.
 2015-09-24 10:37:08 -04:00
Joe e12da7c9a3 NIFI-985: Custom log prefix for LogAttribute processor 
The LogAttribute processor evaluates the log prefix EL using the current flow file.

Log prefix helps to distinguish the log output of multiple LogAttribute processors and identify the right processor. Log prefix appears in the first and the last log line, followed by the original 50 dashes. If you configure log prefix 'STEP 1: ' the log output looks like this:

STEP 1 :  --------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'lineageStartDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'fileSize'
        Value: '9'
FlowFile Attribute Map Content
Key: 'customAttribute'
        Value: 'custom value'
STEP 1 :  --------------------------------------------------

flow file content...

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-09-24 10:31:04 -04:00
Mark Payne 24c080788f NIFI-604: Removed unused import, as it caused checkstyle violation 2015-09-24 10:06:39 -04:00
Mark Payne 193dbe6533 Merge branch 'NIFI-604' of https://github.com/rickysaltzer/nifi into NIFI-604 2015-09-23 16:03:46 -04:00
Mark Payne 26f80095b7 Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi 2015-09-23 15:31:19 -04:00
Mark Payne f884086fc2 NIFI-713: Fixed checkstyle issue 2015-09-23 15:20:25 -04:00
Mark Payne da56b49b88 Merge branch 'NIFI-713' of https://github.com/rickysaltzer/nifi into NIFI-713 2015-09-23 12:06:50 -04:00
Bryan Bende 8615941c89 NIFI-959 Fixing incorrect evaluation for getting the collection and adding a unit test to prevent regression 2015-09-22 15:38:53 -04:00
Bryan Bende 5764e89293 NIFI-975 Fixing NullPointerException when one of the delimiters is not provided when using the Text strategy 2015-09-22 13:19:15 -04:00
Joe 14eaeeb1ee NIFI-984: Bad class used for logging in TestDetectDuplicate 
Using TestListenUDP instead of TestDetectDuplicate when creating the logger.

This closes #89

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-09-22 08:51:58 -04:00
Matt Gilman d75c7b54e8 NIFI-934: 
- Added a content viewer for image files.
 2015-09-18 18:17:12 -04:00
Bryan Bende 600f91a262 NIFI-932 Adding hasIncomingConnection() and hasConnection(Relationship) to ProcessContext and updating ExecuteSQL 2015-09-18 17:05:31 -04:00
Matt Gilman 1fd45958d3 NIFI-876: 
- Merge branch 'release-nifi-0.3.0-rc1'
 2015-09-18 08:48:48 -04:00
Matt Gilman 624bb5dd74 NIFI-876: 
- Merge branch 'release-nifi-0.3.0-rc1'
 2015-09-18 08:48:40 -04:00
Bryan Bende b36841e213 NIFI-919 Adding SplitAvro processor that splits binary datafiles into smaller datafiles, or bare records. 
- Adding documentation about bare record use, renaming Split Size to Output Size, and adding a test case with 0 records
- Removing validators on properties that have allowable values, using positive integer validator for Output Size, and fixing type on processor description
 2015-09-16 10:11:30 -04:00
Bryan Bende 1007999415 NIFI-912 Initial version of ExtractAvroMetadata processor. 
- Adding optional ability to extract record count
- Renaming record.count to item.count for clarity, and updating documentation
- Adding a test case with 0 records
- Removing validators from properties that use allowable values
 2015-09-16 09:59:50 -04:00
Matt Gilman ded74ec94c NIFI-876 prepare for next development iteration 2015-09-14 21:48:11 -04:00
Matt Gilman 2ec735e350 NIFI-876 prepare release nifi-0.3.0-RC1 2015-09-14 21:48:00 -04:00
Mark Payne 3d4ce34529 NIFI-938: If ResourceClaim is removed while a process has access to its stream, don't delete the claim 2015-09-14 11:47:02 -04:00
Mark Payne 992e841027 NIFI-948: Provide capability to register notifications for nifi lifecycle events 2015-09-13 19:55:12 -04:00
Mark Payne 4a7d1fe618 NIFI-936: Ensure that if we fail to write a record to the repository that we do not write to that log file again 2015-09-11 14:55:48 -04:00
Mark Payne 3780159d01 NIFI-939: Fixed bug in equals and hashCode methods of StandardContentClaim; added unit test to TestStandardProcessSession in order to verify behavior of append() method 2015-09-11 12:50:39 -04:00
Matt Gilman 291e65c6ef NIFI-947: 
- Added a profile to disable doclint when running jdk 1.8.
 2015-09-11 10:17:33 -04:00
Joseph Percivall a83ed34f91 Commit for NIFI-836 to fix broken javadoc @link elements 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-10 12:05:47 -04:00
Joseph Percivall 9dae76b9c4 Initial commit of NIFI-867 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 15:09:33 -04:00
Joseph Percivall 59b7a71c8a NIFI-907: addressing comments to fix periods and link from expression lanaguage doc to developer doc 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 13:45:56 -04:00
Joseph Percivall 47e9a3cdee NIFI-907: Addressing comment on adding the value of the attribute within the enum 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 13:45:56 -04:00
Joseph Percivall 690e674a0d NIFI-907: Initial commit of core attributes in doc 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 13:45:56 -04:00
Matt Gilman 3b675e99e3 This closes #86 to address incorrect link in README 2015-09-09 11:21:36 -04:00
Utkarsh Upadhyay a9f4b6ca7a MAINT: Fix link to documentation in README. 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 11:19:13 -04:00
Matt Gilman d1206fe074 NIFI-926: 
- Ensuring that nodes are not disconnected when the user attempts to reset a counter that does not exist on that node. This can happen when/if counters are adjusted conditionally.
 2015-09-07 08:41:47 -04:00
Bryan Bende 85534ca860 NIFI-916 Refactoring how the closed flag is used in PersistentProvenanceRepository to ensure proper shutdown 2015-09-06 13:22:07 -04:00
Mark Payne 72ccc252fe NIFI-927: Use a serializable version of NiFiDataPacket in the spark receiver 2015-09-04 12:22:19 -04:00
Mark Payne e4e263c292 NIFI-914: If no krb5 file set in nifi properties, treat it the same as an empty string set 2015-08-31 15:18:33 -04:00
Matt Gilman cd2e1424cb NIFI-911: 
- Updating default value for Regex so it matches once (?s:^.*$) instead of twice (.*). Matching on .* results in matching for every character and then again for 0 characters.
 2015-08-31 14:58:38 -04:00
ricky c72fb201d5 NIFI-713: Infer Hadoop Compression Automatically 
- Three main types of compression options:
	NONE 		: no compression
	AUTOMATIC 	: infers codec by extension
	SPECIFIED	: specified codec (e.g. snappy, gzip, bzip, or lz4)
 2015-08-31 14:38:15 -04:00
Mark Payne 2bb7853001 Merge branch 'NIFI-905' 2015-08-31 11:14:17 -04:00
Mark Payne f8c216b061 NIFI-903: Check for null value before trying to close 'out' OutputStream on StandardRecordWriter.close 2015-08-31 10:50:00 -04:00
Mark Payne c68da68dc2 Merge branch 'NIFI-902' 2015-08-30 19:48:27 -04:00
Mark Payne a8b063d61b NIFI-902: Ensure that we close the underlying file stream when we roll over a partition instead of the bufferedoutputstream, which could cause corruption of there was a failure to flush the entire buffer previously. 2015-08-30 19:48:19 -04:00
Mark Payne 3159cec782 NIFI-905: Ensure that when archive threshold is hit, archived data is destroyed and if no archived data exists that Processors aren't blocked from updating content repo 2015-08-28 14:15:35 -04:00
Mark Payne 5de37f63d9 NIFI-902: Ensure that if we get an IOException during rollover of WAL, we are able to recover 2015-08-28 10:04:58 -04:00
Mike Moser 85cb5dd1e7 NIFI-904 mock controller service fix 
Signed-off-by: joewitt <joewitt@apache.org>
 2015-08-27 23:22:41 -04:00
Mark Payne 76b5b38cc4 Merge branch 'NIFI-893' 2015-08-27 17:34:27 -04:00
ricky 9cefc4a5a5 NIFI-604: Custom Argument Delimiters ExecuteStreamCommand / ExecuteProcess 
- Unified the way ExecuteStreamCommand and ExecuteProcess handle arguments
- Argument delimiters can now be specified. Their default being what they were using before (; and space)
 2015-08-27 15:26:56 -04:00