Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,645 Commits 143 Branches 197 Tags 392 MiB
Commit Graph

1645 Commits

Author SHA1 Message Date
Bryan Bende 1007999415 NIFI-912 Initial version of ExtractAvroMetadata processor. 
- Adding optional ability to extract record count
- Renaming record.count to item.count for clarity, and updating documentation
- Adding a test case with 0 records
- Removing validators from properties that use allowable values
 2015-09-16 09:59:50 -04:00
Matt Gilman ded74ec94c NIFI-876 prepare for next development iteration 2015-09-14 21:48:11 -04:00
Matt Gilman 2ec735e350 NIFI-876 prepare release nifi-0.3.0-RC1 2015-09-14 21:48:00 -04:00
Mark Payne 3d4ce34529 NIFI-938: If ResourceClaim is removed while a process has access to its stream, don't delete the claim 2015-09-14 11:47:02 -04:00
Mark Payne 992e841027 NIFI-948: Provide capability to register notifications for nifi lifecycle events 2015-09-13 19:55:12 -04:00
Mark Payne 4a7d1fe618 NIFI-936: Ensure that if we fail to write a record to the repository that we do not write to that log file again 2015-09-11 14:55:48 -04:00
Mark Payne 3780159d01 NIFI-939: Fixed bug in equals and hashCode methods of StandardContentClaim; added unit test to TestStandardProcessSession in order to verify behavior of append() method 2015-09-11 12:50:39 -04:00
Matt Gilman 291e65c6ef NIFI-947: 
- Added a profile to disable doclint when running jdk 1.8.
 2015-09-11 10:17:33 -04:00
Yu ISHIKAWA eb1d6b554c Remove `REL_NOT_FOUND` 2015-09-11 18:05:20 +09:00
Joseph Percivall a83ed34f91 Commit for NIFI-836 to fix broken javadoc @link elements 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-10 12:05:47 -04:00
Joseph Percivall 9dae76b9c4 Initial commit of NIFI-867 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 15:09:33 -04:00
Joseph Percivall 59b7a71c8a NIFI-907: addressing comments to fix periods and link from expression lanaguage doc to developer doc 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 13:45:56 -04:00
Joseph Percivall 47e9a3cdee NIFI-907: Addressing comment on adding the value of the attribute within the enum 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 13:45:56 -04:00
Joseph Percivall 690e674a0d NIFI-907: Initial commit of core attributes in doc 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 13:45:56 -04:00
Matt Gilman 3b675e99e3 This closes #86 to address incorrect link in README 2015-09-09 11:21:36 -04:00
Utkarsh Upadhyay a9f4b6ca7a MAINT: Fix link to documentation in README. 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2015-09-09 11:19:13 -04:00
Yu ISHIKAWA f718b4bf46 Modify an error message 2015-09-07 23:34:22 +09:00
Yu ISHIKAWA d32a32a92d Remove the process to check if the target key exists or not 2015-09-07 23:32:48 +09:00
Matt Gilman d1206fe074 NIFI-926: 
- Ensuring that nodes are not disconnected when the user attempts to reset a counter that does not exist on that node. This can happen when/if counters are adjusted conditionally.
 2015-09-07 08:41:47 -04:00
Bryan Bende 85534ca860 NIFI-916 Refactoring how the closed flag is used in PersistentProvenanceRepository to ensure proper shutdown 2015-09-06 13:22:07 -04:00
Mark Payne 72ccc252fe NIFI-927: Use a serializable version of NiFiDataPacket in the spark receiver 2015-09-04 12:22:19 -04:00
Yuu ISHIKAWA c492a1aaae Fix a type and modify an error message 2015-09-02 21:54:02 +09:00
Yu ISHIKAWA 0334f04640 Add a relation for "not found" and that is transfered if a target key doesn't exist on S3 2015-09-02 13:48:39 +09:00
Yu ISHIKAWA 213f507f53 Add @Override annotations 2015-09-02 13:02:39 +09:00
Yuu ISHIKAWA 6cbc6db860 Remove `getSupportedDynamicPropertyDescriptor` 2015-09-02 06:49:46 +09:00
Yuu ISHIKAWA 7e6834937b Ignore the test suite 2015-09-01 22:36:50 +09:00
Yu ISHIKAWA d1dbd37629 [NIFI-774] Create a DeleteS3Object Processor 2015-09-01 22:35:11 +09:00
Mark Payne e4e263c292 NIFI-914: If no krb5 file set in nifi properties, treat it the same as an empty string set 2015-08-31 15:18:33 -04:00
Matt Gilman cd2e1424cb NIFI-911: 
- Updating default value for Regex so it matches once (?s:^.*$) instead of twice (.*). Matching on .* results in matching for every character and then again for 0 characters.
 2015-08-31 14:58:38 -04:00
ricky c72fb201d5 NIFI-713: Infer Hadoop Compression Automatically 
- Three main types of compression options:
	NONE 		: no compression
	AUTOMATIC 	: infers codec by extension
	SPECIFIED	: specified codec (e.g. snappy, gzip, bzip, or lz4)
 2015-08-31 14:38:15 -04:00
Mark Payne 2bb7853001 Merge branch 'NIFI-905' 2015-08-31 11:14:17 -04:00
Mark Payne f8c216b061 NIFI-903: Check for null value before trying to close 'out' OutputStream on StandardRecordWriter.close 2015-08-31 10:50:00 -04:00
Mark Payne c68da68dc2 Merge branch 'NIFI-902' 2015-08-30 19:48:27 -04:00
Mark Payne a8b063d61b NIFI-902: Ensure that we close the underlying file stream when we roll over a partition instead of the bufferedoutputstream, which could cause corruption of there was a failure to flush the entire buffer previously. 2015-08-30 19:48:19 -04:00
Mark Payne 3159cec782 NIFI-905: Ensure that when archive threshold is hit, archived data is destroyed and if no archived data exists that Processors aren't blocked from updating content repo 2015-08-28 14:15:35 -04:00
Mark Payne 5de37f63d9 NIFI-902: Ensure that if we get an IOException during rollover of WAL, we are able to recover 2015-08-28 10:04:58 -04:00
Mike Moser 85cb5dd1e7 NIFI-904 mock controller service fix 
Signed-off-by: joewitt <joewitt@apache.org>
 2015-08-27 23:22:41 -04:00
Mark Payne 76b5b38cc4 Merge branch 'NIFI-893' 2015-08-27 17:34:27 -04:00
ricky 9cefc4a5a5 NIFI-604: Custom Argument Delimiters ExecuteStreamCommand / ExecuteProcess 
- Unified the way ExecuteStreamCommand and ExecuteProcess handle arguments
- Argument delimiters can now be specified. Their default being what they were using before (; and space)
 2015-08-27 15:26:56 -04:00
Mark Payne fbec28bad9 NIFI-893: Ensure that if session.commit fails, previously 'checkpointed' sessions are rolled back 2015-08-27 15:17:55 -04:00
Bryan Bende d39848f06e NIFI-894 Introducing a lock file to communicate from boostrap to NiFi that a shutdown is in progress. 2015-08-27 10:06:02 -04:00
Bryan Bende f34d73e73e NIFI-895 ensuring the session factory is re-set in the onTrigger method in the case where the runner needed to be stopped 2015-08-26 11:21:08 -04:00
Mark Payne 4baffacc42 NIFI-892: If nifi.flowfile.repository.partitions property is changed, but repository already exists, just previous value 2015-08-25 09:58:37 -04:00
Bryan Bende 310347fd66 Merge branch 'NIFI-842' 2015-08-24 18:58:56 -04:00
Bryan Bende 58aedd785d This closes #75 Feedback on the PR has been provided in NIFI-866 2015-08-24 15:38:30 -04:00
ricky 7fb6e884a7 NIFI-866: Add Kerberos Support for Hadoop 
- Add krb5.conf to nifi.properties

	nifi.kerberos.krb5.file | path to krb5.conf

- Connections to secure Hadoop clusters will be determined by their config,
  that is, hadoop.security.authentication should be set to kerberos.

- Added two optional arguments to AbstractHadoopProcessor (principal and keytab),
  these are only required if the cluster you're connecting to is secured. Both of
  these options require the krb5.conf to be present in nifi.properties.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2015-08-24 15:36:22 -04:00
Bryan Bende 3bfe830afc NIFI-842 Updating org.apache.nifi.NiFi so it sends a started signal to bootstrap which can then be used to make retsart decisions 2015-08-24 12:00:21 -04:00
Alan Jackoway c7f7704220 Changed line wrap length to 200 and combined adjacent imports into single try-with-resources blocks. 
This closes #76

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2015-08-23 23:07:50 -04:00
Alan Jackoway b30fbe1f3b NIFI-888 EncryptContent for PGP Leaks File Handles. 
Closes InputStreams created to read the public keys for PGP encryption and several other
streams involved in PGP encryptiong. This prevents NiFi from leaking file handles on
every validate call or encryption attempt in the EncryptContent processor.
 2015-08-23 23:07:26 -04:00
joewitt df1066d2ed NIFI-875 more incubator references - argh 2015-08-23 22:42:32 -04:00