Mark Payne
5ecdb1858e
NIFI-810: Updated the wording on validation errors due to upstream connections
2015-10-07 17:26:14 -04:00
Matt Gilman
13edcfda2e
NIFI-810:
...
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
2015-10-07 17:26:14 -04:00
Mark Payne
4afd8f88f8
NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree
2015-10-07 17:26:14 -04:00
Randy Gelhausen
31fba6b333
Bumped nifi-kafka-processors Kafka version
...
This closes #99 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-05 10:39:22 -04:00
Bryan Bende
6b2f5ad1f5
NIFI-992 Adding NOTICE to nifi-couchbase-nar
2015-10-01 16:56:49 -04:00
ijokarumawak
033a1553ab
nifi-992 Improvements based on code review part II.
...
- Penalize or Yield based on ErrorHandlingStrategy.Penalty
- Add Retry relationship to PutCouchbaseKey
- Remove unnecessary try/catch and let the framework handle it
- Change CouchbaseException relation mapping for Fatal from Failure to Retry
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-01 14:13:20 -04:00
ijokarumawak
72eb64e8a4
nifi-992 Improvements based on code review.
...
- Removed checkstyle and contrib-check profile since it's inherit from
top-level pom.
- Consolidate DOC_ID and DOC_ID_EXP into a single DOC_ID property.
- Add capability description on GetCouchbaseKey.
- Fixed documentation spell misses.
- Handle Exceptions accordingly.
- Add 'retry' relationship.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-29 13:48:13 -04:00
ijokarumawak
2466a24530
nifi-992 Adding nifi-couchbase-bundle.
...
- new CouchbaseClusterControllerService
- new Processors
- GetCouchbaseKey
- PutCouchbaseKey
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-28 11:21:42 -04:00
Matt Gilman
2215bc848b
NIFI-810:
...
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
2015-09-25 17:46:58 -04:00
Mark Payne
034ee6de6b
NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree
2015-09-25 11:39:58 -04:00
Mark Payne
96764ed6a1
Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi
2015-09-25 09:15:34 -04:00
Mark Payne
eb94dab00c
NIFI-604: Fixed checkstyle violation
2015-09-24 11:51:44 -04:00
Joe Skora
e53ab391fa
NIFI-641 Add delete capability to the UpdateAttributes processor.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-24 10:46:10 -04:00
Joe
e12da7c9a3
NIFI-985: Custom log prefix for LogAttribute processor
...
The LogAttribute processor evaluates the log prefix EL using the current flow file.
Log prefix helps to distinguish the log output of multiple LogAttribute processors and identify the right processor. Log prefix appears in the first and the last log line, followed by the original 50 dashes. If you configure log prefix 'STEP 1: ' the log output looks like this:
STEP 1 : --------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'lineageStartDate'
Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'fileSize'
Value: '9'
FlowFile Attribute Map Content
Key: 'customAttribute'
Value: 'custom value'
STEP 1 : --------------------------------------------------
flow file content...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-09-24 10:31:04 -04:00
Mark Payne
24c080788f
NIFI-604: Removed unused import, as it caused checkstyle violation
2015-09-24 10:06:39 -04:00
Mark Payne
193dbe6533
Merge branch 'NIFI-604' of https://github.com/rickysaltzer/nifi into NIFI-604
2015-09-23 16:03:46 -04:00
Mark Payne
26f80095b7
Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi
2015-09-23 15:31:19 -04:00
Mark Payne
f884086fc2
NIFI-713: Fixed checkstyle issue
2015-09-23 15:20:25 -04:00
Mark Payne
da56b49b88
Merge branch 'NIFI-713' of https://github.com/rickysaltzer/nifi into NIFI-713
2015-09-23 12:06:50 -04:00
Joe
ee7d89cb01
NIFI-988: Test cases for PutDistributedMapCache
2015-09-23 14:32:37 +02:00
Joe
6b1328f3f1
NIFI-988: PutDisributedMapCache processor implementation
2015-09-23 14:31:13 +02:00
Bryan Bende
8615941c89
NIFI-959 Fixing incorrect evaluation for getting the collection and adding a unit test to prevent regression
2015-09-22 15:38:53 -04:00
Bryan Bende
5764e89293
NIFI-975 Fixing NullPointerException when one of the delimiters is not provided when using the Text strategy
2015-09-22 13:19:15 -04:00
Joe
14eaeeb1ee
NIFI-984: Bad class used for logging in TestDetectDuplicate
...
Using TestListenUDP instead of TestDetectDuplicate when creating the logger.
This closes #89
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-09-22 08:51:58 -04:00
Matt Gilman
d75c7b54e8
NIFI-934:
...
- Added a content viewer for image files.
2015-09-18 18:17:12 -04:00
Bryan Bende
600f91a262
NIFI-932 Adding hasIncomingConnection() and hasConnection(Relationship) to ProcessContext and updating ExecuteSQL
2015-09-18 17:05:31 -04:00
Matt Gilman
1fd45958d3
NIFI-876:
...
- Merge branch 'release-nifi-0.3.0-rc1'
2015-09-18 08:48:48 -04:00
Matt Gilman
624bb5dd74
NIFI-876:
...
- Merge branch 'release-nifi-0.3.0-rc1'
2015-09-18 08:48:40 -04:00
Bryan Bende
b36841e213
NIFI-919 Adding SplitAvro processor that splits binary datafiles into smaller datafiles, or bare records.
...
- Adding documentation about bare record use, renaming Split Size to Output Size, and adding a test case with 0 records
- Removing validators on properties that have allowable values, using positive integer validator for Output Size, and fixing type on processor description
2015-09-16 10:11:30 -04:00
Bryan Bende
1007999415
NIFI-912 Initial version of ExtractAvroMetadata processor.
...
- Adding optional ability to extract record count
- Renaming record.count to item.count for clarity, and updating documentation
- Adding a test case with 0 records
- Removing validators from properties that use allowable values
2015-09-16 09:59:50 -04:00
Matt Gilman
ded74ec94c
NIFI-876 prepare for next development iteration
2015-09-14 21:48:11 -04:00
Matt Gilman
2ec735e350
NIFI-876 prepare release nifi-0.3.0-RC1
2015-09-14 21:48:00 -04:00
Mark Payne
3d4ce34529
NIFI-938: If ResourceClaim is removed while a process has access to its stream, don't delete the claim
2015-09-14 11:47:02 -04:00
Mark Payne
992e841027
NIFI-948: Provide capability to register notifications for nifi lifecycle events
2015-09-13 19:55:12 -04:00
Mark Payne
4a7d1fe618
NIFI-936: Ensure that if we fail to write a record to the repository that we do not write to that log file again
2015-09-11 14:55:48 -04:00
Mark Payne
3780159d01
NIFI-939: Fixed bug in equals and hashCode methods of StandardContentClaim; added unit test to TestStandardProcessSession in order to verify behavior of append() method
2015-09-11 12:50:39 -04:00
Yu ISHIKAWA
eb1d6b554c
Remove `REL_NOT_FOUND`
2015-09-11 18:05:20 +09:00
Joseph Percivall
a83ed34f91
Commit for NIFI-836 to fix broken javadoc @link elements
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-09-10 12:05:47 -04:00
Yu ISHIKAWA
f718b4bf46
Modify an error message
2015-09-07 23:34:22 +09:00
Yu ISHIKAWA
d32a32a92d
Remove the process to check if the target key exists or not
2015-09-07 23:32:48 +09:00
Matt Gilman
d1206fe074
NIFI-926:
...
- Ensuring that nodes are not disconnected when the user attempts to reset a counter that does not exist on that node. This can happen when/if counters are adjusted conditionally.
2015-09-07 08:41:47 -04:00
Bryan Bende
85534ca860
NIFI-916 Refactoring how the closed flag is used in PersistentProvenanceRepository to ensure proper shutdown
2015-09-06 13:22:07 -04:00
Yuu ISHIKAWA
c492a1aaae
Fix a type and modify an error message
2015-09-02 21:54:02 +09:00
Yu ISHIKAWA
0334f04640
Add a relation for "not found" and that is transfered if a target key doesn't exist on S3
2015-09-02 13:48:39 +09:00
Yu ISHIKAWA
213f507f53
Add @Override annotations
2015-09-02 13:02:39 +09:00
Yuu ISHIKAWA
6cbc6db860
Remove `getSupportedDynamicPropertyDescriptor`
2015-09-02 06:49:46 +09:00
Yuu ISHIKAWA
7e6834937b
Ignore the test suite
2015-09-01 22:36:50 +09:00
Yu ISHIKAWA
d1dbd37629
[NIFI-774] Create a DeleteS3Object Processor
2015-09-01 22:35:11 +09:00
Matt Gilman
cd2e1424cb
NIFI-911:
...
- Updating default value for Regex so it matches once (?s:^.*$) instead of twice (.*). Matching on .* results in matching for every character and then again for 0 characters.
2015-08-31 14:58:38 -04:00
ricky
c72fb201d5
NIFI-713: Infer Hadoop Compression Automatically
...
- Three main types of compression options:
NONE : no compression
AUTOMATIC : infers codec by extension
SPECIFIED : specified codec (e.g. snappy, gzip, bzip, or lz4)
2015-08-31 14:38:15 -04:00
Mark Payne
2bb7853001
Merge branch 'NIFI-905'
2015-08-31 11:14:17 -04:00
Mark Payne
f8c216b061
NIFI-903: Check for null value before trying to close 'out' OutputStream on StandardRecordWriter.close
2015-08-31 10:50:00 -04:00
Mark Payne
3159cec782
NIFI-905: Ensure that when archive threshold is hit, archived data is destroyed and if no archived data exists that Processors aren't blocked from updating content repo
2015-08-28 14:15:35 -04:00
Mark Payne
5de37f63d9
NIFI-902: Ensure that if we get an IOException during rollover of WAL, we are able to recover
2015-08-28 10:04:58 -04:00
Mark Payne
76b5b38cc4
Merge branch 'NIFI-893'
2015-08-27 17:34:27 -04:00
ricky
9cefc4a5a5
NIFI-604: Custom Argument Delimiters ExecuteStreamCommand / ExecuteProcess
...
- Unified the way ExecuteStreamCommand and ExecuteProcess handle arguments
- Argument delimiters can now be specified. Their default being what they were using before (; and space)
2015-08-27 15:26:56 -04:00
Mark Payne
fbec28bad9
NIFI-893: Ensure that if session.commit fails, previously 'checkpointed' sessions are rolled back
2015-08-27 15:17:55 -04:00
Bryan Bende
f34d73e73e
NIFI-895 ensuring the session factory is re-set in the onTrigger method in the case where the runner needed to be stopped
2015-08-26 11:21:08 -04:00
Bryan Bende
310347fd66
Merge branch 'NIFI-842'
2015-08-24 18:58:56 -04:00
ricky
7fb6e884a7
NIFI-866: Add Kerberos Support for Hadoop
...
- Add krb5.conf to nifi.properties
nifi.kerberos.krb5.file | path to krb5.conf
- Connections to secure Hadoop clusters will be determined by their config,
that is, hadoop.security.authentication should be set to kerberos.
- Added two optional arguments to AbstractHadoopProcessor (principal and keytab),
these are only required if the cluster you're connecting to is secured. Both of
these options require the krb5.conf to be present in nifi.properties.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-24 15:36:22 -04:00
Bryan Bende
3bfe830afc
NIFI-842 Updating org.apache.nifi.NiFi so it sends a started signal to bootstrap which can then be used to make retsart decisions
2015-08-24 12:00:21 -04:00
Alan Jackoway
c7f7704220
Changed line wrap length to 200 and combined adjacent imports into single try-with-resources blocks.
...
This closes #76
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-23 23:07:50 -04:00
Alan Jackoway
b30fbe1f3b
NIFI-888 EncryptContent for PGP Leaks File Handles.
...
Closes InputStreams created to read the public keys for PGP encryption and several other
streams involved in PGP encryptiong. This prevents NiFi from leaking file handles on
every validate call or encryption attempt in the EncryptContent processor.
2015-08-23 23:07:26 -04:00
Mark Payne
4d4f74cf05
NIFI-889: Return the failure relationshp in the set of allowed relationships
2015-08-22 20:47:45 -04:00
Mark Payne
671445f10a
Merge branch 'NIFI-844'
2015-08-21 17:15:39 -04:00
Mark Payne
e8248353df
Merge branch 'NIFI-882'
2015-08-21 17:13:43 -04:00
Mark Payne
a9c2bf58b8
NIFI-844: Initial import of the ConvertAvroToJSON processor
2015-08-21 17:11:56 -04:00
Mark Payne
d351f3ed1b
NIFI-882: When a ProcessGroup is removed from the graph, ensure that the removeXYZ method is called for each component in that Process Group so that resources are appropriately cleaned up
2015-08-21 15:55:04 -04:00
joewitt
1f6805f06d
NIFI-886 purging old events much more frequently
2015-08-21 15:40:26 -04:00
Mark Payne
1ddd736558
NIFI-854: Ensure that controller services are included in template if any processor (or other service) in the template references it, regardless of how many levels deep the component's ProcessGroup is
2015-08-21 14:46:20 -04:00
Mark Payne
82d32230e6
NIFI-881: Added support for Proxy Host and Proxy Port properties to InvokeHTTP
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-08-21 11:35:30 -04:00
Mark Payne
4f6c1cfff3
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-08-21 11:29:20 -04:00
Mark Payne
15a8699dc4
NIFI-744: Addressed feedback from review, mostly adding documentation to a few points in the code
2015-08-21 11:08:34 -04:00
Mark Payne
68d94cc01b
NIFI-744: Refactored ContentClaim into ContentClaim and ResourceClaim and allowed resource claim to be reused across sessions
2015-08-21 11:08:34 -04:00
Bryan Bende
d421e3c242
NIFI-846 MonitorActivity not setting start of evaluation period correctly
2015-08-21 11:06:20 -04:00
Joe Percivall
b17be66a10
Fixing contrib check and addressing comments
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:42 -04:00
Joe Percivall
dedff148ca
Making metadata extractor max tags property optional
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Joe Percivall
d992730fb7
NIFI-864 first contrib to nifi supports working with images and addressing comments
...
Committing modified files
Addressing code review comments
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-08-21 08:56:41 -04:00
Bryan Bende
706edeb01f
NIFI-855 Adding support for filtering on multiple locations
2015-08-19 20:57:57 -04:00
Chris Mangold
3cca046550
NIFI-855 Add location bounding bix filter to twitter processor.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-08-19 20:42:27 -04:00
Mark Payne
28549c2b1e
NIFI-853: Made updates to processors
2015-08-19 17:36:29 -04:00
Mark Payne
1a37c95f58
NIFI-293: Added processors ConvertFlatJSONToSQL, PutSQL
2015-08-19 17:36:29 -04:00
Mark Payne
16dc5d5fd9
NIFI-756: Do not remove documents from a Lucene Index; instead, wait until the entire index is 'expired' and delete the index's directory
2015-08-19 13:53:13 -04:00
Mark Payne
8ebf1f03c2
Merge branch 'nifi-868' of https://github.com/pukkaone/nifi into NIFI-868
2015-08-19 12:56:26 -04:00
Mark Payne
e345218eaa
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-08-19 12:27:41 -04:00
Mark Payne
19f7db6986
NIFI-793: Added multi-threading to the indexing in the Persistent Provenance Repository
2015-08-19 12:24:25 -04:00
Aldrin Piri
f044ba5d45
NIFI-808 Providing property to allow exclusion of capture group 0 for any regex expressions as an attribute.
2015-08-19 12:00:25 -04:00
Mark Payne
f171756a88
NIFI-862: Ensure that if we are unable to stop a controller service, we can still stop processors referencing it and the service itself
2015-08-19 10:12:57 -04:00
Mark Payne
e409b6c5c1
NIFI-839: When disabling controller services, do so one-at-a-time in the process scheduler, so that we can ensure that all are disable-able and then disable them atomically
2015-08-19 08:55:15 -04:00
Chin Huang
8f98f80938
NIFI-868 Configure advertised host name of Remote Process Group Input Port
...
Before this change, the host given out to clients to connect to a Remote
Process Group Input Port is the host where the NiFi instance runs.
However, sometimes the binding host is different from the host that
clients connect to. For example, when a NiFi instance runs inside a
Docker container, a client on a separate machine must connect to the
Docker host which forwards the connection to the container.
Add a configuration property to specify the host name to give out to
clients to connect to a Remote Process Group Input Port. If the property
is not configured, then give out the name of host running the NiFi
instance.
2015-08-18 21:35:28 -07:00
joewitt
8e5347156f
NIFI-841 fixed contrib check issues
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-08-18 20:06:42 -04:00
joewitt
c3731703f3
NIFI-841 correct patch paths and fixed formatting issues
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-08-18 20:06:42 -04:00
Mark Payne
35439db347
NIFI-841: Ensure that IOExceptions on session commit are handled properly
...
Signed-off-by: joewitt <joewitt@apache.org>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-08-18 20:06:41 -04:00
Bryan Bende
a264c49d80
Merge branch 'NIFI-790-NEW'
2015-08-17 17:33:26 -04:00
Bryan Bende
1c34478eb8
NIFI-790 Create reporting task to deliver metrics to Apache Ambari
...
- Adding NOTICE for nifi-ambari-nar, and fixing formatting issues in nifi-ambari-reporting-task pom
- Addressing review feedback: updating assembly NOTICE, fixing unit test, and minor clean up
- Adding additionalDetails.html
2015-08-17 15:47:49 -04:00
Matt Gilman
ffa7ceb2b1
NIFI-861:
...
- Addressing issue with blank processor names when attempting to generate ellipsis on the canvas.
2015-08-17 15:23:36 -04:00
Aldrin Piri
740b09b182
NIFI-796 Adjusting ControlRate documentation to reflect that a long is used instead of an integer.
2015-08-17 11:51:10 -04:00
joewitt
6066557e66
NIFI-827 added headless entry
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-08-17 09:16:34 -04:00
joewitt
a837fa5f38
NIFI-801 fixed reference to BSD and name of NOTICE
2015-08-16 22:42:28 -04:00
joewitt
cd74519133
NIFI-857 merged develop into master in preparation for the removal of develop branch
2015-08-16 15:56:46 -04:00
joewitt
aa99884782
NIFI-850 removed nifi parent, updated nifi pom, moved all nifi subdirs up one level, fixed readme.
2015-08-15 13:12:22 -04:00