nifi/nifi-commons
Koji Kawamura d9acdb54be NIFI-3415: Add Rollback on Failure.
- Added org.apache.nifi.processor.util.pattern package in nifi-processor-utils containing reusable functions to mix-in 'Rollback on Failure' capability.
- Created a process pattern classes, Put and PutGroup. It will be helpful to standardize Processor implementations.
- Applied Rollback on Failure to PutSQL, PutHiveQL, PutHiveStreaming and PutDatabaseRecord.
- Stop using AbstractProcessor for these processors, as it penalizes FlowFiles being processed when it rollback a process session. If FlowFiles are penalized, it will not be fetched again until penalization expires.
- Yield processor when a failure occurs and RollbackOnFailure is enabled. If we do not penalize nor yield, a failed FlowFile retries too frequently.
- When Rollback on Failure is enabled but processor is not transactional, discontinue when an error occurred after successful processes.
- Fixed existing issues on PutHiveStreaming:
  - Output FlowFile Avro format was corrupted by concatenating multiple Avro files.
  - Output FlowFile records had incorrect values because of reusing GenericRecord instance.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1658
2017-04-27 13:44:56 -04:00
..
nifi-data-provenance-utils NIFI-3356: Initial implementation of writeahead provenance repository 2017-02-22 12:40:06 -05:00
nifi-expression-language NIFI-3682: This closes #1682. Add Schema Access Strategy and Schema Write Strategy Record Readers and Writers; bug fixes. 2017-04-24 17:02:45 -04:00
nifi-flowfile-packager NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
nifi-hadoop-utils NIFI-3520 Updated nifi-hdfs-processors POM to depend directly on hadoop-client 2017-03-13 12:21:49 -04:00
nifi-hl7-query-language NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
nifi-logging-utils NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
nifi-processor-utilities NIFI-3415: Add Rollback on Failure. 2017-04-27 13:44:56 -04:00
nifi-properties NIFI-3380 Bumping NAR plugin to 1.2.0-SNAPSHOT development to leverage changes from master, adding buildnumber-maven-plugin to nifi-nar-bundles to properly set build info in MANIFEST of NARs 2017-03-24 11:06:44 -04:00
nifi-schema-utils NIFI-3356: Initial implementation of writeahead provenance repository 2017-02-22 12:40:06 -05:00
nifi-security-utils NIFI-3541: - Allowing the user to specify the network interface to send/receive data for a Remote Process Group. 2017-03-06 10:38:15 -05:00
nifi-site-to-site-client NIFI-1202: Site-to-Site batch settings. 2017-04-27 10:35:07 -04:00
nifi-socket-utils NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
nifi-utils NIFI-2876 refactored demarcators into a common abstract class 2017-02-24 10:06:53 -05:00
nifi-web-utils NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
nifi-write-ahead-log NIFI-3273 This closes #1611. Handle the case of trailing NUL bytes in MinimalLockingWriteAheadLog 2017-04-19 22:08:59 -07:00
pom.xml NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00