5 Commits

Author SHA1 Message Date
Mark Payne
6b4daa2ec2
NIFI-13801: Fixed counter for ConsumeKafka to correctly indicate number of messages received using using a demarcator
This closes #9311.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-24 21:31:14 -04:00
Mark Payne
1b525aef0c
NIFI-13791 Added Counters to PublishKafka and ConsumeKafka for Records per Topic (#9300)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 20:58:03 -05:00
Mark Payne
d04d38fc44
NIFI-13787 Fixed error and record handling in ConsumeKafka
Eliminated unnecessary connection pooling at the service layer so that a single Consumer is made available to the processor. This allows the processor to rollback offsets and provides a simpler API.

This closes #9298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 17:33:54 -05:00
Mark Payne
6ddae78b6f
NIFI-13784 Fixed Kafka Publishing Behavior creating multiple Producers (#9297)
Fixed error handling in several situations. Cleaned up leaky abstraction. Some code cleanup, fixed default values for time-based properties to use 'sec' instead of 's' to adhere to typical conventions.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-21 16:45:36 -05:00
Paul Grey
24925ed9b5
NIFI-11259 Added Redesigned Kafka Processors and Services
- Added ConsumeKafka and PublishKafka Processors with Kafka3ConnectionService
- Added Kafka 3 integration tests

This closes #8463

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 17:55:06 -05:00