Commit Graph

265 Commits

Author SHA1 Message Date
Paul Grey 5cad5838c5
NIFI-11840 Add Kafka Partition and Topic Attributes before handoff to RecordReader
This closes #7510

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:40:22 -05:00
mr1716 7c7b7c026b
NIFI-11710 Corrected nifi-kafka-2-6-nar Description
This closes #7390

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:39:46 -05:00
Matthew Burgess df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
2023-05-24 10:43:30 +02:00
Nandor Soma Abonyi ed1cee4520
NIFI-11202 Removed deprecated Kerberos properties from Kafka 2_6
This closes #6978

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-09 16:04:58 -06:00
Nandor Soma Abonyi a8cd33a243
NIFI-11248 Removed Kafka 2_0 Components
This closes #7010

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-06 09:35:31 -06:00
Pierre Villard 46f89e3226
NIFI-11182 Removed Kafka 1.x components
This closes #6955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 18:38:42 -06:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
Paul Grey b426226207
NIFI-10993 - PublishKafkaRecord should use correct record schema
This closes #6833.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 21:40:29 +01:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Nandor Soma Abonyi eb5d172693
NIFI-10991 Add AWS MSK IAM support to Kafka processors
This closes #6846.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 12:33:49 +01:00
exceptionfactory c3b0e1a790
NIFI-10919 Corrected SCRAM SASL Mechanism for Kafka Components
This closes #6743
Signed-off-by: Paul Grey <greyp@apache.org>
2022-12-01 11:29:29 -05:00
greyp9 282c56b5ce
NIFI-10901 - PublishKafka headers not sent in ProducerRecord (#6731) 2022-11-30 13:23:23 -05:00
Joe Witt 198a27abbe
NIFI-10854 adjusting post merge for next release cycle 2022-11-28 08:49:35 -07:00
Joe Witt 1046b2c308
Merge branch 'NIFI-10854-RC1' 2022-11-28 08:43:56 -07:00
exceptionfactory 9cc9692c98
NIFI-10866 Refactored Kafka 1.0 and 2.0 using nifi-kafka-shared
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6710.
2022-11-23 05:04:34 -05:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
exceptionfactory 8e417c890a
NIFI-10819 Restricted JndiLoginModule for Kafka JAAS Config
- Refactored property configuration and validation to nifi-kafka-shared

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6690.
2022-11-22 16:51:23 -05:00
greyp9 30facedc43
NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key (#6131)
* NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key
* publisher wrapper record; property naming and display order; doc updates
2022-11-16 16:07:43 -05:00
Matt Gilman e638bcee2f
NIFI-10617:
- Adding dynamic property annotation on a number of extensions that were missing it.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6501
2022-10-10 10:32:50 -04:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Daniel Urban 387ae7d323
NIFI-10199: PublishKafka InFlightMessageTracker should not log batch level errors on each record
Currently, when a batch level error occurs (e.g. delivery timeout), the same error is logged for each record of the batch, needlessly flooding the logs.
InFlightMessageTracker now only logs an exception when a flow file encounters it for the first time.

This closes #6185
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-05 14:12:43 -04:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
exceptionfactory 0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
Ravinarayan Singh 28c7583bdb
fixed error message reporting (#5979) 2022-04-21 09:12:02 -04:00
Nandor Soma Abonyi 9774bb90ca
NIFI-9917 fix the tooltip of "delivery guarantee/best effort" to a more accurate one
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5963.
2022-04-20 16:25:42 +02:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Mark Payne e6229ab938
NIFI-9771: When a Kafka record is obtained during config verification, we should produce an invalid response if the Record Reader is not able to produce any records from it
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5847.
2022-03-08 06:42:27 -05:00
Mike Thomsen 51cf0fb0d1
NIFI-9133 Refactored nifi-media-bundle to use JUnit 5
- NIFI-9130 Refactored nifi-language-translation-bundle to use JUnit 5
- NIFI-9126 Refactored nifi-kafka-bundle to use JUnit 5
- NIFI-9125 Refactored nifi-jolt-record-bundle to use JUnit 5

This closes #5792

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-02-23 21:18:25 -06:00
exceptionfactory 9075fc2cd8
NIFI-9611 Removed unnecessary references to nifi-processor-utils
- Replaced nifi-processor-utils with nifi-utils where necessary
- Added direct dependencies on commons-lang3 where necessary

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5693.
2022-01-26 11:52:08 -05:00
Joe Witt 48c8193c4c
NIFI-9595 Removed nifi-kafka-0.x modules
This closes #5680

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-19 11:18:36 -06:00
Joe Witt 2f95eed8cb
NIFI-9575 This closes #5667. updating copyright year to 2022
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 09:14:09 -07:00
Pierre Villard 8638b7c0d8
NIFI-9466 - PublishKafka 2.x - change default delivery guarantee from best effort to replicated
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5586
2021-12-16 15:10:32 -05:00
Pierre Villard 03cf976c07
NIFI-9467 - Update description for DefaultPartitioner in PublishKafka 2.6 to mention sticky partitioning
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5587
2021-12-16 15:07:55 -05:00
Pierre Villard 7dc0f847bd
NIFI-9468 - Bump Kafka client from 2.6.0 to 2.6.3
This closes #5588

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 06:59:43 -06:00
Joe Witt c055895952
NIFI-9344-RC3 prepare for next development iteration 2021-11-03 08:53:37 -07:00
Joe Witt 7fdc07cccd
NIFI-9344-RC3 prepare release nifi-1.15.0-RC3 2021-11-03 08:53:32 -07:00
exceptionfactory 60d6d469bf
NIFI-9342 Upgraded to Netty 3.10.6 and 4.1.69
- Replaced Netty 3.6.9 and 3.7.1 with 3.10.6
- Replaced Netty 4.1 with 4.1.69

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5490.
2021-10-28 09:34:31 +02:00
markap14 90ae271692
NIFI-9310: Addressed issues found while testing the component verification features. Added a supportsVerification flag to the ConfigAnalysis DTO (#5469)
This closes #5469
2021-10-20 11:07:17 -04:00
Bryan Bende 4bcfc61563
NIFI-9011 Correct tags in publish Kafka 2.6 processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5464.
2021-10-19 16:48:15 +02:00
exceptionfactory 9d578e63fd
NIFI-9285 Upgraded ZooKeeper transitive dependencies to 3.4.14
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5443.
2021-10-07 05:32:39 -04:00
exceptionfactory 4bcd03024a
NIFI-9283 Excluded Log4j 1.2 and upgraded Log4j2 to 2.14.1
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5440.
2021-10-06 11:17:36 -04:00
Mark Payne 607480c1a0
NIFI-9239: Updated Consume/Publish Kafka processors to support Exactly Once Semantics. Added ExecuteStateless processor/bundle
- A few minor updates to Stateless in order to surface some concepts from the stateless engine up to the caller, such as bulletins, counters, etc.

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5412.
2021-10-04 15:32:21 -04:00
Mark Payne baf29e59f1
NIFI-9009: Created VerifiableProcessor, VerifiableControllerService, VerifiableReportingTask components; implemented backend work to call the methods. Added REST APIs and created/updated data models for component configuration verification
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5288
2021-09-22 19:00:23 -04:00
exceptionfactory f5a421ccb1
NIFI-9067 Upgraded JAXB Runtime from 2.3.0 to 2.3.5
- Replaced old com.sun.xml.bind:jaxb-impl and jaxb-core with current org.glassfish.jaxb:jaxb-runtime
- Replaced old javax.xml.bind:jaxb-api with current jakarta.xml.bind-api
- Removed unnecessary dependency references to javax.activation-api

This closes #5320

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-07 13:27:53 -04:00
Bryan Bende 21c2fb95d3
NIFI-8973 Implement KerberosUserService API and keytab, password, and ticket cache implementations
NIFI-8974 Integrate KerberosUserService with HDFS processors

NIFI-8980 Integrate KerberosUserService with Kafka 2.6 processors
- Introduced SelfContainerKerberosUserService to restrict which impls can be used with Kafka
- Add variations of KerberosUser doAs that allow setting the context ClassLoader
- Add additional unit tests for configurations

This closes #5277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-18 19:54:56 -05:00