joewitt
92f17a995b
NIFI-3100-rc2 prepare for next development iteration
2016-11-25 23:49:27 -05:00
joewitt
5536f690a8
NIFI-3100-rc2 prepare release nifi-1.1.0-RC2
2016-11-25 23:49:13 -05:00
joewitt
fb9cbccc38
NIFI-2954 This closes #1244 . Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils.
2016-11-21 16:30:42 -05:00
jpercivall
2614b83543
NIFI-3043 Fixing Kafka unit test failures
2016-11-15 16:31:10 -05:00
Andrew Lim
5f9cae97b7
NIFI-2883 Renamed directories holding ConsumeKafka_0_10 and PublishKafka_0_10 additional details
...
This closes #1170
2016-11-02 12:29:09 -04:00
Andrew Lim
979b4d8ab9
NIFI-2801 Edited Kafka processor documentation to explicitly state which Kafka versions supported by each processor
...
This closes #1119 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-12 10:35:45 -07:00
Mark Payne
b9cb6b1b47
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-06 15:51:16 -04:00
Bryan Bende
a4ed622152
Revert "NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged"
...
This reverts commit 92cca96d49
.
2016-10-06 15:19:00 -04:00
Mark Payne
92cca96d49
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged
...
This closes #1097 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-06 10:05:51 -04:00
Andre F de Miranda
3b408f5601
NIFI-2816 - Clean typos across the code - Part 2. This closes #1085
2016-10-05 13:07:57 -04:00
Andre F de Miranda
446cd44702
NIFI-2816 - Clean typos across the code
...
This closes #1057 .
2016-09-26 17:47:31 +02:00
vijayk
80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-07 12:06:01 -04:00
Mark Payne
8d6e12fdc4
NIFI-2739: Call KafkaConsumer.wakeup() if consumer is blocking for at least 30 seconds when OnUnscheduled is called
2016-09-07 08:56:23 -04:00
joewitt
7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call
...
This closes #987 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 15:48:40 -04:00
Joseph Percivall
1fe18a1567
NIFI-2676-rc1 prepare for next development iteration
2016-08-26 11:40:58 -04:00
Joseph Percivall
74d5224783
NIFI-2676-rc1 prepare release nifi-1.0.0-RC1
2016-08-26 11:40:44 -04:00
joewitt
405252244e
NIFI-2670 minor doc edit to remove kafka.key.hex reference
2016-08-25 22:17:07 -04:00
Mark Payne
58e0ce7f92
NIFI-2670: This closes #954 . Expose option for how to interpret Kafka Key - hexadeimal encoding or UTF-8 String
2016-08-25 21:39:40 -04:00
Oleg Zhurakousky
04db806ace
NIFI-2614 This closes #944 . added support for max.request.size
2016-08-25 13:51:08 -04:00
joewitt
1745c1274b
NIFI-2608 This closes #930 . restructured the ConsumeKafka processor to follow new consumer API. Made nar classloading more precise to support spawned threads NIFI-2660.
2016-08-25 10:09:50 -04:00
Bryan Bende
626e23e0ab
Adding ConsumerResource and ConsumerPool for ConsumeKafka
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-08-25 09:47:26 -04:00
Oleg Zhurakousky
18f4150015
NIFI-2515 This closes #814 . fixed Kafka serialization/deserialization settings
2016-08-09 14:28:51 -04:00
Oleg Zhurakousky
29f53c07f5
NIFI-2509 This closes #805 . fixed NPE condition in KafkaConsumer
2016-08-07 23:48:57 -04:00
Mark Payne
7ffa30d21b
NIFI-2423: Make use of the SSLContextService to provide SSL information
...
Signed-off-by: Oleg Zhurakousky <oleg@suitcase.io>
2016-08-05 14:14:38 -04:00
Oleg Zhurakousky
c39a127ec8
NIFI-2322, NIFI-2423, NIFI-2412 Kafka improvements
...
- Fixed KafkaConsumer's connection block when broker is not available
- Fixed Serializer/Deserializer configs in both Consume/Publish Kafka
- Added sensitive properties for SSL ket/trust stores
NIFI-2322 fixed tests
2016-08-05 14:14:38 -04:00
Oleg Zhurakousky
54549891e3
NIFI-2444 NIFI-2445 fixed PublishKafka
...
- fixed the logging issue NIFI-2444 by ensuring the ProcessLog is added to KafkaPublisher
- fixed KafkaPublisher's isAllAcked operation to ensure that it properly reports that the flow file has failed.
- added additional test
This closes #758 .
2016-08-02 20:30:34 -04:00
jpercivall
2a6580992b
NIFI-2455 Removing 'Queue Buffering Max Time' as a required property of PutKafka. This closes #765
2016-08-02 17:01:58 -04:00
Oleg Zhurakousky
0dbba811f3
NIFI-2298 This closes #687 added Kafka consume attributes to a FlowFile
2016-07-21 22:56:24 -04:00
Oleg Zhurakousky
7a901952b5
NIFI-2192: Fixed OOM issue in KafkaPublisher
...
This closes #618 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2016-07-08 15:33:49 -04:00
Aldrin Piri
1bd2cf0d09
NIFI-1811 Renaming MockProcessorLogger to MockComponentLogger for consistency. Removing unused imports from ExecuteScript causing checkstyle failures.
2016-05-19 14:38:41 -04:00
Pierre Villard
372ffb8aa0
NIFI-1811 Removed ProcessorLog and updated dependent interfaces
...
This closes #403 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-19 13:08:09 -04:00
Oleg Zhurakousky
2d03489ec5
NIFI-1296, NIFI-1680, NIFI-1764, NIFI-1837, NIFI-1827, NIFI-1699 implemented new Kafka processors that leverage Kafka 0.9 API
...
- Improved StreamScanner for better performance
- Renamed StreamScanner to StreamDemarcator as suggested by Joe
- Added failure handling logic to ensure both processors can be reset to their initial state (as if they were just started)
- Provided comprehensive test suite to validate various aspects of both Publish and Consume from Kafka
- Added relevant javadocs
- Added initial additionalDetails docs
- Addressed NPE reported by NIFI-1764
- Life-cycle refactoring for the existing PutKafka to ensure producer restart after errors
- Incorporated code changes contributed by Ralph Perko (see NIFI-1837)
- Addressed partition issue in RoundRobinPartitioner discussed in NIFI-1827
- Updated PropertyDescriptor descriptions to reflect their purpose
NIFI-1296 added @Ignore on some Kafka tests to improve test time
NIFI-1296 reworked tests to avoid dependency on embedded Kafka
NIFI-1296 fixed spelling error
NIFI-1296 fixed trailing whitespaces in non-java files
This closes #366
2016-05-19 07:33:03 -04:00
Pierre Villard
3d6e664097
NIFI-1672 Improved the Provenance Events emitted by PutKafka
...
This closes #355
2016-04-20 10:33:03 -04:00
Oleg Zhurakousky
bd1f0a82ae
NIFI-1748 removed un-used test data
...
This closes #344 .
Signed-off-by: Joe Skora <jskora@apache.org>
2016-04-11 19:50:22 -04:00
Oleg Zhurakousky
95dda1d920
NIFI-1748 removed un-used test data
...
This closes #341 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-11 02:24:45 -04:00
Joe Skora
696a12e4e7
Revert "NIFI-1748 removed un-used test data"
...
This reverts commit 47cd9ff22c
.
2016-04-11 02:05:24 -04:00
Oleg Zhurakousky
47cd9ff22c
NIFI-1748 removed un-used test data
...
This closes #341 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-10 13:21:37 -04:00
ijokarumawak
9235a28f82
NIFI-1736 Move kafka.StreamScanner to nifi-utils. This closes #333
2016-04-07 07:37:28 -04:00
Aldrin Piri
0e9e9b36d9
NIFI-1728 Specifying charsets for messages sent to/received from Kafka in Kafka processor and related tests to remedy failures in Windows environments. Specifying EOF as an int instead of a byte.
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-05 09:38:39 -04:00
Matt Gilman
2de7f3f884
Updating versions to 1.0.0-SNAPSHOT.
2016-04-04 11:36:20 -04:00
Oleg Zhurakousky
25290cedc4
NIFI-1701 fixed StreamScanner, added more tests
...
NIFI-1701 additional refactoring, clean up and more tests
2016-04-04 09:55:16 -04:00
Oleg Zhurakousky
c3d54ab724
NIFI-1684 This closes #308 . fixed ZKClient connection leak
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:24 -04:00
Oleg Zhurakousky
9912f18de5
NIFI-1684 This closes #302 . fixed random partitioner initialization
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:08 -04:00
Oleg Zhurakousky
1292581ec8
NIFI-1684 added penalization on failure
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:04 -04:00
Oleg Zhurakousky
8d960f5243
NIFI-1684 fixed NPE in PutKafka when retrieving key attribute bytes
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:04 -04:00
Oleg Zhurakousky
e35c40b0fd
NIFI-1684 fixed NPE, added tests
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:04 -04:00
Aldrin Piri
e977729b56
NIFI-1634-rc2 prepare for next development iteration
2016-03-23 18:56:34 -04:00
Aldrin Piri
0b9bd20d31
NIFI-1634-rc2 prepare release nifi-0.6.0-RC2
2016-03-23 18:56:22 -04:00
Mark Payne
f7ecb47e29
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2016-03-23 11:24:28 -04:00
Oleg Zhurakousky
e0e00ff282
NIFI-1645 refactored PutKafka
...
- used newest API available in 0.8.* version
- added PutKafka integration tests
- Kafka module code coverage is at 85%
NIFI-1645 polishing
NIFI-1645 PR comments round 1
NIFI-1645 PR comments round 2
NIFI-1645 change to use async Kafka producer
NIFI-1645 polishing
NIFI-1645 polishing
NIFI-1645 polishing
NIFI-1645 changed from java.util.Scanner to custom StreamScanner
NIFI-1645 polishing
NIFI-1645 final polish
2016-03-23 10:31:34 -04:00