Bryan Bende
ae3db82303
NIFI-3644 Fixing the result handler in HBase_1_1_2_ClientMapCacheService to use the offsets for the value bytes
...
This closes #1645 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:28 -04:00
baolsen
152f002abf
Completed initial development of HBase_1_1_2_ClientMapCacheService.java which is compatible with DetectDuplicate (and other processors)
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:23 -04:00
Mike Moser
232380dbfd
NIFI-1452 on timer-driven yield, use the greater of yield duration or run schedule
...
This closes #1832 .
2017-05-24 14:24:29 -04:00
Mark Payne
b12cf8a6d2
NIFI-3671: This closes #1852 . Ensure that we use the existing ResourceClaim (if it exists) when swapping data in, instead of creating a new one. Otherwise, if the ResourceClaim is still writable, then we may archive the data and then write to it, which can cause a NullPointerException in FileSystemRepository
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-24 14:21:18 -04:00
Pierre Villard
fb7d6d1150
NIFI-3799 Add Input Requirement Info to Docs
...
Added input requirement info for processor documentation
This closes #1756 .
Signed-off-by: James Wing <jvwing@gmail.com>
2017-05-24 10:45:45 -07:00
Mark Payne
08b66b5b6a
NIFI-3969: Prevent merging flowfiles prematurely when all bins fill but some are already full and can be processed
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1850 .
2017-05-24 19:36:18 +02:00
Pierre Villard
bb96b0f464
NIFI-3816 - Added correct mime.type to S2S bulletin and provenance reporting tasks
...
This closes #1758 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-25 00:33:50 +09:00
Scott Aslan
7a46238baf
[NIFI-3943] align combo option item toolips to hover closer to the icon. This closes #1849
2017-05-24 11:14:48 -04:00
Pierre Villard
ba49b8427c
NIFI-3191 - HDFS Processors Should Allow Choosing LZO Compression
...
This closes #1802 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 11:04:00 -04:00
Pierre Villard
d63fa8a822
NIFI-3878 This closes #1790 . AmbariReportingTask - Default run schedule set to 1 minute
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-24 00:09:17 -04:00
Andy LoPresto
6d07ebf50c
NIFI-3954 This closes #1841 . Upgraded version of httpclient library to handle TLS issues.
...
Added explicit dependency on httpcore for @ThreadSafe annotation.
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-23 23:42:28 -04:00
Mark Payne
2c751a8e5b
NIFI-3962: This closes #1846 . Updated ConsumerLease to better handle batching of messages into a single FlowFile in the same way that it is handled for demarcated data
2017-05-23 23:20:13 -04:00
Matt Burgess
fb925fc182
NIFI-3867: Fixed issue with getConnectionURL in HiveConnectionPool using Expression Language
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1847 .
2017-05-23 21:28:59 +02:00
James Wing
9238fdb493
NIFI-3903 Unit Tests for AWS Processors
...
* Added non-integration unit tests for Lambda, S3, SNS, and SQS processors
* Moved non-integration tests out of integration test files
* Moved SQS integration tests to IT* files for clarification
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1814 .
2017-05-23 19:25:55 +02:00
Joe Skora
0a7d149656
NIFI-3932 Symbols in API comments cause problems with Swagger Codegen
...
* Update ApiModelProperty descriptions to avoid problematic characters.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1821 .
2017-05-23 19:04:54 +02:00
Matt Gilman
3ec0aa947f
NIFI-3955:
...
- Filtering out the EventTime searchable field for all implementation of ProvenanceRepository. Prefer user query using the startDate/endDate fields.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1844 .
2017-05-23 18:48:29 +02:00
James Wing
b64232117f
NIFI-3707 Sort Attributes in FlowFile Details UI
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #1843 .
2017-05-23 18:06:18 +02:00
Andrew Lim
49270f8a8c
NIFI-3944 Update docs and screenshots for Component Versioning
...
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
This closes #1840
2017-05-23 11:06:59 -04:00
Bryan Bende
a8de27e69b
NIFI-3732 Adding connect with timeout to StandardCommsSession and SSLCommsSession to avoid blocking
...
This closes #1842 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-23 15:43:27 +09:00
Matt Gilman
ded396f0ef
NIFI-3933:
...
- When monitoring heartbeats use the connected nodes as the basis for the check. This addresses the case when a node is terminated and no corresponding heartbeats exist.
This closes #1838 .
2017-05-22 16:51:13 -04:00
Matt Gilman
d33c4c72d4
NIFI-3933:
...
- When monitoring heartbeats use the connected nodes as the basis for the check. This addresses the case when a node is terminated and no corresponding heartbeats exist.
2017-05-22 16:50:30 -04:00
Mark Payne
a1b07b1e9c
NIFI-3949: Updated Grok Reader to allow for sub-patterns to be used when determining the schema
...
This closes #1839 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 16:30:47 -04:00
Mark Payne
6937a6cf64
NIFI-3953: This closes #1837 . Allow multiple schemas on same kafka topic/partition for ConsumeKafkaRecord_0_10
...
Also, updated record writers to ensure that they write the schema as appropriate if not using a RecordSet. Updated ConsumeKafkaRecord to allow for multiple schemas to be on same topic and partition
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-22 14:37:53 -04:00
Mark Payne
6d16fdf170
NIFI-3952: Updated UpdateRecord to pass field-related variables to the Expression Language
...
This closes #1836 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 14:32:45 -04:00
Mark Payne
1a3c525dd6
NIFI-3951: Fixed bug that calculated the index incorrectly when filtering for ArrayIndexPath
...
This closes #1835 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 12:39:32 -04:00
Mark Payne
7f8987471d
NIFI-3946: Update LookupService to take a Map instead of a String for the input
...
NIFI-3946: Fixed issues where null values were returned instead of empty optionals
This closes #1833 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 11:52:41 -04:00
Bryan Bende
71cd497fef
NIFI-3942 Added retry logic if a lookup fails due to InvalidDatabaseException which occurs if the underlying file was modified before we could refresh the reader
...
This closes #1831 .
2017-05-22 09:12:51 -04:00
Bryan Bende
f35e0ecdd0
NIFI-3942 Making IPLookupService reload the database file on the fly when detecting the file has changed
2017-05-22 09:06:42 -04:00
Mark Payne
c49933f03d
NIFI-3948: This closes #1834 . Added flush() method to RecordWriter and call it when writing a single record to OutputStream for PublishKafkaRecord. Also removed no-longer-used class WriteAvroResult
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 23:05:04 -04:00
Tim Reardon
58ce52d5d6
NIFI-3854 This closes #1773 . Expand expression language support for Kafka processors
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 15:51:23 -04:00
Matt Burgess
9294a26139
NIFI-3938: Added ScriptedLookupService, some refactor for reusable scripting classes
...
This closes #1828 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-05-19 11:20:38 -07:00
Bryan Bende
d4f0c1d048
NIFI-3945 This closes #1829 . Adding documentaion about security protocols to Kafka 0.10 processors
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 13:59:27 -04:00
Mark Payne
ae9953db64
NIFI-3857: This closes #1825 . Added PartitionRecord processor
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 02:08:52 -04:00
Mark Payne
9bd0246a96
NIFI-3863: Initial implementation of Lookup Services. Implemented LookupRecord processors. This required some refactoring of RecordSetWriter interface, so refactored that interface and all implementations and references of it
2017-05-19 01:02:41 -04:00
joewitt
3b98abbf41
NIFI-3940 upgraded to latest jruby which resolves an apparent lgpl bunding issue
...
This closes #1827 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-05-18 21:37:25 -07:00
Andrew Lim
28eadaa683
NIFI-3911 Improve Controller Services and Reporting Task Documentation
...
This closes #1826 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-05-18 19:20:39 -07:00
joewitt
762293c01c
NIFI-3935 made the old persistent prov test more forgiving of timing issues and extended lucene test timeouts for slower environments. These should be integration tests really.
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1823
2017-05-18 14:42:46 -04:00
joewitt
be67f3552b
NIFI-3853 fixing tests to properly encapsulate their environments
...
This closes #1822 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-18 13:36:02 -04:00
Koji Kawamura
36e7bd6164
NIFI-3894: This closes #1820 . Fixed close and consume order with compression.
...
Before this fix, 'NullPointerException: Inflater has been closed' can be thrown as the Inflater is closed before input stream is consumed.
Also, calling close from AbstractTransaction.receive is removed, because the DataPacket is exposed as its return value and this class will not be able to know when to close the stream.
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-17 22:57:33 -04:00
Jeff Storck
8e1c79eaaf
NIFI-1963 Allows a node reconnecting to the cluster to inherit non-fingerprinted processor settings
...
Forces a node reconnecting to a cluster to serialize the updated flow to disk
Added most processor settings to the flow fingerprint (excluding name, style, comment, position, and schedule state)
Updated some test data for FingerprintFactoryTest to test for new fields added to the flow fingerprint
Updated StandardProcessorNode to allow processor comments and name to be settable while a processor is running
Updated StandardFlowSynchronizer to inherit non-fingerprinted processor settings (name, style, comment, and position) when flow is already synchronized
This closes #1812
2017-05-17 17:35:33 -04:00
Andre F de Miranda
289dde098e
NIFI-3896 - Makes DeprecationNotice more intuitive. This closes #1799
...
Update developers guide on how to deprecate a component
2017-05-17 16:37:11 -04:00
Mark Payne
5cf4bf61b3
NIFI-3917: Use a default value of 'false' for CSV Reader's Skip Header Line property. This closes #1819
2017-05-17 13:31:53 -04:00
Koji Kawamura
3fd7d3b272
NIFI-3873: Improve Avro logical types readability
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1788
2017-05-17 13:08:00 -04:00
Scott Aslan
2dde480029
[NIFI-3906] Introduce additional validation when handling user-supplied input to ensure appropriate values and output encoding within SlickGrid tables. This closes #1818
2017-05-17 13:04:31 -04:00
Mark Payne
9198bee038
NIFI-3923: Only start processors after repositories have been initialized. This closes #1817
2017-05-17 11:12:59 -04:00
Koji Kawamura
40a9cd4f2e
NIFI-3919: Let AvroTypeUtil try every possible type
...
Before this fix, AvroTypeUtil can throw an Exception before trying every possible data types defined within a union field.
This closes #1816 .
2017-05-17 10:53:27 -04:00
Koji Kawamura
f019d509f3
NIFI-3918: Added Choice mapping to JsonTreeRowRecordReader.
2017-05-17 09:49:11 -04:00
Koji Kawamura
33dc3e36fb
NIFI-3920: Remove unnecessary code from AvroTypeUtil
...
- Removed remaining duplicate lines of code left by NIFI-3861 refactoring.
- Added test case that writes Avro record having union field.
This closes #1813 .
2017-05-17 09:45:21 -04:00
Matt Gilman
c50d516076
NIFI-3848:
...
- Allowing the revision check to be overridden when the state of a nodes connection to the cluster changes.
This closes #1811
2017-05-16 17:09:48 -04:00
Matt Gilman
6b71b4cbb8
NIFI-3868: - Ensuring we do not attempt to group bulletins that lack permissions. - Only group bulletins when all nodes report the same message. - Retain the most recent bulletin.
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1801
2017-05-16 16:54:30 -04:00