Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,026 Commits 143 Branches 197 Tags 400 MiB
Commit Graph

4026 Commits

Author SHA1 Message Date
Andy LoPresto 6d07ebf50c NIFI-3954 This closes #1841. Upgraded version of httpclient library to handle TLS issues. 
Added explicit dependency on httpcore for @ThreadSafe annotation.

Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-23 23:42:28 -04:00
Mark Payne 2c751a8e5b NIFI-3962: This closes #1846. Updated ConsumerLease to better handle batching of messages into a single FlowFile in the same way that it is handled for demarcated data 2017-05-23 23:20:13 -04:00
Matt Burgess fb925fc182 NIFI-3867: Fixed issue with getConnectionURL in HiveConnectionPool using Expression Language 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1847.
 2017-05-23 21:28:59 +02:00
James Wing 9238fdb493 NIFI-3903 Unit Tests for AWS Processors 
* Added non-integration unit tests for Lambda, S3, SNS, and SQS processors
* Moved non-integration tests out of integration test files
* Moved SQS integration tests to IT* files for clarification

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1814.
 2017-05-23 19:25:55 +02:00
Joe Skora 0a7d149656 NIFI-3932 Symbols in API comments cause problems with Swagger Codegen 
* Update ApiModelProperty descriptions to avoid problematic characters.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1821.
 2017-05-23 19:04:54 +02:00
Matt Gilman 3ec0aa947f NIFI-3955: 
- Filtering out the EventTime searchable field for all implementation of ProvenanceRepository. Prefer user query using the startDate/endDate fields.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1844.
 2017-05-23 18:48:29 +02:00
James Wing b64232117f NIFI-3707 Sort Attributes in FlowFile Details UI 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1843.
 2017-05-23 18:06:18 +02:00
Andrew Lim 49270f8a8c NIFI-3944 Update docs and screenshots for Component Versioning 
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1840
 2017-05-23 11:06:59 -04:00
Bryan Bende a8de27e69b NIFI-3732 Adding connect with timeout to StandardCommsSession and SSLCommsSession to avoid blocking 
This closes #1842.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-05-23 15:43:27 +09:00
Matt Gilman ded396f0ef NIFI-3933: 
- When monitoring heartbeats use the connected nodes as the basis for the check. This addresses the case when a node is terminated and no corresponding heartbeats exist.

This closes #1838.
 2017-05-22 16:51:13 -04:00
Matt Gilman d33c4c72d4 NIFI-3933: 
- When monitoring heartbeats use the connected nodes as the basis for the check. This addresses the case when a node is terminated and no corresponding heartbeats exist.
 2017-05-22 16:50:30 -04:00
Mark Payne a1b07b1e9c
NIFI-3949: Updated Grok Reader to allow for sub-patterns to be used when determining the schema 
This closes #1839.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-22 16:30:47 -04:00
Mark Payne 6937a6cf64 NIFI-3953: This closes #1837. Allow multiple schemas on same kafka topic/partition for ConsumeKafkaRecord_0_10 
Also, updated record writers to ensure that they write the schema as appropriate if not using a RecordSet. Updated ConsumeKafkaRecord to allow for multiple schemas to be on same topic and partition

Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-22 14:37:53 -04:00
Mark Payne 6d16fdf170
NIFI-3952: Updated UpdateRecord to pass field-related variables to the Expression Language 
This closes #1836.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-22 14:32:45 -04:00
Mark Payne 1a3c525dd6
NIFI-3951: Fixed bug that calculated the index incorrectly when filtering for ArrayIndexPath 
This closes #1835.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-22 12:39:32 -04:00
Mark Payne 7f8987471d
NIFI-3946: Update LookupService to take a Map instead of a String for the input 
NIFI-3946: Fixed issues where null values were returned instead of empty optionals

This closes #1833.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-22 11:52:41 -04:00
Bryan Bende 71cd497fef NIFI-3942 Added retry logic if a lookup fails due to InvalidDatabaseException which occurs if the underlying file was modified before we could refresh the reader 
This closes #1831.
 2017-05-22 09:12:51 -04:00
Bryan Bende f35e0ecdd0 NIFI-3942 Making IPLookupService reload the database file on the fly when detecting the file has changed 2017-05-22 09:06:42 -04:00
Mark Payne c49933f03d NIFI-3948: This closes #1834. Added flush() method to RecordWriter and call it when writing a single record to OutputStream for PublishKafkaRecord. Also removed no-longer-used class WriteAvroResult 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-19 23:05:04 -04:00
Tim Reardon 58ce52d5d6 NIFI-3854 This closes #1773. Expand expression language support for Kafka processors 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-19 15:51:23 -04:00
Matt Burgess 9294a26139
NIFI-3938: Added ScriptedLookupService, some refactor for reusable scripting classes 
This closes #1828.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-05-19 11:20:38 -07:00
Bryan Bende d4f0c1d048 NIFI-3945 This closes #1829. Adding documentaion about security protocols to Kafka 0.10 processors 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-19 13:59:27 -04:00
Mark Payne ae9953db64 NIFI-3857: This closes #1825. Added PartitionRecord processor 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-19 02:08:52 -04:00
Mark Payne 9bd0246a96 NIFI-3863: Initial implementation of Lookup Services. Implemented LookupRecord processors. This required some refactoring of RecordSetWriter interface, so refactored that interface and all implementations and references of it 2017-05-19 01:02:41 -04:00
joewitt 3b98abbf41
NIFI-3940 upgraded to latest jruby which resolves an apparent lgpl bunding issue 
This closes #1827.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-05-18 21:37:25 -07:00
Andrew Lim 28eadaa683
NIFI-3911 Improve Controller Services and Reporting Task Documentation 
This closes #1826.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-05-18 19:20:39 -07:00
joewitt 762293c01c NIFI-3935 made the old persistent prov test more forgiving of timing issues and extended lucene test timeouts for slower environments. These should be integration tests really. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1823
 2017-05-18 14:42:46 -04:00
joewitt be67f3552b
NIFI-3853 fixing tests to properly encapsulate their environments 
This closes #1822.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-18 13:36:02 -04:00
Koji Kawamura 36e7bd6164 NIFI-3894: This closes #1820. Fixed close and consume order with compression. 
Before this fix, 'NullPointerException: Inflater has been closed' can be thrown as the Inflater is closed before input stream is consumed.

Also, calling close from AbstractTransaction.receive is removed, because the DataPacket is exposed as its return value and this class will not be able to know when to close the stream.

Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-17 22:57:33 -04:00
Jeff Storck 8e1c79eaaf
NIFI-1963 Allows a node reconnecting to the cluster to inherit non-fingerprinted processor settings 
Forces a node reconnecting to a cluster to serialize the updated flow to disk
Added most processor settings to the flow fingerprint (excluding name, style, comment, position, and schedule state)
Updated some test data for FingerprintFactoryTest to test for new fields added to the flow fingerprint
Updated StandardProcessorNode to allow processor comments and name to be settable while a processor is running
Updated StandardFlowSynchronizer to inherit non-fingerprinted processor settings (name, style, comment, and position) when flow is already synchronized
This closes #1812
 2017-05-17 17:35:33 -04:00
Andre F de Miranda 289dde098e
NIFI-3896 - Makes DeprecationNotice more intuitive. This closes #1799 
Update developers guide on how to deprecate a component
 2017-05-17 16:37:11 -04:00
Mark Payne 5cf4bf61b3
NIFI-3917: Use a default value of 'false' for CSV Reader's Skip Header Line property. This closes #1819 2017-05-17 13:31:53 -04:00
Koji Kawamura 3fd7d3b272 NIFI-3873: Improve Avro logical types readability 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1788
 2017-05-17 13:08:00 -04:00
Scott Aslan 2dde480029
[NIFI-3906] Introduce additional validation when handling user-supplied input to ensure appropriate values and output encoding within SlickGrid tables. This closes #1818 2017-05-17 13:04:31 -04:00
Mark Payne 9198bee038
NIFI-3923: Only start processors after repositories have been initialized. This closes #1817 2017-05-17 11:12:59 -04:00
Koji Kawamura 40a9cd4f2e NIFI-3919: Let AvroTypeUtil try every possible type 
Before this fix, AvroTypeUtil can throw an Exception before trying every possible data types defined within a union field.

This closes #1816.
 2017-05-17 10:53:27 -04:00
Koji Kawamura f019d509f3 NIFI-3918: Added Choice mapping to JsonTreeRowRecordReader. 2017-05-17 09:49:11 -04:00
Koji Kawamura 33dc3e36fb NIFI-3920: Remove unnecessary code from AvroTypeUtil 
- Removed remaining duplicate lines of code left by NIFI-3861 refactoring.
- Added test case that writes Avro record having union field.

This closes #1813.
 2017-05-17 09:45:21 -04:00
Matt Gilman c50d516076 NIFI-3848: 
- Allowing the revision check to be overridden when the state of a nodes connection to the cluster changes.

This closes #1811
 2017-05-16 17:09:48 -04:00
Matt Gilman 6b71b4cbb8 NIFI-3868: - Ensuring we do not attempt to group bulletins that lack permissions. - Only group bulletins when all nodes report the same message. - Retain the most recent bulletin. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1801
 2017-05-16 16:54:30 -04:00
Mark Payne ce1bc42ac5 NIFI-3912: This closes #1809. Fixed NPE that would result in validation failure for FreeFormTextRecordSetWriter 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-16 16:17:04 -04:00
Mark Payne 2f3ba57dd6
NIFI-3914: Do not validate that remote group ports can start transmitting if there is no connection 
This closes #1810.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2017-05-16 16:10:00 -04:00
Bryan Bende 3a0004a665
NIFI-3904 Adding logic to only reload when incoming bundle is different and to use additional URLs from spec component 
NIFI-3908 Changing UI to submit filterType for CSs and filter for processors and reporting tasks
 2017-05-16 16:08:28 -04:00
Mark Payne 494a0e8928
NIFI-3900: Ensure that when we serialize a flow to send to Cluster Coordinator that we include the Scheduled State for processors as they are intended to be, not as they are currently because during startup they may not have been started yet. 
NIFI-3900: Rebased against master and updated new unit test to use new method signature for FlowSerializer.serialize

This closes #1804.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-05-16 16:04:09 -04:00
Matt Gilman ac8e57259f
NIFI-3907 Added response headers. 
Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-05-16 11:55:36 -07:00
Mark Payne fb94990e60 NIFI-3909: This closes #1806. If we have a FlowFile with 0 records, ensure that PublishKafkaRecord_0_10 handles the flowfile properly 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-16 14:42:42 -04:00
Scott Aslan f5f6cab646
NIFI-3906 Added formatting to tables. 
Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2017-05-16 11:17:29 -07:00
Koji Kawamura 77a676bf92 NIFI-3894: Call Inflater/Deflater.end to free up memory 
This closes #1796.
 2017-05-16 13:49:31 -04:00
Mark Payne 4fdea680ec NIFI-3905: This closes #1805. When a Provenance Query is submitted to WriteAheadProvenanceRepository, purge any obsolete queries from the internal state before rejecting the query due to 'too many outstanding queries' 
Signed-off-by: joewitt <joewitt@apache.org>
 2017-05-16 13:48:16 -04:00
Aldrin Piri 58cf15a912 NIFI-2199 NIFI-3112 Pipe stdout to /dev/null and allow stderr to propagate through. 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1786
 2017-05-16 13:31:15 -04:00