8572852bdf
NIFI-6184: This closes #3413 . Removed unnecessary test-jar dep from nifi-livy-processors causing race condition, added assertion to catch failures
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2019-04-08 14:52:40 -04:00
1c588f10b2
NIFI-5979 Add Line-by-Line Evaluation Mode to ReplaceText
...
Refactored to use functions to better handle strategy specific variables
via closure.
2019-04-08 16:19:48 +09:00
d222f14a9e
NIFI-5979 : enhanced ReplaceText processor with "Number of Occurrences" and "Occurrence offset" configurations
...
Fixed indentation errors to pass checkstyle-checks
Added Evaluation Modes as per discussion in PR thread
Adding exclusions of test files on rat plugin
Added new property 'Line-by-Line Evaluation Mode' and refactored common code
This closes #3375 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-04-08 16:19:27 +09:00
25cb29e109
NIFI-6177 Refactor HBaseListLookupService tests to remove use of TestRecordLookupProcessor
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3400 .
2019-04-06 14:31:50 +02:00
75217b33d0
NIFI-6181 FetchSFTP and FetchFTP File Not Found fix
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3407 .
2019-04-06 14:27:39 +02:00
96279415a7
NIFI-6188 - Added 1s delay on Search control autocomplete query event to prevent premature results retrieval
...
This closes #3408 .
Signed-off-by: Brandon Devries <devriesb@apache.org>
2019-04-05 12:32:40 -04:00
4810f6d32e
NIFI-6172 Fixed a bug that caused ElasticSearchStringLookupService to always return a value even when it should return Optional.empty().
...
NIFI-6172 Fixed broken integration test.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3399
2019-04-05 11:12:30 -04:00
d372318d47
NIFI-6191 HBase 2 ClientService documentation refers to HBase 1.x
...
This closes #3409 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-04-05 14:55:58 +09:00
e374d2cc30
NIFI-6140 - Incorrect title on the read only version of the Reporting Task detail dialog
...
This closes #3385
2019-04-04 13:40:14 -04:00
d36fa6a210
NIFI-6016 PutCassandraRecord batch size
...
Adds resetting the batch size to fix broken batch processing
Removes empty line
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3337
2019-04-04 11:26:08 -04:00
c93ee5ad59
NIFI-6186 Resolve handling of module paths in JythonScriptEngineConfigurator
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3406
2019-04-04 11:13:18 -04:00
cb4fdc2ae1
NIFI-6126 - throttle requests to refresh the canvas to prevent too many server requests when holding down CTRL-R
...
* Added lodash utility library to leverage its throttle capability (and many other useful functions in the future).
* Made lodash available in all JSP's so it could be imported into nf-common (or any component for that matter).
* Added a throttle function to nf-common that just wraps _.throttle
This closes #3393
2019-04-04 09:51:41 -04:00
1b196ea213
NIFI-5338: Added SimpleScriptedLookupService controller service
...
This closes #3397
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-04-04 08:41:34 -04:00
73571ae309
NIFI-6185: ListDatabaseTables processor doesn't close ResultSets
...
This closes #3405 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-04-04 12:24:47 +09:00
3a63de2ae2
NIFI-6180: exposing firehose grace period to DruidTranquilityController
...
this allows for configuring `druidBeam.firehoseGracePeriod`
(https://github.com/druid-io/tranquility/blob/master/docs/configuration.md#properties )
NIFI-6180: Corrected typo in DruidTranquilityController
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3403
2019-04-03 12:31:57 -04:00
e907b689e8
NIFI-6179: minor changes to DruidTranquilityController
...
- hooking in property INDEX_RETRY_PERIOD to list of properties
- fixing property description
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3402
2019-04-03 12:24:32 -04:00
76392ee862
NIFI-6155: Ensure that any task submitted to FlowEngine catches Throwable so that the task doesn't die just die silently in the case of an unexpected error/exception
...
This closes #3395 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-29 10:09:35 -04:00
4de51fd3d5
NIFI-6148 - Added support for aggregation option 'allowDiskUse'
...
This closes #3389
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-03-28 11:06:25 -04:00
d3d43262db
NIFI-6150: Moved logic of decrementing content claims from ProcessSession.commit to the FlowFile Repository. Also updated load-balancing protocol and queue drop logic to no longer decrement content claims since the flowfile repo will handle the logic. This allows us ts to ensure that the claimant counts are decremented only if the repo is successfully updated and still before checking if the claim is still in use or not.
...
This closes #3391 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-27 10:22:01 -04:00
ead6a3b842
NIFI-6144 - Enable EL on listening port in HandleHttpRequest
...
This closes #3386 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-03-25 11:52:28 +09:00
1bdab73201
NIFI-6121 Updated the easy dependencies to update
...
This closes #3374
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-03-22 09:01:21 -04:00
ce09b93ef1
NIFI-6139: Add fragment attributes to PartitionRecord
...
This closes #3382 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-03-22 10:41:10 +09:00
48a6c81fa2
NIFI-4735: ParseEVTX only outputs one event per chunk
...
This change is based on https://github.com/apache/nifi/pull/2489
I have reproduced the issue with some additional test cases and test files then applied the original fix.
commit message from the original change:
Updated the EVTX FileHeader class to correctly check if there are more chunks in the file. Previously this would not process the last chunk.
Updated the EVTX ChunkHeader class to correctly check if there are additional records in the chunk. Previously this would only process the first record of each chunk. It was using the fileLastRecordNumber where it should have been using the logLastRecordNumber value.
Updated the EVTX unit tests to have the correct expected number of events and use the logLastRecordNumber.
refactoring duplicated code and magic numbers
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2489
This closes #3379
2019-03-20 14:12:03 -04:00
d35d15cdda
NIFI-6027
...
- Allowing user or group existence enforcement to be parameterized.
- Fixing error handling when loading user groups which may have resulted in stack trace leaking.
This closes #3377 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2019-03-20 13:38:46 -04:00
cd3567873b
NIFI-5918 Fix issue with MergeRecord when DefragmentStrategy is on
...
Added an unit test representing the fixed issue.
And updated existing testDefragment test to illustrate
the remaining FlowFiles those did not meet the threshold.
2019-03-20 12:36:08 +09:00
b97fbd2c89
NIFI-5918 Fix issue with MergeRecord when DefragmentStrategy is on
...
This closes #3334 .
Signed-off-by: Andres Garagiola <andresgaragiola@gmail.com>
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-03-20 12:15:40 +09:00
9d21a106ad
NIFI-6120 Move nifi.registry.version property to root pom so it can be shared between nifi-framework and nifi-toolkit
...
This closes #3369 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-03-20 10:56:10 +09:00
77b84edf5b
NIFI-6122: PutS3Object supports national characters in filenames.
...
This closes #3373 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-03-20 10:51:39 +09:00
0cb15cfb1a
NIFI-6118 - Fix: UI - Not all calls to nfCanvasUtil.reloadConnectionSourceAndDestination are made with the proper component IDs
...
This closes #3368
2019-03-18 14:48:41 -04:00
6401e32a33
NIFI-6126 - Change nf-canvas to respond to keyup events rather than keydown
...
This closes #3376
2019-03-18 14:08:56 -04:00
45ebeba846
NIFI-5267 Kafka support to replay by timestamp
...
This closes #3372 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-15 09:18:39 -04:00
82e2c97782
NIFI-5956 Option BlockCache HBaseScanProcessor
...
This closes #3295 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-14 12:22:41 -04:00
4db5446c87
NIFI-6082: Refactor the way to handle fields nullable
...
- Make enriched fields nullable at LookupRecord.
- Removed unnecessary AvroConversionOptions and reader schema creation,
because ResultSetRecordSet can generate NiFi Record Schema from RS
directly. No Avro schema is needed to do that.
2019-03-14 09:33:39 +09:00
ca76fe178c
NIFI-6082: Added DatabaseRecordLookupService, refactored common DB utils
...
NIFI-6082: Added SimpleDatabaseLookupService
NIFI-6082: Merged Koji's improvements, incorporated review comments
This closes #3341 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-03-14 09:33:30 +09:00
0e10e417df
NIFI-4358 This closes #3363 . cassandra connection enable compression at resquest and response
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2019-03-13 15:56:13 -04:00
35d1cace08
Documentation : ConsumerKafka_2_0 - updated configuration details re… ( #3360 )
...
* Documentation : ConsumerKafka_2_0 - updated configuration details related to SASL_PLAINTEXT - SCRAM
* Updated rest of the related documents with SCRAM configurations and few NOTEs
* incorporated review comments
* incorporated review comments
2019-03-13 11:12:00 -04:00
98ca28d50d
NIFI-6083 - Improving documentation for Kafka Service Name property
...
This closes #3365 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-12 12:29:22 -04:00
160ade9f9d
NIFI-5018
...
- Added snap alignment for nf-label, label resize events, and nf-connection
- Shift key now disables snap alignment during the drag event.
- nf-connection load-balance-icon updated
This closes #3335
2019-03-11 13:52:09 -04:00
c84f40ee36
NIFI-6111: Fixed bugs in the Status History values. If metrics are not available yet from all nodes for the last point on the graph, leave the cluster aggregate value off for the last point to prevent it from dropping significantly at the end of the chart. Fixed bug where counter values were not properly summed together in cluster view. Addressed issue with Average Task Duration
...
This closes #3361 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-08 17:27:49 -05:00
58a25cfa5a
NIFI-6110: Updated StandardProcessSession such that if we fail to update the FlowFile Repository, we do not decrement claimant counts for any FlowFiles that were removed. Doing so can cause an issue where a FlowFile is removed, then the FlowFileRepo update fails, resulting in the flowfile being rolled back, but after its claimant count is decremented. It will then be processed again, which can result in the same thing, and we'll end up decrementing the claimant count repeatedly. Also updated LengthDelimitedJournal so that if the overflow directory already exists, it does not fail when trying to create the directory and instead just moves on. Updated unit tests to test both of these new fixes and updated DummyRecordSerde to be thread-safe because the TestLengthDelimitedJournal now needs it to be thread safe due to the new unit test that was added.
...
This closes #3358 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-08 10:32:38 -05:00
79e05c9f58
NIFI-6078: Create PostSlack processor
...
Processor for sending messages on Slack and optionally upload and attach
the FlowFile content (e.g. an image) to the message.
NIFI-6078: Remove username/icon properties.
NIFI-6078: Make Text property optional.
NIFI-6078: Documentation changes.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3339
2019-03-07 13:00:31 -05:00
d53cefa2a7
NIFI-3685 Azure EventHub processor tests fail
...
Moved test classes into the proper folder.
Fixed outdated mocking and added assertions that actually tests the content.
This closes #3346 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-03-07 14:26:40 +09:00
1d06044e3b
NIFI-6108: Fix port names when imported from registry
...
This closes #3356 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-06 17:07:18 -05:00
c32ea618c5
NIFI-6040: Fixed ExecuteSQL processors when Output Batch Size is set
...
This closes #3355 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-03-06 13:44:33 -05:00
36bbc77723
NIFI-6097 - Upgraded the fasterxml jackson version to 2.9.8. Ensure that the version is consistent across modules using a maven property defined in the root pom.
...
This closes #3347
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-03-04 19:30:35 -05:00
32bd7ed8b4
NIFI-6062: Add support for BLOB, CLOB, NCLOB in record handling
...
This closes #3329
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-02-28 08:59:37 -05:00
e5fa18d63c
NIFI-6088: Widen type inference for BIGINT and DOUBLE
...
This closes #3342
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-02-28 05:51:33 -05:00
2a6c3c1686
NIFI-5977 - Add "Minimum/Maximum File Age" Parameter to ListSFTP
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3324 .
2019-02-28 09:15:59 +01:00
922da68a23
NIFI-6076 syslog5424 should support missing MSG
...
- newer lib version and better test
This closes #3331 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-02-26 09:39:09 -05:00
cd7edb1c04
NIFI-5172 Adding the ability to specify a record writer for PutElasticsearchHttpRecord in order to individually handle failed records
...
Addressing PR feedback
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3299
2019-02-25 17:15:39 -05:00
Matthew Burgess
Koji Kawamura
pushpavanthar
Bryan Bende
bdesert
Alex Aversa
Mike Thomsen
Lars Francke
Rob Fellows
dnsbtchr
ambah
Endre Zoltan Kovacs
Mark Payne
Craig Davidson
Pierre Villard
Joe Witt
Ferenc Szabó
Matt Gilman
Andres Garagiola
Peter Turcsanyi
Sandish Kumar
Ryan Bower
Kevin Doran
thenatog
Arpad Boda
Otto Fowler
Joe Percivall