Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,817 Commits 146 Branches 201 Tags 407 MiB
Commit Graph

3017 Commits

Author SHA1 Message Date
Mark Payne 3ba0c0ca82 NIFI-5798: Fixed bug in FlattenJson that was escaping text as Java instead of escaping as JSON 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3138.
 2018-11-08 09:27:30 +01:00
Kotaro Terada 13232c7413 NIFI-5752: Load balancing fails with wildcard certs 
NIFI-5752: Remove an unnecessary String.format

NIFI-5752: Remove an unnecessary block

This closes #3110.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-07 17:16:20 +09:00
Mark Payne da1f9eaf6a
NIFI-5796 Addressed bug in subtract() method for keeping running total of counters for status history 
This closes #3136.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 17:55:21 -05:00
Mark Payne 4069d75550
NIFI-5796: Addressed issue that caused Counters' values to show the wrong value in Status History 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 17:55:09 -05:00
Mark Payne 931bb0bc3b
NIFI-5769: Refactored FlowController to use Composition over Inheritance 
- Ensure that when root group is set, that we register its ID in FlowManager

This closes #3132.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 11:23:33 -05:00
Andrew Lim 59e102ad47 NIFI-5767 Added NiFi Toolkit Guide to docs 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3124.
 2018-11-06 11:23:54 +01:00
Kotaro Terada 0c9120a73f NIFI-5777: Update the log-level property of LogMessage to support EL 
This closes #3122.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-06 16:20:40 +09:00
Koji Kawamura 37a0e1b304 NIFI-4715: Update currentKeys after listing loop 
ListS3 used to update currentKeys within listing loop, that causes
    duplicates. Because S3 returns object list in lexicographic order, if we
    clear currentKeys during the loop, we cannot tell if the object has been
    listed or not, in a case where newer object has a lexicographically
    former name.

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #3116, closes #2361.
 2018-11-03 14:26:00 -07:00
Adam Lamar 0a014dcdb1 NIFI-4715: ListS3 produces duplicates in frequently updated buckets 
Keep totalListCount, reduce unnecessary persistState

This closes #2361.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-03 14:24:21 -07:00
Ed B 2812fe60a2 NIFI-5728 - XML Writer to populate record tag name properly 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3098.
 2018-11-02 09:46:45 +01:00
Matthew Burgess d8d220ccb8
NIFI-5601: Add fragment.* attributes to GenerateTableFetch 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3074
 2018-11-01 15:14:29 -06:00
Bryan Bende fdd8cdbb31 NIFI-5673 Set up property/assembly for new auto-load directory 
- Set up NarAutoLoader to watch directory for new files
- Move NarAutoLoader to JettyServer since it will need access to ExtensionManager
- Created NarLoader to shared between NarAutoLoader and the framework
- Created nifi-framework-nar-loading-utils so we can use nifi-documentation to call DocGenerator
- Add additional bundles to overall map in NarClassLoaders as they are loaded
- Added handling of skipped NARs to include them in next iteration
- Added check of last modified timestamp on NARs
- Refactored JettyServer so we can load additional web contexts while the application is running
- Setting up unit tests
- Remove static use of ExtensionManager
- Adding unit tests for NarLoader
- Extracting interface for ExtensionManager and splitting discovery into it's own interface

This closes #3119.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-11-01 14:41:10 -04:00
Ed B 89295e52ef NIFI-5770 Fix Memory Leak in ExecuteScript on Jython 
Moved module appending (aka classpath in python) into init stage instead of running each time onTrigger.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3117
 2018-11-01 11:28:48 -04:00
Pierre Villard bcfd6f0b13 NIFI-5781 - Incorrect schema for provenance events in SiteToSiteProvenanceReportingTask 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3123
 2018-11-01 10:58:46 -04:00
Koji Kawamura f0a7dda842 NIFI-5776: ListSFTP should log SSH_FXP_STATUS id value 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3120.
 2018-11-01 13:01:40 +01:00
Kotaro Terada 2a035cc390 NIFI-1505: Add processor description for LogAttribute 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3121.
 2018-11-01 12:56:01 +01:00
Mark Payne 4c10b47e60
NIFI-5771: Ensure that we only increment claimant count for content claim if we have a FlowFile that references it 
This closes #3118.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-31 15:25:24 -04:00
Gardella Juan Pablo 1f2cf4bc61 NIFI-5761 ReplaceText processor can stop processing data if it evaluates invalid expressions 
NIFI-5761 Code review.
Remove startsWidth to check an exception. Added the dependency as provided.

NIFI-5761 Code review.
Remove provided.

NIFI-5761 Code review.
Improve logging.

This closes #3112.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-31 12:01:16 +09:00
Joe Percivall db966cf348 NIFI-5765 Fixing WriteJsonResult to use chosenDataType when writing an Array value 
Fixing the same bug in PutElasticsearchHttpRecord.java

This closes #3114.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-30 11:51:17 +09:00
Jeff Storck 4f14e517db Merge branch 'NIFI-5720-RC3' as part of the NiFi 1.8.0 release process 2018-10-26 13:56:23 -04:00
juliansniff fdbcf34281 NIFI-5747 fix NPE when redirecting from HTTPS to HTTP for InvokeHTTP 
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-26 17:08:17 +09:00
Mark Payne 234ddb0fe1 NIFI-5745: When determining if backpressure should be applied across nodes for load balancing, only consider if the local partition has reached the threshold limits instead of considering the size of the entire queue 
This closes #3108.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-26 16:04:46 +09:00
Mark Payne c7ff2fc5db NIFI-5746: Use Node Identifier's node address instead of getting from socket for RECEIVE prov events; make SEND prov events match syntax of RECEIVE prov events 
NIFI-5746: Addressed issue found in review process

This closes #3109.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-26 10:24:12 +09:00
Pierre Villard 2201f7746f NIFI-5714 - Hive[3]ConnectionPool - Kerberos Authentication issue/misleading 
add @Ignore on unit test...

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3086
 2018-10-24 13:33:30 -04:00
Koji Kawamura d28b1172db NIFI-5739: Maintain CaptureChangeMySQL JDBC connection automatically 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3103.
 2018-10-24 09:26:41 +02:00
Mark Payne ebead820f9
NIFI-5741: When returning a ConnectionFactory from the JndiJmsConnectionFactoryProvider, ensure that we wrap the ConnectionFactory so that any calls to the ConnectionFactory happen within the context of the Controller Service's Class Loader 
This closes #3106.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-23 16:17:25 -04:00
Bryan Bende 10479a5a2a NIFI-5740 Ensuring permissions are restored after test completes in TestFetchFile 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3104
 2018-10-23 15:26:33 -04:00
rednikotin c8928ce350 NIFI-5727: Added replace unnecessary row count with -1 stub value when paging is used 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3094
 2018-10-23 14:46:14 -04:00
Mohit Garg e45584d0fb
NIFI-5706 Added ConvertAvroToParquet processor 
- Refactored code : ParquetBuilderProperties merged in ParquetUtils

This closes #3079.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-23 14:08:07 -04:00
Jeff Storck c0182294ed NIFI-5720-RC3 prepare for next development iteration 2018-10-22 22:16:43 -04:00
Jeff Storck 98aabf2c50 NIFI-5720-RC3 prepare release nifi-1.8.0-RC3 2018-10-22 22:16:23 -04:00
Matt Gilman 02261311b3 NIFI-5737: 
- Removing needClientAuth property since cluster comms now requires two way ssl. Jetty client auth settings are based on configured features.
- Removing dead code.
- Updating documentation.
- Removing references to needClientAuth property in all test resources.
- Removing overloaded util method with strict parameter.

This closes #3102.
 2018-10-22 20:02:47 -04:00
Pierre Villard c6106d1d88 NIFI-5525 - CSVRecordReader fails with StringIndexOutOfBoundsException when field is a double quote 
review

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3092
 2018-10-22 16:58:36 -04:00
Christian Englert 4fe7cb33e4
NIFI-5734 MQTTProcessors should have sensitive password 
This closes #3099.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-22 15:19:06 -04:00
Bryan Bende ebaaf5797e
NIFI-5721 Fixing connection handling in MQTT processors 
This closes #3096.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2018-10-22 15:13:14 -04:00
Mark Payne 5561c29ed3 NIFI-5736: Removed 'synchronized' keyword from SwappablePriorityQueue#getProperties - the method should not be synchronized, as it guards access to member variables via a ReadLock. I am guessing that the synchronized keyword is the result of refactoring from 'synchronized' to a read lock and inadvertently leaving the 'synchronized' keyword in. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3101
 2018-10-22 12:22:05 -04:00
thenatog 08c54bc48d Revert "NIFI-4558 - Set JKS as the default keystore type and truststore type." 
This reverts commit 2b9fdf8415.

This closes #3097.
 2018-10-20 17:50:24 -04:00
Bryan Bende f3f7cdbab9 NIFI-5719 Ensuring FetchFile routes to failure if the move completion strategy can't be completed 
This closes #3088.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-18 14:37:55 +09:00
Matthew Burgess c752ec8394
NIFI-5705: Added Hive 3 attribution to nifi-assembly and top-level NOTICEs 
This closes #3076
 2018-10-17 12:24:32 -04:00
Mark Payne d6422e2d2c NIFI-5711: Replaced JavaDocs that appear also to be copied/pasted from BufferedReader, ran IDE code formatter to get consistent whitespace/formatting 
This closes #3085.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-10-17 10:57:57 -04:00
patricker 95e4294673 NIFI-5711 NLKBufferedReader appears extend and copy portions of the JDK BufferedReader 2018-10-17 10:57:53 -04:00
Matt Gilman 87c6b3aa7c
NIFI-5715: Updating the allowable values for the runStatus. 
This closes #3087.

Signed-off-by: Kevin Doran <kdoran@apache.org>
 2018-10-17 10:33:53 -04:00
Bryan Bende 51ed618cf0 NIFI-5708 Fixing the creation of ValidationContextFactory for controller services so it uses the ComponentVariableRegistry and not the file-based instance 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3081
 2018-10-16 15:38:32 -04:00
Mark Payne 4d21f9b34e
NIFI-5709, NIFI-5710: Addressed issue that causes NiFi to not be able to read provenance events when the a new FlowFile is created and then auto-terminated in the same session; minor bug fixes outlined in NIFI-5710 
This closes #3083
 2018-10-16 15:25:29 -04:00
Matt Gilman 11fd67cd1e
NIFI-375: 
- Ensuring the run status endpoints are properly merged.

This closes #3082.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-16 14:59:27 -04:00
Mike Thomsen 11afb0115e NIFI-4811 This closes #2856. Removed no longer necessary license and updated NOTICE 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-10-15 16:43:05 -04:00
Mark Payne 32db43b306 NIFI-5686: Updated StandardProcessScheduler so that if it fails to schedule a Reporting Task, it re-schedules the @OnScheduled task instead of looping and calling Thread.sleep. As it was, the single-threaded Process Scheduler was, when calling ProcessScheduler.unschedule(), the unschedule task was not executing because the schedule task was using the only thread. But switching the logic to schedule the task for later and return, instead of calling Thread.sleep and looping, we are able to avoid blocking the one thread in the thread pool. Also, performed some trivial code cleanup and updated erroneous links in Java-docs. 
NIFI-5686: Fixed unit test in TestSocketLoadBalancedFlowFileQueue; renamed TestProcessorLifecycle to ProcessorLifecycleIT as it is testing integration between many components and largely focuses on high numbers of concurrent tasks to see if it can trigger any threading bugs that may get introduced

NIFI-5686: Extended unit test timeouts
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3062
 2018-10-15 15:21:05 -04:00
Matthew Burgess 218063a0b5 NIFI-5678: Fixed MAP type support of MapRecord objects in StandardSchemaValidator 
This closes #3060.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-10-15 14:33:21 -04:00
Matt Gilman f55204cb69
NIFI-4806: 
- Bumping to tika 1.19.1.

This closes #3069
 2018-10-15 13:52:49 -04:00
Endre Zoltan Kovacs d5f071b2fe NIFI-3469 multipart request support added to HandleHttpRequest 
- introducing a in-memory-file-size-threashold, above which the incoming file is written to local disk
- using java.io.tmpdir for such file writes
- enhancing documentation
- documenting how to avoid premature HTTP response
- fix and UT for unsuccessful request registration

This closes #2991.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-10-15 13:14:31 -04:00