Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,929 Commits 146 Branches 201 Tags 404 MiB
Commit Graph

4929 Commits

Author SHA1 Message Date
Mark Payne d3b1674813 NIFI-5805: Pool the BinaryEncoders used by the WriteAvroResultWithExternalSchema writer. Unfortunately, the writer that embeds schemas does not allow for this optimization due to the Avro API 
This closes #3160.
 2018-11-12 09:32:12 -05:00
Mark Payne 08189596d2 NIFI-5809: If QueryRecord has a single-column projection and that results in a null value, do not confuse that with a null value being returned from the Record Reader 
This closes #3163.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-12 14:39:27 +09:00
Ed B 878a0b8b74 NIFI-5810 Add UserName EL support to JMS processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3164.
 2018-11-10 10:33:40 +01:00
Mark Payne 830f7aa84d
NIFI-5718: Added performance-based unit test (Ignored) for LineDemarcator 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3100.
 2018-11-09 14:27:32 -07:00
Mark Payne 564ad0cd71
NIFI-5718: Implemented LineDemarcator and removed NLKBufferedReader in order to improve performance 2018-11-09 14:26:20 -07:00
Arek Burdach 765df67817 NIFI-5757 Using Caffeine instead of slow synchronization on LinkedHashMap for caches - mainly avro schema caches 
This closes #3111.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-11-09 14:50:24 -05:00
Colin Dean a628aced6b
NIFI-5790: Exposes 6 commons-dbcp options in DBCPConnectionPool 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This Closes #3133
 2018-11-09 11:29:11 -07:00
Vish Uma 63f55d05b4 NIFI-5724 make database connection autocommit configurable 
making the database session autocommit value a configurable property

adding custom validation to PutSQL processor so as to disallow 'supports transaction' and 'rollback on failure' to be true when the autocommit value has been set to true

fixing some style issues to conform to standards

This closes #3113.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-09 17:07:27 +09:00
Pierre Villard d5bce91970 NIFI-5794 Allow empty string demarcator in ConsumeKafka processors 
This closes #3159.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-09 09:41:45 +09:00
Mark Payne 49ba3643c7 Increase timeouts in all HandleHttpRequest unit tests from 3 seconds to 20 seconds to avoid frequent unit test failures 2018-11-08 16:20:28 -05:00
Mark Payne 50c0d1ed5d Increase timeouts in unit tests to avoid frequent failures 2018-11-08 16:17:50 -05:00
Koji Kawamura 78a1cb7c5e NIFI-5802: Add QueryRecord nullable field support 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3158.
 2018-11-08 09:50:45 +01:00
Mark Payne a9045d54a1 NIFI-5800: Do not recursively call hashCode on child schema for Record Field Types 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3157.
 2018-11-08 09:36:47 +01:00
Andrew Lim 5cf58b42e0 NIFI-5784 Edit Admin Guide to remove duplicate content that is in new Toolkit Guide 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3155.
 2018-11-08 09:32:51 +01:00
Mark Payne 3ba0c0ca82 NIFI-5798: Fixed bug in FlattenJson that was escaping text as Java instead of escaping as JSON 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3138.
 2018-11-08 09:27:30 +01:00
Kotaro Terada 13232c7413 NIFI-5752: Load balancing fails with wildcard certs 
NIFI-5752: Remove an unnecessary String.format

NIFI-5752: Remove an unnecessary block

This closes #3110.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-07 17:16:20 +09:00
Mark Payne da1f9eaf6a
NIFI-5796 Addressed bug in subtract() method for keeping running total of counters for status history 
This closes #3136.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 17:55:21 -05:00
Mark Payne 4069d75550
NIFI-5796: Addressed issue that caused Counters' values to show the wrong value in Status History 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 17:55:09 -05:00
Mark Payne 931bb0bc3b
NIFI-5769: Refactored FlowController to use Composition over Inheritance 
- Ensure that when root group is set, that we register its ID in FlowManager

This closes #3132.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 11:23:33 -05:00
Andrew Lim 59e102ad47 NIFI-5767 Added NiFi Toolkit Guide to docs 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3124.
 2018-11-06 11:23:54 +01:00
Kotaro Terada 0c9120a73f NIFI-5777: Update the log-level property of LogMessage to support EL 
This closes #3122.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-06 16:20:40 +09:00
Brandon aabb5d7832 NIFI-5787 Update ReadMe doc to start Nifi on windows 
Update 1.8 assembly ReadMe doc to start Nifi on windows. Change it to run-nifi.bat

This closes #3127.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-06 15:49:03 +09:00
Andrew Lim d0688d0785 NIFI-5677 Added note to clarify why modifying/creating variables not local changes in versioned flows 
Update user-guide.adoc

This closes #3125.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-06 15:17:32 +09:00
Koji Kawamura 37a0e1b304 NIFI-4715: Update currentKeys after listing loop 
ListS3 used to update currentKeys within listing loop, that causes
    duplicates. Because S3 returns object list in lexicographic order, if we
    clear currentKeys during the loop, we cannot tell if the object has been
    listed or not, in a case where newer object has a lexicographically
    former name.

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #3116, closes #2361.
 2018-11-03 14:26:00 -07:00
Adam Lamar 0a014dcdb1 NIFI-4715: ListS3 produces duplicates in frequently updated buckets 
Keep totalListCount, reduce unnecessary persistState

This closes #2361.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-03 14:24:21 -07:00
Ed B 2812fe60a2 NIFI-5728 - XML Writer to populate record tag name properly 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3098.
 2018-11-02 09:46:45 +01:00
Matthew Burgess d8d220ccb8
NIFI-5601: Add fragment.* attributes to GenerateTableFetch 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3074
 2018-11-01 15:14:29 -06:00
Bryan Bende fdd8cdbb31 NIFI-5673 Set up property/assembly for new auto-load directory 
- Set up NarAutoLoader to watch directory for new files
- Move NarAutoLoader to JettyServer since it will need access to ExtensionManager
- Created NarLoader to shared between NarAutoLoader and the framework
- Created nifi-framework-nar-loading-utils so we can use nifi-documentation to call DocGenerator
- Add additional bundles to overall map in NarClassLoaders as they are loaded
- Added handling of skipped NARs to include them in next iteration
- Added check of last modified timestamp on NARs
- Refactored JettyServer so we can load additional web contexts while the application is running
- Setting up unit tests
- Remove static use of ExtensionManager
- Adding unit tests for NarLoader
- Extracting interface for ExtensionManager and splitting discovery into it's own interface

This closes #3119.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-11-01 14:41:10 -04:00
Ed B 89295e52ef NIFI-5770 Fix Memory Leak in ExecuteScript on Jython 
Moved module appending (aka classpath in python) into init stage instead of running each time onTrigger.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3117
 2018-11-01 11:28:48 -04:00
Pierre Villard bcfd6f0b13 NIFI-5781 - Incorrect schema for provenance events in SiteToSiteProvenanceReportingTask 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3123
 2018-11-01 10:58:46 -04:00
Koji Kawamura f0a7dda842 NIFI-5776: ListSFTP should log SSH_FXP_STATUS id value 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3120.
 2018-11-01 13:01:40 +01:00
Kotaro Terada 2a035cc390 NIFI-1505: Add processor description for LogAttribute 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3121.
 2018-11-01 12:56:01 +01:00
Mark Payne 4c10b47e60
NIFI-5771: Ensure that we only increment claimant count for content claim if we have a FlowFile that references it 
This closes #3118.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-31 15:25:24 -04:00
Gardella Juan Pablo 1f2cf4bc61 NIFI-5761 ReplaceText processor can stop processing data if it evaluates invalid expressions 
NIFI-5761 Code review.
Remove startsWidth to check an exception. Added the dependency as provided.

NIFI-5761 Code review.
Remove provided.

NIFI-5761 Code review.
Improve logging.

This closes #3112.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-31 12:01:16 +09:00
Andrew Lim fdb1fd1a64 NIFI-5766 Make formatting in User Guide consistent with Admin Guide 
This closes #3115

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-10-30 12:04:29 -04:00
Joe Percivall db966cf348 NIFI-5765 Fixing WriteJsonResult to use chosenDataType when writing an Array value 
Fixing the same bug in PutElasticsearchHttpRecord.java

This closes #3114.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-30 11:51:17 +09:00
Jeff Storck f6d8eada6a NIFI-5720 Updated dockerhub module for next release 2018-10-26 14:10:45 -04:00
Jeff Storck 4f14e517db Merge branch 'NIFI-5720-RC3' as part of the NiFi 1.8.0 release process 2018-10-26 13:56:23 -04:00
Pierre Villard e4b702ed4f NIFI-5726 - Update README with Slack Workspace information 
This closes #3093

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-10-26 08:57:05 -04:00
juliansniff fdbcf34281 NIFI-5747 fix NPE when redirecting from HTTPS to HTTP for InvokeHTTP 
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-26 17:08:17 +09:00
Mark Payne 234ddb0fe1 NIFI-5745: When determining if backpressure should be applied across nodes for load balancing, only consider if the local partition has reached the threshold limits instead of considering the size of the entire queue 
This closes #3108.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-26 16:04:46 +09:00
Mark Payne c7ff2fc5db NIFI-5746: Use Node Identifier's node address instead of getting from socket for RECEIVE prov events; make SEND prov events match syntax of RECEIVE prov events 
NIFI-5746: Addressed issue found in review process

This closes #3109.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-10-26 10:24:12 +09:00
Pierre Villard 2201f7746f NIFI-5714 - Hive[3]ConnectionPool - Kerberos Authentication issue/misleading 
add @Ignore on unit test...

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3086
 2018-10-24 13:33:30 -04:00
Koji Kawamura d28b1172db NIFI-5739: Maintain CaptureChangeMySQL JDBC connection automatically 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3103.
 2018-10-24 09:26:41 +02:00
Mark Payne ebead820f9
NIFI-5741: When returning a ConnectionFactory from the JndiJmsConnectionFactoryProvider, ensure that we wrap the ConnectionFactory so that any calls to the ConnectionFactory happen within the context of the Controller Service's Class Loader 
This closes #3106.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-23 16:17:25 -04:00
Bryan Bende 10479a5a2a NIFI-5740 Ensuring permissions are restored after test completes in TestFetchFile 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3104
 2018-10-23 15:26:33 -04:00
rednikotin c8928ce350 NIFI-5727: Added replace unnecessary row count with -1 stub value when paging is used 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3094
 2018-10-23 14:46:14 -04:00
Mohit Garg e45584d0fb
NIFI-5706 Added ConvertAvroToParquet processor 
- Refactored code : ParquetBuilderProperties merged in ParquetUtils

This closes #3079.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-10-23 14:08:07 -04:00
Jeff Storck c0182294ed NIFI-5720-RC3 prepare for next development iteration 2018-10-22 22:16:43 -04:00
Jeff Storck 98aabf2c50 NIFI-5720-RC3 prepare release nifi-1.8.0-RC3 2018-10-22 22:16:23 -04:00