Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,158 Commits 146 Branches 201 Tags 404 MiB
Commit Graph

5158 Commits

Author SHA1 Message Date
luup2k cc9f89b003
NIFI-5795 RedisDistributedMapCacheClientService put missing option 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3135.
 2018-12-03 10:37:47 +01:00
zenfenan 7df537aeca
NIFI-5850: Replaced custom AWS regions enum with the one from AWS Java SDK 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3190. This closes #3187.
 2018-12-02 13:09:21 +01:00
Matthew Burgess 8a12307d1a
NIFI-5855: Remove unnecessary ORDER BY clause in GenerateTableFetch when Partition Size is zero 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3191.
 2018-11-30 10:54:23 +01:00
Kotaro Terada 72662f0b2c
NIFI-5846: Redirect URL is incorrect after logout 
This closes #3185.

Signed-off-by: Peter Wicks <patricker@gmail.com>
 2018-11-29 08:16:39 -07:00
Koji Kawamura 30f2f42051
NIFI-5849: ListXXX can lose cluster state on processor restart 
NIFI-5406 introduced the issue by trying to use the resetState variable for
different purposes. AbstractListProcessor should have had a different variable
to control whether to clear state for tracking entity strategy.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3189.
 2018-11-29 10:31:35 +01:00
Matthew Burgess 68a49cfad0 NIFI-5845: Add support for OTHER and SQLXML JDBC types to SQL/Hive processors 
NIFI-5845: Incorporated review comments

This closes #3184.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-29 09:50:21 +09:00
Alex Savitsky 98cdb50cc0 NIFI-5843 added subjects to the error message when neither script body nor script text are provided 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3186
 2018-11-28 11:13:17 -05:00
Matthew Burgess 455e3c1bc8 NIFI-5834: Restore default PutHiveQL error handling behavior 
NIFI-5834: Incorporated review comments

This closes #3179.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-27 18:10:26 +09:00
Mike Thomsen e603c486f4 NIFI-5333 Added GetMongoRecord. 
Signed-off-by: zenfenan <zenfenan@apache.org>

This closes #3011
 2018-11-23 15:01:45 +05:30
zenfenan e34d653ba1
NIFI-5812: Marked Database processors as PrimaryNodeOnly 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3167.
 2018-11-22 09:33:01 +01:00
joewitt 2a4745c077
NIFI-5836 This closes #3181. changed the brittle timing based tests to integration tests 2018-11-21 13:11:06 -05:00
Kumara M S Hemantha 71499f774d
NIFI-5560 This closes #3000. Added Follow SYMLINK support for listFTP & listSFTP and getFTP & getSFTP processors 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:53:38 -05:00
Aaron Leon 286a1c880a
NIFI-4260 This closes #3166. Add avro-ipc dependency to hadoop-libraries to support Flume avro source 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:49:22 -05:00
Pierre Villard 03ef646547
NIFI-4731 This closes #3019. This closes #2682. This closes #2420. 
NIFI-4933 BigQuery PR Review

Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:28:40 -05:00
Daniel Jimenez 444caf8a78
NIFI-4731: BQ Processors and GCP library update. 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:27:41 -05:00
Andy LoPresto f6b171d5f7
NIFI-5833 This closes #3180. Marked GetTwitter Consumer Key and Access Token processor properties as sensitive. 
NIFI-5833 Added unit test to demonstrate arbitrary decryption of sensitive values regardless of processor property sensitive status.
NIFI-5833 Updated GetTwitter documentation with note about 1.9.0+ marking Consumer Key and Access Token as sensitive.

Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:02:25 -05:00
yjhyjhyjh0 3c7012ffda
NIFI-5744: Put exception message to attribute while ExecuteSQL fail 
This closes #3107.

Signed-off-by: Peter Wicks <patricker@gmail.com>
 2018-11-20 09:00:46 -07:00
Mark Payne 7bcf9fcb5d NIFI-5814: Addressed issue in DatabaseReader class that was attempting to set values on the JSON returned by MaxMind. Instead of modifying the object directly, we should use an Injectable in the Reader so that the value read will have the appropriate values but we don't need to modify those objects returned by MaxMind 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3168.
 2018-11-19 11:41:43 +01:00
Colin Dean 54402a1ecd NIFI-5828: Documents behavior of ExecuteSQL attrs when Max Rows Per Flow File is enabled 
This closes #3177.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-19 14:18:31 +09:00
gkkorir 023f0c41ce NIFI-5662 - Support for generic fixed when using decimal logical type 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3175.
 2018-11-17 16:36:04 +01:00
Colin Dean 102a5288ef NIFI-5823: Fixes typo in min idle connections property name 
So many people missed it :-(

This closes #3172.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-16 11:16:55 +09:00
Matthew Burgess 0207d0813e
NIFI-5604: Added property to allow empty FlowFile when no SQL generated by GenerateTableFetch 
co-authored by: Peter Wicks <patricker@gmail.com>
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3075.
 2018-11-15 13:37:43 -07:00
yjhyjhyjh0 75906226a6
NIFI-5780 Add pre and post statements to ExecuteSQL and ExecuteSQLRecord 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3156.
 2018-11-15 13:18:31 -07:00
Mark Payne be0949570a
NIFI-5824: Added unit test to FlowController to ensure that the ProcessScheduler that it creates is properly initialized. Also updated the properties file used by TestFlowController to use a VolatileContentRepository instead of FileSystemRepository, and fixed EventDrivenWorkerQueue to return if calls to poll() are interrupted (via Thread.interrupt) - making these minor fixes resulted in the unit test TestFlowController running in 2 seconds instead of 30+ seconds on my machine 
This closes #3173.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-15 15:01:56 -05:00
Mark Payne 76b0065a67
NIFI-5822: Ensure that we don't call FlowController.getControllerServiceProvider() before the ControllerServiceProvider has been initialized 
This closes #3171.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-15 13:25:33 -05:00
vadimar d319a3ef2f NIFI-5788: Introduce batch size limit in PutDatabaseRecord processor 
NIFI-5788: Introduce batch size limit in PutDatabaseRecord processor

        Renamed 'batch size' to 'Maximum Batch Size'.
        Changed default value of max_batch_size to zero (INFINITE)
        Fixed parameter validation.
        Added unit tests

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3128
 2018-11-15 10:31:34 -05:00
Matthew Burgess 13011ac6d6 NIFI-5652: Fixed LogMessage when logging level is disabled 
This closes #3170.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-15 15:14:57 +09:00
Pierre Villard 4112af013d NIFI-4130 Add lookup controller service in TransformXML to define XSLT from the UI 
addressed review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #1953
 2018-11-14 09:45:20 -05:00
Pierre Villard 9e7610ac70 NIFI-5815 - PutORC processor 'Restricted' still requires access to restricted components regardless of restriction 
This closes #3169.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-14 13:50:00 +09:00
Mark Payne d3b1674813 NIFI-5805: Pool the BinaryEncoders used by the WriteAvroResultWithExternalSchema writer. Unfortunately, the writer that embeds schemas does not allow for this optimization due to the Avro API 
This closes #3160.
 2018-11-12 09:32:12 -05:00
Mark Payne 08189596d2 NIFI-5809: If QueryRecord has a single-column projection and that results in a null value, do not confuse that with a null value being returned from the Record Reader 
This closes #3163.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-12 14:39:27 +09:00
Ed B 878a0b8b74 NIFI-5810 Add UserName EL support to JMS processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3164.
 2018-11-10 10:33:40 +01:00
Mark Payne 830f7aa84d
NIFI-5718: Added performance-based unit test (Ignored) for LineDemarcator 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3100.
 2018-11-09 14:27:32 -07:00
Mark Payne 564ad0cd71
NIFI-5718: Implemented LineDemarcator and removed NLKBufferedReader in order to improve performance 2018-11-09 14:26:20 -07:00
Arek Burdach 765df67817 NIFI-5757 Using Caffeine instead of slow synchronization on LinkedHashMap for caches - mainly avro schema caches 
This closes #3111.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-11-09 14:50:24 -05:00
Colin Dean a628aced6b
NIFI-5790: Exposes 6 commons-dbcp options in DBCPConnectionPool 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This Closes #3133
 2018-11-09 11:29:11 -07:00
Vish Uma 63f55d05b4 NIFI-5724 make database connection autocommit configurable 
making the database session autocommit value a configurable property

adding custom validation to PutSQL processor so as to disallow 'supports transaction' and 'rollback on failure' to be true when the autocommit value has been set to true

fixing some style issues to conform to standards

This closes #3113.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-09 17:07:27 +09:00
Pierre Villard d5bce91970 NIFI-5794 Allow empty string demarcator in ConsumeKafka processors 
This closes #3159.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-09 09:41:45 +09:00
Mark Payne 49ba3643c7 Increase timeouts in all HandleHttpRequest unit tests from 3 seconds to 20 seconds to avoid frequent unit test failures 2018-11-08 16:20:28 -05:00
Mark Payne 50c0d1ed5d Increase timeouts in unit tests to avoid frequent failures 2018-11-08 16:17:50 -05:00
Koji Kawamura 78a1cb7c5e NIFI-5802: Add QueryRecord nullable field support 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3158.
 2018-11-08 09:50:45 +01:00
Mark Payne a9045d54a1 NIFI-5800: Do not recursively call hashCode on child schema for Record Field Types 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3157.
 2018-11-08 09:36:47 +01:00
Andrew Lim 5cf58b42e0 NIFI-5784 Edit Admin Guide to remove duplicate content that is in new Toolkit Guide 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3155.
 2018-11-08 09:32:51 +01:00
Mark Payne 3ba0c0ca82 NIFI-5798: Fixed bug in FlattenJson that was escaping text as Java instead of escaping as JSON 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3138.
 2018-11-08 09:27:30 +01:00
Kotaro Terada 13232c7413 NIFI-5752: Load balancing fails with wildcard certs 
NIFI-5752: Remove an unnecessary String.format

NIFI-5752: Remove an unnecessary block

This closes #3110.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-07 17:16:20 +09:00
Mark Payne da1f9eaf6a
NIFI-5796 Addressed bug in subtract() method for keeping running total of counters for status history 
This closes #3136.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 17:55:21 -05:00
Mark Payne 4069d75550
NIFI-5796: Addressed issue that caused Counters' values to show the wrong value in Status History 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 17:55:09 -05:00
Mark Payne 931bb0bc3b
NIFI-5769: Refactored FlowController to use Composition over Inheritance 
- Ensure that when root group is set, that we register its ID in FlowManager

This closes #3132.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-06 11:23:33 -05:00
Andrew Lim 59e102ad47 NIFI-5767 Added NiFi Toolkit Guide to docs 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3124.
 2018-11-06 11:23:54 +01:00
Kotaro Terada 0c9120a73f NIFI-5777: Update the log-level property of LogMessage to support EL 
This closes #3122.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-06 16:20:40 +09:00