Commit Graph

3120 Commits

Author SHA1 Message Date
gkkorir c51512f5e3 NIFI-5891 fix handling of null logical types in Hive3Streaming processor
NIFI-5891: Fixed Checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3216
2018-12-13 10:23:18 -05:00
zenfenan 9a1ab4c504 NIFI-5621: Added Cassandra connection provider service
NIFI-5621: Improvements on LICENSE & NOTICE files

This closes #3105

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-12-12 09:59:32 -05:00
Pierre Villard 85cc5aa9eb NIFI-5889 - changed the wording about Destination URL in S2S RTs
This closes #3215.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-12 11:15:48 +09:00
Mark Payne 1ac5b93144
NIFI-5859: Added XML-based documentation writer that can be used to document a component.
- Found several instances of nifi-framework-api's ProviderException being thrown from processors. Changed those to IllegalStateException, as ProviderException is not an appropriate Exception in those cases, and extensions should not depend on nifi-framework-api.
- Performed some cleanup, moving Property Descriptors from Controller Service API's/specs into the implementations. Adding to the Service API results in bringing in nifi-utils to the nifi-standard-services-api-nar, which is a bad practice. The 'main' service api nar should not have a dependency on a util class.

NIFI-5859: Added javadocs. Fixed pom.xml that was left pointing to snapshot version of nar maven plugin

NIFI-5859: Addressing review feedback: adding component type, multiple additional details into separate file(s)

This closes #3192.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-12-10 11:16:01 -05:00
Pierre Villard a6f91a1975 NIFI-5872 - Added compression option to JsonRecordSetWriter
This closes #3208.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-10 16:25:59 +09:00
Bryan Bende 60064a9f68 NIFI-5884 Bumping hbase-client version from 1.1.2 to 1.1.13
This closes #3211.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-10 11:00:08 +09:00
Kemix Koo e76c54234d NIFI-5881: Enable to export the template for non-ascii name
This closes #3210.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-10 09:51:46 +09:00
Alexander Bukarev 84c32f9137
NIFI-5830 - RedisConnectionPoolService does not work with Standalone Redis using non-localhost deployment
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3176.
2018-12-06 23:31:25 +01:00
Bryan Bende f1e03b5ed5
NIFI-5877 Protecting against null values when obtaining master address
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3206.
2018-12-06 22:03:23 +01:00
Mark Payne 72ea93a657
NIFI-5868: Added instrumentation around ListFile such that all disk accesses are timed and any unusually long listing times or disk access operations can be logged. Additionally, information is logged at a debug level including significant amounts of troubleshooting information when configured to do so
This closes #3202.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-12-05 13:01:14 -05:00
Koji Kawamura 8ebb4d1974
NIFI-5863 Fixed AbstractFlowFileQueue logging
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3199.
2018-12-05 11:29:50 +01:00
Peter Wicks 6c1c9017e9 NIFI-5862 MockRecordParser Has Bad Logic for failAfterN
This closes #3195.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-05 10:09:31 +09:00
Pierre Villard 986a2a4842 NIFI-5838 - Improve the schema validation method in Kite processors
review

Add empty check

This closes #3182.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-05 09:53:52 +09:00
luup2k cc9f89b003
NIFI-5795 RedisDistributedMapCacheClientService put missing option
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3135.
2018-12-03 10:37:47 +01:00
zenfenan 7df537aeca
NIFI-5850: Replaced custom AWS regions enum with the one from AWS Java SDK
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3190. This closes #3187.
2018-12-02 13:09:21 +01:00
Matthew Burgess 8a12307d1a
NIFI-5855: Remove unnecessary ORDER BY clause in GenerateTableFetch when Partition Size is zero
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3191.
2018-11-30 10:54:23 +01:00
Kotaro Terada 72662f0b2c
NIFI-5846: Redirect URL is incorrect after logout
This closes #3185.

Signed-off-by: Peter Wicks <patricker@gmail.com>
2018-11-29 08:16:39 -07:00
Koji Kawamura 30f2f42051
NIFI-5849: ListXXX can lose cluster state on processor restart
NIFI-5406 introduced the issue by trying to use the resetState variable for
different purposes. AbstractListProcessor should have had a different variable
to control whether to clear state for tracking entity strategy.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3189.
2018-11-29 10:31:35 +01:00
Matthew Burgess 68a49cfad0 NIFI-5845: Add support for OTHER and SQLXML JDBC types to SQL/Hive processors
NIFI-5845: Incorporated review comments

This closes #3184.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-29 09:50:21 +09:00
Alex Savitsky 98cdb50cc0 NIFI-5843 added subjects to the error message when neither script body nor script text are provided
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3186
2018-11-28 11:13:17 -05:00
Matthew Burgess 455e3c1bc8 NIFI-5834: Restore default PutHiveQL error handling behavior
NIFI-5834: Incorporated review comments

This closes #3179.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-27 18:10:26 +09:00
Mike Thomsen e603c486f4 NIFI-5333 Added GetMongoRecord.
Signed-off-by: zenfenan <zenfenan@apache.org>

This closes #3011
2018-11-23 15:01:45 +05:30
zenfenan e34d653ba1
NIFI-5812: Marked Database processors as PrimaryNodeOnly
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3167.
2018-11-22 09:33:01 +01:00
joewitt 2a4745c077
NIFI-5836 This closes #3181. changed the brittle timing based tests to integration tests 2018-11-21 13:11:06 -05:00
Kumara M S Hemantha 71499f774d
NIFI-5560 This closes #3000. Added Follow SYMLINK support for listFTP & listSFTP and getFTP & getSFTP processors
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:53:38 -05:00
Aaron Leon 286a1c880a
NIFI-4260 This closes #3166. Add avro-ipc dependency to hadoop-libraries to support Flume avro source
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:49:22 -05:00
Pierre Villard 03ef646547
NIFI-4731 This closes #3019. This closes #2682. This closes #2420.
NIFI-4933 BigQuery PR Review

Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:28:40 -05:00
Daniel Jimenez 444caf8a78
NIFI-4731: BQ Processors and GCP library update.
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:27:41 -05:00
Andy LoPresto f6b171d5f7
NIFI-5833 This closes #3180. Marked GetTwitter Consumer Key and Access Token processor properties as sensitive.
NIFI-5833 Added unit test to demonstrate arbitrary decryption of sensitive values regardless of processor property sensitive status.
NIFI-5833 Updated GetTwitter documentation with note about 1.9.0+ marking Consumer Key and Access Token as sensitive.

Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:02:25 -05:00
yjhyjhyjh0 3c7012ffda
NIFI-5744: Put exception message to attribute while ExecuteSQL fail
This closes #3107.

Signed-off-by: Peter Wicks <patricker@gmail.com>
2018-11-20 09:00:46 -07:00
Mark Payne 7bcf9fcb5d NIFI-5814: Addressed issue in DatabaseReader class that was attempting to set values on the JSON returned by MaxMind. Instead of modifying the object directly, we should use an Injectable in the Reader so that the value read will have the appropriate values but we don't need to modify those objects returned by MaxMind
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3168.
2018-11-19 11:41:43 +01:00
Colin Dean 54402a1ecd NIFI-5828: Documents behavior of ExecuteSQL attrs when Max Rows Per Flow File is enabled
This closes #3177.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-19 14:18:31 +09:00
gkkorir 023f0c41ce NIFI-5662 - Support for generic fixed when using decimal logical type
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3175.
2018-11-17 16:36:04 +01:00
Colin Dean 102a5288ef NIFI-5823: Fixes typo in min idle connections property name
So many people missed it :-(

This closes #3172.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-16 11:16:55 +09:00
Matthew Burgess 0207d0813e
NIFI-5604: Added property to allow empty FlowFile when no SQL generated by GenerateTableFetch
co-authored by: Peter Wicks <patricker@gmail.com>
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3075.
2018-11-15 13:37:43 -07:00
yjhyjhyjh0 75906226a6
NIFI-5780 Add pre and post statements to ExecuteSQL and ExecuteSQLRecord
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3156.
2018-11-15 13:18:31 -07:00
Mark Payne be0949570a
NIFI-5824: Added unit test to FlowController to ensure that the ProcessScheduler that it creates is properly initialized. Also updated the properties file used by TestFlowController to use a VolatileContentRepository instead of FileSystemRepository, and fixed EventDrivenWorkerQueue to return if calls to poll() are interrupted (via Thread.interrupt) - making these minor fixes resulted in the unit test TestFlowController running in 2 seconds instead of 30+ seconds on my machine
This closes #3173.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-15 15:01:56 -05:00
Mark Payne 76b0065a67
NIFI-5822: Ensure that we don't call FlowController.getControllerServiceProvider() before the ControllerServiceProvider has been initialized
This closes #3171.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-15 13:25:33 -05:00
vadimar d319a3ef2f NIFI-5788: Introduce batch size limit in PutDatabaseRecord processor
NIFI-5788: Introduce batch size limit in PutDatabaseRecord processor

        Renamed 'batch size' to 'Maximum Batch Size'.
        Changed default value of max_batch_size to zero (INFINITE)
        Fixed parameter validation.
        Added unit tests

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3128
2018-11-15 10:31:34 -05:00
Matthew Burgess 13011ac6d6 NIFI-5652: Fixed LogMessage when logging level is disabled
This closes #3170.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-15 15:14:57 +09:00
Pierre Villard 4112af013d NIFI-4130 Add lookup controller service in TransformXML to define XSLT from the UI
addressed review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #1953
2018-11-14 09:45:20 -05:00
Pierre Villard 9e7610ac70 NIFI-5815 - PutORC processor 'Restricted' still requires access to restricted components regardless of restriction
This closes #3169.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-14 13:50:00 +09:00
Mark Payne d3b1674813 NIFI-5805: Pool the BinaryEncoders used by the WriteAvroResultWithExternalSchema writer. Unfortunately, the writer that embeds schemas does not allow for this optimization due to the Avro API
This closes #3160.
2018-11-12 09:32:12 -05:00
Mark Payne 08189596d2 NIFI-5809: If QueryRecord has a single-column projection and that results in a null value, do not confuse that with a null value being returned from the Record Reader
This closes #3163.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-12 14:39:27 +09:00
Ed B 878a0b8b74 NIFI-5810 Add UserName EL support to JMS processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3164.
2018-11-10 10:33:40 +01:00
Mark Payne 564ad0cd71
NIFI-5718: Implemented LineDemarcator and removed NLKBufferedReader in order to improve performance 2018-11-09 14:26:20 -07:00
Arek Burdach 765df67817 NIFI-5757 Using Caffeine instead of slow synchronization on LinkedHashMap for caches - mainly avro schema caches
This closes #3111.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-11-09 14:50:24 -05:00
Colin Dean a628aced6b
NIFI-5790: Exposes 6 commons-dbcp options in DBCPConnectionPool
Signed-off-by: Peter Wicks <patricker@gmail.com>

This Closes #3133
2018-11-09 11:29:11 -07:00
Vish Uma 63f55d05b4 NIFI-5724 make database connection autocommit configurable
making the database session autocommit value a configurable property

adding custom validation to PutSQL processor so as to disallow 'supports transaction' and 'rollback on failure' to be true when the autocommit value has been set to true

fixing some style issues to conform to standards

This closes #3113.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-09 17:07:27 +09:00
Pierre Villard d5bce91970 NIFI-5794 Allow empty string demarcator in ConsumeKafka processors
This closes #3159.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-09 09:41:45 +09:00
Mark Payne 49ba3643c7 Increase timeouts in all HandleHttpRequest unit tests from 3 seconds to 20 seconds to avoid frequent unit test failures 2018-11-08 16:20:28 -05:00
Mark Payne 50c0d1ed5d Increase timeouts in unit tests to avoid frequent failures 2018-11-08 16:17:50 -05:00
Koji Kawamura 78a1cb7c5e NIFI-5802: Add QueryRecord nullable field support
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3158.
2018-11-08 09:50:45 +01:00
Mark Payne 3ba0c0ca82 NIFI-5798: Fixed bug in FlattenJson that was escaping text as Java instead of escaping as JSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3138.
2018-11-08 09:27:30 +01:00
Kotaro Terada 13232c7413 NIFI-5752: Load balancing fails with wildcard certs
NIFI-5752: Remove an unnecessary String.format

NIFI-5752: Remove an unnecessary block

This closes #3110.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-07 17:16:20 +09:00
Mark Payne da1f9eaf6a
NIFI-5796 Addressed bug in subtract() method for keeping running total of counters for status history
This closes #3136.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-06 17:55:21 -05:00
Mark Payne 4069d75550
NIFI-5796: Addressed issue that caused Counters' values to show the wrong value in Status History
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-06 17:55:09 -05:00
Mark Payne 931bb0bc3b
NIFI-5769: Refactored FlowController to use Composition over Inheritance
- Ensure that when root group is set, that we register its ID in FlowManager

This closes #3132.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-06 11:23:33 -05:00
Andrew Lim 59e102ad47 NIFI-5767 Added NiFi Toolkit Guide to docs
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3124.
2018-11-06 11:23:54 +01:00
Kotaro Terada 0c9120a73f NIFI-5777: Update the log-level property of LogMessage to support EL
This closes #3122.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-06 16:20:40 +09:00
Koji Kawamura 37a0e1b304 NIFI-4715: Update currentKeys after listing loop
ListS3 used to update currentKeys within listing loop, that causes
    duplicates. Because S3 returns object list in lexicographic order, if we
    clear currentKeys during the loop, we cannot tell if the object has been
    listed or not, in a case where newer object has a lexicographically
    former name.

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #3116, closes #2361.
2018-11-03 14:26:00 -07:00
Adam Lamar 0a014dcdb1 NIFI-4715: ListS3 produces duplicates in frequently updated buckets
Keep totalListCount, reduce unnecessary persistState

This closes #2361.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-03 14:24:21 -07:00
Ed B 2812fe60a2 NIFI-5728 - XML Writer to populate record tag name properly
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3098.
2018-11-02 09:46:45 +01:00
Matthew Burgess d8d220ccb8
NIFI-5601: Add fragment.* attributes to GenerateTableFetch
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3074
2018-11-01 15:14:29 -06:00
Bryan Bende fdd8cdbb31 NIFI-5673 Set up property/assembly for new auto-load directory
- Set up NarAutoLoader to watch directory for new files
- Move NarAutoLoader to JettyServer since it will need access to ExtensionManager
- Created NarLoader to shared between NarAutoLoader and the framework
- Created nifi-framework-nar-loading-utils so we can use nifi-documentation to call DocGenerator
- Add additional bundles to overall map in NarClassLoaders as they are loaded
- Added handling of skipped NARs to include them in next iteration
- Added check of last modified timestamp on NARs
- Refactored JettyServer so we can load additional web contexts while the application is running
- Setting up unit tests
- Remove static use of ExtensionManager
- Adding unit tests for NarLoader
- Extracting interface for ExtensionManager and splitting discovery into it's own interface

This closes #3119.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-11-01 14:41:10 -04:00
Ed B 89295e52ef NIFI-5770 Fix Memory Leak in ExecuteScript on Jython
Moved module appending (aka classpath in python) into init stage instead of running each time onTrigger.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3117
2018-11-01 11:28:48 -04:00
Pierre Villard bcfd6f0b13 NIFI-5781 - Incorrect schema for provenance events in SiteToSiteProvenanceReportingTask
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3123
2018-11-01 10:58:46 -04:00
Koji Kawamura f0a7dda842 NIFI-5776: ListSFTP should log SSH_FXP_STATUS id value
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3120.
2018-11-01 13:01:40 +01:00
Kotaro Terada 2a035cc390 NIFI-1505: Add processor description for LogAttribute
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3121.
2018-11-01 12:56:01 +01:00
Mark Payne 4c10b47e60
NIFI-5771: Ensure that we only increment claimant count for content claim if we have a FlowFile that references it
This closes #3118.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-10-31 15:25:24 -04:00
Gardella Juan Pablo 1f2cf4bc61 NIFI-5761 ReplaceText processor can stop processing data if it evaluates invalid expressions
NIFI-5761 Code review.
Remove startsWidth to check an exception. Added the dependency as provided.

NIFI-5761 Code review.
Remove provided.

NIFI-5761 Code review.
Improve logging.

This closes #3112.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-10-31 12:01:16 +09:00
Joe Percivall db966cf348 NIFI-5765 Fixing WriteJsonResult to use chosenDataType when writing an Array value
Fixing the same bug in PutElasticsearchHttpRecord.java

This closes #3114.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-10-30 11:51:17 +09:00
Jeff Storck 4f14e517db Merge branch 'NIFI-5720-RC3' as part of the NiFi 1.8.0 release process 2018-10-26 13:56:23 -04:00
juliansniff fdbcf34281 NIFI-5747 fix NPE when redirecting from HTTPS to HTTP for InvokeHTTP
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-10-26 17:08:17 +09:00
Mark Payne 234ddb0fe1 NIFI-5745: When determining if backpressure should be applied across nodes for load balancing, only consider if the local partition has reached the threshold limits instead of considering the size of the entire queue
This closes #3108.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-10-26 16:04:46 +09:00
Mark Payne c7ff2fc5db NIFI-5746: Use Node Identifier's node address instead of getting from socket for RECEIVE prov events; make SEND prov events match syntax of RECEIVE prov events
NIFI-5746: Addressed issue found in review process

This closes #3109.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-10-26 10:24:12 +09:00
Pierre Villard 2201f7746f NIFI-5714 - Hive[3]ConnectionPool - Kerberos Authentication issue/misleading
add @Ignore on unit test...

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3086
2018-10-24 13:33:30 -04:00
Koji Kawamura d28b1172db NIFI-5739: Maintain CaptureChangeMySQL JDBC connection automatically
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3103.
2018-10-24 09:26:41 +02:00
Mark Payne ebead820f9
NIFI-5741: When returning a ConnectionFactory from the JndiJmsConnectionFactoryProvider, ensure that we wrap the ConnectionFactory so that any calls to the ConnectionFactory happen within the context of the Controller Service's Class Loader
This closes #3106.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-10-23 16:17:25 -04:00
Bryan Bende 10479a5a2a NIFI-5740 Ensuring permissions are restored after test completes in TestFetchFile
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3104
2018-10-23 15:26:33 -04:00
rednikotin c8928ce350 NIFI-5727: Added replace unnecessary row count with -1 stub value when paging is used
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3094
2018-10-23 14:46:14 -04:00
Mohit Garg e45584d0fb
NIFI-5706 Added ConvertAvroToParquet processor
- Refactored code : ParquetBuilderProperties merged in ParquetUtils

This closes #3079.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-10-23 14:08:07 -04:00
Jeff Storck c0182294ed NIFI-5720-RC3 prepare for next development iteration 2018-10-22 22:16:43 -04:00
Jeff Storck 98aabf2c50 NIFI-5720-RC3 prepare release nifi-1.8.0-RC3 2018-10-22 22:16:23 -04:00
Matt Gilman 02261311b3 NIFI-5737:
- Removing needClientAuth property since cluster comms now requires two way ssl. Jetty client auth settings are based on configured features.
- Removing dead code.
- Updating documentation.
- Removing references to needClientAuth property in all test resources.
- Removing overloaded util method with strict parameter.

This closes #3102.
2018-10-22 20:02:47 -04:00
Pierre Villard c6106d1d88 NIFI-5525 - CSVRecordReader fails with StringIndexOutOfBoundsException when field is a double quote
review

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3092
2018-10-22 16:58:36 -04:00
Christian Englert 4fe7cb33e4
NIFI-5734 MQTTProcessors should have sensitive password
This closes #3099.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-10-22 15:19:06 -04:00
Bryan Bende ebaaf5797e
NIFI-5721 Fixing connection handling in MQTT processors
This closes #3096.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-10-22 15:13:14 -04:00
Mark Payne 5561c29ed3 NIFI-5736: Removed 'synchronized' keyword from SwappablePriorityQueue#getProperties - the method should not be synchronized, as it guards access to member variables via a ReadLock. I am guessing that the synchronized keyword is the result of refactoring from 'synchronized' to a read lock and inadvertently leaving the 'synchronized' keyword in.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3101
2018-10-22 12:22:05 -04:00
thenatog 08c54bc48d Revert "NIFI-4558 - Set JKS as the default keystore type and truststore type."
This reverts commit 2b9fdf8415.

This closes #3097.
2018-10-20 17:50:24 -04:00
Bryan Bende f3f7cdbab9 NIFI-5719 Ensuring FetchFile routes to failure if the move completion strategy can't be completed
This closes #3088.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-10-18 14:37:55 +09:00
Matthew Burgess c752ec8394
NIFI-5705: Added Hive 3 attribution to nifi-assembly and top-level NOTICEs
This closes #3076
2018-10-17 12:24:32 -04:00
Mark Payne d6422e2d2c NIFI-5711: Replaced JavaDocs that appear also to be copied/pasted from BufferedReader, ran IDE code formatter to get consistent whitespace/formatting
This closes #3085.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-10-17 10:57:57 -04:00
patricker 95e4294673 NIFI-5711 NLKBufferedReader appears extend and copy portions of the JDK BufferedReader 2018-10-17 10:57:53 -04:00
Matt Gilman 87c6b3aa7c
NIFI-5715: Updating the allowable values for the runStatus.
This closes #3087.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-10-17 10:33:53 -04:00
Bryan Bende 51ed618cf0 NIFI-5708 Fixing the creation of ValidationContextFactory for controller services so it uses the ComponentVariableRegistry and not the file-based instance
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3081
2018-10-16 15:38:32 -04:00
Mark Payne 4d21f9b34e
NIFI-5709, NIFI-5710: Addressed issue that causes NiFi to not be able to read provenance events when the a new FlowFile is created and then auto-terminated in the same session; minor bug fixes outlined in NIFI-5710
This closes #3083
2018-10-16 15:25:29 -04:00
Matt Gilman 11fd67cd1e
NIFI-375:
- Ensuring the run status endpoints are properly merged.

This closes #3082.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-10-16 14:59:27 -04:00
Mike Thomsen 11afb0115e NIFI-4811 This closes #2856. Removed no longer necessary license and updated NOTICE
Signed-off-by: joewitt <joewitt@apache.org>
2018-10-15 16:43:05 -04:00
Mark Payne 32db43b306 NIFI-5686: Updated StandardProcessScheduler so that if it fails to schedule a Reporting Task, it re-schedules the @OnScheduled task instead of looping and calling Thread.sleep. As it was, the single-threaded Process Scheduler was, when calling ProcessScheduler.unschedule(), the unschedule task was not executing because the schedule task was using the only thread. But switching the logic to schedule the task for later and return, instead of calling Thread.sleep and looping, we are able to avoid blocking the one thread in the thread pool. Also, performed some trivial code cleanup and updated erroneous links in Java-docs.
NIFI-5686: Fixed unit test in TestSocketLoadBalancedFlowFileQueue; renamed TestProcessorLifecycle to ProcessorLifecycleIT as it is testing integration between many components and largely focuses on high numbers of concurrent tasks to see if it can trigger any threading bugs that may get introduced

NIFI-5686: Extended unit test timeouts
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3062
2018-10-15 15:21:05 -04:00