d34789881b
NIFI-5904: Fix PutHive3Streaming handling of RecordReaderFactoryException
2018-12-17 14:12:18 -05:00
10e29ee4d6
NIFI-5898: Updated the display name for ACCESS_KEY & SECRET_KEY
2018-12-16 17:05:52 +05:30
ee24a593e9
NIFI-5893: AWS Endpoint Overriding now functions properly
2018-12-15 19:37:31 +05:30
0efddf47d5
NIFI-4579: Fix ValidateRecord type coercing
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2794
2018-12-13 16:10:41 -05:00
c51512f5e3
NIFI-5891 fix handling of null logical types in Hive3Streaming processor
...
NIFI-5891: Fixed Checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3216
2018-12-13 10:23:18 -05:00
9a1ab4c504
NIFI-5621: Added Cassandra connection provider service
...
NIFI-5621: Improvements on LICENSE & NOTICE files
This closes #3105
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-12-12 09:59:32 -05:00
85cc5aa9eb
NIFI-5889 - changed the wording about Destination URL in S2S RTs
...
This closes #3215 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-12 11:15:48 +09:00
13a7f16860
NIFI-5890 Added a unit test that proves that 1.9 fixes a bug in the date conversion behavior in 1.8.
...
This closes #3214 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-12 11:08:18 +09:00
1a937b6511
NIFI-5875 Improve docs around the PriorityAttributePrioritizer
...
Clear up the documentation around the PriorityAttributePrioritizer to make it clearer that if the attributes are both number the largest wins but if they are not numbers they sort the other way around.
I had to go and look at the code to work out what was going on after reading the existing documentation.
Simplify PriorityAttributePrioritzer docs
Simplify the main section of documentation for PriorityAttributePrioritzer and then add a notes section with more details about the ordering.
Fix example.
Put back comment setting the priority attribute
Further improvements to the Priority ordering
This closes #3205 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-11 10:43:25 +09:00
1ac5b93144
NIFI-5859: Added XML-based documentation writer that can be used to document a component.
...
- Found several instances of nifi-framework-api's ProviderException being thrown from processors. Changed those to IllegalStateException, as ProviderException is not an appropriate Exception in those cases, and extensions should not depend on nifi-framework-api.
- Performed some cleanup, moving Property Descriptors from Controller Service API's/specs into the implementations. Adding to the Service API results in bringing in nifi-utils to the nifi-standard-services-api-nar, which is a bad practice. The 'main' service api nar should not have a dependency on a util class.
NIFI-5859: Added javadocs. Fixed pom.xml that was left pointing to snapshot version of nar maven plugin
NIFI-5859: Addressing review feedback: adding component type, multiple additional details into separate file(s)
This closes #3192 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-12-10 11:16:01 -05:00
4e7a856f77
NIFI-5885 ArrayOutOfBoundsException at EL 'or' and 'and' functions
...
EL 'or' and 'and' functions can be called multiple times within the same context using the same evaluator instance.
That happens if their subject is derived from an IteratingEvaluator such as 'anyDelineatedValues'.
And if the right hand side expression for such 'or' and 'and' contains another IteratingEvaluator,
then it can be evaluated more than the number of its candidates, ultimately an ArrayOutOfBoundsException is thrown.
This commit makes Or/AndEvaluator caching its right hand side result to prevent that happens.
For 'or' and 'and' functions, the right hand side expression is independant from their subject boolean value.
It's enough evaluating right hand side once, because it returns the same result even with different subjects.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3212 .
2018-12-10 11:47:58 +01:00
a6f91a1975
NIFI-5872 - Added compression option to JsonRecordSetWriter
...
This closes #3208 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-10 16:25:59 +09:00
60064a9f68
NIFI-5884 Bumping hbase-client version from 1.1.2 to 1.1.13
...
This closes #3211 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-10 11:00:08 +09:00
e76c54234d
NIFI-5881: Enable to export the template for non-ascii name
...
This closes #3210 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-10 09:51:46 +09:00
ecbed6a782
NIFI-5883 - Update README.md
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3209 .
2018-12-07 14:43:54 +01:00
84c32f9137
NIFI-5830 - RedisConnectionPoolService does not work with Standalone Redis using non-localhost deployment
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3176 .
2018-12-06 23:31:25 +01:00
f1e03b5ed5
NIFI-5877 Protecting against null values when obtaining master address
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3206 .
2018-12-06 22:03:23 +01:00
72ea93a657
NIFI-5868: Added instrumentation around ListFile such that all disk accesses are timed and any unusually long listing times or disk access operations can be logged. Additionally, information is logged at a debug level including significant amounts of troubleshooting information when configured to do so
...
This closes #3202 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-12-05 13:01:14 -05:00
8ebb4d1974
NIFI-5863 Fixed AbstractFlowFileQueue logging
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3199 .
2018-12-05 11:29:50 +01:00
6c1c9017e9
NIFI-5862 MockRecordParser Has Bad Logic for failAfterN
...
This closes #3195 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-05 10:09:31 +09:00
986a2a4842
NIFI-5838 - Improve the schema validation method in Kite processors
...
review
Add empty check
This closes #3182 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-05 09:53:52 +09:00
cc9f89b003
NIFI-5795 RedisDistributedMapCacheClientService put missing option
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3135 .
2018-12-03 10:37:47 +01:00
7df537aeca
NIFI-5850: Replaced custom AWS regions enum with the one from AWS Java SDK
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3190 . This closes #3187 .
2018-12-02 13:09:21 +01:00
8a12307d1a
NIFI-5855: Remove unnecessary ORDER BY clause in GenerateTableFetch when Partition Size is zero
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3191 .
2018-11-30 10:54:23 +01:00
72662f0b2c
NIFI-5846: Redirect URL is incorrect after logout
...
This closes #3185 .
Signed-off-by: Peter Wicks <patricker@gmail.com>
2018-11-29 08:16:39 -07:00
30f2f42051
NIFI-5849: ListXXX can lose cluster state on processor restart
...
NIFI-5406 introduced the issue by trying to use the resetState variable for
different purposes. AbstractListProcessor should have had a different variable
to control whether to clear state for tracking entity strategy.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3189 .
2018-11-29 10:31:35 +01:00
68a49cfad0
NIFI-5845: Add support for OTHER and SQLXML JDBC types to SQL/Hive processors
...
NIFI-5845: Incorporated review comments
This closes #3184 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-29 09:50:21 +09:00
98cdb50cc0
NIFI-5843 added subjects to the error message when neither script body nor script text are provided
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3186
2018-11-28 11:13:17 -05:00
455e3c1bc8
NIFI-5834: Restore default PutHiveQL error handling behavior
...
NIFI-5834: Incorporated review comments
This closes #3179 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-27 18:10:26 +09:00
e603c486f4
NIFI-5333 Added GetMongoRecord.
...
Signed-off-by: zenfenan <zenfenan@apache.org>
This closes #3011
2018-11-23 15:01:45 +05:30
e34d653ba1
NIFI-5812: Marked Database processors as PrimaryNodeOnly
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3167 .
2018-11-22 09:33:01 +01:00
2a4745c077
NIFI-5836 This closes #3181 . changed the brittle timing based tests to integration tests
2018-11-21 13:11:06 -05:00
71499f774d
NIFI-5560 This closes #3000 . Added Follow SYMLINK support for listFTP & listSFTP and getFTP & getSFTP processors
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:53:38 -05:00
286a1c880a
NIFI-4260 This closes #3166 . Add avro-ipc dependency to hadoop-libraries to support Flume avro source
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:49:22 -05:00
03ef646547
NIFI-4731 This closes #3019 . This closes #2682 . This closes #2420 .
...
NIFI-4933 BigQuery PR Review
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:28:40 -05:00
444caf8a78
NIFI-4731: BQ Processors and GCP library update.
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:27:41 -05:00
f6b171d5f7
NIFI-5833 This closes #3180 . Marked GetTwitter Consumer Key and Access Token processor properties as sensitive.
...
NIFI-5833 Added unit test to demonstrate arbitrary decryption of sensitive values regardless of processor property sensitive status.
NIFI-5833 Updated GetTwitter documentation with note about 1.9.0+ marking Consumer Key and Access Token as sensitive.
Signed-off-by: joewitt <joewitt@apache.org>
2018-11-21 10:02:25 -05:00
3c7012ffda
NIFI-5744: Put exception message to attribute while ExecuteSQL fail
...
This closes #3107 .
Signed-off-by: Peter Wicks <patricker@gmail.com>
2018-11-20 09:00:46 -07:00
7bcf9fcb5d
NIFI-5814: Addressed issue in DatabaseReader class that was attempting to set values on the JSON returned by MaxMind. Instead of modifying the object directly, we should use an Injectable in the Reader so that the value read will have the appropriate values but we don't need to modify those objects returned by MaxMind
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3168 .
2018-11-19 11:41:43 +01:00
54402a1ecd
NIFI-5828: Documents behavior of ExecuteSQL attrs when Max Rows Per Flow File is enabled
...
This closes #3177 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-19 14:18:31 +09:00
023f0c41ce
NIFI-5662 - Support for generic fixed when using decimal logical type
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3175 .
2018-11-17 16:36:04 +01:00
102a5288ef
NIFI-5823: Fixes typo in min idle connections property name
...
So many people missed it :-(
This closes #3172 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-16 11:16:55 +09:00
0207d0813e
NIFI-5604: Added property to allow empty FlowFile when no SQL generated by GenerateTableFetch
...
co-authored by: Peter Wicks <patricker@gmail.com>
Signed-off-by: Peter Wicks <patricker@gmail.com>
This closes #3075 .
2018-11-15 13:37:43 -07:00
75906226a6
NIFI-5780 Add pre and post statements to ExecuteSQL and ExecuteSQLRecord
...
Signed-off-by: Peter Wicks <patricker@gmail.com>
This closes #3156 .
2018-11-15 13:18:31 -07:00
be0949570a
NIFI-5824: Added unit test to FlowController to ensure that the ProcessScheduler that it creates is properly initialized. Also updated the properties file used by TestFlowController to use a VolatileContentRepository instead of FileSystemRepository, and fixed EventDrivenWorkerQueue to return if calls to poll() are interrupted (via Thread.interrupt) - making these minor fixes resulted in the unit test TestFlowController running in 2 seconds instead of 30+ seconds on my machine
...
This closes #3173 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-15 15:01:56 -05:00
76b0065a67
NIFI-5822: Ensure that we don't call FlowController.getControllerServiceProvider() before the ControllerServiceProvider has been initialized
...
This closes #3171 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-11-15 13:25:33 -05:00
d319a3ef2f
NIFI-5788: Introduce batch size limit in PutDatabaseRecord processor
...
NIFI-5788: Introduce batch size limit in PutDatabaseRecord processor
Renamed 'batch size' to 'Maximum Batch Size'.
Changed default value of max_batch_size to zero (INFINITE)
Fixed parameter validation.
Added unit tests
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3128
2018-11-15 10:31:34 -05:00
13011ac6d6
NIFI-5652: Fixed LogMessage when logging level is disabled
...
This closes #3170 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-15 15:14:57 +09:00
4112af013d
NIFI-4130 Add lookup controller service in TransformXML to define XSLT from the UI
...
addressed review comments
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #1953
2018-11-14 09:45:20 -05:00
9e7610ac70
NIFI-5815 - PutORC processor 'Restricted' still requires access to restricted components regardless of restriction
...
This closes #3169 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-14 13:50:00 +09:00
Matthew Burgess
zenfenan
Koji Kawamura
gkkorir
Pierre Villard
Mike Thomsen
Wil Selwood
Mark Payne
Bryan Bende
Kemix Koo
Dan Levy
Alexander Bukarev
Peter Wicks
luup2k
Kotaro Terada
Alex Savitsky
joewitt
Kumara M S Hemantha
Aaron Leon
Daniel Jimenez
Andy LoPresto
yjhyjhyjh0
Colin Dean
Colin Dean
vadimar