Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-06 01:58:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,139 Commits 147 Branches 203 Tags
Commit Graph

3282 Commits

Author SHA1 Message Date
SavtechSolutions
f9f386b0f0 NIFI-5871 ignore UUID attribute when copying flow file attributes (#3203) 
NIFI-5871 ignore UUID attribute when copying flow file attributes

Signed-off-by: Peter Wicks <patricker@gmail.com>
 2018-12-20 10:05:25 -07:00
Pierre Villard
f22a6c46ad
Merge pull request #3219 from zenfenan/NIFI-5893 
NIFI-5893: AWS Endpoint Overriding now functions properly
 2018-12-19 10:50:05 +01:00
Pierre Villard
590fa2063c NIFI-4892 - ValidateCSV: no doublequote escaping in invalid output 
NIFI-4892 - ValidateCSV: no doublequote escaping in invalid output

NIFI-5907 - unit test

This closes #2481.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-19 11:20:55 +09:00
Pierre Villard
e9cb915ca9
Merge pull request #3225 from ijokarumawak/nifi-5905 
NIFI-5905 Secure S2S fails with NullPointerException
 2018-12-18 10:21:29 +01:00
Pierre Villard
c52f880cc1
Merge pull request #3224 from mattyb149/NIFI-5904 
NIFI-5904: Fix PutHive3Streaming handling of RecordReaderFactoryException
 2018-12-18 09:50:25 +01:00
Matthew Burgess
7548d7c859 NIFI-3988: Add fragment attributes to SplitRecord 
This closes #3217.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-18 15:07:43 +09:00
Koji Kawamura
4b70465ea5 NIFI-5905 Secure S2S fails with NullPointerException 
The constructor arguments should be set to instance variables so that
subsequent code can refer "this.*".
 2018-12-18 15:03:31 +09:00
Jeff Storck
cc47a8c0e1
NIFI-5748 Improved Proxy Header Support 
- Fixed proxy header support to use X-Forwarded-Host instead of X-ForwardedServer
- Added support for the context path header used by Traefik when proxying a service (X-Forwarded-Prefix)
- Added tests to ApplicationResourceTest for X-Forwarded-Context and X-Forwarded-Prefix
- Updated administration doc to include X-Forwarded-Prefix
- Added NIFI_WEB_PROXY_CONTEXT_PATH env var to dockerhub and dockermaven start.sh scripts
- Added documentation for NIFI_WEB_PROXY_CONTEXT_PATH to dockerhub README.md
- Updated ApplicationResource to handle a port specified in X-ProxyPort and X-Forwarded-Port headers

This closes #3129.

Signed-off-by: Kevin Doran <kdoran@apache.org>
 2018-12-17 17:32:06 -05:00
Matthew Burgess
d34789881b NIFI-5904: Fix PutHive3Streaming handling of RecordReaderFactoryException 2018-12-17 14:12:18 -05:00
zenfenan
10e29ee4d6 NIFI-5898: Updated the display name for ACCESS_KEY & SECRET_KEY 2018-12-16 17:05:52 +05:30
zenfenan
ee24a593e9 NIFI-5893: AWS Endpoint Overriding now functions properly 2018-12-15 19:37:31 +05:30
Koji Kawamura
0efddf47d5 NIFI-4579: Fix ValidateRecord type coercing 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2794
 2018-12-13 16:10:41 -05:00
gkkorir
c51512f5e3 NIFI-5891 fix handling of null logical types in Hive3Streaming processor 
NIFI-5891: Fixed Checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3216
 2018-12-13 10:23:18 -05:00
zenfenan
9a1ab4c504 NIFI-5621: Added Cassandra connection provider service 
NIFI-5621: Improvements on LICENSE & NOTICE files

This closes #3105

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-12-12 09:59:32 -05:00
Pierre Villard
85cc5aa9eb NIFI-5889 - changed the wording about Destination URL in S2S RTs 
This closes #3215.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-12 11:15:48 +09:00
Mark Payne
1ac5b93144
NIFI-5859: Added XML-based documentation writer that can be used to document a component. 
- Found several instances of nifi-framework-api's ProviderException being thrown from processors. Changed those to IllegalStateException, as ProviderException is not an appropriate Exception in those cases, and extensions should not depend on nifi-framework-api.
- Performed some cleanup, moving Property Descriptors from Controller Service API's/specs into the implementations. Adding to the Service API results in bringing in nifi-utils to the nifi-standard-services-api-nar, which is a bad practice. The 'main' service api nar should not have a dependency on a util class.

NIFI-5859: Added javadocs. Fixed pom.xml that was left pointing to snapshot version of nar maven plugin

NIFI-5859: Addressing review feedback: adding component type, multiple additional details into separate file(s)

This closes #3192.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-12-10 11:16:01 -05:00
Pierre Villard
a6f91a1975 NIFI-5872 - Added compression option to JsonRecordSetWriter 
This closes #3208.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-10 16:25:59 +09:00
Bryan Bende
60064a9f68 NIFI-5884 Bumping hbase-client version from 1.1.2 to 1.1.13 
This closes #3211.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-10 11:00:08 +09:00
Kemix Koo
e76c54234d NIFI-5881: Enable to export the template for non-ascii name 
This closes #3210.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-10 09:51:46 +09:00
Alexander Bukarev
84c32f9137
NIFI-5830 - RedisConnectionPoolService does not work with Standalone Redis using non-localhost deployment 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3176.
 2018-12-06 23:31:25 +01:00
Bryan Bende
f1e03b5ed5
NIFI-5877 Protecting against null values when obtaining master address 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3206.
 2018-12-06 22:03:23 +01:00
Mark Payne
72ea93a657
NIFI-5868: Added instrumentation around ListFile such that all disk accesses are timed and any unusually long listing times or disk access operations can be logged. Additionally, information is logged at a debug level including significant amounts of troubleshooting information when configured to do so 
This closes #3202.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-12-05 13:01:14 -05:00
Koji Kawamura
8ebb4d1974
NIFI-5863 Fixed AbstractFlowFileQueue logging 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3199.
 2018-12-05 11:29:50 +01:00
Peter Wicks
6c1c9017e9 NIFI-5862 MockRecordParser Has Bad Logic for failAfterN 
This closes #3195.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-05 10:09:31 +09:00
Pierre Villard
986a2a4842 NIFI-5838 - Improve the schema validation method in Kite processors 
review

Add empty check

This closes #3182.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-12-05 09:53:52 +09:00
luup2k
cc9f89b003
NIFI-5795 RedisDistributedMapCacheClientService put missing option 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3135.
 2018-12-03 10:37:47 +01:00
zenfenan
7df537aeca
NIFI-5850: Replaced custom AWS regions enum with the one from AWS Java SDK 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3190. This closes #3187.
 2018-12-02 13:09:21 +01:00
Matthew Burgess
8a12307d1a
NIFI-5855: Remove unnecessary ORDER BY clause in GenerateTableFetch when Partition Size is zero 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3191.
 2018-11-30 10:54:23 +01:00
Kotaro Terada
72662f0b2c
NIFI-5846: Redirect URL is incorrect after logout 
This closes #3185.

Signed-off-by: Peter Wicks <patricker@gmail.com>
 2018-11-29 08:16:39 -07:00
Koji Kawamura
30f2f42051
NIFI-5849: ListXXX can lose cluster state on processor restart 
NIFI-5406 introduced the issue by trying to use the resetState variable for
different purposes. AbstractListProcessor should have had a different variable
to control whether to clear state for tracking entity strategy.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3189.
 2018-11-29 10:31:35 +01:00
Matthew Burgess
68a49cfad0 NIFI-5845: Add support for OTHER and SQLXML JDBC types to SQL/Hive processors 
NIFI-5845: Incorporated review comments

This closes #3184.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-29 09:50:21 +09:00
Alex Savitsky
98cdb50cc0 NIFI-5843 added subjects to the error message when neither script body nor script text are provided 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3186
 2018-11-28 11:13:17 -05:00
Matthew Burgess
455e3c1bc8 NIFI-5834: Restore default PutHiveQL error handling behavior 
NIFI-5834: Incorporated review comments

This closes #3179.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-27 18:10:26 +09:00
Mike Thomsen
e603c486f4 NIFI-5333 Added GetMongoRecord. 
Signed-off-by: zenfenan <zenfenan@apache.org>

This closes #3011
 2018-11-23 15:01:45 +05:30
zenfenan
e34d653ba1
NIFI-5812: Marked Database processors as PrimaryNodeOnly 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3167.
 2018-11-22 09:33:01 +01:00
joewitt
2a4745c077
NIFI-5836 This closes #3181. changed the brittle timing based tests to integration tests 2018-11-21 13:11:06 -05:00
Kumara M S Hemantha
71499f774d
NIFI-5560 This closes #3000. Added Follow SYMLINK support for listFTP & listSFTP and getFTP & getSFTP processors 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:53:38 -05:00
Aaron Leon
286a1c880a
NIFI-4260 This closes #3166. Add avro-ipc dependency to hadoop-libraries to support Flume avro source 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:49:22 -05:00
Pierre Villard
03ef646547
NIFI-4731 This closes #3019. This closes #2682. This closes #2420. 
NIFI-4933 BigQuery PR Review

Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:28:40 -05:00
Daniel Jimenez
444caf8a78
NIFI-4731: BQ Processors and GCP library update. 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:27:41 -05:00
Andy LoPresto
f6b171d5f7
NIFI-5833 This closes #3180. Marked GetTwitter Consumer Key and Access Token processor properties as sensitive. 
NIFI-5833 Added unit test to demonstrate arbitrary decryption of sensitive values regardless of processor property sensitive status.
NIFI-5833 Updated GetTwitter documentation with note about 1.9.0+ marking Consumer Key and Access Token as sensitive.

Signed-off-by: joewitt <joewitt@apache.org>
 2018-11-21 10:02:25 -05:00
yjhyjhyjh0
3c7012ffda
NIFI-5744: Put exception message to attribute while ExecuteSQL fail 
This closes #3107.

Signed-off-by: Peter Wicks <patricker@gmail.com>
 2018-11-20 09:00:46 -07:00
Mark Payne
7bcf9fcb5d NIFI-5814: Addressed issue in DatabaseReader class that was attempting to set values on the JSON returned by MaxMind. Instead of modifying the object directly, we should use an Injectable in the Reader so that the value read will have the appropriate values but we don't need to modify those objects returned by MaxMind 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3168.
 2018-11-19 11:41:43 +01:00
Colin Dean
54402a1ecd NIFI-5828: Documents behavior of ExecuteSQL attrs when Max Rows Per Flow File is enabled 
This closes #3177.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-19 14:18:31 +09:00
gkkorir
023f0c41ce NIFI-5662 - Support for generic fixed when using decimal logical type 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3175.
 2018-11-17 16:36:04 +01:00
Colin Dean
102a5288ef NIFI-5823: Fixes typo in min idle connections property name 
So many people missed it :-(

This closes #3172.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-11-16 11:16:55 +09:00
Matthew Burgess
0207d0813e
NIFI-5604: Added property to allow empty FlowFile when no SQL generated by GenerateTableFetch 
co-authored by: Peter Wicks <patricker@gmail.com>
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3075.
 2018-11-15 13:37:43 -07:00
yjhyjhyjh0
75906226a6
NIFI-5780 Add pre and post statements to ExecuteSQL and ExecuteSQLRecord 
Signed-off-by: Peter Wicks <patricker@gmail.com>

This closes #3156.
 2018-11-15 13:18:31 -07:00
Mark Payne
be0949570a
NIFI-5824: Added unit test to FlowController to ensure that the ProcessScheduler that it creates is properly initialized. Also updated the properties file used by TestFlowController to use a VolatileContentRepository instead of FileSystemRepository, and fixed EventDrivenWorkerQueue to return if calls to poll() are interrupted (via Thread.interrupt) - making these minor fixes resulted in the unit test TestFlowController running in 2 seconds instead of 30+ seconds on my machine 
This closes #3173.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-15 15:01:56 -05:00
Mark Payne
76b0065a67
NIFI-5822: Ensure that we don't call FlowController.getControllerServiceProvider() before the ControllerServiceProvider has been initialized 
This closes #3171.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-11-15 13:25:33 -05:00