Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,339 Commits 143 Branches 197 Tags 390 MiB
Commit Graph

45 Commits

Author SHA1 Message Date
Jeff Storck a61f353051
NIFI-3520 Updated nifi-hdfs-processors POM to depend directly on hadoop-client 
- Removed NAR dependency on nifi-hadoop-libraries-nar from nifi-hadoop-nar so that hadoop-client dependencies will be included directly in nifi-hadoop-nar
- Added RequiresInstanceClassLoading annotation to AbstractHadoopProcessor and HiveConnectionPool
- UGI relogins are now performed using doAs
- Added debug-level logging for UGI relogins in KerberosTicketRenewer and AbstractHadoopProcessor

This closes #1539.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-03-13 12:21:49 -04:00
Bryan Rosander cd8eb775e6 NIFI-3574 - PutHiveStreaming UGI fixes 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1578
 2017-03-10 10:50:52 -05:00
Bryan Rosander cfe899d189 NIFI-3530 - Ensuring configuration and ugi information is passed down to Hive in PutHiveStreaming 
NIFI-3530 - closing renewer in PutHiveStreaming.cleanup(), making npe less likely in HiveWriter.toString()

This closes #1544
 2017-02-27 15:01:59 -05:00
Aldrin Piri 76fcf5def1 NIFI-3385 - This closes #1440. Updating copyright statements to reflect the new year. 2017-02-16 00:10:02 -05:00
Ben Schofield d5b139ffd4 NIFI-3418 Add records-per-transaction property to putHiveStreaming processor 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1455

Minor whitespace Checkstyle issue fixed
 2017-01-30 11:46:42 -05:00
David W. Streever bbc714e73b PutHiveQL and SelectHiveQL Processor enhancements. Added support for multiple statements in a script. Options for delimiters, quotes, escaping, include header and alternate header. 
Add support in SelectHiveQL to get script content from the Flow File to bring consistency with patterns used for PutHiveQL and support extra query management.

Changed behavior of using Flowfile to match ExecuteSQL.  Handle query delimiter when embedded.  Added test case for embedded delimiter

Formatting and License Header

PutHiveQL and SelectHiveQL Processor enhancements. Added support for multiple statements in a script.  Options for delimiters, quotes, escaping, include header and alternate header.

Add support in SelectHiveQL to get script content from the Flow File to bring consistency with patterns used for PutHiveQL and support extra query management.

Changed behavior of using Flowfile to match ExecuteSQL.  Handle query delimiter when embedded.  Added test case for embedded delimiter

Removing dead code.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Comments to Clarify test case.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Final whitespace/formatting/typo changes

This closes #1316
 2017-01-18 14:47:31 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Burgess eb5abf809d
NIFI-2927: Added Validation Query to HiveConnectionPool 
This closes #1252.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-21 14:21:22 -05:00
Matt Burgess 435d9cf353 NIFI-2991 This closes #1194. Exclude org.json dependency from Hive bundle 2016-11-10 08:33:43 -05:00
Mark Payne c441a8696d NIFI-2850 This closes #1115. Added a migrate() method to ProcessSession and refactored BinFiles and MergeContent to use it 2016-11-09 16:25:03 -05:00
Matt Burgess f5f132b1ab NIFI-2828: Fixed issue with transitive Hadoop dependencies in Hive NAR 
This closes #1146
 2016-10-20 14:56:01 -04:00
Matt Burgess b52b839895 NIFI-2897: Fixed SelectHiveQL for CSV output of complex types 
This closes #1132
 2016-10-14 12:35:38 -04:00
d810146 e969a5ffe3 NIFI-2873: Nifi throws UnknownHostException with HA NameNode 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2873: Changed test hive-site.xml to use local FS, fixed Checkstyle violations

This closes #1113
 2016-10-14 09:23:19 -04:00
Andre F de Miranda 3b408f5601 NIFI-2816 - Clean typos across the code - Part 2. This closes #1085 2016-10-05 13:07:57 -04:00
Matt Burgess f157076378
NIFI-2828: Fix Hive NAR dependencies 
NIFI-2828: Added dependency on hadoop-client to Hive NAR

This closes #1075.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-05 11:37:05 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code 
This closes #1057.
 2016-09-26 17:47:31 +02:00
Matt Burgess 6c9291ad53
NIFI-2765: Fixed Kerberos support for PutHiveStreaming 
This closes #1012.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 11:13:06 -04:00
vijayk 80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-07 12:06:01 -04:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
Matt Burgess 5d1a4f343f
NIFI-2622: Added support for complex types in SelectHiveQL 
This closes #922.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-23 15:52:16 -04:00
Matt Burgess fbec3b9c13
NIFI-2623: Fixed support for binary types in SelectHiveQL 
This closes #920.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-23 11:43:46 -04:00
Matt Burgess 46b81058c7 NIFI-2602: Fixed NPE in SelectHiveQL when CSV output and null column value 
This closes #898.
 2016-08-19 09:56:26 +02:00
Matt Burgess 6874a5d82d NIFI-2593: This closes #891. Fixed handling of nested records/structs in ConvertAvroToORC 2016-08-18 15:15:51 -04:00
Matt Burgess a74bc2c7c7 NIFI-2598: This closes #889. Fixed issue with static init of properties in HiveConnectionPool 2016-08-18 13:38:22 -04:00
Bryan Bende e0e4b3407a NIFI-2574 This clsoes #887. Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables 2016-08-18 12:19:46 -04:00
joewitt d9633757a6 NIFI-2574 fix spring context definitions 2016-08-17 03:38:31 -07:00
joewitt 7d7401add4 NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it. 2016-08-17 00:10:07 -07:00
Matt Burgess 03d3b3961d NIFI-2577: Increased default stripe size in ConvertAvroToORC to 64MB 
This closes #870.
 2016-08-16 11:53:05 +02:00
Matt Burgess ed42f2e3e3 NIFI-2552: Updated Curator for HiveQL processors using Zookeeper quorum in URL 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #865
 2016-08-15 16:53:57 -04:00
Matt Burgess 2938a5353a NIFI-1663: Adding attribution for derived work for OrcFlowFileWriter 2016-08-10 14:51:05 -04:00
Matt Burgess d9720239f5 NIFI-1663: Add ConvertAvroToORC processor 
This closes #727
 2016-08-10 12:37:15 -04:00
Bryan Rosander 2dc094765d NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5 
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12

This closes #809.
 2016-08-09 22:43:29 +02:00
Matt Burgess 7575e87cb1 NIFI-2520 This closes #818. Added attribution for storm-hive and other Hive dependencies to NOTICEs 2016-08-09 15:27:24 -04:00
Matt Burgess 3943d72e95
NIFI-1868: Incorporate PutHiveStreaming review comments 
This closes #706.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-04 10:05:56 -04:00
Matt Burgess 59659232c7
NIFI-1868: Downgrade to Hive 1.2.1 and remove ConvertAvroToORC 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-04 10:05:45 -04:00
Matt Burgess c2019b9339
NIFI-1868: Add PutHiveStreaming processor 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-04 10:05:44 -04:00
Matt Burgess b213ed95e0 NIFI-2422: Fix SelectHiveQL handling of Number types 
This closes #744.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-07-29 15:38:32 -04:00
Bryan Bende c27763a12f NIFI-1733 Initial commit for nifi-ranger-bundle 
- Adding Authorizer implementation for Ranger
- Adding build profile and assembly that controls the inclusion of Ranger in the final assembly
- Add properties to specify ranger admin identity and a flag to indicate if ranger is using kerberos, plugin is updated to perform a UGI login if ranger is using kerberos
- Adding LICENSE and NOTICE for Ranger NAR, and some other licensing clean up
- Adding tests for kerberos properties, adding test for RangerBasePluginWithPolicies, cleaning up code to use Java 8 features

This closes #574
 2016-07-26 10:15:22 -04:00
joewitt f987b21609 NIFI-1157 searched for and resolved all remaining references to deprecated items that were clearly addressable. 2016-07-14 09:32:35 -04:00
Matt Burgess d6391652e0 NIFI-1663: Add ConvertAvroToORC processor 
- Code review changes
 - This closes #477.
 2016-06-29 12:18:27 -04:00
Aldrin Piri 1bd2cf0d09 NIFI-1811 Renaming MockProcessorLogger to MockComponentLogger for consistency. Removing unused imports from ExecuteScript causing checkstyle failures. 2016-05-19 14:38:41 -04:00
Matt Burgess 106b0fa0fc NIFI-981: Added SelectHiveQL and PutHiveQL processors 
This closes #410.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-05-03 13:51:38 -04:00