4361 Commits

Author SHA1 Message Date
Matt Gilman
6938e58c81 NIFI-5066:
- Allowing the enable/disable buttons to be active under the same conditions as the start/stop buttons.

This closes #2633.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-04-25 14:58:29 -04:00
zenfenan
72f8999b15 NIFI-5015: Implemented Azure Queue Storage processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2611.
2018-04-25 20:07:15 +02:00
zenfenan
c118e96238 NIFI-5000 - ListHDFS properly lists files from updated directory path
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2576.
2018-04-25 18:03:44 +02:00
joewitt
ac9944ccee
NIFI-5108 Updated all explicit refs and media nar usage of commons-compress to latest version and updated spring redis client
This closes #2651.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-04-24 15:16:04 -04:00
abhinavrohatgi30
e3f4720797
NIFI-4035 - Adding PutSolrRecord Processor that reads NiFi records and indexes them into Solr as SolrDocuments
Adding Test Cases for PutSolrRecord Processor

Adding PutSolrRecord Processor in the list of Processors

Resolving checkstyle errors

Resolving checkstyle errors in test classes

Adding License information and additional information about the processor

1. Implementing Batch Indexing 2. Changes for nested records 3. Removing MockRecordParser

Fixing bugs with nested records

Updating version of dependencies

Setting Expression Language Scope

This closes #2561.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-04-24 10:50:40 -04:00
patricker
0390c0f196 NIFI-4561 ExecuteSQL returns no FlowFile for some queries
This closes #2243

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-24 10:27:44 -04:00
Mike Thomsen
5ca6261de0 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2018-04-23 15:39:20 -04:00
Otto Fowler
45bc1f1b4f NIFI-3576 Support for QueryInfo relationship, can be used to track no-hits
Squashed commit includes related commit from GitHub user wietze.

This closes #2601

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-23 15:38:27 -04:00
Mark Payne
0e736f59fd NIFI-4185: Minor tweaks to XML Record Reader, around documentation and error handling
This closes #2587.
2018-04-23 14:41:17 -04:00
JohannesDaniel
d21bd3870b NIFI-4185: Add XML Record Reader 2018-04-23 14:39:18 -04:00
Koji Kawamura
8e4aa6bf22 NIFI-5075: Do not execute Funnels with no outgoing connections
- Added dedicated conditions for Funnels
- Fixed stale Javadoc
- Stopped caching hasNonLoopConnection variable
- Grouped some conditions to isSourceComponent variable for better
readability

This closes #2634.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-04-23 10:37:22 -04:00
Pierre Villard
2799211946 NIFI-5099 - Update flow differences when updating a connection
This closes #2649

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-23 07:08:00 -04:00
Matthew Burgess
ba32879ec8 NIFI-5082: Added support for custom Oracle timestamp types to Avro conversion
This closes #2638

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-22 19:59:48 -04:00
JohannesDaniel
8b6539e3c7 Added provenance reporting
This closes #2650

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-22 15:58:06 -04:00
Mark Payne
54eb6bc232
NIFI-5096: Periodically poll ZooKeeper to determine the leader for each registered role in Leader Election. This avoids a condition whereby a node may occasionally fail to receive notification that it is no longer the elected leader.
NIFI-5096: More proactively setting leadership to false when ZooKeeper/Curator ConnectionState changes

This closes #2646
2018-04-20 16:51:02 -04:00
Pierre Villard
262bf011e4 NIFI-5078 - added source/destination connection info in S2SStatusRT
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2632
2018-04-20 11:50:06 -04:00
Koji Kawamura
c575a98936 NIFI-5095: Suppress SET property parse failure at Hive processors
Log debug message when ParseException is thrown.

Log warning message if other unknown Exception is thrown.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2645
2018-04-20 11:24:02 -04:00
zenfenan
1dbfcb9445 NIFI-5062: Removed hbase-client dependecy from hbase bundle
This closes #2636

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-20 08:50:25 -04:00
Kevin Doran
fc902234b6 NIFI-4942 Fixes Travis CI build
- Fixes unit test salt assertion regex
- Adds RAT excludes and reenables console output for unapproved files

NIFI-4942 Temporarily disables tests that are failing on Linux

This closes #2648.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-04-20 05:15:47 +00:00
Alex Moundalexis
af12923da4 NIFI-5097 This closes #2647. add client-side HTTP redirect to error index.jsp
Existing web error index page suggests user may have meant /nifi/ and crafts a contextPath link, may as well redirect them automatically. Non-human (i.e. curl/wget) can still retrieve the original source without being redirected.

Signed-off-by: joewitt <joewitt@apache.org>
2018-04-19 15:01:33 -04:00
Matthew Burgess
090e748726 NIFI-4647: Fix support for strings in unions for ConvertAvroToORC
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2644.
2018-04-19 09:49:32 +02:00
JohannesDaniel
aa196bc01f NIFI-4516 Added QuerySolr after rebase
This closes #2517

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-18 17:47:04 -04:00
Joe Percivall
a0c9bebe24 NIFI-5085 In InvokeHttp, moving the OkHttp Response object to a try with resources 2018-04-18 13:18:30 -04:00
Matthew Burgess
6d804ee1fe
NIFI-5089: Exclude Maven progress output from Travis builds
This closes #2641.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-04-18 12:28:11 -04:00
Andy LoPresto
6d06defa63 NIFI-4942 [WIP] Added skeleton for secure hash handling in encrypt-config toolkit. Added test resource for Python scrypt implementation/verifier. Added unit tests.
NIFI-4942 [WIP] More unit tests passing.

NIFI-4942 All unit tests pass and test artifacts are cleaned up.

NIFI-4942 Added RAT exclusions.

NIFI-4942 Added Scrypt hash format checker. Added unit tests.

NIFI-4942 Added NiFi hash format checker. Added unit tests.

NIFI-4942 Added check for simultaneous use of -z/-y. Added logic to check hashed password/key. Added logic to retrieve secure hash from file to compare. Added unit tests (125/125).

NIFI-4942 Added new ExitCode. Added logic to return current hash params in JSON for Ambari to consume. Fixed typos in error messages. Added unit tests (129/129).

NIFI-4942 Added Scrypt hash format verification for hash check. Added unit tests.

NIFI-4942 Fixed RAT checks.

Signed-off-by: Yolanda Davis <ymdavis@apache.org>

This closes #2628
2018-04-13 18:25:09 -04:00
patricker
82ac815536 NIFI-1706: Extend QueryDatabaseTable to support arbitrary queries
- Only include Maximum Value columns in the type map.
- Squashed commits in the previous PR
- Rebased against the latest master
- Added stop method to GenerateTableFetch so that it refreshes the
column type map when it gets restarted
- Fixed whitespacing around if/for statement
- Updated expressionLanguageSupported value since it is not auto-merged
correctly

This closes #2618.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-04-13 16:30:13 +09:00
Matt Gilman
b7272e3f32 NIFI-4997:
- Fixing process group audit advice.
- Setting spring security user in background threads.
- Removing unnecessary overloaded methods.

This closes #2626.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-04-11 16:18:36 -04:00
Pierre Villard
6fbe1515ee NIFI-4809 - Implement a SiteToSiteMetricsReportingTask
Fixed dependency issue by providing a local JSON reader

Rebased + fixed conflict + updated versions in pom + EL scope

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2575
2018-04-11 14:44:30 -04:00
Andrew Lim
ce0855e988 NIFI-5074 Added section Variables in Versioned Flows to User Guide
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2627.
2018-04-11 18:53:07 +02:00
mans2singh
4366c67b27 NIFI-4927 - InfluxDB Query Processor
This closes #2562

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-11 06:58:07 -04:00
Koji Kawamura
b2fae5f56e NIFI-5065: HTTP Site-to-Site fails sending data more than 2GB at once
Int variables got overflown.

This closes #5065

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-10 16:08:11 -04:00
Mark Bean
274ed46d92 NIFI-5055 added ability to unpenalize MockFlowFile directly or from MockProcessSession
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-10 14:55:46 -04:00
Andrew Lim
eb3391f1d2 NIFI-5063 Added screenshots and supporting text for Primary Node processors
This closes #2624

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-04-10 13:34:18 -04:00
Andrew Lim
b6c052066a NIFI-4941 Updated nifi.sensitive.props.additional.keys description to refer to nifi.properties
This closes #2620

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-04-10 09:29:39 -04:00
Matthew Burgess
b29304df79 NIFI-4857: Support String<->byte[] conversion for records
This closes #2570.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-04-09 14:53:21 -04:00
Andrew Lim
5f16f48a27
NIFI-5042 Added section Restricted Components in Versioned Flows and edited related section in Adding Components to the Canvas
This closes #2610.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-04-09 09:53:22 -04:00
Matthew Burgess
ae1d3e3945 NIFI-4862: Keep incoming flowfile attributes in outgoing flowfiles from SelectHiveQL
This closes #2605.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-04-09 12:31:05 +09:00
joewitt
5013753119 NIFI-4995 update docker image and text info for next release 2018-04-06 17:03:18 -07:00
joewitt
59f625d3c2 Merge branch 'NIFI-4995-RC3' as part of NiFi 1.6.0 release process 2018-04-06 16:48:08 -07:00
Vi On
b414132324 NIFI-5050 update frontend-maven-plugin
This closes #2613

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-04-06 16:07:25 -04:00
Mike Thomsen
63d4bba5a4 NIFI-5047 Fixed a bug in PutMongo that prevented it from working if the mode is insert and the query/query key are not set.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2609.
2018-04-06 21:36:30 +02:00
Andrew Lim
8e10f0bd54 NIFI-5048 Corrected typo in KeytabCredentialsService controller service description
This closes #2612

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-04-06 15:17:03 -04:00
Pierre Villard
7cc77937d8 NIFI-4149 - fixed contrib-check errors 2018-04-06 20:38:04 +02:00
Mark Payne
644133dc35 NIFI-4149: Minor tweaks to verbiage
This closes #2205.
2018-04-06 12:42:38 -04:00
Pierre Villard
4c787799ff NIFI-4149 - Indicate if EL is evaluated against FFs or not
- take into account input requirement for documentation rendering
- Renamed variable registry scope and added comments
- Doc + change in mock framework to check scope + update of components + UI
2018-04-06 12:40:54 -04:00
Matthew Burgess
7ff38f690d
NIFI-5045: Fixed error code handling in PutHiveQL. This closes #2608 2018-04-05 16:03:42 -04:00
Marco Gaido
c119547222 NIFI-5043: TailFile in Multifile mode should not open new readers in onTrigger
This closes #2606.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-04-05 13:53:01 -04:00
Mike Moser
dc9b4cb516
NIFI-3599 Allow back pressure object count and data size to be configurable in nifi.properties. This closes #2497 2018-04-05 13:50:16 -04:00
Bryan Bende
7abb02fff0 NIFI-5027 Adding commands pg-get-services, pg-enable-services, and pg-disable-services
- Improving response when service is stuck enabling, and improving response when some services couldn't be enabled
- Throwing exception when a service is stuck enabling or can't be enabled so that standalone mode gets a non-zero status code, also allowing use of -verbose so stand-alone can decide if output is desired
- Improving information provided by pg-disable-services

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2604.
2018-04-04 23:26:24 +02:00
Koji Kawamura
1913b1e2a8
NIFI-4932: Enable S2S work behind a Reverse Proxy
Adding S2S endpoint Reverse Proxy mapping capability.
Added license header to SVG files.
Incorporated review comments.
Use regex to check property key processing.
Catch AttributeExpressionLanguageParsingException.
This closes #2510
2018-04-03 15:40:28 -04:00