Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,205 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

3205 Commits

Author SHA1 Message Date
Joe Gresock 937dc71aec NIFI-2417: Addressing code review comments 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-09-22 15:00:06 -04:00
Joe Gresock 00412f6e97 NIFI-2417: Adding Query and Scroll processors for Elasticsearch 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-09-22 15:00:06 -04:00
Scott Aslan e973874793 [NIFI-2781] removing bower and allowing npm to manage client side resources in nifi-web-ui and nifi-jolt-transform-json-ui. This closes #1030 2016-09-22 14:50:21 -04:00
Matt Gilman 0218bc61ef
NIFI-1870: - Restoring the upstream/downstream connections dialog. - Correcting input port label when showing downstream components. 
This closes #1028.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-22 11:32:19 -04:00
Bartosz Wozniak f11682202b NIFI-1893 Add processor for validating JSON 
This closes #1037.
 2016-09-22 13:08:34 +02:00
Byunghwa Yun 77f8503e98 NIFI-2802 The implementation classes don't support orderByClause. 
This closes #1044.
 2016-09-22 12:21:43 +02:00
Matt Gilman 5198e70d14
NIFI-2707: - Ensuring that connections are always sorted accordingly to their zIndex. This preserves the 'bring to front' settings. 
This closes #1023.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 17:20:44 -04:00
Matt Gilman b304f70f3e
NIFI-2785: - Ensure the URL is updated when uploading a template to ensure it's going to the appropriate Process Group. 
This closes #1029.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 14:40:10 -04:00
Nicolas Dupont be83c0c5b2 NIFI-1844 - Added ListFTP and FetchFTP processors 
This closes #881.
 2016-09-21 17:40:38 +02:00
Peter Wicks 938c7cccb8 NIFI-2749 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #997
 2016-09-21 11:16:57 -04:00
Aldrin Piri fda15d916d Removing reference to removed lineage identifier header for ExecuteFlumeSink additional details. 
THis closes #1039
 2016-09-21 10:36:24 -04:00
Matt Gilman e10b4beb90
NIFI-2797: - Correcting download URIs for OTPs. 
This closes #1038.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 10:33:39 -04:00
Matt Gilman 684f417406 NIFI-2792 - Ensuring the flow is saved when a template is deleted. 
This closes #1031.
 2016-09-21 16:31:40 +02:00
Pierre Villard 930e95aa00 NIFI-1170 - Improved TailFile processor to support multiple files tailing 
This closes #980
 2016-09-21 10:05:39 -04:00
Matt Burgess 68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types 
This closes #1035.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-20 15:33:06 -04:00
Andre F de Miranda 52fa50cdeb NIFI-2728 - Improve travis-ci build settings. This closes #985. 
Improvemens:

            * Adjusts Xmx value
            * run mvn in quiet mode to prevent issues scrolling build
              logs on travis-ci and appveyor
            * add $HOME/.m2 to travis cache
            * add $HOME/.npm to travis cache
            * split compilation (multi threaded) from checkstyle:check
              (single threaded) following @mcgilman comment (travis)
 2016-09-20 13:46:23 -04:00
Toivo Adams 4fc0e9c407 nifi-2381 Connection Pooling Service -Drop invalid connections and create new ones. 
This closes #986.
 2016-09-20 18:21:42 +02:00
Toivo Adams ad3d63d204 nifi-1214d Mock Framework should allow order-independent assumptions on FlowFiles. 
This closes #1033

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-20 10:25:36 -04:00
Oleg Zhurakousky b693a4a561 NIFI-2789, NIFI-2790 - polishing 
This closes #1027
 2016-09-20 09:32:43 -04:00
Joey Frazee c238676058 NIFI-2789, NIFI-2790 - Read JMS properties and add to FlowFile attributes in ConsumeJMS 
Remove unused assertEquals import

Move destination from default to send/receive to support EL better
 2016-09-20 09:30:14 -04:00
Koji Kawamura feaa4c9db8
NIFI-2757: Site-to-Site with DN mapping 
Added DN identity mapping pattern support to Site-to-Site client
authorization.

This closes #1010.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-19 12:56:54 -04:00
Pierre Villard d838f61291 NIFI-1942 Processor to validate CSV against user-supplied schema 
This closes #476

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-16 11:13:07 -04:00
Andy LoPresto 022f5a506d NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1. 
This closes #999.
 2016-09-16 00:08:08 +02:00
Matt Gilman abcfbeb062 NIFI-2771: 
- Using GzipHandler instead of GzipFilter.

This closes #1020
 2016-09-15 10:27:39 -04:00
Andre F de Miranda aa933a1941 NIFI-2755 - Fixes minor typo in Developers Guide 
This closes #1003
 2016-09-15 10:12:04 -04:00
Pierre Villard c1ad913598 NIFI-1342 Added default User-Agent in PostHttp 
This closes #1021
 2016-09-15 09:57:09 -04:00
Peter Wicks 8a28395e9f NIFI-2754 
- Migrating swap to active prior to swapping if necessary.
- This closes #1000.
 2016-09-14 14:27:50 -04:00
Yolanda M. Davis 67a47dbead NIFI-2251 
- Initial commit for client side provenance lineage svg download.
- css styling adjustments, changes for svg replace
- Addressing some style/spacing.
- This closes #982.
 2016-09-14 14:23:46 -04:00
Koji Kawamura bc005e3398
NIFI-2772: Unsecure RAW Site-to-Site fails with User DN is not known 
This closes #1019.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-14 10:39:11 -04:00
Matt Gilman 36846e0fe7
NIFI-2719: - Caching components recently added/removed in case ajax requests are received out of order. This is not an issue for modifications of existing components as we're able to leverage the revision. 
This closes #1011.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-14 10:33:10 -04:00
Joe Skora c72a9aa54b NIFI-2752 Correct ReplaceText default pattern and unit tests 
* Corrected the DEFAULT_REGEX pattern.
 * Added tests to isolate regex capture group problem and verify corrected functionality.
 * Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.

This closes #1007.
 2016-09-13 22:55:55 +02:00
Scott Aslan 02ca2a0d78 [NIFI-2770] fix action details dialog 
This closes #1017.
 2016-09-13 22:17:37 +02:00
Matt Gilman 5dd743947c
NIFI-2768: - Ensuring we correctly enforce authorization when the destination of a connection changes. This includes source, destination, and parent process group. - Ensuring the UI reseting accordingly when a request fails. 
This closes #1014.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 11:41:51 -04:00
Matt Burgess 6c9291ad53
NIFI-2765: Fixed Kerberos support for PutHiveStreaming 
This closes #1012.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 11:13:06 -04:00
Matt Gilman b48355e75a
NIFI-2766: - Ensuring the root group is included in /resources. 
This closes #1013.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 10:59:26 -04:00
Matt Burgess d325773760 NIFI-2262: Added Avro-normalization of table/column names in SQL processors 
This closes #994.
 2016-09-13 15:46:33 +02:00
Bryan Bende 9ff5c0b25f
NIFI-2760 Specifying jersey-bundle 1.19 for Ranger plugin 
This closes #1006.
 2016-09-12 14:18:11 -04:00
Kirk Tarou e25885650a NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor 
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT

Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile

Signed-off-by: Joe Skora <jskora@gmail.com>

This closes #931.
 2016-09-09 22:44:23 -04:00
Scott Aslan abaacfa5e5 [NIFI-2721] update CS GoTo. This closes #998 2016-09-09 12:31:46 -04:00
Koji Kawamura ae251c1a6f NIFI-2718: Show HTTP S2S Auth error on bulletin 
This commit fixes following two issues, that happens when a Root Group Port
policy for S2S data transfer is removed at a remote NiFi, after a client NiFi has
connected to that port:

1. At client side, Remote Process Group should show that authorization
is failing on its bulletin, but the Exception is caught and
ignored. Nothing is shown on the UI with HTTP transport protocol.
RAW S2S shows error on RPG bulletin. This commit fixes HTTP S2S to
behave the same.

2. At server side, corresponding input-port or output-port should show
that it is accessed by an unauthorized client on its bulletin, but it's
not shown with HTTP transport protocol.
RAW S2S shows warning messages for this. This commit fixes HTTP S2S to
behave the same.

In order to fix the 2nd issue above, request authorization at
DataTransferResource is changed from using DataTransferAuthorizable
directly, to call RootGroupPort.checkUserAuthorization().

Because the blettin is tied to the Port instance and it's
difficult to produce blettin message from this resource.

Since RootGroupPort.checkUserAuthorization uses
DataTransferAuthorizable inside, the check logic stays the same as
before.

Adding a RootGroupPortAuthorizable to provide access to necessary components for performing the authorization.

This closes #996
 2016-09-08 13:43:38 -04:00
Mark Payne bc7c42efa5
NIFI-1966: Recreated issue that is outlined in JIRA (the reason for re-opening the ticket) that results in 'java.util.NoSuchElementException: No value present' in unit test - Resolved issue where two flows that are both empty but have different fingerprints (due to root group id being different) causes vote election to fail 
This closes #995.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-08 10:48:24 -04:00
Oleg Zhurakousky d36b76cc60 NIFI-2745 added _source destination name_ attribute to ConsumeJMS 
This closes #992
 2016-09-07 15:28:34 -04:00
Mark Payne 938e32ed97 NIFI-2746: Ensure that the FlowController is injected into all ResourceApplications. This closes #993 2016-09-07 14:11:46 -04:00
vijayk 80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-07 12:06:01 -04:00
Mark Payne 8d6e12fdc4 NIFI-2739: Call KafkaConsumer.wakeup() if consumer is blocking for at least 30 seconds when OnUnscheduled is called 2016-09-07 08:56:23 -04:00
Matt Burgess 2afc739ab7 NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976 2016-09-06 16:52:40 -04:00
Mark Payne a7e76cc00a NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977 2016-09-06 16:31:37 -04:00
joewitt 7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call 
This closes #987.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-06 15:48:40 -04:00
Mark Payne 088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers. 
This closes #958.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-06 12:25:28 -04:00
Mark Payne a9d029d74e NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side 
This closes #978

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-06 10:57:53 +09:00