Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,924 Commits 146 Branches 200 Tags 402 MiB
Commit Graph

1390 Commits

Author SHA1 Message Date
Mark Payne 09568d092b NIFI-2836: 
- Ensure that we wait until a request is completed before unlocking the lock for request replication
- Ensure that failures do not trigger request completion logic unless the failure is the last node to report its status
- This closes #1109
 2016-10-06 16:41:05 -04:00
Matt Gilman bb6c5d9d4e NIFI-2777: 
NIFI-2856:
- Only performing response merging when the node is the cluster cooridinator even if there is a single response.
- Fixing PropertyDescriptor merging to ensure the 'choosen' descriptor is included in map of all responses.

This closes #1095.
 2016-10-06 16:19:19 -04:00
Mark Payne b9cb6b1b47
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-06 15:51:16 -04:00
Bryan Bende a4ed622152
Revert "NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged" 
This reverts commit 92cca96d49.
 2016-10-06 15:19:00 -04:00
Andrew Lim 53f7a21663 NIFI-2691 Replaced references to kerberos/spegno principle with principal in nifi.properties and admin guide 
This closes: #1105

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-07 01:22:49 +11:00
Mark Payne 92cca96d49
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged 
This closes #1097.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-06 10:05:51 -04:00
Scott Aslan 8bd85e2085 [NIFI-1792] Clear the selected rule id when deleting the last rule in the list. Add scrollable styles when appropriate. Close popups when appropriate. This PR also adjusts the position of the table cell nfel and long text editors. This closes #1099. 2016-10-06 09:51:05 -04:00
Matt Gilman 3c673972e0 NIFI-2816: 
- Fixing compilation error resulting from the initial NIFI-2816 commit.
 2016-10-06 09:29:59 -04:00
Pierre Villard 3c8545a902 NIFI-1912 - PutEmail fixed format when attachment 
Correction as suggested by users in JIRA.
+ adding a unit test to check attachments.

This closes: #1081

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-06 21:34:56 +11:00
Scott Aslan 6ad633d174 [NIFI-2838] update width of rule name and save message. This closes #1089 2016-10-05 16:40:06 -04:00
mans2singh da33e2859c NIFI-2398 - GetIgnite processor 
This closes #721.
 2016-10-05 22:31:01 +02:00
Scott Aslan e46fea920a [NIFI-1794] Update .dialog-content to wrap text. This closes #1094 2016-10-05 16:15:11 -04:00
Scott Aslan c764f83506 [NIFI-1904] If open, close hamburger menu on window resize. This closes #1106 2016-10-05 14:23:13 -04:00
Andre F de Miranda 3b408f5601 NIFI-2816 - Clean typos across the code - Part 2. This closes #1085 2016-10-05 13:07:57 -04:00
Matt Burgess f157076378
NIFI-2828: Fix Hive NAR dependencies 
NIFI-2828: Added dependency on hadoop-client to Hive NAR

This closes #1075.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-05 11:37:05 -04:00
Pierre Villard 75d0c74d27 NIFI-1840 Added compression type property in Kite processors 
This closes #409
 2016-10-06 00:20:52 +11:00
Byunghwa Yun 2c907c63af NIFI-2858: 
- getSystemLoadAverage of OperatingSystemMXBean sometimes returns a negative value.
- ProcessorLoadAverage sets -1.0. It added a defensive logic.
- When load average is zero(load average: 0.00, 0.02, 0.04), systemLoad is zero.
- This closes #1091
 2016-10-05 08:59:26 -04:00
Scott Aslan 44cc7e0072 [NIFI-2864] Update when shell empties content. This closes #1096 2016-10-05 08:14:15 -04:00
Koji Kawamura 17a36c6fd5
NIFI-2825: Fix S2S getPeers flow file count 
- Added ClusterWorkload message to retrieve workload information from a
  cluster coordinator
- Use cluster workload to return queued flow file count to site-to-site
  client so that it can calculate distribution of data transfer

This closes #1084.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-03 13:28:01 -04:00
Joe N 34e5a5321a NIFI-2826 Adding enqueue time to GetAzureEventHub processor 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-10-03 10:41:33 -04:00
Andre F de Miranda bec7dbbad6 NIFI-2709 - Refactor ConsumeIMAP and ConsumePOP3 to generate RFC2822 
compliant flowfiles

NIFI-2709 - refactor ConsumePOP/ConsumeIMAP jUnit

            tests now use the greenmail mock email server

            This closes: #1083
 2016-10-04 01:35:34 +11:00
Andre F de Miranda 25b7dfa9b1 NIFI-1971 - Introduce QueryWhois processor with batching (i.e. netcat protocol) support 
This closes #858.
 2016-10-01 18:38:58 +02:00
Pierre Villard d6867283b5 NIFI-2832 State management should be part of the documentation/usage. This closes #1074 2016-09-30 09:59:35 -04:00
Scott Aslan e230e50f9d [NIFI-1851] correctly display number of total process groups upon refresh. This closes #1079 2016-09-29 13:25:19 -04:00
Scott Aslan 1a24f5f34c [NIFI-2831] update auto terminate messages. This closes #1077 2016-09-29 13:09:29 -04:00
Scott Aslan 12e3315ae9 [NIFI-2833] Increase font size and line height for small dialogs. This closes #1078 2016-09-29 11:57:04 -04:00
Matt Gilman 833ec4409c NIFI-2758: - Updating move verification to account for Controller Service moving out of scope. 
This closes #1064

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-28 15:01:38 -04:00
d810146 cfc738ec19 NIFI-2763: S3 processors do not work with older S3-compatible object stores 
This closes #1076.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-09-28 10:32:11 -07:00
Bryan Bende d4948a3778 NIFI-1768 Adding TLS/SSL support to Solr processors NIFI-1980 Added a default value for PutSolrContentStream commitWithIn NIFI-2568 Added Kerberos support to Solr processors 
Upgrading SolrJ to 6.2.

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1005
 2016-09-28 13:14:57 -04:00
Scott Aslan c4826cac54 [NIFI-1757] remove iframe from shell dialog to prevent reoccurring requests, update fill color and label config dialog content margins to fit into their respective dialogs. This closes #1069 2016-09-27 15:38:10 -04:00
Scott Aslan d674cdfc79 [NIFI-2775] update Provenance table GoTo button visibility in FF. This closes #1040 2016-09-27 15:08:11 -04:00
Matt Gilman dd9ecc2907 NIFI-2824: - Updating replication logic to account for the potential replication target and then invoking the corresponding action. 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1068
 2016-09-27 11:44:21 -04:00
James Wing 508b218b59 NIFI-2795 Sys Diagnostics in Cluster UI 
- Cleaning up tab resize loop
- Pre-authorizing sys diagnostics api calls
- Addressing issues filtering the tables in the cluster table.
- Addressing issues sorting the tables in the cluster page.
 2016-09-27 10:58:01 -04:00
Byunghwa Yun 28acb07433 NIFI-2811 JdbcCommon doesn't convert bigint(20) column. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1053
 2016-09-27 10:18:48 -04:00
Yolanda M. Davis 30f008d676 NIFI-2822 - pass the JWT Authorization token i. This closes #1065 2016-09-26 15:16:32 -04:00
Byunghwa Yun 8868235993 NIFI-2803 The pagination of GenerateTableFetch has a sort bug. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2803: Updated unit tests for GenerateTableFetch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1052
 2016-09-26 12:05:16 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code 
This closes #1057.
 2016-09-26 17:47:31 +02:00
Matt Gilman 1b88552b46 NIFI-2796: 
- Fixing incorrect documentation for the cluster summary endpoint.

This closes #1063.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-09-26 11:43:33 -04:00
Pierre Villard 44d4b882bf NIFI-2071 - Support repeating capture groups in ExtractText 
This closes #1050.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-26 17:22:21 +09:00
Mike Moser 85a1f753a7 NIFI-2787 truncate flowfile attributes that get indexed to fit within Lucene limits 
Signed-off-by: Joe Skora <jskora@apache.org>

This closes #1043
 2016-09-23 16:01:23 -04:00
Scott Aslan 25150d4016 [NIFI-2788] update global hamburger menu to have fixed width icons and align text. This closes #1041 2016-09-23 14:35:38 -04:00
Matt Burgess 66fe004058 NIFI-2815: Fixed InvokeScriptedProcessor to allow changes to script engine type 
This closes #1055.
 2016-09-23 19:30:51 +02:00
Mike Moser 5a3d00c7bb NIFI-2636 resolve thread safety problem in UnpackContent 
Signed-off-by: Joe Skora <jskora@apache.org>
 2016-09-23 13:25:03 -04:00
Edgardo b34de74db2 NIFI-2810 Allow Content Type to be set in PutS3Object processor 
This closes #1034.
 2016-09-23 17:12:30 +02:00
Scott Aslan f06aeaee2a [NIFI-2720] update view configuration properties tables dialogs to match editable configuration properties dialogs 
This closes #1051.
 2016-09-23 15:46:53 +02:00
Matt Burgess 49297b725d NIFI-2805: Add fragment attributes to SplitAvro 
This closes #1046.
 2016-09-22 21:46:23 +02:00
Joe Gresock 937dc71aec NIFI-2417: Addressing code review comments 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-09-22 15:00:06 -04:00
Joe Gresock 00412f6e97 NIFI-2417: Adding Query and Scroll processors for Elasticsearch 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-09-22 15:00:06 -04:00
Scott Aslan e973874793 [NIFI-2781] removing bower and allowing npm to manage client side resources in nifi-web-ui and nifi-jolt-transform-json-ui. This closes #1030 2016-09-22 14:50:21 -04:00
Matt Gilman 0218bc61ef
NIFI-1870: - Restoring the upstream/downstream connections dialog. - Correcting input port label when showing downstream components. 
This closes #1028.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-22 11:32:19 -04:00
Bartosz Wozniak f11682202b NIFI-1893 Add processor for validating JSON 
This closes #1037.
 2016-09-22 13:08:34 +02:00
Byunghwa Yun 77f8503e98 NIFI-2802 The implementation classes don't support orderByClause. 
This closes #1044.
 2016-09-22 12:21:43 +02:00
Matt Gilman 5198e70d14
NIFI-2707: - Ensuring that connections are always sorted accordingly to their zIndex. This preserves the 'bring to front' settings. 
This closes #1023.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 17:20:44 -04:00
Matt Gilman b304f70f3e
NIFI-2785: - Ensure the URL is updated when uploading a template to ensure it's going to the appropriate Process Group. 
This closes #1029.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 14:40:10 -04:00
Nicolas Dupont be83c0c5b2 NIFI-1844 - Added ListFTP and FetchFTP processors 
This closes #881.
 2016-09-21 17:40:38 +02:00
Peter Wicks 938c7cccb8 NIFI-2749 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #997
 2016-09-21 11:16:57 -04:00
Aldrin Piri fda15d916d Removing reference to removed lineage identifier header for ExecuteFlumeSink additional details. 
THis closes #1039
 2016-09-21 10:36:24 -04:00
Matt Gilman e10b4beb90
NIFI-2797: - Correcting download URIs for OTPs. 
This closes #1038.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 10:33:39 -04:00
Matt Gilman 684f417406 NIFI-2792 - Ensuring the flow is saved when a template is deleted. 
This closes #1031.
 2016-09-21 16:31:40 +02:00
Pierre Villard 930e95aa00 NIFI-1170 - Improved TailFile processor to support multiple files tailing 
This closes #980
 2016-09-21 10:05:39 -04:00
Matt Burgess 68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types 
This closes #1035.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-20 15:33:06 -04:00
Toivo Adams 4fc0e9c407 nifi-2381 Connection Pooling Service -Drop invalid connections and create new ones. 
This closes #986.
 2016-09-20 18:21:42 +02:00
Oleg Zhurakousky b693a4a561 NIFI-2789, NIFI-2790 - polishing 
This closes #1027
 2016-09-20 09:32:43 -04:00
Joey Frazee c238676058 NIFI-2789, NIFI-2790 - Read JMS properties and add to FlowFile attributes in ConsumeJMS 
Remove unused assertEquals import

Move destination from default to send/receive to support EL better
 2016-09-20 09:30:14 -04:00
Koji Kawamura feaa4c9db8
NIFI-2757: Site-to-Site with DN mapping 
Added DN identity mapping pattern support to Site-to-Site client
authorization.

This closes #1010.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-19 12:56:54 -04:00
Pierre Villard d838f61291 NIFI-1942 Processor to validate CSV against user-supplied schema 
This closes #476

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-16 11:13:07 -04:00
Andy LoPresto 022f5a506d NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1. 
This closes #999.
 2016-09-16 00:08:08 +02:00
Matt Gilman abcfbeb062 NIFI-2771: 
- Using GzipHandler instead of GzipFilter.

This closes #1020
 2016-09-15 10:27:39 -04:00
Pierre Villard c1ad913598 NIFI-1342 Added default User-Agent in PostHttp 
This closes #1021
 2016-09-15 09:57:09 -04:00
Peter Wicks 8a28395e9f NIFI-2754 
- Migrating swap to active prior to swapping if necessary.
- This closes #1000.
 2016-09-14 14:27:50 -04:00
Yolanda M. Davis 67a47dbead NIFI-2251 
- Initial commit for client side provenance lineage svg download.
- css styling adjustments, changes for svg replace
- Addressing some style/spacing.
- This closes #982.
 2016-09-14 14:23:46 -04:00
Koji Kawamura bc005e3398
NIFI-2772: Unsecure RAW Site-to-Site fails with User DN is not known 
This closes #1019.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-14 10:39:11 -04:00
Matt Gilman 36846e0fe7
NIFI-2719: - Caching components recently added/removed in case ajax requests are received out of order. This is not an issue for modifications of existing components as we're able to leverage the revision. 
This closes #1011.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-14 10:33:10 -04:00
Joe Skora c72a9aa54b NIFI-2752 Correct ReplaceText default pattern and unit tests 
* Corrected the DEFAULT_REGEX pattern.
 * Added tests to isolate regex capture group problem and verify corrected functionality.
 * Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.

This closes #1007.
 2016-09-13 22:55:55 +02:00
Scott Aslan 02ca2a0d78 [NIFI-2770] fix action details dialog 
This closes #1017.
 2016-09-13 22:17:37 +02:00
Matt Gilman 5dd743947c
NIFI-2768: - Ensuring we correctly enforce authorization when the destination of a connection changes. This includes source, destination, and parent process group. - Ensuring the UI reseting accordingly when a request fails. 
This closes #1014.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 11:41:51 -04:00
Matt Burgess 6c9291ad53
NIFI-2765: Fixed Kerberos support for PutHiveStreaming 
This closes #1012.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 11:13:06 -04:00
Matt Gilman b48355e75a
NIFI-2766: - Ensuring the root group is included in /resources. 
This closes #1013.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 10:59:26 -04:00
Matt Burgess d325773760 NIFI-2262: Added Avro-normalization of table/column names in SQL processors 
This closes #994.
 2016-09-13 15:46:33 +02:00
Bryan Bende 9ff5c0b25f
NIFI-2760 Specifying jersey-bundle 1.19 for Ranger plugin 
This closes #1006.
 2016-09-12 14:18:11 -04:00
Kirk Tarou e25885650a NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor 
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT

Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile

Signed-off-by: Joe Skora <jskora@gmail.com>

This closes #931.
 2016-09-09 22:44:23 -04:00
Scott Aslan abaacfa5e5 [NIFI-2721] update CS GoTo. This closes #998 2016-09-09 12:31:46 -04:00
Koji Kawamura ae251c1a6f NIFI-2718: Show HTTP S2S Auth error on bulletin 
This commit fixes following two issues, that happens when a Root Group Port
policy for S2S data transfer is removed at a remote NiFi, after a client NiFi has
connected to that port:

1. At client side, Remote Process Group should show that authorization
is failing on its bulletin, but the Exception is caught and
ignored. Nothing is shown on the UI with HTTP transport protocol.
RAW S2S shows error on RPG bulletin. This commit fixes HTTP S2S to
behave the same.

2. At server side, corresponding input-port or output-port should show
that it is accessed by an unauthorized client on its bulletin, but it's
not shown with HTTP transport protocol.
RAW S2S shows warning messages for this. This commit fixes HTTP S2S to
behave the same.

In order to fix the 2nd issue above, request authorization at
DataTransferResource is changed from using DataTransferAuthorizable
directly, to call RootGroupPort.checkUserAuthorization().

Because the blettin is tied to the Port instance and it's
difficult to produce blettin message from this resource.

Since RootGroupPort.checkUserAuthorization uses
DataTransferAuthorizable inside, the check logic stays the same as
before.

Adding a RootGroupPortAuthorizable to provide access to necessary components for performing the authorization.

This closes #996
 2016-09-08 13:43:38 -04:00
Mark Payne bc7c42efa5
NIFI-1966: Recreated issue that is outlined in JIRA (the reason for re-opening the ticket) that results in 'java.util.NoSuchElementException: No value present' in unit test - Resolved issue where two flows that are both empty but have different fingerprints (due to root group id being different) causes vote election to fail 
This closes #995.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-08 10:48:24 -04:00
Oleg Zhurakousky d36b76cc60 NIFI-2745 added _source destination name_ attribute to ConsumeJMS 
This closes #992
 2016-09-07 15:28:34 -04:00
Mark Payne 938e32ed97 NIFI-2746: Ensure that the FlowController is injected into all ResourceApplications. This closes #993 2016-09-07 14:11:46 -04:00
vijayk 80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-07 12:06:01 -04:00
Mark Payne 8d6e12fdc4 NIFI-2739: Call KafkaConsumer.wakeup() if consumer is blocking for at least 30 seconds when OnUnscheduled is called 2016-09-07 08:56:23 -04:00
Matt Burgess 2afc739ab7 NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976 2016-09-06 16:52:40 -04:00
Mark Payne a7e76cc00a NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977 2016-09-06 16:31:37 -04:00
joewitt 7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call 
This closes #987.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-06 15:48:40 -04:00
Mark Payne 088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers. 
This closes #958.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-06 12:25:28 -04:00
Mark Payne a9d029d74e NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side 
This closes #978

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-06 10:57:53 +09:00
Joe Gresock 0e64c3ed30 NIFI-2631: Adding page commits and 'Use Versions' to ListS3 
This closes #916 and closes #917.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-09-03 16:04:42 -07:00
Jeff Storck 97e2f406da NIFI-2708 Added merging of SiteToSite details 
NIFI-2708 Updated to include ports from clientDto for port merging.

This closes #981
 2016-09-02 14:55:08 -04:00
Matt Gilman d37480eaff NIFI-2722: 
- Updating the component entity as long as the proposed entity is not older than the current one since stats are bundled in the entity too.

This closes #983

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-02 22:25:25 +09:00
Scott Aslan 867c84f32c [NIFI-2649] Update CS table upon creation of a CS from the RT or CS properties table 
- Ensuring the controller services table to correctly reloaded regardless if its the processor group or controller level controller services. This closes #968
 2016-09-01 09:53:12 -04:00
Matt Gilman 96a766464c
NIFI-2678: - Ensuring the most recent version of each component is save for rendering on the canvas. 
This closes #979.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-31 15:59:52 -04:00
Matt Gilman 9e10371c8a NIFI-2704: 
- Re-using the DataTransferAuthorizable in the DataTransferResource.
- Removing use of the DataTransferResource when obtaining site to site details as it performs additional unnecessary checks.
- Code clean up.
- This closes #971.
 2016-08-31 15:09:17 -04:00
Yolanda M. Davis 1bb909ebca NIFI-2703 - Added bootstrap.conf file for running integration tests. This closes #975 2016-08-31 09:28:08 -04:00