Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,169 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

1584 Commits

Author SHA1 Message Date
Matt Burgess 892c74dff2 NIFI-2819: Added support for Expresssion Language in ModifyBytes 
This closes #1130
 2016-11-02 13:02:25 -04:00
Scott Aslan 05ea76dd6f [NIFI-2888] Display processor fill color when zoomed in/out. This closes #1151. 2016-11-02 12:54:58 -04:00
Andrew Lim 5f9cae97b7 NIFI-2883 Renamed directories holding ConsumeKafka_0_10 and PublishKafka_0_10 additional details 
This closes #1170
 2016-11-02 12:29:09 -04:00
Pierre Villard 7fbc23639a NIFI-2956 - GetHDFS - fixed directly path evaluation 2016-11-02 12:15:26 -04:00
simplesteph 56da2b51e1 [NIFI-2900] transformed all datetime fields to string as they don't comply with ISO norms. This closes #1136. 2016-11-02 09:39:48 -04:00
Mark Payne e1f0ba5a43
NIFI-2925: When swapping in FlowFiles, do not assume that its Resource Claim is 'in use' but instead look up the canonical representation of the resource claim 
This closes #1150.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-31 09:59:06 -04:00
Oleg Zhurakousky 7fd2c42b19 NIFI-2879,NIFI-2880 This closes #1120. fixed NarThreadContextClassLoader instantiation error handling 2016-10-28 12:15:12 -04:00
Koji Kawamura 9e90aae066 NIFI-2936: Fix TestExecuteProcess error on Travis. 
This closes #1162.
 2016-10-28 10:35:37 +02:00
Matt Gilman 8dc60c72d4
NIFI-2884: - Adding support to selecting multiple users before updating a policy. 
NIFI-2533: - Only including a user/group in the search results if they are not currently selected.
NIFI-2286: - Providing a tooltip for the add user and remove policy button.

This closes #1155.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-27 11:50:46 -04:00
jpercivall 1d74b5d3ce NIFI-2791 Adding 'math' expression language function 
This closes #1157.
 2016-10-25 19:45:38 +02:00
Michal Klempa 368ea7a2d2 NIFI-1069 Removing the exit directive 
This closes #1159

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-10-25 12:44:19 -04:00
jpercivall e4a3e09643 NIFI-1662 Adding proper UI regex support for decimals in EL 
This closes #1018
 2016-10-24 10:31:16 -04:00
Andre F de Miranda 9b08f23b24
NIFI-1531 - Remove bogus .gitignore files from sub directories 
This closes #1154.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-10-23 10:29:09 -04:00
Scott Aslan 6676e94a7c [NIFI-2929] remove canvas element names when zoomed out and view permissions are removed. This closes #1152 2016-10-21 16:11:27 -04:00
Andre F de Miranda b864d49f66 NIFI-2341 - Introduce ParseCEF processor 
This closes #785
 2016-10-20 17:16:57 -04:00
Matt Burgess f5f132b1ab NIFI-2828: Fixed issue with transitive Hadoop dependencies in Hive NAR 
This closes #1146
 2016-10-20 14:56:01 -04:00
Matt Gilman af27e4070b NIFI-2843: - Removing the View Configuration menu item from the context menu on Process Groups. 
This closes #1087

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-10-20 12:45:37 -04:00
Michal Klempa 99d3c39748 NIFI-1069 - improve init script exit codes so that results are LSB compliant 
This closes: #1093

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-20 23:12:23 +11:00
Oleg Zhurakousky 611cadd231
NIFI-2919 Improved GetFile processor to fail (and provide bulletins) if target directory is inaccessible. 
This closes #1147.

Signed-off-by: Andy LoPresto <alopresto@apache.org>

Fixed typos in error messages, renamed variables in test, and cleaned up unnecessary imports. (+1 squashed commit)
Squashed commits:
[e755cbd] NIFI-2919 improved GetFile to fail if target directory is inaccessible
 2016-10-19 16:33:33 -04:00
Scott Aslan a8e1c775fd [NIFI-1459] add css translate3d to properties table editors in order to move the element along the z-axis of the 3D space and allow the scrollbars to properly be poistioned. This closes #1070 2016-10-19 15:39:58 -04:00
Andre F de Miranda 3914141c45
NIFI-1710 - Resolve path name to nifi.sh script 
This closes #1137.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 16:43:03 -07:00
Koji Kawamura 27dba60f27
NIFI-2905: Log error stream of ExecuteProcess cmd 
ExecuteProcess ignores error stream when Redirect Error Stream is
false, this commit let it to be logged instead so that user can see it on
bulletin.

This closes #1143.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 15:56:27 -07:00
Scott Aslan f287bc9119
[NIFI-2913] update z-index of codemirror resize handle to match the z-index of the codemirror vert. and horz. scrollbars 
This closes #1145.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 15:24:18 -07:00
Oleg Zhurakousky 5afbc43364 NIFI-2500 This closes #1131. made container queue configurable 2016-10-18 14:47:49 -04:00
Scott Aslan 9fb3039416 [NIFI-2898] Add Processor dialog processor descriptions now scrollable 
This closes #1134.
 2016-10-17 23:07:39 +02:00
James Wing b9a940bbd1 NIFI-2902 Fix for S3 Signer v4 Override 
This closes #1140.
 2016-10-17 22:51:45 +02:00
Oleg Zhurakousky c883f98cbf NIFI-2906 removed unused memebr variables 
This closes #1144.
 2016-10-17 22:32:23 +02:00
Matt Burgess 596b98865b NIFI-2894: Fixed typo in PutSQL documentation 
This closes #1129
 2016-10-14 12:45:34 -04:00
Matt Burgess b52b839895 NIFI-2897: Fixed SelectHiveQL for CSV output of complex types 
This closes #1132
 2016-10-14 12:35:38 -04:00
Michal Klempa 88d125137e NIFI-2199 - allows nifi.sh restart through ssh 
Closes: #1092

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-15 00:48:04 +11:00
d810146 e969a5ffe3 NIFI-2873: Nifi throws UnknownHostException with HA NameNode 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2873: Changed test hive-site.xml to use local FS, fixed Checkstyle violations

This closes #1113
 2016-10-14 09:23:19 -04:00
Edgardo 7107616420 NIFI-2872 Create PutCloudWatchMetric Processor 
This closes #1125.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-13 19:53:53 -07:00
Stephane Maarek 33ba1a822e
NIFI-2899 Updated swagger-maven-plugin to 3.0.1 
Incorporates the fix from https://github.com/kongchen/swagger-maven-plugin/issues/141
Ensures the new swagger.json is spec 2.0 compliant, see https://github.com/swagger-api/swagger-codegen/issues/3976

This closes #1135.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-13 17:21:11 -07:00
Pierre Villard 26f46538b3 NIFI-766: 
- Improved connection UI display when backpressure is enabled
- Updating the connection label to include backpressure indicators for object count and data size thresholds.
- Coloring the connection path and drop shadow once backpressure is engaged.
- Fixing bug with expiration icon tooltip.
- Including columns in the summary table for backpressure.
- Updating empty queue action to reload the connection status upon completion to ensure an updated count.

This closes #1080.
 2016-10-13 12:14:16 -04:00
Koji Kawamura c470fae065 NIFI-2863: S2S to allow cluster URL more leniently. This closes #1122 
- Consolidated the target cluster URL resolving logic into
  SiteToSiteRestApiClient's as a common method
- Changed to more descriptive error message
- Added more unit test cases
 2016-10-13 09:50:50 -04:00
Keren Tseytlin 6dc2f14198 NIFI-2799 AWS Assume Role Credentials With Proxy 
This closes #1112.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-12 17:19:13 -07:00
Andrew Lim 979b4d8ab9
NIFI-2801 Edited Kafka processor documentation to explicitly state which Kafka versions supported by each processor 
This closes #1119.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-12 10:35:45 -07:00
Peter Mitchell 893fed794c Add Stateful annotation to scripting processors 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2682: Added text to Stateful description for AbstractScriptProcessor
 2016-10-12 13:20:37 -04:00
Matt Gilman a25b651da9
NIFI-2837: - Immediately hiding the template dialog after clicking the Upload button to prevent an accidental re-submission. 
This closes #1086.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-12 09:18:58 -04:00
mans2singh af27179322 Nifi-1540 - AWS Kinesis Streams put processor 
This closes #239.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-11 20:21:29 -07:00
Joey Frazee 6d5f4777c5 Fixed HL7 segment index bug for order control codes, more testing 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

Added NOTICE entries for test data and fixed checkstyle violations

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1123
 2016-10-11 14:57:40 -04:00
Oleg Zhurakousky ee14ae8af0 NIFI-2774 added configurable QoS options to ConsumeJMS 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1036.
 2016-10-11 10:32:00 -04:00
Matt Gilman 4a4c87fa15
NIFI-2849: 
- Showing process group name when possible.
- Providing a link to jump to the process group defined in the effective policy.
- Preventing editing an inherited policy.
- When overriding a policy, allowing the user to indicate if the policy should be empty or should copy the user/groups of the inherited policy.

This closes #1090.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-11 00:06:09 -07:00
Koji Kawamura 540ef63efa NIFI-2855: Site-to-Site with port forwarding. 
- Added following properties:
  - nifi.web.http.port.forwarding
  - nifi.web.https.port.forwarding

This closes #1100.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-10-07 15:00:37 +09:00
Mark Payne 09568d092b NIFI-2836: 
- Ensure that we wait until a request is completed before unlocking the lock for request replication
- Ensure that failures do not trigger request completion logic unless the failure is the last node to report its status
- This closes #1109
 2016-10-06 16:41:05 -04:00
Matt Gilman bb6c5d9d4e NIFI-2777: 
NIFI-2856:
- Only performing response merging when the node is the cluster cooridinator even if there is a single response.
- Fixing PropertyDescriptor merging to ensure the 'choosen' descriptor is included in map of all responses.

This closes #1095.
 2016-10-06 16:19:19 -04:00
Mark Payne b9cb6b1b47
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-06 15:51:16 -04:00
Bryan Bende a4ed622152
Revert "NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged" 
This reverts commit 92cca96d49.
 2016-10-06 15:19:00 -04:00
Andrew Lim 53f7a21663 NIFI-2691 Replaced references to kerberos/spegno principle with principal in nifi.properties and admin guide 
This closes: #1105

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-07 01:22:49 +11:00
Mark Payne 92cca96d49
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged 
This closes #1097.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-06 10:05:51 -04:00
Scott Aslan 8bd85e2085 [NIFI-1792] Clear the selected rule id when deleting the last rule in the list. Add scrollable styles when appropriate. Close popups when appropriate. This PR also adjusts the position of the table cell nfel and long text editors. This closes #1099. 2016-10-06 09:51:05 -04:00
Matt Gilman 3c673972e0 NIFI-2816: 
- Fixing compilation error resulting from the initial NIFI-2816 commit.
 2016-10-06 09:29:59 -04:00
Pierre Villard 3c8545a902 NIFI-1912 - PutEmail fixed format when attachment 
Correction as suggested by users in JIRA.
+ adding a unit test to check attachments.

This closes: #1081

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-06 21:34:56 +11:00
Scott Aslan 6ad633d174 [NIFI-2838] update width of rule name and save message. This closes #1089 2016-10-05 16:40:06 -04:00
mans2singh da33e2859c NIFI-2398 - GetIgnite processor 
This closes #721.
 2016-10-05 22:31:01 +02:00
Scott Aslan e46fea920a [NIFI-1794] Update .dialog-content to wrap text. This closes #1094 2016-10-05 16:15:11 -04:00
Scott Aslan c764f83506 [NIFI-1904] If open, close hamburger menu on window resize. This closes #1106 2016-10-05 14:23:13 -04:00
Andre F de Miranda 3b408f5601 NIFI-2816 - Clean typos across the code - Part 2. This closes #1085 2016-10-05 13:07:57 -04:00
Matt Burgess f157076378
NIFI-2828: Fix Hive NAR dependencies 
NIFI-2828: Added dependency on hadoop-client to Hive NAR

This closes #1075.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-05 11:37:05 -04:00
Pierre Villard 75d0c74d27 NIFI-1840 Added compression type property in Kite processors 
This closes #409
 2016-10-06 00:20:52 +11:00
Byunghwa Yun 2c907c63af NIFI-2858: 
- getSystemLoadAverage of OperatingSystemMXBean sometimes returns a negative value.
- ProcessorLoadAverage sets -1.0. It added a defensive logic.
- When load average is zero(load average: 0.00, 0.02, 0.04), systemLoad is zero.
- This closes #1091
 2016-10-05 08:59:26 -04:00
Scott Aslan 44cc7e0072 [NIFI-2864] Update when shell empties content. This closes #1096 2016-10-05 08:14:15 -04:00
Koji Kawamura 17a36c6fd5
NIFI-2825: Fix S2S getPeers flow file count 
- Added ClusterWorkload message to retrieve workload information from a
  cluster coordinator
- Use cluster workload to return queued flow file count to site-to-site
  client so that it can calculate distribution of data transfer

This closes #1084.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-03 13:28:01 -04:00
Joe N 34e5a5321a NIFI-2826 Adding enqueue time to GetAzureEventHub processor 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-10-03 10:41:33 -04:00
Andre F de Miranda bec7dbbad6 NIFI-2709 - Refactor ConsumeIMAP and ConsumePOP3 to generate RFC2822 
compliant flowfiles

NIFI-2709 - refactor ConsumePOP/ConsumeIMAP jUnit

            tests now use the greenmail mock email server

            This closes: #1083
 2016-10-04 01:35:34 +11:00
Andre F de Miranda 25b7dfa9b1 NIFI-1971 - Introduce QueryWhois processor with batching (i.e. netcat protocol) support 
This closes #858.
 2016-10-01 18:38:58 +02:00
Pierre Villard d6867283b5 NIFI-2832 State management should be part of the documentation/usage. This closes #1074 2016-09-30 09:59:35 -04:00
Scott Aslan e230e50f9d [NIFI-1851] correctly display number of total process groups upon refresh. This closes #1079 2016-09-29 13:25:19 -04:00
Scott Aslan 1a24f5f34c [NIFI-2831] update auto terminate messages. This closes #1077 2016-09-29 13:09:29 -04:00
Scott Aslan 12e3315ae9 [NIFI-2833] Increase font size and line height for small dialogs. This closes #1078 2016-09-29 11:57:04 -04:00
Matt Gilman 833ec4409c NIFI-2758: - Updating move verification to account for Controller Service moving out of scope. 
This closes #1064

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-28 15:01:38 -04:00
d810146 cfc738ec19 NIFI-2763: S3 processors do not work with older S3-compatible object stores 
This closes #1076.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-09-28 10:32:11 -07:00
Bryan Bende d4948a3778 NIFI-1768 Adding TLS/SSL support to Solr processors NIFI-1980 Added a default value for PutSolrContentStream commitWithIn NIFI-2568 Added Kerberos support to Solr processors 
Upgrading SolrJ to 6.2.

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1005
 2016-09-28 13:14:57 -04:00
Scott Aslan c4826cac54 [NIFI-1757] remove iframe from shell dialog to prevent reoccurring requests, update fill color and label config dialog content margins to fit into their respective dialogs. This closes #1069 2016-09-27 15:38:10 -04:00
Scott Aslan d674cdfc79 [NIFI-2775] update Provenance table GoTo button visibility in FF. This closes #1040 2016-09-27 15:08:11 -04:00
Matt Gilman dd9ecc2907 NIFI-2824: - Updating replication logic to account for the potential replication target and then invoking the corresponding action. 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1068
 2016-09-27 11:44:21 -04:00
James Wing 508b218b59 NIFI-2795 Sys Diagnostics in Cluster UI 
- Cleaning up tab resize loop
- Pre-authorizing sys diagnostics api calls
- Addressing issues filtering the tables in the cluster table.
- Addressing issues sorting the tables in the cluster page.
 2016-09-27 10:58:01 -04:00
Byunghwa Yun 28acb07433 NIFI-2811 JdbcCommon doesn't convert bigint(20) column. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1053
 2016-09-27 10:18:48 -04:00
Yolanda M. Davis 30f008d676 NIFI-2822 - pass the JWT Authorization token i. This closes #1065 2016-09-26 15:16:32 -04:00
Byunghwa Yun 8868235993 NIFI-2803 The pagination of GenerateTableFetch has a sort bug. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2803: Updated unit tests for GenerateTableFetch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1052
 2016-09-26 12:05:16 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code 
This closes #1057.
 2016-09-26 17:47:31 +02:00
Matt Gilman 1b88552b46 NIFI-2796: 
- Fixing incorrect documentation for the cluster summary endpoint.

This closes #1063.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-09-26 11:43:33 -04:00
Pierre Villard 44d4b882bf NIFI-2071 - Support repeating capture groups in ExtractText 
This closes #1050.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-26 17:22:21 +09:00
Mike Moser 85a1f753a7 NIFI-2787 truncate flowfile attributes that get indexed to fit within Lucene limits 
Signed-off-by: Joe Skora <jskora@apache.org>

This closes #1043
 2016-09-23 16:01:23 -04:00
Scott Aslan 25150d4016 [NIFI-2788] update global hamburger menu to have fixed width icons and align text. This closes #1041 2016-09-23 14:35:38 -04:00
Matt Burgess 66fe004058 NIFI-2815: Fixed InvokeScriptedProcessor to allow changes to script engine type 
This closes #1055.
 2016-09-23 19:30:51 +02:00
Mike Moser 5a3d00c7bb NIFI-2636 resolve thread safety problem in UnpackContent 
Signed-off-by: Joe Skora <jskora@apache.org>
 2016-09-23 13:25:03 -04:00
Edgardo b34de74db2 NIFI-2810 Allow Content Type to be set in PutS3Object processor 
This closes #1034.
 2016-09-23 17:12:30 +02:00
Scott Aslan f06aeaee2a [NIFI-2720] update view configuration properties tables dialogs to match editable configuration properties dialogs 
This closes #1051.
 2016-09-23 15:46:53 +02:00
Matt Burgess 49297b725d NIFI-2805: Add fragment attributes to SplitAvro 
This closes #1046.
 2016-09-22 21:46:23 +02:00
Joe Gresock 937dc71aec NIFI-2417: Addressing code review comments 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-09-22 15:00:06 -04:00
Joe Gresock 00412f6e97 NIFI-2417: Adding Query and Scroll processors for Elasticsearch 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-09-22 15:00:06 -04:00
Scott Aslan e973874793 [NIFI-2781] removing bower and allowing npm to manage client side resources in nifi-web-ui and nifi-jolt-transform-json-ui. This closes #1030 2016-09-22 14:50:21 -04:00
Matt Gilman 0218bc61ef
NIFI-1870: - Restoring the upstream/downstream connections dialog. - Correcting input port label when showing downstream components. 
This closes #1028.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-22 11:32:19 -04:00
Bartosz Wozniak f11682202b NIFI-1893 Add processor for validating JSON 
This closes #1037.
 2016-09-22 13:08:34 +02:00
Byunghwa Yun 77f8503e98 NIFI-2802 The implementation classes don't support orderByClause. 
This closes #1044.
 2016-09-22 12:21:43 +02:00
Matt Gilman 5198e70d14
NIFI-2707: - Ensuring that connections are always sorted accordingly to their zIndex. This preserves the 'bring to front' settings. 
This closes #1023.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 17:20:44 -04:00
Matt Gilman b304f70f3e
NIFI-2785: - Ensure the URL is updated when uploading a template to ensure it's going to the appropriate Process Group. 
This closes #1029.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 14:40:10 -04:00
Nicolas Dupont be83c0c5b2 NIFI-1844 - Added ListFTP and FetchFTP processors 
This closes #881.
 2016-09-21 17:40:38 +02:00
Peter Wicks 938c7cccb8 NIFI-2749 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #997
 2016-09-21 11:16:57 -04:00
Aldrin Piri fda15d916d Removing reference to removed lineage identifier header for ExecuteFlumeSink additional details. 
THis closes #1039
 2016-09-21 10:36:24 -04:00
Matt Gilman e10b4beb90
NIFI-2797: - Correcting download URIs for OTPs. 
This closes #1038.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-21 10:33:39 -04:00
Matt Gilman 684f417406 NIFI-2792 - Ensuring the flow is saved when a template is deleted. 
This closes #1031.
 2016-09-21 16:31:40 +02:00
Pierre Villard 930e95aa00 NIFI-1170 - Improved TailFile processor to support multiple files tailing 
This closes #980
 2016-09-21 10:05:39 -04:00
Matt Burgess 68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types 
This closes #1035.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-20 15:33:06 -04:00
Toivo Adams 4fc0e9c407 nifi-2381 Connection Pooling Service -Drop invalid connections and create new ones. 
This closes #986.
 2016-09-20 18:21:42 +02:00
Oleg Zhurakousky b693a4a561 NIFI-2789, NIFI-2790 - polishing 
This closes #1027
 2016-09-20 09:32:43 -04:00
Joey Frazee c238676058 NIFI-2789, NIFI-2790 - Read JMS properties and add to FlowFile attributes in ConsumeJMS 
Remove unused assertEquals import

Move destination from default to send/receive to support EL better
 2016-09-20 09:30:14 -04:00
Koji Kawamura feaa4c9db8
NIFI-2757: Site-to-Site with DN mapping 
Added DN identity mapping pattern support to Site-to-Site client
authorization.

This closes #1010.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-19 12:56:54 -04:00
Pierre Villard d838f61291 NIFI-1942 Processor to validate CSV against user-supplied schema 
This closes #476

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-16 11:13:07 -04:00
Andy LoPresto 022f5a506d NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1. 
This closes #999.
 2016-09-16 00:08:08 +02:00
Matt Gilman abcfbeb062 NIFI-2771: 
- Using GzipHandler instead of GzipFilter.

This closes #1020
 2016-09-15 10:27:39 -04:00
Pierre Villard c1ad913598 NIFI-1342 Added default User-Agent in PostHttp 
This closes #1021
 2016-09-15 09:57:09 -04:00
Peter Wicks 8a28395e9f NIFI-2754 
- Migrating swap to active prior to swapping if necessary.
- This closes #1000.
 2016-09-14 14:27:50 -04:00
Yolanda M. Davis 67a47dbead NIFI-2251 
- Initial commit for client side provenance lineage svg download.
- css styling adjustments, changes for svg replace
- Addressing some style/spacing.
- This closes #982.
 2016-09-14 14:23:46 -04:00
Koji Kawamura bc005e3398
NIFI-2772: Unsecure RAW Site-to-Site fails with User DN is not known 
This closes #1019.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-14 10:39:11 -04:00
Matt Gilman 36846e0fe7
NIFI-2719: - Caching components recently added/removed in case ajax requests are received out of order. This is not an issue for modifications of existing components as we're able to leverage the revision. 
This closes #1011.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-14 10:33:10 -04:00
Joe Skora c72a9aa54b NIFI-2752 Correct ReplaceText default pattern and unit tests 
* Corrected the DEFAULT_REGEX pattern.
 * Added tests to isolate regex capture group problem and verify corrected functionality.
 * Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.

This closes #1007.
 2016-09-13 22:55:55 +02:00
Scott Aslan 02ca2a0d78 [NIFI-2770] fix action details dialog 
This closes #1017.
 2016-09-13 22:17:37 +02:00
Matt Gilman 5dd743947c
NIFI-2768: - Ensuring we correctly enforce authorization when the destination of a connection changes. This includes source, destination, and parent process group. - Ensuring the UI reseting accordingly when a request fails. 
This closes #1014.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 11:41:51 -04:00
Matt Burgess 6c9291ad53
NIFI-2765: Fixed Kerberos support for PutHiveStreaming 
This closes #1012.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 11:13:06 -04:00
Matt Gilman b48355e75a
NIFI-2766: - Ensuring the root group is included in /resources. 
This closes #1013.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-13 10:59:26 -04:00
Matt Burgess d325773760 NIFI-2262: Added Avro-normalization of table/column names in SQL processors 
This closes #994.
 2016-09-13 15:46:33 +02:00
Bryan Bende 9ff5c0b25f
NIFI-2760 Specifying jersey-bundle 1.19 for Ranger plugin 
This closes #1006.
 2016-09-12 14:18:11 -04:00
Kirk Tarou e25885650a NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor 
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT

Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile

Signed-off-by: Joe Skora <jskora@gmail.com>

This closes #931.
 2016-09-09 22:44:23 -04:00
Scott Aslan abaacfa5e5 [NIFI-2721] update CS GoTo. This closes #998 2016-09-09 12:31:46 -04:00
Koji Kawamura ae251c1a6f NIFI-2718: Show HTTP S2S Auth error on bulletin 
This commit fixes following two issues, that happens when a Root Group Port
policy for S2S data transfer is removed at a remote NiFi, after a client NiFi has
connected to that port:

1. At client side, Remote Process Group should show that authorization
is failing on its bulletin, but the Exception is caught and
ignored. Nothing is shown on the UI with HTTP transport protocol.
RAW S2S shows error on RPG bulletin. This commit fixes HTTP S2S to
behave the same.

2. At server side, corresponding input-port or output-port should show
that it is accessed by an unauthorized client on its bulletin, but it's
not shown with HTTP transport protocol.
RAW S2S shows warning messages for this. This commit fixes HTTP S2S to
behave the same.

In order to fix the 2nd issue above, request authorization at
DataTransferResource is changed from using DataTransferAuthorizable
directly, to call RootGroupPort.checkUserAuthorization().

Because the blettin is tied to the Port instance and it's
difficult to produce blettin message from this resource.

Since RootGroupPort.checkUserAuthorization uses
DataTransferAuthorizable inside, the check logic stays the same as
before.

Adding a RootGroupPortAuthorizable to provide access to necessary components for performing the authorization.

This closes #996
 2016-09-08 13:43:38 -04:00
Mark Payne bc7c42efa5
NIFI-1966: Recreated issue that is outlined in JIRA (the reason for re-opening the ticket) that results in 'java.util.NoSuchElementException: No value present' in unit test - Resolved issue where two flows that are both empty but have different fingerprints (due to root group id being different) causes vote election to fail 
This closes #995.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-08 10:48:24 -04:00
Oleg Zhurakousky d36b76cc60 NIFI-2745 added _source destination name_ attribute to ConsumeJMS 
This closes #992
 2016-09-07 15:28:34 -04:00
Mark Payne 938e32ed97 NIFI-2746: Ensure that the FlowController is injected into all ResourceApplications. This closes #993 2016-09-07 14:11:46 -04:00
vijayk 80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-07 12:06:01 -04:00
Mark Payne 8d6e12fdc4 NIFI-2739: Call KafkaConsumer.wakeup() if consumer is blocking for at least 30 seconds when OnUnscheduled is called 2016-09-07 08:56:23 -04:00
Matt Burgess 2afc739ab7 NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976 2016-09-06 16:52:40 -04:00
Mark Payne a7e76cc00a NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977 2016-09-06 16:31:37 -04:00
joewitt 7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call 
This closes #987.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-06 15:48:40 -04:00
Mark Payne 088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers. 
This closes #958.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-06 12:25:28 -04:00
Mark Payne a9d029d74e NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side 
This closes #978

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-06 10:57:53 +09:00
Joe Gresock 0e64c3ed30 NIFI-2631: Adding page commits and 'Use Versions' to ListS3 
This closes #916 and closes #917.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-09-03 16:04:42 -07:00
Jeff Storck 97e2f406da NIFI-2708 Added merging of SiteToSite details 
NIFI-2708 Updated to include ports from clientDto for port merging.

This closes #981
 2016-09-02 14:55:08 -04:00
Matt Gilman d37480eaff NIFI-2722: 
- Updating the component entity as long as the proposed entity is not older than the current one since stats are bundled in the entity too.

This closes #983

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-02 22:25:25 +09:00
Scott Aslan 867c84f32c [NIFI-2649] Update CS table upon creation of a CS from the RT or CS properties table 
- Ensuring the controller services table to correctly reloaded regardless if its the processor group or controller level controller services. This closes #968
 2016-09-01 09:53:12 -04:00
Matt Gilman 96a766464c
NIFI-2678: - Ensuring the most recent version of each component is save for rendering on the canvas. 
This closes #979.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-31 15:59:52 -04:00
Matt Gilman 9e10371c8a NIFI-2704: 
- Re-using the DataTransferAuthorizable in the DataTransferResource.
- Removing use of the DataTransferResource when obtaining site to site details as it performs additional unnecessary checks.
- Code clean up.
- This closes #971.
 2016-08-31 15:09:17 -04:00
Yolanda M. Davis 1bb909ebca NIFI-2703 - Added bootstrap.conf file for running integration tests. This closes #975 2016-08-31 09:28:08 -04:00
Scott Aslan 648ddb6158 [NIFI-2679] User is now able to disable/enable processors that are invalid or stopped through Operate palette. This closes #973 2016-08-31 09:11:46 -04:00
Mark Payne 1213b46632 NIFI-2628: Whenever a flow is inherited from cluster coordinator, save flow immediately to disk 
This closes #967
 2016-08-30 16:13:45 -04:00
Matt Gilman ba19238757
NIFI-2694: - Addressing instances where phase one objects were being referenced instead of phase two objects. - Code clean up. 
This closes #970.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-30 15:50:48 -04:00
Andy LoPresto 8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8. 2016-08-30 09:27:24 -07:00
Andy LoPresto d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7. 
This closes #955.
 2016-08-30 08:25:38 -07:00
jpercivall 1752a57197 Merge branch 'NIFI-2676-rc1' of https://git-wip-us.apache.org/repos/asf/nifi 2016-08-31 14:01:57 +10:00
Koji Kawamura daf4855570 NIFI-2687: RPG Port ID was used instead of RPG ID 
It caused "Error: Unable to find remote process group with id 'XXXX'" error with modifying the transmitting toggle switch of an Input or Output port.

This closes #962
 2016-08-29 10:14:55 -04:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
Scott Aslan c8ae7fcbe1 [NIFI-2480] remove explicit angular $sanitize to fix multibyte chars in breadcrumbs and flow status bar. All values are escapoed through the angular ng-bind. This closes #957 2016-08-26 11:03:10 -04:00
Koji Kawamura 2ed58912b2 NIFI-2480: Fix for multibyte chars in breadcrumbs. This closes #956 
Removed $sanitize from breadcrumbs controller, as it escapes multibyte
chars with numerical reference. Even without $sanitize, html tags can be
escaped when Angular binds the value to text content.
 2016-08-26 10:27:27 -04:00
Matt Burgess 0745990c2d NIFI-2604: Added validators and logic for multiple URLs/files/folders for DB driver location 
This closes #912

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-25 23:35:41 -04:00
jpercivall 6ef1cca18f NIFI-2269 Fixing Datadog licensing 2016-08-25 22:43:00 -04:00
jpercivall e1da9fc11f NIFI-2667 Adding License and Notice information to Media Bundle Nar and Assembly 
This closes #950
 2016-08-25 22:42:37 -04:00
joewitt 405252244e NIFI-2670 minor doc edit to remove kafka.key.hex reference 2016-08-25 22:17:07 -04:00
Mark Payne 58e0ce7f92 NIFI-2670: This closes #954. Expose option for how to interpret Kafka Key - hexadeimal encoding or UTF-8 String 2016-08-25 21:39:40 -04:00
Bryan Rosander 102a9a2b74 NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #953
 2016-08-25 21:16:26 -04:00
Oleg Zhurakousky 7879a99206
NIFI-2675 fixed NPE in template generation 
This closes #951.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-25 16:44:02 -07:00
Bryan Bende 957c120343 NIFI-2664 Moving System.setProperty for krb5.conf to NiFi startup, and removing conflicting property from KerberosProvider config 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #946
 2016-08-25 17:26:37 -04:00
Mark Payne f908ae3c3b NIFI-2669: This closes #949. Ensure that if Exception is thrown during Transaction initialization that the underlying client is closed/cleaned up. Also ensure that we generate bulletins when logging error/warn level log messages 2016-08-25 16:39:00 -04:00
Matt Burgess a84d3c9873 NIFI-2665: This closes #942. Fixed intermittent validation errors in InvokeScriptedProcessor 2016-08-25 15:34:50 -04:00
joewitt 1624dd8e4d NIFI-2666 This closes #947. updated where it says BSD to say MIT for bcrypt 2016-08-25 14:59:46 -04:00
joewitt 218408953a NIFI-2668 Added missing license/notice entries for ignite deps in nar 2016-08-25 14:50:38 -04:00
Matt Burgess 3224b1a5dd NIFI-2668: This closes #945. Replaced JSR-107 JCache API JAR w Geronimo version, updated notices 2016-08-25 14:41:08 -04:00
Matt Burgess ad7808f63d NIFI-2641: This closes #928. Add max values as attributes to QueryDatabaseTable 2016-08-25 14:13:55 -04:00
Oleg Zhurakousky 04db806ace NIFI-2614 This closes #944. added support for max.request.size 2016-08-25 13:51:08 -04:00
Matt Gilman a6133d4ce3 NIFI-2635: 
- Fixing contrib check issues.
- Clean up pom.
- Addressing issue where reporting task property descriptor using wrong scope.

NIFI-2635:
- Fixing issue with revisions when creating users and user groups.
- Forwarding requests to the coordinator instead of replicating.
- Tweaking verbage in dialog for removing users and groups.

This closes #943
 2016-08-25 13:08:35 -04:00
joewitt 1745c1274b NIFI-2608 This closes #930. restructured the ConsumeKafka processor to follow new consumer API. Made nar classloading more precise to support spawned threads NIFI-2660. 2016-08-25 10:09:50 -04:00
Bryan Bende 626e23e0ab Adding ConsumerResource and ConsumerPool for ConsumeKafka 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-08-25 09:47:26 -04:00
Scott Aslan 56e515f7ae [NIFI-2658] Use bulletinEntity id instead of bulleting id since the ids match but bulletinEntities do not get bulletin objects if user is not authorized. This closes #938 2016-08-25 09:27:41 -04:00
Andre F de Miranda 6fd1c17ca4 NIFI-2662 - Fix checkstyle violations introduced by NIFI-2635 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #940
 2016-08-25 08:55:34 -04:00
Peter Wicks e210172d93 PutSQLBinary 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591 - Added Format option for binary data types. Updated unit tests.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #883
 2016-08-25 08:41:23 -04:00
Koji Kawamura afb9a0016f NIFI-2659: Fixed RPG Received stats. This closes #939 
It was showing the 'Sent' stats as 'Received' stats.
 2016-08-25 08:34:17 -04:00
Matt Gilman c2bfc4ef24 NIFI-2635: - Re-using the original request during the second phase of the two phase commit. - Forwarding requests to the coordinator when received by a node. 
This closes #933

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-24 22:42:10 -04:00
Matt Gilman 2ceb5c8097
NIFI-2647: 
- Referencing correct components when checking if save is required.

This closes #935.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-24 15:52:20 -07:00
Andy LoPresto 6331dda8d3 NIFI-2643 Changed null check to !isBlank() for key in RunNiFi. 
NIFI-2643 Updated comment in bootstrap.conf template.

This closes #932
 2016-08-24 16:20:10 -04:00
Jeff Storck 6475924f53 NIFI-2642 Catches (and ignores) ResourceNotFoundException during the updating of a property value for a controller service when the current value points to a controller service that has been deleted, allowing the assigning of a new controller service to continue. 
This closes #931
 2016-08-24 15:55:04 -04:00
Mark Payne c2ae7a6d7c NIFI-2605: - Fixing a regression bug where nodes would potentially be elected leader for Cluster Coordinator role when they do not have the correct flow 
-  Ensure that we log which node is the cluster coordinator on startup instead of just indicating that there is one. If we later determine that there is none, ensure that we register for the role

This closes #900

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-24 12:30:48 -04:00
Andy LoPresto c638191a47
NIFI-1831 Added internal logic and command-line tool to allow AES-encrypted sensitive configuration values in nifi.properties. 
This closes #834.
 2016-08-23 20:34:31 -07:00
Matt Burgess ee9bd94082 NIFI-2632: Added fragment attributes to SplitJson and SplitXml 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #919
 2016-08-23 16:30:57 -04:00
Matt Burgess 5d1a4f343f
NIFI-2622: Added support for complex types in SelectHiveQL 
This closes #922.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-23 15:52:16 -04:00
Andrew Psaltis 0303805c01
NIFI-2620 Adding support for Binary Row Keys for both PutHBaseCell and PutHBaseJSON. This also involved making changes to PutFlowFile and PutColumn to carry around byte[] and not all strings. This closes #914. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-23 13:25:55 -04:00
Oleg Zhurakousky 4a49587533 NIFI-2610 annotated unstable tests with @Ignore 
This closes #918
 2016-08-23 13:13:05 -04:00
Matt Burgess fbec3b9c13
NIFI-2623: Fixed support for binary types in SelectHiveQL 
This closes #920.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-23 11:43:46 -04:00
Mark Payne 8cc670c8a6 NIFI-2634: Ensure that we check whether or not the Site-to-Site protocol is set when importing template, instead of assuming that it will be 
This closes #921

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-23 11:19:44 -04:00
Scott Aslan 3f60eac544 [NIFI-2599] Enhance Status History Dialog. This closes #894 2016-08-23 10:53:10 -04:00
jpercivall 6e82ec738c NIFI-2269 Fixing minor issues with style check, licensing, etc. 2016-08-22 21:34:51 -04:00
Ramiz 376d3c4ef4 NIFI-2269 Added datadog support 
This closes #655

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-22 21:34:51 -04:00
Jeff Storck dca3764ed1 NIFI-2626 Fixes jetty server thread leak. This closes #910 2016-08-22 15:58:06 -04:00
Joe Gresock 17dec04939 NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #905
 2016-08-22 14:47:24 -04:00
Matt Gilman 087622eadc NIFI-2606: 
- Addressing issue when fingerprinting ReportingTasks and ControllerServices properties with default values.
- Ensuring the flow is saved when templates are created and imported.
- Ensuring default values are included in templates.
- Fixing unit tests.
This closes #908.
 2016-08-22 13:35:15 -04:00
Mark Payne 1fcec3747b NIFI-2617: Instead of retrying an infinite number of times to communicate with ZooKeeper, should try only for a short period in CuratorLeaderElectionManager. This is because web requests may be blocked waiting on a determination of which node is cluster coordinator 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #906
 2016-08-22 13:24:22 -04:00
Mark Payne 5fab783b50
NIFI-2609: Ensure that we handle URIs for Remote Process Groups that do not have a path of /nifi or /nifi/ 
This closes #902.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-22 13:21:42 -04:00
Mark Payne 95b5877f5d NIFI-2600: Ensure that we do not close Index Searchers prematurely, even if they are poisoned 
This closes #896
 2016-08-22 12:03:47 -04:00
Joe Skora a2d3d0c289 Update to support offsets larger than 2 gigabyte. 2016-08-22 11:02:48 -04:00
Matt Burgess b7dc21bd95 NIFI-2547: Fixed checkstyle errors and updated to reflect KerberosProperties changes 2016-08-21 10:26:40 -04:00
ricky 26d362b144 NIFI-2547: Add DeleteHDFS Processor 
This processor adds the capability to delete files or
directories inside of HDFS.

Paths supports both static and expression language values,
as well as glob support (e.g. /data/for/2016/07/*).

This processor may be used standalone, as well as part of a
downstream connection.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Add Glob Matcher with Tests

Also set displayName on properties.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #850
 2016-08-21 10:10:21 -04:00
Joe Skora 02071103d0 * Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content. 
* Removed @Ignore annotation on class and unnecessary EOL translation of test data.  Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.

This closes #890.
 2016-08-19 20:05:14 +02:00
Matt Gilman 3378426f35 NIFI-2581: Keeping context menu and tooltips open when refreshing the canvas. 
This closes #899.
 2016-08-19 19:36:26 +02:00
Scott Aslan a181c7b9d7 [NIFI-2601] Update bower.json to use specific versions. This closes #897 2016-08-19 10:34:48 -04:00
Jeff Storck 31ca8d02f7 NIFI-2488 Fixed BulletinDTOs not getting their node addresses set properly during bulletin merging. This closes #888 2016-08-19 08:32:00 -04:00
Matt Burgess 46b81058c7 NIFI-2602: Fixed NPE in SelectHiveQL when CSV output and null column value 
This closes #898.
 2016-08-19 09:56:26 +02:00
Matt Gilman 6b5950647a NIFI-2596: 
- Adding tooltip for property descriptor on mouse enter of table cell.

This closes #893.
 2016-08-18 17:23:30 -04:00
Matt Gilman 57648308db NIFI-2597: 
- Updating the correct object when attempting to create a self loop.
 2016-08-18 17:15:16 -04:00
Matt Gilman 87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins. 
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.

This closes #892.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-18 17:06:28 -04:00
Matt Gilman f3387426a0 NIFI-2587: 
- Adding additional authorization for accessing component property history.
 2016-08-18 17:05:32 -04:00
Matt Burgess 6874a5d82d NIFI-2593: This closes #891. Fixed handling of nested records/structs in ConvertAvroToORC 2016-08-18 15:15:51 -04:00
Matt Burgess a74bc2c7c7 NIFI-2598: This closes #889. Fixed issue with static init of properties in HiveConnectionPool 2016-08-18 13:38:22 -04:00
Bryan Bende e0e4b3407a NIFI-2574 This clsoes #887. Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables 2016-08-18 12:19:46 -04:00
Scott Aslan 0e90a0f76a [NIFI-2488] update UI to relect changes to ActionDTO and BulletinDTO. This closes #882 2016-08-18 09:38:16 -04:00
Jeff Storck 08735a4f57 NIFI-2488 Wrapping ActionDTO and BulletinDTO in entities to be able to provide readability permission to the client 2016-08-18 09:37:11 -04:00
Mark Payne 567535c3d0 NIFI-2382: Fixed typo in documentation 2016-08-18 09:15:55 -04:00
Mark Payne 91a59a8a5a NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account 
This closes #836.
 2016-08-18 08:33:45 -04:00
Peter Wicks 7bc7b7f683
NIFI-2584 Fixing date format in PutSQL 
This closes #878.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-17 16:10:56 -04:00
Matt Gilman 3d1a24ab7d NIFI-2578: 
- Ensuring NiFi still attempts to issue a registration request to support 1.x -> 0.x site to site.
 2016-08-17 15:35:16 -04:00
Oleg Zhurakousky a0fab15eb7 NIFI-2519 polishing remote address formatting to avoid NPE and other potential exceptions. 
This closes #871
 2016-08-17 15:13:05 -04:00
Andre F de Miranda e7288af859 NIFI-2519 - ListenSMTP addresses mismatch between smtp.src attribute documentation and attribute.put 2016-08-17 14:58:02 -04:00
Andy LoPresto 0ffdc2eb92
Merge branch 'master' of https://github.com/apache/nifi 
(Apologies for merge commits, but it was not possible to rebase the 2574 commits (PR 872)).

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-17 10:58:38 -07:00
joewitt b2e468ecf8
NIFI-2574 updated to reflect new accessor methods for nifi properties with kerberos service 
This closes #872.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-17 10:51:55 -07:00
Peter Wicks a0d1aae603 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:20:44 -04:00
Peter Wicks 1470a52b1b NIFI-2582 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2583 Tweaks

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:19:56 -04:00
joewitt a5261914fb NIFI-2574 merging latest kerb changes to adjust for NiFiProperties 2016-08-17 09:06:18 -07:00
joewitt 7c99b5e638 NIFI-2574 fixed queue swap threshold setting 2016-08-17 09:05:36 -07:00
Matt Gilman 3f7216ab84 NIFI-2561: - Decoupling kerberos service and spnego principles and keytabs. 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #873
 2016-08-17 08:14:05 -04:00
joewitt d9633757a6 NIFI-2574 fix spring context definitions 2016-08-17 03:38:31 -07:00
joewitt 6bf7e7f325 NIFI-2574 merging master with cluster changes to updated NiFiProperties approach 2016-08-17 01:23:54 -07:00
joewitt 7d7401add4 NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it. 2016-08-17 00:10:07 -07:00
Mark Payne e42ea9ad45 NIFI-2566: Refactored to allow just the Leader Election Manager to be responsible for determining who is the Cluster Coordinator 
NIFI-2566: Removed storage of cluster roles from heartbeats and NodeConnectionStatus; use LeaderElectionManager to determine roles instead

NIFI-2566: Updated Heartbeats so that if a node is out-of-sync with cluster topology, cluster coordinator will provide updated information back to the nodes

NIFI-2566: Fixed issue that prevented standalone instance from starting by creating a standalone-instance version of the Leader Election Manager. Also added Controller Service enabled/disabled state to fingerprint rather than attempting to update the state when joining the cluster, as the implementation was incorrect and the correct implementation will be a rather significant effort that doesn't have to happen for 1.0.0 release

This closes #866

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-16 20:39:04 -04:00
Matt Gilman b3f36489ad
NIFI-2534: - Refreshing using component IDs. - Code clean up. 
This closes #874.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 16:05:20 -04:00
Simon Elliston Ball b0122c6a73
NIFI-2465 - InferAvroSchema EL support based on incoming FlowFiles 
This closes #863.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 12:50:53 -04:00
Scott Aslan 26f5c496d1
NIFI-2534 Fix JS error when stopping a process group 
This closes #867.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 11:09:41 -04:00
Peter Wicks b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format 
This closes #869.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 10:26:24 -04:00
Matt Burgess 03d3b3961d NIFI-2577: Increased default stripe size in ConvertAvroToORC to 64MB 
This closes #870.
 2016-08-16 11:53:05 +02:00
Mark Payne 6af768d0a1 NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim. 2016-08-15 17:02:15 -04:00
Matt Burgess ed42f2e3e3 NIFI-2552: Updated Curator for HiveQL processors using Zookeeper quorum in URL 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #865
 2016-08-15 16:53:57 -04:00
Matt Gilman 7d8dd27027
NIFI-2554: - Requiring READ permissions on the referenced controller service when creating/updating processors, controller services, and reporting tasks. 
- Preventing client side selection of unauthorized controller services unless they were the previously configured value.

This closes #860.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 16:46:58 -04:00
Scott Aslan 2a92747046 [NIFI-2559] UI - Controller Service update missing icons 
This closes #864
 2016-08-15 16:27:12 -04:00
Matt Gilman d45114e48d NIFI-2501: - Ensuring users can access the controller service list regardless of permissions on the corresponding process group or controller. - Better handling the case where the user had write permissions but no read permissions. - Returning to the appropriate controller service listing after going to the usage page. 
This closes #835

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-15 15:16:58 -04:00
Oleg Zhurakousky 51c566ffc8
NIFI-2546 fixed NPE in FlowSnippetDTO fixed NPE caused by non-configured ControllerService 
This closes #859.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 14:55:20 -04:00
Yolanda M. Davis fbd3201157 NIFI-2524 - Fixes to improve handling of missing journal files during rollover/merge execution.Includes: 
This closes #840

 Removed partial file check (based on missing first file)
 Added condition to merge if at least one journal files available on disk. If all files are  missing from disk that is considered an error.
 Added retry logic to prevent endless thread execution when encountering errors (such as missing files).
 2016-08-15 14:43:38 -04:00
Peter Wicks 44057f097a
NIFI-2356 ConvertJSONToSQL assumes IS_AUTOINCREMENT 
This closes #862.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 14:17:16 -04:00
Bryan Bende fd0dd51ff5 NIFI-2553 Fixing handling of Paths in HDFS processors 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #843
 2016-08-15 08:59:42 -04:00
joewitt 9c7668948c NIFI-2560 This closes #851. fixed property handling and added tests using it 2016-08-14 14:35:25 -04:00
Oleg Zhurakousky b7b56b1cad NIFI-2560 added connection timeout to IMAP/POP3 2016-08-14 14:06:07 -04:00
joewitt d3b96dcac1 NIFI-2519 This closes #856. aligned threading model with subethastmp 2016-08-14 13:32:00 -04:00
Oleg Zhurakousky 48fa76ecff NIFI-2519 Fixed and refactored ListenSMTP processor 
- Removed message queueing which could result in data loss
- Fixed life-cycle issues that coudl put processor in an unstable state
- Fixed PropertyDescriptor translation for Time units and Byte sizes
- Fixed broken tests
- Added additional tests

NIFI-2519 added default for SMTP_MAXIMUM_CONNECTIONS

NIFI-2519 addressed PR comments, polishing
- fixed intermittent deadlock on processor stop and added test for it
- the attributes that can not be extracted from the message but available via MessageContext are written into the outgoing FlowFile
- other minor fixes

NIFI-2519 addressed lates PR comments

NIFI-2519 added better messaging when server closes the connection

NIFI-2519 some polishing and additional tests to validate deadlocks

NIFI-2519 address latest PR comments
fixed deadlock condition for when the consumer is stopped while server is distributing messages
fixed MAX message size issue ensuring it is validated
set max connections to SMTPServer
polished pom
added L&N

NIFI-2519 PR comments
- fixed LICENSE
- Added usage of LimitingInputStream
- simplified SmtpConsumer by removing hasMessage operation
 2016-08-14 13:31:46 -04:00