Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,037 Commits 143 Branches 197 Tags 390 MiB
Commit Graph

1478 Commits

Author SHA1 Message Date
Andy LoPresto 4d1bcc808f
NIFI-3032 Resolved issue where multiple invocations of NiFiPropertiesLoader.withKey() used cached key. 
Added unit tests and resources.

NIFI-3032 Fixed bug in AESSensitivePropertyProvider#getIdentifierKey where the result was always the max available key size, not the size of the current key.
Added unit test.

This closes #1220

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2016-11-14 17:50:32 -05:00
Matt Gilman ae4f27a627 NIFI-3023: 
- Ensuring there are no authorization issues prior to considering the remote process group's transmitting flag.
This closes #1205
 2016-11-14 16:23:36 -05:00
Matt Gilman 2c91a1a33d NIFI-3023: 
- Verifying permissions prior to checking Remote Process Group transmission status.
 2016-11-14 16:03:47 -05:00
Mathias Tiberghien 65b7b377e3 NIFI-1526: DefaultSchedule annotation should be use on Custom Processor to set the default scheduling strategy, scheduling period or max number of concurrent task for each instance of the processor 
DefaultSettings annotation should be use on Custom Processor to set the default penalty period, the yield duration or the bulletin log level for each instance of the processor
 2016-11-14 12:04:21 -05:00
Oleg Zhurakousky 41f519e84c NIFI-2851 initial commit of perf improvements on SplitText 
- introduced org.apache.nifi.stream.io.util.TextLineDemarcator
- refactored SplitText to use org.apache.nifi.stream.io.util.TextLineDemarcator
- updated SplitText's capability discription to provide more clarity around splits with headers.
 2016-11-11 15:45:40 -05:00
Mark Payne b73ba7f8d4 NIFI-2999: When Cluster Coordinator changes, purge any old heartbeats so that we don't disconnect a node due to very old heartbeats 
This closes #1210
 2016-11-11 15:13:49 -05:00
joewitt b9ef0fb847 NIFI-2818 This closes #1059. aligned read method with read/write method 2016-11-11 14:52:13 -05:00
Andre F de Miranda f32bdf7be9 NIFI-2818 - Minimise fs permission required by NiFi 
1 - Replace a r/w test over $NIFI_HOME/lib that is performed
            but never utilised by a RO test
            2 - Rename ensureDirectoryExistAndCanAccess to
            ensureDirectoryExistAndCanReadAndWrite and deprecate the
            former
 2016-11-11 14:49:33 -05:00
Scott Aslan 52cde9ad13 [NIFI-2898] restore ellipsis for processor type, controller servies type, and reporting task type descriptions. This closes #1191 2016-11-11 14:46:20 -05:00
Byunghwa Yun 91f0170416 NIFI-3027: ExecuteProcess supports the expression language 2016-11-11 14:41:35 -05:00
Pierre Villard 06f191ca10
NIFI-2912 Allow custom text in GenerateFlowFile 
This closes #1206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-11 10:18:43 -08:00
Matt Gilman 9f417a84b9 NIFI-3002: 
- Removing legacy code when retrieving site to site details when the target instance is this local NiFi.
- Ensures the UI accurately reflects available remote ports.
NIFI-2603:
- Fixing color of remote output port status in connection label.

This closes #1189.
 2016-11-11 10:06:41 -05:00
Scott Aslan 4957b628fb [NIFI-3021] remove white-space:no-wrap on view configuration properties tables textareas 
This closes #1204.
 2016-11-10 22:12:08 +01:00
Matt Gilman f83863ebae NIFI-3009: 
- Fixing NaN error when backpressure is not configured.
This closes #1200
 2016-11-10 11:39:08 -05:00
Scott Aslan b426de1793 [NIFI-3012] update regex for the summary tables input, output, transferred, received, and sent column parse function. This closes #1197 2016-11-10 09:25:08 -05:00
Matt Burgess 435d9cf353 NIFI-2991 This closes #1194. Exclude org.json dependency from Hive bundle 2016-11-10 08:33:43 -05:00
João Henrique Ferreira de Freitas 1b5a28d130 NIFI-3013 GetSNMP fix stop and start null pointer exception 
This closes #1195.
 2016-11-10 13:30:16 +01:00
Mark Payne c441a8696d NIFI-2850 This closes #1115. Added a migrate() method to ProcessSession and refactored BinFiles and MergeContent to use it 2016-11-09 16:25:03 -05:00
Jeff Storck cc2fbcaac4 NIFI-3008 Enabled expression language on BASE_DIRECTORY and FILENAME properties in TailFile 
This closes #1190
 2016-11-09 12:11:11 -05:00
joewitt 3e892c55ec NIFI-2971 This closes #1172. addressed RPM bundled deps and handling exception for bootstrap cl construction 2016-11-09 11:08:43 -05:00
Matt Gilman bff89f17b3 NIFI-401: - Minor tweaks to PR #1117. - Ensuring existing configuraiton is retained and shown until the user explicits changes it. - Retaining, but disabling, deprecated options. 
This closes #1185
This closes #1117
This closes #512

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-08 17:06:43 -05:00
Brian Eugley 7eca2037bd NIFI-401 
Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-08 17:06:36 -05:00
patricker 4b4e099f2e NIFI-2764 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2764: Updated call to convertToAvroStream in TestJdbcCommon

This closes #1009
 2016-11-08 14:45:49 -05:00
Matt Burgess 63bda32a8b NIFI-2998: Add validator to Avro Record Name in InferAvroSchema 
This closes #1187
 2016-11-08 14:14:40 -05:00
Bryan Bende 78020825e9 NIFI-2841 Refactoring logic in SplitAvro RecordSplitter to avoid making two calls in a row to reader.hasNext() 
This closes #1088
 2016-11-08 13:50:42 -05:00
Bryan Bende d1d053725b NIFI-2909 Adding per-instance class loading capability through @RequiresInstanceClassLoading annotation 
NIFI-1712 Applying per-instance class loading to HBaseClientService to allow specifying Phoenix Client JAR

-Refactoring the ClassLoading so that every processor, controller service, and reporting task gets an InstanceClassLoader with a parent of the NAR ClassLoader, and only components with @RequiresInstanceClassLoading will make a copy of the NAR ClassLoader resources, and addressing some review feedback

This closes #1156
 2016-11-08 13:21:27 -05:00
Matt Gilman 2f0d9a34f1 NIFI-2982: 
- Updating the labels in the Add Users/Groups to the Policy dialog..

This closes #1178.
 2016-11-08 16:55:27 +01:00
Matt Gilman 9d3fe3f03e NIFI-2989: 
- Updating the content of the delete policy dialog to make it a little more clear that the permissions for the component will revert back to the inherit policy.

This closes #1183.
 2016-11-08 14:58:11 +01:00
Matt Gilman aa8ba0bd1c NIFI-2965: 
- Ensuring the selection is cleared when going to the Process Group where the selected component policy is defined.
- Ensure that the selection context is updated when going to a component or group.

This closes #1174.
 2016-11-08 14:49:12 +01:00
Oleg Zhurakousky 5fd4a55791 NIFI-2778 added abilty to interrupt Lucene search 
polishing

This closes #1138
 2016-11-07 16:28:16 -05:00
Pierre Villard 6aefc0b910 NIFI-2751 NIFI-2848 Get batch of flow files in a round-robin manner 
This closes #1111
 2016-11-07 14:01:18 -05:00
Oleg Zhurakousky c13cfa6ea6 NIFI-1322 fixed breaking changes introduced in previous commit 
This closes #1181
 2016-11-04 08:23:10 -04:00
Pierre Villard a7d06412f8 NIFI-1322 - PutHDFS - allow file append resolution 2016-11-04 08:23:10 -04:00
James Wing 50010fb340 NIFI-2948 Fix DynamoDB Cached Credentials 
This closes #1182
 2016-11-04 07:04:25 -04:00
Matt Burgess 0841f14c18
NIFI-2928: Fixed checkstyle violation in FetchFile 
This closes #1180

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2016-11-03 14:46:10 -04:00
Oleg Zhurakousky ed035f85e3 NIFI-2928 added support to validate accessibility of the file system 
NIFI-2928 polishing

This closes #1160
 2016-11-03 12:25:31 -04:00
James Wing a486fefb1e NIFI-2115 Detailed Version Info in About Box 
* Java version and vendor
* OS name and version
* Release Tag
* Build revision (commit SHA), branch, and timestamp
* Handles formal releases, ad-hoc builds, and non-release source builds
* Standalone UI presence in About dialog, Summary -> System Diagnostics
* Cluster UI as Versions tab in Cluster dialog
* Reduce About Dialog Content
* Fix Missing Property Display Bugs
* Marking the build time as type string.
* This closes #583
 2016-11-03 11:16:20 -04:00
Matt Gilman edb0ebe52b
NIFI-2931: - Using the delete button state (which correctly checks if a policy is inherited) to drive the presence of the remove user button. 
This closes #1153.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-03 09:47:26 -04:00
Matt Burgess 9e44734042 NIFI-2980: Fixed doc for Elasticsearch URL property in ElasticsearchHttp processors 
This closes #1173
 2016-11-02 16:18:30 -04:00
Pierre Villard 1abd017c35 NIFI-2963 FetchHDFS should support Compression Codec property 
This closes #1166
 2016-11-02 16:15:09 -04:00
Joe N b5550ffcf5 NIFI-2834 Better Configs for Fetch and Timeout 
NIFI-2834 Better Configs for Fetch and Timeout

NIFI-2834 Better Configs for Fetch and Timeout

NIFI-2834 ofSec to of Mils

This closes #1167
 2016-11-02 16:10:37 -04:00
Scott Aslan 769530beae [NIFI-2603] applying color to highlight status changes 
- Updating the colors of the target port status and ensuring that when one no longer exists it reports that it is not running.
- This closes #1171
 2016-11-02 15:15:29 -04:00
Peter Wicks 60423f05b5 NIFI-2603 
- Gui Icons
- Gui Icons - Fixing Orange Color
- Gui Icons - Fixing misc. colors
- Gui Icons - Summary page + spinner
- Gui Icons - Summary page again
 2016-11-02 14:11:56 -04:00
patricker 2fb3b01ebe NIFI-2918 JDBC getColumnName may return empty string 
This closes #1149
 2016-11-02 13:13:34 -04:00
Matt Burgess 892c74dff2 NIFI-2819: Added support for Expresssion Language in ModifyBytes 
This closes #1130
 2016-11-02 13:02:25 -04:00
Scott Aslan 05ea76dd6f [NIFI-2888] Display processor fill color when zoomed in/out. This closes #1151. 2016-11-02 12:54:58 -04:00
Andrew Lim 5f9cae97b7 NIFI-2883 Renamed directories holding ConsumeKafka_0_10 and PublishKafka_0_10 additional details 
This closes #1170
 2016-11-02 12:29:09 -04:00
Pierre Villard 7fbc23639a NIFI-2956 - GetHDFS - fixed directly path evaluation 2016-11-02 12:15:26 -04:00
simplesteph 56da2b51e1 [NIFI-2900] transformed all datetime fields to string as they don't comply with ISO norms. This closes #1136. 2016-11-02 09:39:48 -04:00
Mark Payne e1f0ba5a43
NIFI-2925: When swapping in FlowFiles, do not assume that its Resource Claim is 'in use' but instead look up the canonical representation of the resource claim 
This closes #1150.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-31 09:59:06 -04:00
Oleg Zhurakousky 7fd2c42b19 NIFI-2879,NIFI-2880 This closes #1120. fixed NarThreadContextClassLoader instantiation error handling 2016-10-28 12:15:12 -04:00
Koji Kawamura 9e90aae066 NIFI-2936: Fix TestExecuteProcess error on Travis. 
This closes #1162.
 2016-10-28 10:35:37 +02:00
Matt Gilman 8dc60c72d4
NIFI-2884: - Adding support to selecting multiple users before updating a policy. 
NIFI-2533: - Only including a user/group in the search results if they are not currently selected.
NIFI-2286: - Providing a tooltip for the add user and remove policy button.

This closes #1155.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-27 11:50:46 -04:00
jpercivall 1d74b5d3ce NIFI-2791 Adding 'math' expression language function 
This closes #1157.
 2016-10-25 19:45:38 +02:00
Michal Klempa 368ea7a2d2 NIFI-1069 Removing the exit directive 
This closes #1159

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-10-25 12:44:19 -04:00
jpercivall e4a3e09643 NIFI-1662 Adding proper UI regex support for decimals in EL 
This closes #1018
 2016-10-24 10:31:16 -04:00
Andre F de Miranda 9b08f23b24
NIFI-1531 - Remove bogus .gitignore files from sub directories 
This closes #1154.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-10-23 10:29:09 -04:00
Scott Aslan 6676e94a7c [NIFI-2929] remove canvas element names when zoomed out and view permissions are removed. This closes #1152 2016-10-21 16:11:27 -04:00
Andre F de Miranda b864d49f66 NIFI-2341 - Introduce ParseCEF processor 
This closes #785
 2016-10-20 17:16:57 -04:00
Matt Burgess f5f132b1ab NIFI-2828: Fixed issue with transitive Hadoop dependencies in Hive NAR 
This closes #1146
 2016-10-20 14:56:01 -04:00
Matt Gilman af27e4070b NIFI-2843: - Removing the View Configuration menu item from the context menu on Process Groups. 
This closes #1087

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-10-20 12:45:37 -04:00
Michal Klempa 99d3c39748 NIFI-1069 - improve init script exit codes so that results are LSB compliant 
This closes: #1093

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-20 23:12:23 +11:00
Oleg Zhurakousky 611cadd231
NIFI-2919 Improved GetFile processor to fail (and provide bulletins) if target directory is inaccessible. 
This closes #1147.

Signed-off-by: Andy LoPresto <alopresto@apache.org>

Fixed typos in error messages, renamed variables in test, and cleaned up unnecessary imports. (+1 squashed commit)
Squashed commits:
[e755cbd] NIFI-2919 improved GetFile to fail if target directory is inaccessible
 2016-10-19 16:33:33 -04:00
Scott Aslan a8e1c775fd [NIFI-1459] add css translate3d to properties table editors in order to move the element along the z-axis of the 3D space and allow the scrollbars to properly be poistioned. This closes #1070 2016-10-19 15:39:58 -04:00
Andre F de Miranda 3914141c45
NIFI-1710 - Resolve path name to nifi.sh script 
This closes #1137.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 16:43:03 -07:00
Koji Kawamura 27dba60f27
NIFI-2905: Log error stream of ExecuteProcess cmd 
ExecuteProcess ignores error stream when Redirect Error Stream is
false, this commit let it to be logged instead so that user can see it on
bulletin.

This closes #1143.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 15:56:27 -07:00
Scott Aslan f287bc9119
[NIFI-2913] update z-index of codemirror resize handle to match the z-index of the codemirror vert. and horz. scrollbars 
This closes #1145.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 15:24:18 -07:00
Oleg Zhurakousky 5afbc43364 NIFI-2500 This closes #1131. made container queue configurable 2016-10-18 14:47:49 -04:00
Scott Aslan 9fb3039416 [NIFI-2898] Add Processor dialog processor descriptions now scrollable 
This closes #1134.
 2016-10-17 23:07:39 +02:00
James Wing b9a940bbd1 NIFI-2902 Fix for S3 Signer v4 Override 
This closes #1140.
 2016-10-17 22:51:45 +02:00
Oleg Zhurakousky c883f98cbf NIFI-2906 removed unused memebr variables 
This closes #1144.
 2016-10-17 22:32:23 +02:00
Matt Burgess 596b98865b NIFI-2894: Fixed typo in PutSQL documentation 
This closes #1129
 2016-10-14 12:45:34 -04:00
Matt Burgess b52b839895 NIFI-2897: Fixed SelectHiveQL for CSV output of complex types 
This closes #1132
 2016-10-14 12:35:38 -04:00
Michal Klempa 88d125137e NIFI-2199 - allows nifi.sh restart through ssh 
Closes: #1092

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-15 00:48:04 +11:00
d810146 e969a5ffe3 NIFI-2873: Nifi throws UnknownHostException with HA NameNode 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2873: Changed test hive-site.xml to use local FS, fixed Checkstyle violations

This closes #1113
 2016-10-14 09:23:19 -04:00
Edgardo 7107616420 NIFI-2872 Create PutCloudWatchMetric Processor 
This closes #1125.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-13 19:53:53 -07:00
Stephane Maarek 33ba1a822e
NIFI-2899 Updated swagger-maven-plugin to 3.0.1 
Incorporates the fix from https://github.com/kongchen/swagger-maven-plugin/issues/141
Ensures the new swagger.json is spec 2.0 compliant, see https://github.com/swagger-api/swagger-codegen/issues/3976

This closes #1135.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-13 17:21:11 -07:00
Pierre Villard 26f46538b3 NIFI-766: 
- Improved connection UI display when backpressure is enabled
- Updating the connection label to include backpressure indicators for object count and data size thresholds.
- Coloring the connection path and drop shadow once backpressure is engaged.
- Fixing bug with expiration icon tooltip.
- Including columns in the summary table for backpressure.
- Updating empty queue action to reload the connection status upon completion to ensure an updated count.

This closes #1080.
 2016-10-13 12:14:16 -04:00
Koji Kawamura c470fae065 NIFI-2863: S2S to allow cluster URL more leniently. This closes #1122 
- Consolidated the target cluster URL resolving logic into
  SiteToSiteRestApiClient's as a common method
- Changed to more descriptive error message
- Added more unit test cases
 2016-10-13 09:50:50 -04:00
Keren Tseytlin 6dc2f14198 NIFI-2799 AWS Assume Role Credentials With Proxy 
This closes #1112.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-12 17:19:13 -07:00
Andrew Lim 979b4d8ab9
NIFI-2801 Edited Kafka processor documentation to explicitly state which Kafka versions supported by each processor 
This closes #1119.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-12 10:35:45 -07:00
Peter Mitchell 893fed794c Add Stateful annotation to scripting processors 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2682: Added text to Stateful description for AbstractScriptProcessor
 2016-10-12 13:20:37 -04:00
Matt Gilman a25b651da9
NIFI-2837: - Immediately hiding the template dialog after clicking the Upload button to prevent an accidental re-submission. 
This closes #1086.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-12 09:18:58 -04:00
mans2singh af27179322 Nifi-1540 - AWS Kinesis Streams put processor 
This closes #239.

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-10-11 20:21:29 -07:00
Joey Frazee 6d5f4777c5 Fixed HL7 segment index bug for order control codes, more testing 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

Added NOTICE entries for test data and fixed checkstyle violations

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1123
 2016-10-11 14:57:40 -04:00
Oleg Zhurakousky ee14ae8af0 NIFI-2774 added configurable QoS options to ConsumeJMS 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1036.
 2016-10-11 10:32:00 -04:00
Matt Gilman 4a4c87fa15
NIFI-2849: 
- Showing process group name when possible.
- Providing a link to jump to the process group defined in the effective policy.
- Preventing editing an inherited policy.
- When overriding a policy, allowing the user to indicate if the policy should be empty or should copy the user/groups of the inherited policy.

This closes #1090.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-11 00:06:09 -07:00
Koji Kawamura 540ef63efa NIFI-2855: Site-to-Site with port forwarding. 
- Added following properties:
  - nifi.web.http.port.forwarding
  - nifi.web.https.port.forwarding

This closes #1100.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-10-07 15:00:37 +09:00
Mark Payne 09568d092b NIFI-2836: 
- Ensure that we wait until a request is completed before unlocking the lock for request replication
- Ensure that failures do not trigger request completion logic unless the failure is the last node to report its status
- This closes #1109
 2016-10-06 16:41:05 -04:00
Matt Gilman bb6c5d9d4e NIFI-2777: 
NIFI-2856:
- Only performing response merging when the node is the cluster cooridinator even if there is a single response.
- Fixing PropertyDescriptor merging to ensure the 'choosen' descriptor is included in map of all responses.

This closes #1095.
 2016-10-06 16:19:19 -04:00
Mark Payne b9cb6b1b47
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-06 15:51:16 -04:00
Bryan Bende a4ed622152
Revert "NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged" 
This reverts commit 92cca96d49.
 2016-10-06 15:19:00 -04:00
Andrew Lim 53f7a21663 NIFI-2691 Replaced references to kerberos/spegno principle with principal in nifi.properties and admin guide 
This closes: #1105

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-07 01:22:49 +11:00
Mark Payne 92cca96d49
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged 
This closes #1097.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-10-06 10:05:51 -04:00
Scott Aslan 8bd85e2085 [NIFI-1792] Clear the selected rule id when deleting the last rule in the list. Add scrollable styles when appropriate. Close popups when appropriate. This PR also adjusts the position of the table cell nfel and long text editors. This closes #1099. 2016-10-06 09:51:05 -04:00
Matt Gilman 3c673972e0 NIFI-2816: 
- Fixing compilation error resulting from the initial NIFI-2816 commit.
 2016-10-06 09:29:59 -04:00
Pierre Villard 3c8545a902 NIFI-1912 - PutEmail fixed format when attachment 
Correction as suggested by users in JIRA.
+ adding a unit test to check attachments.

This closes: #1081

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-06 21:34:56 +11:00
Scott Aslan 6ad633d174 [NIFI-2838] update width of rule name and save message. This closes #1089 2016-10-05 16:40:06 -04:00
mans2singh da33e2859c NIFI-2398 - GetIgnite processor 
This closes #721.
 2016-10-05 22:31:01 +02:00
Scott Aslan e46fea920a [NIFI-1794] Update .dialog-content to wrap text. This closes #1094 2016-10-05 16:15:11 -04:00