Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,478 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

1019 Commits

Author SHA1 Message Date
Matt Gilman 69586d8bd0 NIFI-2346: 
- Introducing data resource for authorizing provenance events and queue listing.
- Authorizing entire proxy chain for data resource and data transfer resource.
NIFI-2338:
- Ensuring that replay authorization only happens once.

- Allowing users with access to policies for a component to be able to access all policies for that component.
-- Includes the component, data, data transfers, and policies.
- Fixing drop request completion to update the correct queued field.
- Fixing access control check for listing and emptying queues.
- Reseting selected policy when re-opening the policy management page.
- Fixing button/link visibility for available actions in policy management page.
- Fixing policy issues with policy removal when the underlying component is deleted.
- Updating file authorizer seeding to grant data access to node's in the cluster.

This closes #720.
 2016-07-26 14:15:36 -04:00
Bryan Bende c27763a12f NIFI-1733 Initial commit for nifi-ranger-bundle 
- Adding Authorizer implementation for Ranger
- Adding build profile and assembly that controls the inclusion of Ranger in the final assembly
- Add properties to specify ranger admin identity and a flag to indicate if ranger is using kerberos, plugin is updated to perform a UGI login if ranger is using kerberos
- Adding LICENSE and NOTICE for Ranger NAR, and some other licensing clean up
- Adding tests for kerberos properties, adding test for RangerBasePluginWithPolicies, cleaning up code to use Java 8 features

This closes #574
 2016-07-26 10:15:22 -04:00
Oleg Zhurakousky 2ec43076fa NIFI-2344 This closes #711. fixed StandardControllerServiceNode.getRequiredControllerServices 2016-07-26 00:48:24 -04:00
Bryan Bende 67876f707b NIFI-2399 Correcting comparison of maxEventId against lastEventId in SiteToSiteProvenanceReportingTask 2016-07-25 23:37:08 -04:00
Mark Payne 7779af69b4 NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions. 
This closes #717

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-25 23:17:37 -04:00
Bryan Bende 3e9867d5da NIFI-1950 Updating FileAuthorizer to convert access controls from input and output ports during legacy conversion. This closes #702. 2016-07-25 12:37:26 -04:00
Mark Payne b082858595 Revert "NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions." 
This reverts commit 35ff0975bf.
 2016-07-25 12:35:43 -04:00
Mark Payne 35ff0975bf NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions. 2016-07-25 12:14:13 -04:00
Scott Aslan 26ffc6d7ec [NIFI-2050] update dialog advanced buttons 
[NIFI-2076] fix Add inline controller service dialog description width
[NIFI-2143] update to combo width
[NIFI-2136] [NIFI-2139] [NIFI-2134] update provenance details dialog
[NIFI-2368] add transparent glasspane when in a shell
[NIFI-2134] update flow-file details padding and .unset font-weight
[NIFI-2349] [NIFI-2351] update policies shell styles
[NIFI-2350] update empty queue dialog styles
[NIFI-2367] update links on message pane
This closes #703
 2016-07-25 08:24:23 -04:00
Mark Payne 4e08ea6525 NIFI-2376 This closes #713. Ensure that we don't decrement claimant count more than once when append() throws an Exception 2016-07-24 17:00:21 -04:00
Mark Payne 6932a53ec9 NIFI-2360: Leave ZooKeeper running when a node is disconnected. Do not allow the last node in the cluster to be disconnected. Change ClusterProtocoLHeartbeater to use RetryNTime retry strategy instead of RetryForever because web requests could block on this 
This closes #705

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-22 23:57:00 -04:00
joewitt 393a3925dd NIFI-2253 flexibly cleaning zookeeper connect string 
This closes #704

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-22 18:24:52 -04:00
Joey Frazee 4179ce6644 NIFI-2090 This closes #669. Added options for segment names, parse fields in ExtractHL7Attributes 2016-07-22 10:11:03 -04:00
Matt Gilman 4a4d60e6af NIFI-2307: - Enforcing connection permissions based on the source and destination comonent. - Removing connection specific access policies. NIFI-2265: - Filtering out sensitive details in component status and status history when appropriate. NIFI-1800: - Adding parent process group id to the Controller Services table. NIFI-2077: - Removing some old un-used icons following the UI refresh. NIFI-2242: - Requiring write permissions for all components in a selection. NIFI-2080: - Updating style of the name in the selection context to handle scroll bars and use available width. NIFI-2331: - Addressing issue when removing a user/group which was causing the tenant policy to be removed. NIFI-2335: - Ensuring the flow is saved after starting/stopping a process group. NIFI-2235: - Ensuring we use consistent conditions between the context menu and the operate palette. 
- Allowing users with read only access to the tenants page.
- Fixing current user integration test.
- Ensuring schedule methods are locked appropriately.
- Addressing comments from PR.

This closes #698

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-21 23:52:01 -04:00
Oleg Zhurakousky 0dbba811f3 NIFI-2298 This closes #687 added Kafka consume attributes to a FlowFile 2016-07-21 22:56:24 -04:00
jpercivall 4e224c283f NIFI-1899 reworking bi-directional Email processing in ListenSMTP 
This closes #483
 2016-07-21 10:39:21 -04:00
Andre F de Miranda 4f672832c0 NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEmailHeaders processors - Introduce ListenSMTP (allows NiFi to receive data via email) - Addresses @ijokarumawak and @@JPercivall PR comments 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-21 10:26:30 -04:00
Scott Aslan f352ea10b7 [NIFI-2107] [NIFI-2143] Update content-viewer, error, and login pages...Fix Provenance filter combo text. This closes #684 2016-07-21 08:22:22 -04:00
Mark Payne 5eba2b763e NIFI-2334: Delegate requests for cluster info to the cluster coordinator 
This closes #697

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 21:38:53 -04:00
Yolanda M. Davis 35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue 
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-07-21 10:35:42 +09:00
Mark Payne 370d88eeeb NIFI-2333: Consider reporting tasks and controller services when determining whether or not flow is empty 
This closes #693

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 20:06:05 -04:00
Mark Payne 10b91ffe6c NIFI-2332: Ensure that bulletin node address is set when clustered but not overwritten if already set 
This closes #692

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 19:44:32 -04:00
Mark Payne 7f2bda29d9 NIFI-2289: Ensure that we include Node ID's of all nodes when finding cluster coordinator, even if the node is currently still connecting or has not yet joined the cluster, which ccan be the case if all nodes in the cluster are restarting at the same time. 
This closes #681

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:50:25 -04:00
Mark Payne 39a4d84a62 NIFI-2330: Ensure that we set ProcessGroupDTO's contents after populating sets of components, as the contents dto now copies the sets 
This closes #686

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:05:42 -04:00
joewitt 2a8be95480 NIFI-2326 This closes #685. fixed test breaking static class causing ordering issues. Addressed potential issue in NarClassLoaders for multi-init scenarios - now idempotent for a given config 2016-07-20 15:13:37 -04:00
mans2singh 259f5bba47 NIFI-1972 - Ignite processor 
This closes #502.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2016-07-20 18:39:19 +02:00
Mark Payne 2a7f135f1c NIFI-2319: Ensure that when we set cluster node id's and node addresses, that we do so only if they are not already populated 
This closes #680

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:39:57 -04:00
Mark Payne 108c815988 NIFI-2324: Log number of requests per URI if we have too many outstanding requests to replicate 
This closes #683

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:22:24 -04:00
Scott Aslan 8f23afde50 [NIFI-2257] [NIFI-2294] refresh updateattribute processor advanced shell and fix connection config setting tab scrolling issue 
[NIFI-2270] Update splash screen
This closes #646
 2016-07-20 06:59:30 -04:00
Matt Burgess f1ba240326 NIFI-2156: Add ListDatabaseTables processor 
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 13:00:43 -04:00
Bryan Bende 8e2663c54d NIFI-2309 Correcting AmbariReportingTask so it reports total task duration as seconds and as nano-seconds 
This closes #672

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 11:35:09 -04:00
Scott Aslan deb2819bfb [NIFI-2105] [NIFI-2106] fix status history dialog issues. This closes #673 2016-07-19 07:33:34 -04:00
Mark Payne 41c0f19e48 NIFI-2305: Do not run processors that are marked as Primary Node Only if disconnected from cluster 
This closes #667

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-18 15:54:14 -04:00
Oleg Zhurakousky f4d2919955 NIFI-826 (part deux) 
- fixed clustering issues discovered after NIFI-826 was applied
 2016-07-18 15:49:24 -04:00
Matt Gilman aa91032cde NIFI-2272: 
- Ensuring the appropriate visibilty of the action in the policy management page.
NIFI-2273:
- Ensuring we load the policy or inform the user of the appropriate permissions of the effective policy.
NIFI-2239:
- Providing help tooltips for the policies in the management page.
NIFI-2283:
- Adding auditing for access policies, users, and groups.
NIFI-2263:
- Not replicating history requests throughout the cluster.
NIFI-2096:
- Fixing upload template file input in Firefox.
NIFI-2301:
- Removing relevant policies after component deletion.
 2016-07-18 15:05:54 -04:00
Mark Payne 5c8636edf4 NIFI-2289: Directly ask ZooKeeper which node is cluster coordinator and add watches on the ZNode rather than relying on Node Status Updates over the cluster protocol because cluster protocol may get the events out-of-order 
This closes #665.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-07-18 10:13:42 -04:00
Matt Burgess 01cae23745 NIFI-2157: Add GenerateTableFetch processor 
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-17 17:54:42 -04:00
Matt Burgess 1c5975da86 NIFI-2174: Fix handling of time/date types in QueryCassandra 
This closes #661

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-16 13:31:21 -04:00
Oleg Zhurakousky 52a961873b NIFI-826 This closes #617. Added deterministic template support 2016-07-15 20:41:18 -04:00
Mark Payne 4d4c525d9c NIFI-2281: Allow connections to be moved away from running local input ports and funnels 
This closes #662

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 16:36:19 -04:00
Mark Payne c81dc1959a NIFI-1992: 
- Updated site-to-site client and server to support clustered nifi instances
NIFI-2274:
- Ensuring we use the correct URI when updating a connection.

This closes #530
 2016-07-15 16:13:59 -04:00
Joe Gresock b67c9b6f76 NIFI-2250: Enabling EL on GetSQS Queue URL 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:59:37 -04:00
Koji Kawamura e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly 
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:47:37 -04:00
Matt Gilman 5cd5a4ce78 NIFI-2260: 
- Addressing issue searching provenance on a specific node.
- Fixing issues viewing content and replaying events.

This closes #658.
 2016-07-15 12:14:24 -04:00
Koji Kawamura 53326c7f9b NIFI-2267: A way for Processor to know node type 
- Added NodeTypeProvider to expose flowController's isClustered and
  isPrimaryNode so that processor can know if it's running on a cluster
  and if it's a primary node.
- Added mechanism to simulate clustered or not, and primary or not, for testing

This closes #657

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 11:38:50 -04:00
Bryan Bende afc038d2c0 NIFI-2194 This closes #659. Caching metrics in AmbariReportingTask so each iteration sends last iteration's metrics 2016-07-15 11:25:22 -04:00
jpercivall 54574e3889 NIFI-2173 Fixing typo in LDAP referral strategy 
This closes #629
 2016-07-15 09:55:37 -04:00
Aldrin Piri d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00
Yolanda M. Davis 048ba5366c NIFI-2020 - initial commit for custom transformation support 
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #564
 2016-07-14 18:04:14 -04:00
Bryan Rosander 1da18a3f40 NIFI-2222 - Fixing SslContextFactory Properties set by keyStorePasswd and keyPasswd 
This closes #632

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-07-14 14:07:24 -07:00