Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-08 11:05:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,585 Commits 147 Branches 203 Tags
Commit Graph

1112 Commits

Author SHA1 Message Date
Mark Payne
35ff0975bf NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions. 2016-07-25 12:14:13 -04:00
Scott Aslan
26ffc6d7ec [NIFI-2050] update dialog advanced buttons 
[NIFI-2076] fix Add inline controller service dialog description width
[NIFI-2143] update to combo width
[NIFI-2136] [NIFI-2139] [NIFI-2134] update provenance details dialog
[NIFI-2368] add transparent glasspane when in a shell
[NIFI-2134] update flow-file details padding and .unset font-weight
[NIFI-2349] [NIFI-2351] update policies shell styles
[NIFI-2350] update empty queue dialog styles
[NIFI-2367] update links on message pane
This closes #703
 2016-07-25 08:24:23 -04:00
Mark Payne
4e08ea6525 NIFI-2376 This closes #713. Ensure that we don't decrement claimant count more than once when append() throws an Exception 2016-07-24 17:00:21 -04:00
Mark Payne
6932a53ec9 NIFI-2360: Leave ZooKeeper running when a node is disconnected. Do not allow the last node in the cluster to be disconnected. Change ClusterProtocoLHeartbeater to use RetryNTime retry strategy instead of RetryForever because web requests could block on this 
This closes #705

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-22 23:57:00 -04:00
joewitt
393a3925dd NIFI-2253 flexibly cleaning zookeeper connect string 
This closes #704

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-22 18:24:52 -04:00
Joey Frazee
4179ce6644 NIFI-2090 This closes #669. Added options for segment names, parse fields in ExtractHL7Attributes 2016-07-22 10:11:03 -04:00
Matt Gilman
4a4d60e6af NIFI-2307: - Enforcing connection permissions based on the source and destination comonent. - Removing connection specific access policies. NIFI-2265: - Filtering out sensitive details in component status and status history when appropriate. NIFI-1800: - Adding parent process group id to the Controller Services table. NIFI-2077: - Removing some old un-used icons following the UI refresh. NIFI-2242: - Requiring write permissions for all components in a selection. NIFI-2080: - Updating style of the name in the selection context to handle scroll bars and use available width. NIFI-2331: - Addressing issue when removing a user/group which was causing the tenant policy to be removed. NIFI-2335: - Ensuring the flow is saved after starting/stopping a process group. NIFI-2235: - Ensuring we use consistent conditions between the context menu and the operate palette. 
- Allowing users with read only access to the tenants page.
- Fixing current user integration test.
- Ensuring schedule methods are locked appropriately.
- Addressing comments from PR.

This closes #698

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-21 23:52:01 -04:00
Oleg Zhurakousky
0dbba811f3 NIFI-2298 This closes #687 added Kafka consume attributes to a FlowFile 2016-07-21 22:56:24 -04:00
jpercivall
4e224c283f NIFI-1899 reworking bi-directional Email processing in ListenSMTP 
This closes #483
 2016-07-21 10:39:21 -04:00
Andre F de Miranda
4f672832c0 NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEmailHeaders processors - Introduce ListenSMTP (allows NiFi to receive data via email) - Addresses @ijokarumawak and @@JPercivall PR comments 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-21 10:26:30 -04:00
Scott Aslan
f352ea10b7 [NIFI-2107] [NIFI-2143] Update content-viewer, error, and login pages...Fix Provenance filter combo text. This closes #684 2016-07-21 08:22:22 -04:00
Mark Payne
5eba2b763e NIFI-2334: Delegate requests for cluster info to the cluster coordinator 
This closes #697

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 21:38:53 -04:00
Yolanda M. Davis
35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue 
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-07-21 10:35:42 +09:00
Mark Payne
370d88eeeb NIFI-2333: Consider reporting tasks and controller services when determining whether or not flow is empty 
This closes #693

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 20:06:05 -04:00
Mark Payne
10b91ffe6c NIFI-2332: Ensure that bulletin node address is set when clustered but not overwritten if already set 
This closes #692

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 19:44:32 -04:00
Mark Payne
7f2bda29d9 NIFI-2289: Ensure that we include Node ID's of all nodes when finding cluster coordinator, even if the node is currently still connecting or has not yet joined the cluster, which ccan be the case if all nodes in the cluster are restarting at the same time. 
This closes #681

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:50:25 -04:00
Mark Payne
39a4d84a62 NIFI-2330: Ensure that we set ProcessGroupDTO's contents after populating sets of components, as the contents dto now copies the sets 
This closes #686

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:05:42 -04:00
joewitt
2a8be95480 NIFI-2326 This closes #685. fixed test breaking static class causing ordering issues. Addressed potential issue in NarClassLoaders for multi-init scenarios - now idempotent for a given config 2016-07-20 15:13:37 -04:00
mans2singh
259f5bba47 NIFI-1972 - Ignite processor 
This closes #502.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2016-07-20 18:39:19 +02:00
Mark Payne
2a7f135f1c NIFI-2319: Ensure that when we set cluster node id's and node addresses, that we do so only if they are not already populated 
This closes #680

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:39:57 -04:00
Mark Payne
108c815988 NIFI-2324: Log number of requests per URI if we have too many outstanding requests to replicate 
This closes #683

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:22:24 -04:00
Scott Aslan
8f23afde50 [NIFI-2257] [NIFI-2294] refresh updateattribute processor advanced shell and fix connection config setting tab scrolling issue 
[NIFI-2270] Update splash screen
This closes #646
 2016-07-20 06:59:30 -04:00
Matt Burgess
f1ba240326 NIFI-2156: Add ListDatabaseTables processor 
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 13:00:43 -04:00
Bryan Bende
8e2663c54d NIFI-2309 Correcting AmbariReportingTask so it reports total task duration as seconds and as nano-seconds 
This closes #672

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 11:35:09 -04:00
Scott Aslan
deb2819bfb [NIFI-2105] [NIFI-2106] fix status history dialog issues. This closes #673 2016-07-19 07:33:34 -04:00
Mark Payne
41c0f19e48 NIFI-2305: Do not run processors that are marked as Primary Node Only if disconnected from cluster 
This closes #667

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-18 15:54:14 -04:00
Oleg Zhurakousky
f4d2919955 NIFI-826 (part deux) 
- fixed clustering issues discovered after NIFI-826 was applied
 2016-07-18 15:49:24 -04:00
Matt Gilman
aa91032cde NIFI-2272: 
- Ensuring the appropriate visibilty of the action in the policy management page.
NIFI-2273:
- Ensuring we load the policy or inform the user of the appropriate permissions of the effective policy.
NIFI-2239:
- Providing help tooltips for the policies in the management page.
NIFI-2283:
- Adding auditing for access policies, users, and groups.
NIFI-2263:
- Not replicating history requests throughout the cluster.
NIFI-2096:
- Fixing upload template file input in Firefox.
NIFI-2301:
- Removing relevant policies after component deletion.
 2016-07-18 15:05:54 -04:00
Mark Payne
5c8636edf4 NIFI-2289: Directly ask ZooKeeper which node is cluster coordinator and add watches on the ZNode rather than relying on Node Status Updates over the cluster protocol because cluster protocol may get the events out-of-order 
This closes #665.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-07-18 10:13:42 -04:00
Matt Burgess
01cae23745 NIFI-2157: Add GenerateTableFetch processor 
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-17 17:54:42 -04:00
Matt Burgess
1c5975da86 NIFI-2174: Fix handling of time/date types in QueryCassandra 
This closes #661

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-16 13:31:21 -04:00
Oleg Zhurakousky
52a961873b NIFI-826 This closes #617. Added deterministic template support 2016-07-15 20:41:18 -04:00
Mark Payne
4d4c525d9c NIFI-2281: Allow connections to be moved away from running local input ports and funnels 
This closes #662

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 16:36:19 -04:00
Mark Payne
c81dc1959a NIFI-1992: 
- Updated site-to-site client and server to support clustered nifi instances
NIFI-2274:
- Ensuring we use the correct URI when updating a connection.

This closes #530
 2016-07-15 16:13:59 -04:00
Joe Gresock
b67c9b6f76 NIFI-2250: Enabling EL on GetSQS Queue URL 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:59:37 -04:00
Koji Kawamura
e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly 
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:47:37 -04:00
Matt Gilman
5cd5a4ce78 NIFI-2260: 
- Addressing issue searching provenance on a specific node.
- Fixing issues viewing content and replaying events.

This closes #658.
 2016-07-15 12:14:24 -04:00
Koji Kawamura
53326c7f9b NIFI-2267: A way for Processor to know node type 
- Added NodeTypeProvider to expose flowController's isClustered and
  isPrimaryNode so that processor can know if it's running on a cluster
  and if it's a primary node.
- Added mechanism to simulate clustered or not, and primary or not, for testing

This closes #657

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 11:38:50 -04:00
Bryan Bende
afc038d2c0 NIFI-2194 This closes #659. Caching metrics in AmbariReportingTask so each iteration sends last iteration's metrics 2016-07-15 11:25:22 -04:00
jpercivall
54574e3889 NIFI-2173 Fixing typo in LDAP referral strategy 
This closes #629
 2016-07-15 09:55:37 -04:00
Aldrin Piri
d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00
Yolanda M. Davis
048ba5366c NIFI-2020 - initial commit for custom transformation support 
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #564
 2016-07-14 18:04:14 -04:00
Bryan Rosander
1da18a3f40 NIFI-2222 - Fixing SslContextFactory Properties set by keyStorePasswd and keyPasswd 
This closes #632

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-07-14 14:07:24 -07:00
Andy LoPresto
4e3580f58e
NIFI-1688 Resolved issue in PostHTTP -- now uses SSLContextService's protocol setting. Modified construction of SSLSocketFactory to avoid hardcoding supported protocol. Added debug information for supported cipher suites. 
This closes #624.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-07-14 16:43:48 -04:00
Puspendu Banerjee
6d2168049a fixes NIFI-1989 
This closes #514

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-14 15:59:45 -04:00
James Wing
a7c5b88a47
NIFI-2062 AWS SDK Update: 
* Updated the AWS SDK dependency version to 1.11.8
* Removed GetDynamoDBTest references to JsonObject class dropped from AWS SDK
* Fixed integration test ITPutSNS.testPublish() - exception from not evaluating expressions
* Ignored integration test ITPutS3Object.testS3MultipartAgeoff() - did not work before or after SDK update

This closes #562.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-07-14 15:27:26 -04:00
Mark Payne
f6136b69e5 NIFI-1413: Rebased against master and updated templates endpoint merge to use template entities instead of template dto's 
This closes #649
 2016-07-14 15:19:47 -04:00
Mark Payne
329192a7d3 NIFI-1413: Ensure that if a node's templates don't match the clusters that we take the following actions: -Local templates remain but aren't shown in the cluster's templates. -Any templates from the cluster that don't exist on the node are added to the node. -Any conflicting template definitions are replaced by those in the cluster 
This closes #596
 2016-07-14 15:01:46 -04:00
Scott Aslan
02784b5fca [NIFI-2227] fix race condition for showing the view button on the flow file details dialog 
[NIFI-2109] update check boxes
[NIFI-2226] reset controller services properties table size on dialog open
This closes #653
 2016-07-14 14:50:14 -04:00
Mark Payne
2540573d77 NIFI-2087: Do not update the lucene index to delete expired events. Instead, just wait for the entire index to expire and remove the files for that index. This is much more efficient. 
This closes #652

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-14 14:49:30 -04:00