Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,472 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

2472 Commits

Author SHA1 Message Date
Mark Payne b082858595 Revert "NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions." 
This reverts commit 35ff0975bf.
 2016-07-25 12:35:43 -04:00
Mark Payne 35ff0975bf NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions. 2016-07-25 12:14:13 -04:00
Scott Aslan 26ffc6d7ec [NIFI-2050] update dialog advanced buttons 
[NIFI-2076] fix Add inline controller service dialog description width
[NIFI-2143] update to combo width
[NIFI-2136] [NIFI-2139] [NIFI-2134] update provenance details dialog
[NIFI-2368] add transparent glasspane when in a shell
[NIFI-2134] update flow-file details padding and .unset font-weight
[NIFI-2349] [NIFI-2351] update policies shell styles
[NIFI-2350] update empty queue dialog styles
[NIFI-2367] update links on message pane
This closes #703
 2016-07-25 08:24:23 -04:00
Mark Payne 4e08ea6525 NIFI-2376 This closes #713. Ensure that we don't decrement claimant count more than once when append() throws an Exception 2016-07-24 17:00:21 -04:00
Mark Payne 6932a53ec9 NIFI-2360: Leave ZooKeeper running when a node is disconnected. Do not allow the last node in the cluster to be disconnected. Change ClusterProtocoLHeartbeater to use RetryNTime retry strategy instead of RetryForever because web requests could block on this 
This closes #705

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-22 23:57:00 -04:00
joewitt 393a3925dd NIFI-2253 flexibly cleaning zookeeper connect string 
This closes #704

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-22 18:24:52 -04:00
Rob Moran 7e2740160a NIFI-2361 This closes #708. Update cluster information and add new graphic 2016-07-22 14:15:00 -04:00
Joey Frazee 4179ce6644 NIFI-2090 This closes #669. Added options for segment names, parse fields in ExtractHL7Attributes 2016-07-22 10:11:03 -04:00
Matt Gilman 4a4d60e6af NIFI-2307: - Enforcing connection permissions based on the source and destination comonent. - Removing connection specific access policies. NIFI-2265: - Filtering out sensitive details in component status and status history when appropriate. NIFI-1800: - Adding parent process group id to the Controller Services table. NIFI-2077: - Removing some old un-used icons following the UI refresh. NIFI-2242: - Requiring write permissions for all components in a selection. NIFI-2080: - Updating style of the name in the selection context to handle scroll bars and use available width. NIFI-2331: - Addressing issue when removing a user/group which was causing the tenant policy to be removed. NIFI-2335: - Ensuring the flow is saved after starting/stopping a process group. NIFI-2235: - Ensuring we use consistent conditions between the context menu and the operate palette. 
- Allowing users with read only access to the tenants page.
- Fixing current user integration test.
- Ensuring schedule methods are locked appropriately.
- Addressing comments from PR.

This closes #698

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-21 23:52:01 -04:00
Oleg Zhurakousky 0dbba811f3 NIFI-2298 This closes #687 added Kafka consume attributes to a FlowFile 2016-07-21 22:56:24 -04:00
Rob Moran 99b4af7820 NIFI-2211 This closes #700. This closes #691. Updating NiFi architecture graphics for overview doc 2016-07-21 12:16:21 -04:00
Andrew Lim 0e8e19a479 NIFI-2320 Update existing Getting Starting images with new UI images 2016-07-21 10:57:06 -04:00
jpercivall 4e224c283f NIFI-1899 reworking bi-directional Email processing in ListenSMTP 
This closes #483
 2016-07-21 10:39:21 -04:00
Andre F de Miranda 4f672832c0 NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEmailHeaders processors - Introduce ListenSMTP (allows NiFi to receive data via email) - Addresses @ijokarumawak and @@JPercivall PR comments 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-21 10:26:30 -04:00
Scott Aslan f352ea10b7 [NIFI-2107] [NIFI-2143] Update content-viewer, error, and login pages...Fix Provenance filter combo text. This closes #684 2016-07-21 08:22:22 -04:00
Mark Payne 5eba2b763e NIFI-2334: Delegate requests for cluster info to the cluster coordinator 
This closes #697

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 21:38:53 -04:00
Yolanda M. Davis 35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue 
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-07-21 10:35:42 +09:00
Mark Payne 370d88eeeb NIFI-2333: Consider reporting tasks and controller services when determining whether or not flow is empty 
This closes #693

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 20:06:05 -04:00
Mark Payne 10b91ffe6c NIFI-2332: Ensure that bulletin node address is set when clustered but not overwritten if already set 
This closes #692

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 19:44:32 -04:00
Mark Payne 7f2bda29d9 NIFI-2289: Ensure that we include Node ID's of all nodes when finding cluster coordinator, even if the node is currently still connecting or has not yet joined the cluster, which ccan be the case if all nodes in the cluster are restarting at the same time. 
This closes #681

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:50:25 -04:00
Mark Payne 39a4d84a62 NIFI-2330: Ensure that we set ProcessGroupDTO's contents after populating sets of components, as the contents dto now copies the sets 
This closes #686

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:05:42 -04:00
joewitt 2a8be95480 NIFI-2326 This closes #685. fixed test breaking static class causing ordering issues. Addressed potential issue in NarClassLoaders for multi-init scenarios - now idempotent for a given config 2016-07-20 15:13:37 -04:00
mans2singh 259f5bba47 NIFI-1972 - Ignite processor 
This closes #502.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2016-07-20 18:39:19 +02:00
Mark Payne 2a7f135f1c NIFI-2319: Ensure that when we set cluster node id's and node addresses, that we do so only if they are not already populated 
This closes #680

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:39:57 -04:00
Mark Payne 108c815988 NIFI-2324: Log number of requests per URI if we have too many outstanding requests to replicate 
This closes #683

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:22:24 -04:00
Koji Kawamura 76fe751c22 Added PGP key to KEYS file. 2016-07-21 00:09:16 +09:00
Scott Aslan 8f23afde50 [NIFI-2257] [NIFI-2294] refresh updateattribute processor advanced shell and fix connection config setting tab scrolling issue 
[NIFI-2270] Update splash screen
This closes #646
 2016-07-20 06:59:30 -04:00
Oleg Zhurakousky 6c7c3c0822 NIFI-826 (part 3) 
- fixed ID generation routine that was causing miss-identification of the components
 2016-07-19 15:52:35 -04:00
Bryan Bende 1c6d58b959 NIFI-929 Changing permissions of nifi.pid to be readable by all, writable only by user 
This closes #677

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 15:15:16 -04:00
Matt Burgess f1ba240326 NIFI-2156: Add ListDatabaseTables processor 
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 13:00:43 -04:00
Bryan Bende 8e2663c54d NIFI-2309 Correcting AmbariReportingTask so it reports total task duration as seconds and as nano-seconds 
This closes #672

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 11:35:09 -04:00
Scott Aslan deb2819bfb [NIFI-2105] [NIFI-2106] fix status history dialog issues. This closes #673 2016-07-19 07:33:34 -04:00
Bryan Bende e308c6464c NIFI-929 Changing RunNiFi to write just the pid to nifi.pid and the full status to nifi.status 
This closes #668

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-18 17:27:15 -04:00
Mark Payne 41c0f19e48 NIFI-2305: Do not run processors that are marked as Primary Node Only if disconnected from cluster 
This closes #667

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-18 15:54:14 -04:00
Oleg Zhurakousky f4d2919955 NIFI-826 (part deux) 
- fixed clustering issues discovered after NIFI-826 was applied
 2016-07-18 15:49:24 -04:00
Matt Gilman aa91032cde NIFI-2272: 
- Ensuring the appropriate visibilty of the action in the policy management page.
NIFI-2273:
- Ensuring we load the policy or inform the user of the appropriate permissions of the effective policy.
NIFI-2239:
- Providing help tooltips for the policies in the management page.
NIFI-2283:
- Adding auditing for access policies, users, and groups.
NIFI-2263:
- Not replicating history requests throughout the cluster.
NIFI-2096:
- Fixing upload template file input in Firefox.
NIFI-2301:
- Removing relevant policies after component deletion.
 2016-07-18 15:05:54 -04:00
Mark Payne 5c8636edf4 NIFI-2289: Directly ask ZooKeeper which node is cluster coordinator and add watches on the ZNode rather than relying on Node Status Updates over the cluster protocol because cluster protocol may get the events out-of-order 
This closes #665.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-07-18 10:13:42 -04:00
Matt Burgess 01cae23745 NIFI-2157: Add GenerateTableFetch processor 
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-17 17:54:42 -04:00
joewitt ad02b43099 NIFI-1157 removed methods no longer needed due to deprecation cleanup. In NIFI-2280 also ensure they were deprecated on the 0.x line. This closes #663. 2016-07-16 16:07:12 -04:00
Matt Burgess 1c5975da86 NIFI-2174: Fix handling of time/date types in QueryCassandra 
This closes #661

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-16 13:31:21 -04:00
Oleg Zhurakousky 52a961873b NIFI-826 This closes #617. Added deterministic template support 2016-07-15 20:41:18 -04:00
Mark Payne 4d4c525d9c NIFI-2281: Allow connections to be moved away from running local input ports and funnels 
This closes #662

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 16:36:19 -04:00
Mark Payne c81dc1959a NIFI-1992: 
- Updated site-to-site client and server to support clustered nifi instances
NIFI-2274:
- Ensuring we use the correct URI when updating a connection.

This closes #530
 2016-07-15 16:13:59 -04:00
Joe Gresock b67c9b6f76 NIFI-2250: Enabling EL on GetSQS Queue URL 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:59:37 -04:00
Koji Kawamura e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly 
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:47:37 -04:00
Matt Gilman 5cd5a4ce78 NIFI-2260: 
- Addressing issue searching provenance on a specific node.
- Fixing issues viewing content and replaying events.

This closes #658.
 2016-07-15 12:14:24 -04:00
Koji Kawamura 53326c7f9b NIFI-2267: A way for Processor to know node type 
- Added NodeTypeProvider to expose flowController's isClustered and
  isPrimaryNode so that processor can know if it's running on a cluster
  and if it's a primary node.
- Added mechanism to simulate clustered or not, and primary or not, for testing

This closes #657

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 11:38:50 -04:00
Bryan Bende afc038d2c0 NIFI-2194 This closes #659. Caching metrics in AmbariReportingTask so each iteration sends last iteration's metrics 2016-07-15 11:25:22 -04:00
jpercivall 54574e3889 NIFI-2173 Fixing typo in LDAP referral strategy 
This closes #629
 2016-07-15 09:55:37 -04:00
Aldrin Piri d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00