Commit Graph

2814 Commits

Author SHA1 Message Date
Matt Gilman 4a4d60e6af NIFI-2307: - Enforcing connection permissions based on the source and destination comonent. - Removing connection specific access policies. NIFI-2265: - Filtering out sensitive details in component status and status history when appropriate. NIFI-1800: - Adding parent process group id to the Controller Services table. NIFI-2077: - Removing some old un-used icons following the UI refresh. NIFI-2242: - Requiring write permissions for all components in a selection. NIFI-2080: - Updating style of the name in the selection context to handle scroll bars and use available width. NIFI-2331: - Addressing issue when removing a user/group which was causing the tenant policy to be removed. NIFI-2335: - Ensuring the flow is saved after starting/stopping a process group. NIFI-2235: - Ensuring we use consistent conditions between the context menu and the operate palette.
- Allowing users with read only access to the tenants page.
- Fixing current user integration test.
- Ensuring schedule methods are locked appropriately.
- Addressing comments from PR.

This closes #698

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-21 23:52:01 -04:00
Oleg Zhurakousky 0dbba811f3 NIFI-2298 This closes #687 added Kafka consume attributes to a FlowFile 2016-07-21 22:56:24 -04:00
Rob Moran 99b4af7820 NIFI-2211 This closes #700. This closes #691. Updating NiFi architecture graphics for overview doc 2016-07-21 12:16:21 -04:00
Andrew Lim 0e8e19a479 NIFI-2320 Update existing Getting Starting images with new UI images 2016-07-21 10:57:06 -04:00
jpercivall 4e224c283f NIFI-1899 reworking bi-directional Email processing in ListenSMTP
This closes #483
2016-07-21 10:39:21 -04:00
Andre F de Miranda 4f672832c0 NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEmailHeaders processors - Introduce ListenSMTP (allows NiFi to receive data via email) - Addresses @ijokarumawak and @@JPercivall PR comments
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-21 10:26:30 -04:00
Scott Aslan f352ea10b7 [NIFI-2107] [NIFI-2143] Update content-viewer, error, and login pages...Fix Provenance filter combo text. This closes #684 2016-07-21 08:22:22 -04:00
Mark Payne 5eba2b763e NIFI-2334: Delegate requests for cluster info to the cluster coordinator
This closes #697

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-20 21:38:53 -04:00
Yolanda M. Davis 35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-07-21 10:35:42 +09:00
Mark Payne 370d88eeeb NIFI-2333: Consider reporting tasks and controller services when determining whether or not flow is empty
This closes #693

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-20 20:06:05 -04:00
Mark Payne 10b91ffe6c NIFI-2332: Ensure that bulletin node address is set when clustered but not overwritten if already set
This closes #692

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-20 19:44:32 -04:00
Mark Payne 7f2bda29d9 NIFI-2289: Ensure that we include Node ID's of all nodes when finding cluster coordinator, even if the node is currently still connecting or has not yet joined the cluster, which ccan be the case if all nodes in the cluster are restarting at the same time.
This closes #681

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-20 16:50:25 -04:00
Mark Payne 39a4d84a62 NIFI-2330: Ensure that we set ProcessGroupDTO's contents after populating sets of components, as the contents dto now copies the sets
This closes #686

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-20 16:05:42 -04:00
joewitt 2a8be95480 NIFI-2326 This closes #685. fixed test breaking static class causing ordering issues. Addressed potential issue in NarClassLoaders for multi-init scenarios - now idempotent for a given config 2016-07-20 15:13:37 -04:00
mans2singh 259f5bba47 NIFI-1972 - Ignite processor
This closes #502.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2016-07-20 18:39:19 +02:00
Mark Payne 2a7f135f1c NIFI-2319: Ensure that when we set cluster node id's and node addresses, that we do so only if they are not already populated
This closes #680

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-20 11:39:57 -04:00
Mark Payne 108c815988 NIFI-2324: Log number of requests per URI if we have too many outstanding requests to replicate
This closes #683

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-20 11:22:24 -04:00
Koji Kawamura 76fe751c22 Added PGP key to KEYS file. 2016-07-21 00:09:16 +09:00
Scott Aslan 8f23afde50 [NIFI-2257] [NIFI-2294] refresh updateattribute processor advanced shell and fix connection config setting tab scrolling issue
[NIFI-2270] Update splash screen
This closes #646
2016-07-20 06:59:30 -04:00
Oleg Zhurakousky 6c7c3c0822 NIFI-826 (part 3)
- fixed ID generation routine that was causing miss-identification of the components
2016-07-19 15:52:35 -04:00
Bryan Bende 1c6d58b959 NIFI-929 Changing permissions of nifi.pid to be readable by all, writable only by user
This closes #677

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-19 15:15:16 -04:00
Matt Burgess f1ba240326 NIFI-2156: Add ListDatabaseTables processor
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-19 13:00:43 -04:00
Bryan Bende 8e2663c54d NIFI-2309 Correcting AmbariReportingTask so it reports total task duration as seconds and as nano-seconds
This closes #672

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-19 11:35:09 -04:00
Scott Aslan deb2819bfb [NIFI-2105] [NIFI-2106] fix status history dialog issues. This closes #673 2016-07-19 07:33:34 -04:00
Bryan Bende e308c6464c NIFI-929 Changing RunNiFi to write just the pid to nifi.pid and the full status to nifi.status
This closes #668

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-18 17:27:15 -04:00
Mark Payne 41c0f19e48 NIFI-2305: Do not run processors that are marked as Primary Node Only if disconnected from cluster
This closes #667

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-18 15:54:14 -04:00
Oleg Zhurakousky f4d2919955 NIFI-826 (part deux)
- fixed clustering issues discovered after NIFI-826 was applied
2016-07-18 15:49:24 -04:00
Matt Gilman aa91032cde NIFI-2272:
- Ensuring the appropriate visibilty of the action in the policy management page.
NIFI-2273:
- Ensuring we load the policy or inform the user of the appropriate permissions of the effective policy.
NIFI-2239:
- Providing help tooltips for the policies in the management page.
NIFI-2283:
- Adding auditing for access policies, users, and groups.
NIFI-2263:
- Not replicating history requests throughout the cluster.
NIFI-2096:
- Fixing upload template file input in Firefox.
NIFI-2301:
- Removing relevant policies after component deletion.
2016-07-18 15:05:54 -04:00
Mark Payne 5c8636edf4 NIFI-2289: Directly ask ZooKeeper which node is cluster coordinator and add watches on the ZNode rather than relying on Node Status Updates over the cluster protocol because cluster protocol may get the events out-of-order
This closes #665.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-07-18 10:13:42 -04:00
Matt Burgess 01cae23745 NIFI-2157: Add GenerateTableFetch processor
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-17 17:54:42 -04:00
joewitt ad02b43099 NIFI-1157 removed methods no longer needed due to deprecation cleanup. In NIFI-2280 also ensure they were deprecated on the 0.x line. This closes #663. 2016-07-16 16:07:12 -04:00
Matt Burgess 1c5975da86 NIFI-2174: Fix handling of time/date types in QueryCassandra
This closes #661

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-16 13:31:21 -04:00
Oleg Zhurakousky 52a961873b NIFI-826 This closes #617. Added deterministic template support 2016-07-15 20:41:18 -04:00
Mark Payne 4d4c525d9c NIFI-2281: Allow connections to be moved away from running local input ports and funnels
This closes #662

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-15 16:36:19 -04:00
Mark Payne c81dc1959a NIFI-1992:
- Updated site-to-site client and server to support clustered nifi instances
NIFI-2274:
- Ensuring we use the correct URI when updating a connection.

This closes #530
2016-07-15 16:13:59 -04:00
Joe Gresock b67c9b6f76 NIFI-2250: Enabling EL on GetSQS Queue URL
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-15 12:59:37 -04:00
Koji Kawamura e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-15 12:47:37 -04:00
Matt Gilman 5cd5a4ce78 NIFI-2260:
- Addressing issue searching provenance on a specific node.
- Fixing issues viewing content and replaying events.

This closes #658.
2016-07-15 12:14:24 -04:00
Koji Kawamura 53326c7f9b NIFI-2267: A way for Processor to know node type
- Added NodeTypeProvider to expose flowController's isClustered and
  isPrimaryNode so that processor can know if it's running on a cluster
  and if it's a primary node.
- Added mechanism to simulate clustered or not, and primary or not, for testing

This closes #657

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-15 11:38:50 -04:00
Bryan Bende afc038d2c0 NIFI-2194 This closes #659. Caching metrics in AmbariReportingTask so each iteration sends last iteration's metrics 2016-07-15 11:25:22 -04:00
jpercivall 54574e3889 NIFI-2173 Fixing typo in LDAP referral strategy
This closes #629
2016-07-15 09:55:37 -04:00
Aldrin Piri d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00
Yolanda M. Davis 048ba5366c NIFI-2020 - initial commit for custom transformation support
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #564
2016-07-14 18:04:14 -04:00
Bryan Rosander 1da18a3f40 NIFI-2222 - Fixing SslContextFactory Properties set by keyStorePasswd and keyPasswd
This closes #632

Signed-off-by: James Wing <jvwing@gmail.com>
2016-07-14 14:07:24 -07:00
Andy LoPresto 4e3580f58e
NIFI-1688 Resolved issue in PostHTTP -- now uses SSLContextService's protocol setting. Modified construction of SSLSocketFactory to avoid hardcoding supported protocol. Added debug information for supported cipher suites.
This closes #624.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-07-14 16:43:48 -04:00
Puspendu Banerjee 6d2168049a fixes NIFI-1989
This closes #514

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-14 15:59:45 -04:00
James Wing a7c5b88a47
NIFI-2062 AWS SDK Update:
* Updated the AWS SDK dependency version to 1.11.8
* Removed GetDynamoDBTest references to JsonObject class dropped from AWS SDK
* Fixed integration test ITPutSNS.testPublish() - exception from not evaluating expressions
* Ignored integration test ITPutS3Object.testS3MultipartAgeoff() - did not work before or after SDK update

This closes #562.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-07-14 15:27:26 -04:00
Mark Payne f6136b69e5 NIFI-1413: Rebased against master and updated templates endpoint merge to use template entities instead of template dto's
This closes #649
2016-07-14 15:19:47 -04:00
Mark Payne 329192a7d3 NIFI-1413: Ensure that if a node's templates don't match the clusters that we take the following actions: -Local templates remain but aren't shown in the cluster's templates. -Any templates from the cluster that don't exist on the node are added to the node. -Any conflicting template definitions are replaced by those in the cluster
This closes #596
2016-07-14 15:01:46 -04:00
Scott Aslan 02784b5fca [NIFI-2227] fix race condition for showing the view button on the flow file details dialog
[NIFI-2109] update check boxes
[NIFI-2226] reset controller services properties table size on dialog open
This closes #653
2016-07-14 14:50:14 -04:00