Commit Graph

604 Commits

Author SHA1 Message Date
Oleg Zhurakousky 4a49587533 NIFI-2610 annotated unstable tests with @Ignore
This closes #918
2016-08-23 13:13:05 -04:00
Mark Payne 8cc670c8a6 NIFI-2634: Ensure that we check whether or not the Site-to-Site protocol is set when importing template, instead of assuming that it will be
This closes #921

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-23 11:19:44 -04:00
Scott Aslan 3f60eac544 [NIFI-2599] Enhance Status History Dialog. This closes #894 2016-08-23 10:53:10 -04:00
Matt Gilman 087622eadc NIFI-2606:
- Addressing issue when fingerprinting ReportingTasks and ControllerServices properties with default values.
- Ensuring the flow is saved when templates are created and imported.
- Ensuring default values are included in templates.
- Fixing unit tests.
This closes #908.
2016-08-22 13:35:15 -04:00
Mark Payne 1fcec3747b NIFI-2617: Instead of retrying an infinite number of times to communicate with ZooKeeper, should try only for a short period in CuratorLeaderElectionManager. This is because web requests may be blocked waiting on a determination of which node is cluster coordinator
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #906
2016-08-22 13:24:22 -04:00
Mark Payne 5fab783b50
NIFI-2609: Ensure that we handle URIs for Remote Process Groups that do not have a path of /nifi or /nifi/
This closes #902.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-22 13:21:42 -04:00
Matt Gilman 3378426f35 NIFI-2581: Keeping context menu and tooltips open when refreshing the canvas.
This closes #899.
2016-08-19 19:36:26 +02:00
Scott Aslan a181c7b9d7 [NIFI-2601] Update bower.json to use specific versions. This closes #897 2016-08-19 10:34:48 -04:00
Jeff Storck 31ca8d02f7 NIFI-2488 Fixed BulletinDTOs not getting their node addresses set properly during bulletin merging. This closes #888 2016-08-19 08:32:00 -04:00
Matt Gilman 6b5950647a NIFI-2596:
- Adding tooltip for property descriptor on mouse enter of table cell.

This closes #893.
2016-08-18 17:23:30 -04:00
Matt Gilman 57648308db NIFI-2597:
- Updating the correct object when attempting to create a self loop.
2016-08-18 17:15:16 -04:00
Matt Gilman 87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins.
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.

This closes #892.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-18 17:06:28 -04:00
Matt Gilman f3387426a0 NIFI-2587:
- Adding additional authorization for accessing component property history.
2016-08-18 17:05:32 -04:00
Bryan Bende e0e4b3407a NIFI-2574 This clsoes #887. Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables 2016-08-18 12:19:46 -04:00
Scott Aslan 0e90a0f76a [NIFI-2488] update UI to relect changes to ActionDTO and BulletinDTO. This closes #882 2016-08-18 09:38:16 -04:00
Jeff Storck 08735a4f57 NIFI-2488 Wrapping ActionDTO and BulletinDTO in entities to be able to provide readability permission to the client 2016-08-18 09:37:11 -04:00
Mark Payne 91a59a8a5a NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account
This closes #836.
2016-08-18 08:33:45 -04:00
Matt Gilman 3d1a24ab7d NIFI-2578:
- Ensuring NiFi still attempts to issue a registration request to support 1.x -> 0.x site to site.
2016-08-17 15:35:16 -04:00
joewitt b2e468ecf8
NIFI-2574 updated to reflect new accessor methods for nifi properties with kerberos service
This closes #872.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-17 10:51:55 -07:00
joewitt a5261914fb NIFI-2574 merging latest kerb changes to adjust for NiFiProperties 2016-08-17 09:06:18 -07:00
joewitt 7c99b5e638 NIFI-2574 fixed queue swap threshold setting 2016-08-17 09:05:36 -07:00
Matt Gilman 3f7216ab84 NIFI-2561: - Decoupling kerberos service and spnego principles and keytabs.
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #873
2016-08-17 08:14:05 -04:00
joewitt d9633757a6 NIFI-2574 fix spring context definitions 2016-08-17 03:38:31 -07:00
joewitt 6bf7e7f325 NIFI-2574 merging master with cluster changes to updated NiFiProperties approach 2016-08-17 01:23:54 -07:00
joewitt 7d7401add4 NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it. 2016-08-17 00:10:07 -07:00
Mark Payne e42ea9ad45 NIFI-2566: Refactored to allow just the Leader Election Manager to be responsible for determining who is the Cluster Coordinator
NIFI-2566: Removed storage of cluster roles from heartbeats and NodeConnectionStatus; use LeaderElectionManager to determine roles instead

NIFI-2566: Updated Heartbeats so that if a node is out-of-sync with cluster topology, cluster coordinator will provide updated information back to the nodes

NIFI-2566: Fixed issue that prevented standalone instance from starting by creating a standalone-instance version of the Leader Election Manager. Also added Controller Service enabled/disabled state to fingerprint rather than attempting to update the state when joining the cluster, as the implementation was incorrect and the correct implementation will be a rather significant effort that doesn't have to happen for 1.0.0 release

This closes #866

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-16 20:39:04 -04:00
Matt Gilman b3f36489ad
NIFI-2534: - Refreshing using component IDs. - Code clean up.
This closes #874.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 16:05:20 -04:00
Scott Aslan 26f5c496d1
NIFI-2534 Fix JS error when stopping a process group
This closes #867.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 11:09:41 -04:00
Mark Payne 6af768d0a1 NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim. 2016-08-15 17:02:15 -04:00
Matt Gilman 7d8dd27027
NIFI-2554: - Requiring READ permissions on the referenced controller service when creating/updating processors, controller services, and reporting tasks.
- Preventing client side selection of unauthorized controller services unless they were the previously configured value.

This closes #860.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 16:46:58 -04:00
Scott Aslan 2a92747046 [NIFI-2559] UI - Controller Service update missing icons
This closes #864
2016-08-15 16:27:12 -04:00
Matt Gilman d45114e48d NIFI-2501: - Ensuring users can access the controller service list regardless of permissions on the corresponding process group or controller. - Better handling the case where the user had write permissions but no read permissions. - Returning to the appropriate controller service listing after going to the usage page.
This closes #835

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-15 15:16:58 -04:00
Oleg Zhurakousky 51c566ffc8
NIFI-2546 fixed NPE in FlowSnippetDTO fixed NPE caused by non-configured ControllerService
This closes #859.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 14:55:20 -04:00
Matt Gilman 0855cb9bd4
NIFI-2555:
- Addressing potential NullPointerException when an AccessDeniedException is thrown from an endpoint that isn't subject to the security filter chain.

This closes #846.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-12 15:08:00 -07:00
jpercivall 6799bd4919 NIFI-1876 fixing counter URI pattern 2016-08-12 17:23:12 -04:00
Jeff Storck bbdd087d77 NIFI-1876 Implemented PropertyDescriptorDTO merging
NIFI-1876 Updated PermissionsDTO to use boolean primitives instead of Boolean objects for read and write permission
Removed ISE throwing from EntityFactory, it will rely on null checks instead

This closes #694

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:37 -04:00
Matt Gilman e81147c92a NIFI-1876: - Introducing entities for allowable values and process group status.
Signed-off-by: Jeff Storck <jtswork@gmail.com>
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:26 -04:00
Jeff Storck 572dfed78a NIFI-1876 Implements merging of responses to successful requests based on authorization, returning the most restrictive response - Added StandardHttpResponseMergerSpec for testing response merging - Added Permissible interface - Added nifi-api/controller/archive to ProcessGroupEndpointMerger - Removed AbstractMultiEntityEndpoint.java, not used anymore - Implemented reponse merging for GET requests where there are some successful and problematic responses, returning most restrictive one. - Updated nf-settings.js with ControllerConfigurationEntity property rename from controllerConfiguration to component - Implemented merging of status DTOs based on read permission NIFI-2264 Implemented merging of status history results based on readability permissions - Added StatusHistoryEndpointMergerSpec to test merging of status history based on read permission
NIFI-1876 Added merging for labels, funnels, and controller service references.

NIFI-1876 Added Label and Funnel merging to FlowMerger.java

NIFI-1876 Added replication of request for process group controller services
 - Updated merging code for Status and Status History based on read permissions

NIFI-1876 Fixed issue with node status snapshots all looking like they came from one node
Updated ProcessGroupStatusSnapshotDTO to contain status snapshot entities to retain readability permission
Added entity classes for ConnectionStatusSnapshotDTO, PortStatusSnapshotDTO, ProcessGroupStatusSnapshotDTO, ProcessorStatusSnapshotDTO, and RemoteProcessGroupStatusSnapshotDTO
Updated PropertyDescriptorDTO to contain AllowableValueEntity to retain readability permission
Added entity class for AllowableValueDTO
Moved AllowableValueDTO to its own top-level class
Updated DtoFactory to get permissions for status snapshot entities
Updated StatusMerger to merge status snapshot entities

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:17 -04:00
Scott Aslan a9675552d9 [NIFI-2557] Enhance Modal Plugin. This closes #842 2016-08-12 11:40:45 -04:00
Matt Gilman e5e86cf07c NIFI-2548:
- Allowing selection of User/Cluster node when searching and encountering an exact match.

This closes #839

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-08-12 20:41:49 +09:00
Matt Gilman fa639e2596 NIFI-2542: - Ensuring transitive referencing components are able to be returned. - Ensuring we can enable/disable services with transitive referencing components. - Ensuring we cannot enable/disable services with unauthorized referencing components.
NIFI-2543: - Ensuring we have permissions before attempting to reload a controller service.

This closes #837

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-11 20:42:35 -04:00
Mark Payne 25a2fac453
NIFI-2535: Do not include properties that are unset in flow fingerprint. This allows a new property to be added to a processor without affecting the fingerprint, if the value is never set
This closes #829.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-11 10:44:28 -04:00
Mark Payne 76a4a2c48b
NIFI-2544: Created integration tests for clustering and addressed a few minor bugs that were found in doing so
This closes #832.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-11 10:43:38 -04:00
Mark Payne 85877a73dc NIFI-2540: Exclude from templates the parts of property descriptors that are not necessary. Also ensure that Property Descriptors are not completely removed from Controller Services.
This closes #828
2016-08-10 13:27:20 -04:00
Matt Gilman 219234d001
NIFI-2530: - When no explicit policy is defined, defer to the parent Process Group instead of attempting to match component's within the flow.
This closes #826.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-10 11:06:16 -04:00
Bryan Rosander 2dc094765d NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12

This closes #809.
2016-08-09 22:43:29 +02:00
Matt Gilman fbb705e461
NIFI-2511: - Ensuring Process Group bulletins are bubbling up as expected.
This closes #822.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 16:28:57 -04:00
Matt Gilman 7a1f749f69 NIFI-2475: - Updating UI to better suggest that component specific administrators do not override higher level administrators.
This closes #813
2016-08-09 15:40:28 -04:00
Mark Payne 42df02f014 NIFI-2406 This closes #820. Addressed regression introduced in NIFI-2406 where the cluster does not recognize a new Cluster Coordinator when the coordinator is shutdown 2016-08-09 15:19:49 -04:00
Matt Gilman ae8045d99b
NIFI-2505: - Updating the user identity field in the ActionDTO.
This closes #800.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 13:07:50 -04:00