Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,634 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

576 Commits

Author SHA1 Message Date
Mark Payne 6af768d0a1 NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim. 2016-08-15 17:02:15 -04:00
Matt Gilman 7d8dd27027
NIFI-2554: - Requiring READ permissions on the referenced controller service when creating/updating processors, controller services, and reporting tasks. 
- Preventing client side selection of unauthorized controller services unless they were the previously configured value.

This closes #860.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 16:46:58 -04:00
Scott Aslan 2a92747046 [NIFI-2559] UI - Controller Service update missing icons 
This closes #864
 2016-08-15 16:27:12 -04:00
Matt Gilman d45114e48d NIFI-2501: - Ensuring users can access the controller service list regardless of permissions on the corresponding process group or controller. - Better handling the case where the user had write permissions but no read permissions. - Returning to the appropriate controller service listing after going to the usage page. 
This closes #835

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-15 15:16:58 -04:00
Oleg Zhurakousky 51c566ffc8
NIFI-2546 fixed NPE in FlowSnippetDTO fixed NPE caused by non-configured ControllerService 
This closes #859.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 14:55:20 -04:00
Matt Gilman 0855cb9bd4
NIFI-2555: 
- Addressing potential NullPointerException when an AccessDeniedException is thrown from an endpoint that isn't subject to the security filter chain.

This closes #846.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-12 15:08:00 -07:00
jpercivall 6799bd4919 NIFI-1876 fixing counter URI pattern 2016-08-12 17:23:12 -04:00
Jeff Storck bbdd087d77 NIFI-1876 Implemented PropertyDescriptorDTO merging 
NIFI-1876 Updated PermissionsDTO to use boolean primitives instead of Boolean objects for read and write permission
Removed ISE throwing from EntityFactory, it will rely on null checks instead

This closes #694

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-12 17:22:37 -04:00
Matt Gilman e81147c92a NIFI-1876: - Introducing entities for allowable values and process group status. 
Signed-off-by: Jeff Storck <jtswork@gmail.com>
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-12 17:22:26 -04:00
Jeff Storck 572dfed78a NIFI-1876 Implements merging of responses to successful requests based on authorization, returning the most restrictive response - Added StandardHttpResponseMergerSpec for testing response merging - Added Permissible interface - Added nifi-api/controller/archive to ProcessGroupEndpointMerger - Removed AbstractMultiEntityEndpoint.java, not used anymore - Implemented reponse merging for GET requests where there are some successful and problematic responses, returning most restrictive one. - Updated nf-settings.js with ControllerConfigurationEntity property rename from controllerConfiguration to component - Implemented merging of status DTOs based on read permission NIFI-2264 Implemented merging of status history results based on readability permissions - Added StatusHistoryEndpointMergerSpec to test merging of status history based on read permission 
NIFI-1876 Added merging for labels, funnels, and controller service references.

NIFI-1876 Added Label and Funnel merging to FlowMerger.java

NIFI-1876 Added replication of request for process group controller services
 - Updated merging code for Status and Status History based on read permissions

NIFI-1876 Fixed issue with node status snapshots all looking like they came from one node
Updated ProcessGroupStatusSnapshotDTO to contain status snapshot entities to retain readability permission
Added entity classes for ConnectionStatusSnapshotDTO, PortStatusSnapshotDTO, ProcessGroupStatusSnapshotDTO, ProcessorStatusSnapshotDTO, and RemoteProcessGroupStatusSnapshotDTO
Updated PropertyDescriptorDTO to contain AllowableValueEntity to retain readability permission
Added entity class for AllowableValueDTO
Moved AllowableValueDTO to its own top-level class
Updated DtoFactory to get permissions for status snapshot entities
Updated StatusMerger to merge status snapshot entities

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-12 17:22:17 -04:00
Scott Aslan a9675552d9 [NIFI-2557] Enhance Modal Plugin. This closes #842 2016-08-12 11:40:45 -04:00
Matt Gilman e5e86cf07c NIFI-2548: 
- Allowing selection of User/Cluster node when searching and encountering an exact match.

This closes #839

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-08-12 20:41:49 +09:00
Matt Gilman fa639e2596 NIFI-2542: - Ensuring transitive referencing components are able to be returned. - Ensuring we can enable/disable services with transitive referencing components. - Ensuring we cannot enable/disable services with unauthorized referencing components. 
NIFI-2543: - Ensuring we have permissions before attempting to reload a controller service.

This closes #837

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-11 20:42:35 -04:00
Mark Payne 25a2fac453
NIFI-2535: Do not include properties that are unset in flow fingerprint. This allows a new property to be added to a processor without affecting the fingerprint, if the value is never set 
This closes #829.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-11 10:44:28 -04:00
Mark Payne 76a4a2c48b
NIFI-2544: Created integration tests for clustering and addressed a few minor bugs that were found in doing so 
This closes #832.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-11 10:43:38 -04:00
Mark Payne 85877a73dc NIFI-2540: Exclude from templates the parts of property descriptors that are not necessary. Also ensure that Property Descriptors are not completely removed from Controller Services. 
This closes #828
 2016-08-10 13:27:20 -04:00
Matt Gilman 219234d001
NIFI-2530: - When no explicit policy is defined, defer to the parent Process Group instead of attempting to match component's within the flow. 
This closes #826.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-10 11:06:16 -04:00
Bryan Rosander 2dc094765d NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5 
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12

This closes #809.
 2016-08-09 22:43:29 +02:00
Matt Gilman fbb705e461
NIFI-2511: - Ensuring Process Group bulletins are bubbling up as expected. 
This closes #822.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-09 16:28:57 -04:00
Matt Gilman 7a1f749f69 NIFI-2475: - Updating UI to better suggest that component specific administrators do not override higher level administrators. 
This closes #813
 2016-08-09 15:40:28 -04:00
Mark Payne 42df02f014 NIFI-2406 This closes #820. Addressed regression introduced in NIFI-2406 where the cluster does not recognize a new Cluster Coordinator when the coordinator is shutdown 2016-08-09 15:19:49 -04:00
Matt Gilman ae8045d99b
NIFI-2505: - Updating the user identity field in the ActionDTO. 
This closes #800.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-09 13:07:50 -04:00
Matt Gilman aae6325603
NIFI-2237: - Reorganizing the refactored REST endpoints. - Tweaking message text. 
This closes #788.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-09 12:04:31 -04:00
Oleg Zhurakousky 5e5c3f7c3b NIFI-2504 This closes #810. fixed template export for RPG 
- ensured that RPG and connections to it are treated as special case where instance ID is preserved
 2016-08-08 16:54:27 -04:00
Mark Payne ed14bf22e7 NIFI-2493 This closes #798. Do not fingerprint Remote Ports' running state. When synchronizing remote flow with local flow, start/stop remote group ports as appropriate based on the inherited flow 2016-08-08 16:54:27 -04:00
Mark Payne c1c052af71 NIFI-2406: Ensure that hearbeat monitor continues to run while instance is running. This way if a node sends heartbeat to this node as elected coordinator changes, we notify the node accordingly. Handle Exceptions more gracefully in leader election code. Tweaked some handling of how nodes reconnect to the cluster to ensure more stability with cluster 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #729
 2016-08-08 09:15:10 -04:00
Joe Skora d094130a26 NIFI-2237: 
Extend template handling to read only properties.
* Add read only property handling to type.hbs template.
* Add flag to ProcessorDTO.getRelationships to reflect read only nature of the property.
* Remove explicit "read only" message from ConnectionDTO.getAvailableRelationships to avoid duplicate text.
* This closes #806
 2016-08-08 09:06:47 -04:00
Joe Skora 903b1fe465 NIFI-2494 Remove extraneous text that shows on banner line. This closes #793 2016-08-05 16:03:26 -04:00
Scott Aslan f2f070c5be
NIFI-2468: Improved UI consistency. 
- Addressing comments from PR. Moving new service button below the tab pane. (+2 squashed commits)
Squashed commits:
[f746d09] NIFI-2468:
- Addressing numerous inconsistencies throughout the UI (button placement above tables, timestamp styles, etc)
[7d1fb09] addressing some inconsistencies

This closes #794.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-05 12:32:06 -07:00
Mark Payne 8d34223265 NIFI-2472: Normalize coordinates for all components in a snippet, not just processors 
This closes #786

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-04 19:46:39 -04:00
Matt Gilman c0a253568e NIFI-2486: - Authorizing individual bulletins being returned through the bulletin board. 
This closes #792

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-04 18:41:18 -04:00
Matt Gilman 04147ac22a
NIFI-2458: - Fixing issue with timezone when the initial provenance result was cancelled. 
This closes #773.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-04 17:09:21 -04:00
Mark Payne 7ba10a6dea
NIFI-2484: Ensure that if a Processor throws an Exception from an @OnScheduled method that @OnStopped methods get called 
This closes #791.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-04 15:34:10 -04:00
Matt Gilman 321a2398ba
NIFI-2467: - Resetting cached search term when closing the dialog to ensure the same search time works upon re-opening. 
NIFI-2467: - Fixing issue preventing the selection of an autocomplete result.

This closes #784.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-04 11:22:01 -04:00
Mark Payne cda4310ad8 NIFI-2035: Verify existence of source and destination when creating a connection 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #690
 2016-08-04 09:11:25 -04:00
Koji Kawamura 7a7165152e NIFI-2478 Fixed Zk leaders path to include root. 2016-08-04 08:19:04 -04:00
Scott Aslan ed5c44ba53 [NIFI-2053] update open/close palettes. This closes #775 2016-08-04 07:59:13 -04:00
Bryan Rosander fa4c6ab03c
NIFI-2193 - Added functionality to automate certificate generation, keystore and truststore generation, and nifi.properties keystore and truststore password population. Follow-on changes will be made under NIFI-2476. 
This closes #695.

Signed-off-by: Andy LoPresto <alopresto@apache.org>

Defaulting to same keyStore, key password (+18 squashed commits)
Squashed commits:
[9d01ba0] NIFI-2193 - Fixing typo
[55440bc] NIFI-2193 - Standalone can run as long as there are no conflicting files/folders
[0ca34ed] NIFI-2193 - Fixing some filename, absolute path issues
[9d4f65b] NIFI-2193 - Incorporating feedback
[f7550b4] NIFI-2193 - Cleaning up imports
[59a7637] NIFI-2193 - Updating umask to allow owner to execute
[cf824e7] NIFI-2193 - Moving DN arg to CA service specific parent class
[921ee13] NIFI-2193 - Making keystore getInstance more consistent
[a283c4b] NIFI-2193 - Updating sample config files in assembly to reflect new structure
[8d3a21d] NIFI-2193 - Making TlsHelper static, adding option to use same password for Key, KeyStore
[b13d247] NIFI-2193 - Addressing PR feedback
[46ef8ed] NIFI-2193 - Removing commons-logging, log4j from notice
[d4cf41a] NIFI-2193 - Adding option to specify output file for CA certificate when using cli client
[b74bf25] NIFI-2193 - Removing Bouncy Castle from notice
[6e34f9a] NIFI-2193 - Adding CLI client for easier generation of client certificates
[2924fca] NIFI-2193 - nifi-toolkit-ssl -> nifi-toolkit-tls, removing unused constants
[886167e] NIFI-2193 - Adding slf4j to avoid runtime issue
[082de46] NIFI-2193 - Command line SSL config utility as well as certificate authority client/server
 2016-08-03 21:34:11 -07:00
Mark Payne f0401e4774 NIFI-2419: Ensure that if a node is disconnected that we unregister for 'cluster coordinator' and 'primary node' roles by updating FlowController to know that it is disconnected. Also removed dead code that was needed in the master-worker clustering paradigm but not for zero-master-clustering 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #739
 2016-08-03 23:38:50 -04:00
Matt Gilman c26398eaba NIFI-2402: - Removing client side check component move eligibility and instead relaying on verification server side. Cannot check client side as the current user may not have permissions to inspect required fields. 
This closes #750

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-03 19:08:25 -04:00
Matt Gilman 1511887a68 NIFI-2301: - Ensure all component specific policies are removed when the component is removed. - Allowing snippets to be created if the user has read or write access as we don't know what the intended snippet usage. When used the snippet is still authorized accordingly. - Ensuring actions involving Process Groups correctly authorize encapsulated components. - Not requiring read permissions when showing the delete button for Controller Services and Reporting Tasks. 
This closes #757

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-03 18:06:30 -04:00
Matt Gilman 9338f102cb NIFI-2237: 
- Updating Rest Endpoint documentation specifically regarding access policies.
- Ensuring the resource listing is accurate.
- Removing unnecessary code.
 2016-08-03 16:18:30 -04:00
Matt Gilman fca59ff9d0 NIFI-2438: 
- If a node reports forbidden, using an appropriate response failure exception.
This closes #760.
 2016-08-03 15:01:04 -04:00
Bryan Bende 698cde69ba NIFI-2453 Making FileAuthorizer perform initial seeding when users and groups are already present 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #772
 2016-08-03 11:59:03 -04:00
Mark Payne 16348b071d NIFI-2452: This closes #771. Ensure that we keep track of how many references we have to each lucene searcher and only close the underlying index reader if there are no references to the searcher. Also updated to prefer newer provenance events over older provenance events, and calculate FlowFile lineage based on an event id instead of a FlowFile UUID, as it's much more efficient 2016-08-03 08:05:26 -07:00
Mark Payne bc5237593e NIFI-2291: Correct the Content URI for 1.0.0 REST API; added cluster node identifier & whether or not clustered to ReportingContext so that the Reporting Task could make use of it 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #752
 2016-08-03 10:35:11 -04:00
Matt Gilman 52d97f966d NIFI-2443: - Addressing issue where reload group deferred was being resolved prematurely. 
This closes #756

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-02 17:06:25 -04:00
Matt Gilman ecca76099a NIFI-2427: - Only showing read/write data policies for applicable components. Disabling for labels, controller services, reporting tasks, and templates. 
This closes #748

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-02 16:25:02 -04:00
Bryan Bende a1bb94c08a NIFI-1869 Cloning controller services when referenced by reporting tasks and upgrading from 0.x to 1.0.0. This closes #767 2016-08-02 16:09:54 -04:00
Oleg Zhurakousky df11e1d2c0 NIFI-2425 fixed ControllerService referebcing in DTOs/Templates. This closes #770 2016-08-02 13:58:19 -04:00