Commit Graph

337 Commits

Author SHA1 Message Date
Andrew Lim 59e102ad47 NIFI-5767 Added NiFi Toolkit Guide to docs
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3124.
2018-11-06 11:23:54 +01:00
Andrew Lim d0688d0785 NIFI-5677 Added note to clarify why modifying/creating variables not local changes in versioned flows
Update user-guide.adoc

This closes #3125.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-11-06 15:17:32 +09:00
Andrew Lim fdb1fd1a64 NIFI-5766 Make formatting in User Guide consistent with Admin Guide
This closes #3115

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-10-30 12:04:29 -04:00
Jeff Storck c0182294ed NIFI-5720-RC3 prepare for next development iteration 2018-10-22 22:16:43 -04:00
Jeff Storck 98aabf2c50 NIFI-5720-RC3 prepare release nifi-1.8.0-RC3 2018-10-22 22:16:23 -04:00
Matt Gilman 02261311b3 NIFI-5737:
- Removing needClientAuth property since cluster comms now requires two way ssl. Jetty client auth settings are based on configured features.
- Removing dead code.
- Updating documentation.
- Removing references to needClientAuth property in all test resources.
- Removing overloaded util method with strict parameter.

This closes #3102.
2018-10-22 20:02:47 -04:00
Andrew Lim 5ec85299e7 NIFI-5653 Added default NiFi and Embedded Zookeeper port tables to Admin Guide
This closes #3089.
2018-10-17 15:29:11 -04:00
Andrew Lim 4039c21d67 NIFI-5701 Add documentation for Load Balancing connections to User Guide and add additional properties to Admin Guide
This closes #3080.
2018-10-16 21:00:38 -04:00
Andrew Lim fd5eccc593 NIFI-5659 Add documentation for Offloading Nodes functionality and new Node related CLI commands
This closes #3056
2018-10-15 18:02:14 -04:00
Mark Payne 619f1ffe8f NIFI-5516: Implement Load-Balanced Connections
Refactoring StandardFlowFileQueue to have an AbstractFlowFileQueue
Refactored more into AbstractFlowFileQueue
Added documentation, cleaned up code some
Refactored FlowFileQueue so that there is SwappablePriorityQueue
Several unit tests written
Added REST API Endpoint to allow PUT to update connection to use load balancing or not. When enabling load balancing, though, I saw the queue size go from 9 to 18. Then was only able to process 9 FlowFiles.
Bug fixes
Code refactoring
Added integration tests, bug fixes
Refactored clients to use NIO
Bug fixes. Appears to finally be working with NIO Client!!!!!
NIFI-5516: Refactored some code from NioAsyncLoadBalanceClient to LoadBalanceSession
Bug fixes and allowed load balancing socket connections to be reused
Implemented ability to compress Nothing, Attributes, or Content + Attributes when performing load-balancing
Added flag to ConnectionDTO to indicate Load Balance Status
Updated Diagnostics DTO for connections
Store state about cluster topology in NodeClusterCoordinator so that the state is known upon restart
Code cleanup
Fixed checkstyle and unit tests
NIFI-5516: Updating logic for Cluster Node Firewall so that the node's identity comes from its certificate, not from whatever it says it is.
NIFI-5516: FIxed missing License headers
NIFI-5516: Some minor code cleanup
NIFI-5516: Adddressed review feedback; Bug fixes; some code cleanup. Changed dependency on nifi-registry from SNAPSHOT to official 0.3.0 release
NIFI-5516: Take backpressure configuration into account
NIFI-5516: Fixed ConnectionDiagnosticsSnapshot to include node identifier
NIFI-5516: Addressed review feedback

This closes #2947
2018-10-04 16:11:05 -04:00
Andrew Lim f5e9ea680a NIFI-5578 Correct errors in EL Guide including Date Manipulation and Escaping EL examples
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #3017.
2018-09-21 11:03:36 +02:00
Andrew I. Christianson be2ed060a2
NIFI-5542 Added support for node groups to FileAccessPolicyProvider
This closes #2970.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-09-20 10:27:28 -04:00
Koji Kawamura f570cb980d
NIFI-375: Added operation policy
The operation policy allows that a user to operate components even if they does not have direct READ/WRITE
permission of the component.

Following operations are controlled by the new operate policy:
- Start/stop/enable/disable Processors, ControllerServices,
ReportingTasks, Input/OuputPorts
- Enable/disable transmission of RemoteInput/OutputPorts and
RemoteProcessGroups
- Terminate Processor threads

Refactored what API exposes

The previous commit let API exposes few fields in DTO. But we should
avoid returning partial DTO as it complicates authorization logic.

Instead, this commit adds StatusDTO for ReportingTaskEntity and
ControllerServiceEntity, so that it can be returned regardless of having
READ permission. Component DTO can only be returned with a READ
permission.

Refactor RPG same as ControllerService.

WIP incorporating review comments.

Incorporated review comments

- Cleaned up merger classes
- Recreate DTO instance at each function during two phase commmit

Restrict enabling ControllerService without read permission

Revert the last commit.

Fix review comments.

- Renamed confusing static method names and its parameters
- Removed unnecessary permission checks from UI condition

Fixed delete action display condition.

Fixed NPE at Summary.

Apply operation policy to activateControllerServices.

Removed OperationPermissible from ComponentEntity.

This closes #2990
2018-09-19 15:28:41 -04:00
Matthew Burgess 5a84d650c3 NIFI-5449: Added Base64 Encode/Decode functions to RecordPath
NIFI-5449: Incorporated review comments

This closes #2920

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-09-14 14:04:25 -04:00
Nick Lewis 3efcd45e99 NIFI-5565 Added reference to confluence documentation from the developers guide
This closes #2978

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-09-01 07:32:32 -04:00
Mark Payne aac2c6a60e
NIFI-5482: Made WriteAheadProvenanceRepository the default implementation
This closes #2960.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-23 16:49:55 -07:00
Andrew Lim 86beca0c58 NIFI-5469 Additional italics and code formatting corrections for consistency
This closes #2925

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-13 15:03:41 +05:30
Andy LoPresto 57baae9ae2
NIFI-5476 Added logic to check CA certificate signature against additional certificates.
Moved utility code to TlsHelper.
Added unit tests.
Added command-line parsing for additional CA certificate path.
Added documentation on using the TLS Toolkit to generate and sign certificates using an externally-signed CA.
Updated toolkit external CA documentation to be inline with additional context from NIFI-5473.
Cleaned up toolkit documentation.
Improved error message by changing to absolute path.
Added Javadoc to and removed unthrown exception declarations from TlsHelper#verifyCertificateSignature().
Cleaned up unit tests with utility method.
Fixed checkstyle error.
Support conversion of a PKCS#8 formatted private key automatically to avoid forcing the user to do that. Also add some log messages for debugging when the parser fails to parse the appropriate object
Incorporated Peter's contribution for PKCS #8 to PKCS #1 conversion.
Added documentation and refactored methods.
Refactored unit test.
Added RAT exclusion for test resource.

This closes #2935.

Co-authored-by: pepov <peterwilcsinszky@gmail.com>

Signed-off-by: Matt Gilman <mcgilman@apache.org>
2018-08-07 12:07:35 -07:00
Andy LoPresto 5e6c43f83e
NIFI-5473 Added section on using external signed CA for TLS Toolkit.
Increased TOC level to 3 for ASCIIDOC generated documentation.

This closes #2927.

Signed-off-by: Andrew Lim <andrewlim.apache@gmail.com>
2018-08-02 20:55:39 -07:00
郑书国10209198 9a23d5bc60
NIFI-5447 Modify the description of 'nifi.security.needClientAuth',add default value describe
Added space and formatting to default value for needClientAuth in Admin Guide.

This closes #2912.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-23 18:14:51 -07:00
Mark Payne 72a5e6bfba NIFI-4407: Updated Expression Language Guide to provide details about how escaping $ is accomplished, and when the $ character should and should not be escaped. Fixed bug in the Query compiler that mistakenly would blindly replace 484 with $ even when the 484 did not precede an Expression. Added additional test cases.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2898.
2018-07-18 10:52:13 +02:00
Otto Fowler 3746ae258d
NIFI-5436 Add ability to set the processor name in the ProcessContext when using the TestRunner.
This closes #2902.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-17 14:42:37 -07:00
Andy LoPresto bef91008bb
NIFI-5399 Added wildcard certificate documentation to Admin Guide.
Clarified CN vs. SAN entries.

This closes #2870.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2018-07-10 11:15:07 -07:00
Andrew Lim 0721d9a0ee NIFI-5330 Fixed broken image in Variables in Versioned Flows section of User Guide
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2810
2018-06-25 15:18:17 -04:00
Andy LoPresto d42a1e8bf4
NIFI-5323-RC1 prepare for next development iteration 2018-06-19 20:02:21 -07:00
Andy LoPresto 99bcd1f88d
NIFI-5323-RC1 prepare release nifi-1.7.0-RC1 2018-06-19 20:02:01 -07:00
Matt Gilman fe31a06fdc
NIFI-4907:
- Minor adjustments following PR.
- Avoiding additional find operation when authorizing components when populating component details.
- Requiring access to provenance events when downloading content or submitting a replay as they may provide events details.
- Updating the REST API docs detailing the required permissions.
- Updating the wording in the documentation regarding the provenance and data policies.
- Removed the event attributes from the authorization calls that were verifying access to provenance events.
- Only checking content availability when the user is authorized for the components data.
- Addressing typo in JavaDoc.

This closes #2703
2018-06-14 12:21:47 -04:00
Mark Bean e27798797a
NIFI-4907: add 'view provenance' component policy
whitespace removed for checkstyle
2018-06-14 10:59:17 -04:00
zenfenan 0973c2d8d1 NIFI-543 Added annotation to restrict processor to run only on the primary node
- PR Fix - 'Execution' dropdown will now be shown in all cases
- Annotated ListGCSBucket with PrimaryNodeOnly

This closes #2509.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-05-25 11:50:29 -04:00
Andrew Lim 470d85042d NIFI-4585 Add nifi.cluster.node.max.concurrent.requests to Cluster Node Properties section of Admin Guide
This closes #2719

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-05-22 12:03:37 -04:00
Andrew Lim 8aaa51af31 NIFI-5205 Updated default value for nifi.content.claim.max.appendable.size in Admin Guide
This closes #2716

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-05-17 15:09:37 -04:00
Andrew Lim 775cf42560 NIFI-2966 Add policy resources to Access Policies tables in Admin Guide
This closes #2710

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-05-16 16:18:52 -04:00
Andy LoPresto 7a4990e7fe
NIFI-5146 Only support HTTP or HTTPS operation for NiFi API/UI
- Added logic to check for simultaneous configuration of HTTP and HTTPS connectors in JettyServer.
- Added test logging resources. Added unit tests.
- Refactored shared functionality to generic method which accepts lambdas.
  Fixed unit test with logging side effects.
- Added note about exclusive HTTP/HTTPS behavior to Admin Guide. Fixed typos.

This closes #2683.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-05-09 12:14:11 -04:00
Matt Gilman 5cfa29e48f
NIFI-5135:
- Adding support for applying transforms to user identities and group names.

This closes #2673.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-05-07 11:17:26 -04:00
Andrew Lim ce0855e988 NIFI-5074 Added section Variables in Versioned Flows to User Guide
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2627.
2018-04-11 18:53:07 +02:00
Andrew Lim eb3391f1d2 NIFI-5063 Added screenshots and supporting text for Primary Node processors
This closes #2624

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-04-10 13:34:18 -04:00
Andrew Lim b6c052066a NIFI-4941 Updated nifi.sensitive.props.additional.keys description to refer to nifi.properties
This closes #2620

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2018-04-10 09:29:39 -04:00
Matthew Burgess b29304df79 NIFI-4857: Support String<->byte[] conversion for records
This closes #2570.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-04-09 14:53:21 -04:00
Andrew Lim 5f16f48a27
NIFI-5042 Added section Restricted Components in Versioned Flows and edited related section in Adding Components to the Canvas
This closes #2610.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-04-09 09:53:22 -04:00
joewitt 59f625d3c2 Merge branch 'NIFI-4995-RC3' as part of NiFi 1.6.0 release process 2018-04-06 16:48:08 -07:00
Pierre Villard 4c787799ff NIFI-4149 - Indicate if EL is evaluated against FFs or not
- take into account input requirement for documentation rendering
- Renamed variable registry scope and added comments
- Doc + change in mock framework to check scope + update of components + UI
2018-04-06 12:40:54 -04:00
Mike Moser dc9b4cb516
NIFI-3599 Allow back pressure object count and data size to be configurable in nifi.properties. This closes #2497 2018-04-05 13:50:16 -04:00
Koji Kawamura 1913b1e2a8
NIFI-4932: Enable S2S work behind a Reverse Proxy
Adding S2S endpoint Reverse Proxy mapping capability.
Added license header to SVG files.
Incorporated review comments.
Use regex to check property key processing.
Catch AttributeExpressionLanguageParsingException.
This closes #2510
2018-04-03 15:40:28 -04:00
joewitt d511fe3e4b NIFI-4995-RC3 prepare for next development iteration 2018-04-03 08:28:34 -07:00
joewitt f8466cb16d NIFI-4995-RC3 prepare release nifi-1.6.0-RC3 2018-04-03 08:28:15 -07:00
joewitt 7b5bf265a6 NIFI-4995 updating copyright year on all notices 2018-03-26 21:54:10 -04:00
jugi92 78daaf40f8 NIFI-4991 This closes #2564.
nifi.database.directory should be moved out of default location <root-level-nifi-dir>/database_repository to ease the update process.

Signed-off-by: joewitt <joewitt@apache.org>
2018-03-19 11:41:56 -04:00
Mark Payne d14229e440 NIFI-4774: Allow user to choose which write-ahead log implementation should be used by the WriteAheadFlowFileRepository
Removed TODO comment

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2487
2018-03-13 13:03:39 -04:00
Matt Gilman b1217f529b NIFI-4885:
- Introducing more granular restricted component access policies.

This closes #2515.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-12 14:19:42 -04:00
Willie Engelbrecht 1ec7bcd286 NIFI-4910 Fixing slight spelling mistake in error message, needs a space
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2492.
2018-02-26 21:01:32 -08:00