Commit Graph

1163 Commits

Author SHA1 Message Date
Mark Payne b96e402e78 NIFI-3768: This closes #1727. Avoid wrapping FlowFile Attributes Map in an UnmodifiableMap in the StandardFlowFileBuilder
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-01 22:51:05 -04:00
Mark Payne 07989b8460 NIFI-3739: This closes #1695. Added ConsumeKafkaRecord_0_10 and PublishKafkaRecord_0_10 processors 2017-05-01 18:47:51 -04:00
Yolanda M. Davis 55b8c7ddad
NIFI-3695
- added proxy dn flag to support providing authorized username for secured environments
- addressed pr comments including fix to ensure proxy info added when getting cluster info, showing cleaner error messaging  and improving help text. Also fixed potential issue with versioning comparison (mismatched lengths)
- Printing response body when requests fails.
- This closes #1697
2017-04-27 12:42:12 -04:00
Koji Kawamura a41a2a9b1a
NIFI-1202: Site-to-Site batch settings.
- Added batchCount, batchSize, batchDuration to limit flow files to be
  included in a single Site-to-Site transaction.
- Added batch throttling logic when StandardRemoteGroupPort transfers
  flow files to a remote input port using the batch limit configurations,
  so that users can limit batch not only for pulling data, but also pushing data.
- Added destination list shuffle to provide better load distribution.
  Previously, the load distribution algorithm produced the same host consecutively.
- Added new batch settings to FlowConfiguration.xsd.
- Added new batch settings to Flow Fingerprint.
- Added new batch settings to Audit.
- Sort ports by name at 'Remote Process Group Ports' dialog.
- Show 'No value set' when a batch configuration is not set
- Updated batch settings tooltip to clearly explain how it works the configuration works differently for input and output ports.
- Updated DTO by separating batch settings to BatchSettingsDTO to indicate count, size and duration are a set of configurations.
- This closes #1306
2017-04-27 10:35:07 -04:00
Bryan Rosander 879fe3efd6 NIFI-3737 - Ran optipng on all png files 2017-04-25 12:28:49 -04:00
Anders Breindahl 995c7ce2fa
NIFI-2656: replace -k [password] with -K [passwordfile].
This approaches a proper solution on how to hand over the key from
RunNiFi to NiFi. Insofar the password file is pruned as part of the
startup, NiFi processors can't read it.

See also: NIFI-3045.

This closes #1302.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-04-25 00:32:58 -07:00
Yolanda M. Davis c0f0462e8b
NIFI-3695 - created the nifi admin toolkit which includes shell scripts and classes to support notification and basic node management in standalone and clustered nifi.
This closes #1669.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-04-24 23:08:37 -07:00
Mark Payne 50ea1083ec NIFI-3682: This closes #1682. Add Schema Access Strategy and Schema Write Strategy Record Readers and Writers; bug fixes.
Signed-off-by: joewitt <joewitt@apache.org>
2017-04-24 17:02:45 -04:00
Scott Aslan 57ccf97c58
[NIFI-3035] disable deep linking when URL .searchParams and URL .search properties are unsupported by browser. This closes #1687 2017-04-21 14:37:27 -04:00
Matt Gilman 0b95ccb90a NIFI-3380:
- Fixing opening of Usage from the Controller Service and Reporting Task table.

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1684
2017-04-21 09:48:24 -04:00
Scott Aslan 2f928490e3
[NIFI-3360] inject nf.ControllerServices into nf.ControllerService. This closes #1685 2017-04-21 08:24:14 -04:00
Koji Kawamura 8ce2a1b3a7 NIFI-3657 This closes #1634. Fix HTTP S2S to use local address.
- Fixed SiteInfoProvider and HttpClient to use specified local address with its SiteToSiteRestApiClient
- Removed setupRequestConfig method call from connection and read timeout setter methods at SiteToSiteRestApiClient, because it created config object before local address was set
- Null clear StandardRemoteProcessGroup localAddress when user clears Local Network Interface

Signed-off-by: joewitt <joewitt@apache.org>
2017-04-19 22:19:41 -07:00
Koji Kawamura 0ddb90cd2d NIFI-3166 This closes #1324. Fix SocketRemoteSiteListener NPE.
- Refactored ServerProtocol.sendPeerList method signature to clarify the
  meaning of arguments, and avoid null pointer exception when converting null Integer to int.
- Refactored SocketRemoteSiteListener handleRequest method to make it
  more unit test friendly.
- Added more unit tests.
2017-04-19 22:18:43 -07:00
Mark Payne 0207f21ce4 NIFI-3273: Added nifi-toolkit-flowfile-repo that contains a simple Java class that is capable of recovering a FlowFile Repository manually in the case of an operating system crash that results in trailing 0's being dumped into the edit logs. Also refactored flowfile repo into some independent modules so that it additional capabilities can be added in the future to examine the flowfile repo 2017-04-19 21:44:23 -07:00
Matt Gilman 7e7f9a5deb NIFI-3705:
- Using consistent logic when verifying connection creation. Removed some unecessary checks as verification has been changed to run in cluster and standalone mode.

This closes #1672.
2017-04-19 15:49:11 -04:00
ijokarumawak 220a870a1e NIFI-2697: Fix opening Remote Ports dialog.
If there is an unconnected remote port, right clicking a Remote Process Group
then select 'Remote Ports' causes a JS error saying 'Uncaught TypeError'.
Because there are few code paths those don't return the created
transmissionSwitch value from createPortOption function in
nf-remote-process-group-ports.js.

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1679
2017-04-18 16:08:10 -04:00
joewitt 189b4ad63d NIFI-3694 removed the total cap size value as per review feedback 2017-04-18 14:07:38 -04:00
Matt Gilman 7e1ecad738
NIFI-3706: - Removing non-existent resource when converting a legacy authorized users file.
This closes #1673.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-04-18 09:46:21 -04:00
joewitt d08233b9fe NIFI-3694 updated latest logback,jetty,moved servlet-api and jetty-schemas to lib root as needed now
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1678
2017-04-18 07:41:21 -04:00
Scott Aslan deed25656f
[NIFI-3035] use URLSearchParams .toString() to update URL. This closes #1659 2017-04-13 14:32:30 -04:00
Mark Payne a88d3bfa3c NIFI-1280: Refactoring to make more generic so that other data types can be supported; created InputStreams to content on-demand so that multiple passes can be made over FlowFile content if required. Created new Controller Services for reading and writing specific data types
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2017-04-11 19:29:04 -04:00
Pierre Villard 776a00b0be NIFI-2860 Use different properties for JVM Heap Max and Min values
This closes: #1382

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-04-11 21:18:49 +10:00
Joe Percivall 5419891fe7 NIFI-3633 This closes #1610. Adding HttpNotificationService.
Signed-off-by: joewitt <joewitt@apache.org>
2017-04-11 00:37:12 -04:00
Koji Kawamura 9583ca99c1 NIFI-3414: Added EnforceOrder processor
Use it with FirstInFirstOutPrioritizer, it can enforce original ordering
of 'out-of-order' FlowFiles.

nifi-mock is modified to support FlowFile assertion using Prioritizer.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-3414: Added EnforceOrder processor

Incorporated review comments, added displayNames.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-3414: Added EnforceOrder processor

Incorporate review comments:

- Moved nifi-standard-prioritizers dependency to top level nifi/pom.xml.
- Changed default initial order from 1 to 0.
- Fixed typos.
- Use session.get(batchCount).

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-3414: Added EnforceOrder processor

When a FlowFile is transferred to success, remove attributes previously set when it was transferred to wait or failure.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1496
2017-04-10 14:03:22 -04:00
Matt Gilman 35f4f48f37 NIFI-3683:
- Ensuring we use the appropriate action based on the previously displayed policy.

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1657
2017-04-07 13:03:01 -04:00
Matt Gilman e8771e59a7
NIFI-2940: - Fixing broken integration test following changes introduced in NIFI-2940.
This closes #1653.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-04-07 10:42:11 -04:00
Mark Payne 292dd1d66b
NIFI-3678: Ensure that we catch EOFException when reading header information from WAL Partition files; previously, we caught EOFExceptions when reading a 'record' from the WAL but not when reading header info
NIFI-3678: If we have a transaction ID but then have no more data written to Partition file, we end up with a NPE. Added logic to avoid this and instead return null for the next record when this happens

This closes #1656.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-04-07 10:28:27 -04:00
Bryan Bende 6a75ab1740
Fixing checkstyle error in FlowSnippetDTO 2017-04-07 09:58:15 -04:00
Oleg Zhurakousky c7ecaba234
NIFI-3509 Fixed ID duplication
Fixed the possibility of duplicated MSB part of the component during template creation. This closes #1651
2017-04-06 16:04:27 -04:00
Bryan Bende 556f309df0
NIFI-3520 Refactoring instance class loading
- Fixing FlowController to use appropriate class loader when instantiating processor
- Updating ExtensionManager to leverage new flag in MANIFEST from NAR plugin
- Adding ReloadComponent interface and refactoring instance class loading to use it
- Fixing FetchHDFS issue with TDE by using ugi.doAs
- Refactoring nifi-nar-utils so that ExtensionManager only lives in nifi-framework
- Caching temp components found during service loader in ExtensionManager
- Updating authorizables, docs, and fingerprinting to use the cached components
- Introducing a flag on @RequiresInstanceClassLoading to indicate if ancestor resources should be cloned
- Updating developer guide regarding cloneAncestorResources flag
- This closes #1635
2017-04-06 13:51:08 -04:00
Matt Gilman f5f54c468c
NIFI-3664: - Updating the unmarshalling to consider the current date when parsing the time.
This closes #1647.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-04-05 13:22:35 -04:00
Matt Gilman a565484ddd
NIFI-2940: - Allowing access to configuration actions through the Controller when the underlying component has been removed.
This closes #1648.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-04-04 17:40:09 -04:00
Koji Kawamura 5e62b4ae72 NIFI-3668: Fix purging expired replicate requests.
This closes #1646.

Newly created async response is added before checking map size nor
purging expired ones. If there are already 100 remaining requests,
the added request will not be executed nor removed.
2017-04-03 09:50:47 -04:00
joewitt 6a64b3cd9c NIFI-3440 This closes #1638. fixing tests not written for windows to not run on windows 2017-03-31 01:59:35 -04:00
Matt Gilman 282e1a7b1a NIFI-3421: This closes #1620.
- On contextDestroyed, referencing beans created during contextInitialized to prevent successive attempts to create a bean if that bean failed to be created initially.

Signed-off-by: joewitt <joewitt@apache.org>
2017-03-30 15:14:41 -04:00
Matt Gilman e203535163 NIFI-3272 This closes #1616.
- Updating the garbage collection column to use a icon with tooltip to relay all garbage collections.
2017-03-30 14:55:17 -04:00
Mark Payne 3aa1db6ee5 NIFI-3636: Lazily copy FlowFile Attributes Hash Map instead of doing so eagerly.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-3257: Added additional logging regarding timing information when replicating requests across cluster in order to glean insight as to what is taking so long when replicating some requests

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-3649: Buffer node responses when replicating HTTP Requests up to a maximum buffer size

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-3636: Added unit test to ensure that flowfile attribute maps are copied when appropriate

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-3636: Removed patch file that should not have been in commit

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1612
2017-03-30 09:53:39 -04:00
Andre F de Miranda a7bf683a0d
NIFI-79 - Introduces the ability to set Bulletin Level to NONE 2017-03-30 08:54:24 -04:00
James Wing f9b5bcf7bb NIFI-2907 Fix Flow Schema Validation Errors
This closes #1587.
2017-03-28 10:53:16 -04:00
Matt Gilman 4432958a65
NIFI-3643: - Addressing incorrect capitalization in VersionInfoDTO in NiFiVersion.
This closes #1626.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-03-27 16:44:21 -04:00
Matt Gilman f15e0d8e1e
NIFI-3380: - Addressing issues with paths in generated documentation.
This closes #1627.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-03-27 16:43:15 -04:00
Andre F de Miranda a26689318d
NIFI-814 - Introduce hidden header with name of Processor to allow those arriving to site via direct reference to know the name of the processor
This closes #1624.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-03-26 11:41:15 -04:00
Bryan Bende f0a1c14f02
NIFI-3380 Fixing parent pom of nifi-standard-prioritizers to point to correct parent after moving under nifi-framework 2017-03-25 11:13:58 -04:00
Bryan Bende d90cf846b9 NIFI-3380 Bumping NAR plugin to 1.2.0-SNAPSHOT development to leverage changes from master, adding buildnumber-maven-plugin to nifi-nar-bundles to properly set build info in MANIFEST of NARs
- Refactoring NarDetails to include all info from MANIFEST
- Adding the concept of a Bundle and refactoring NarClassLoaders to pass Bundles to ExtensionManager
- Adding logic to fail start-up when multiple NARs with same coordinates exist, moving Bundle classes to framework API
- Refactoring bundle API to classes and creating BundleCoordinate
- Updating FlowController to use BundleCoordinate

- Updating the UI and DTO model to support showing bundle details that loaded an extension type.
- Adding bundle details for processor canvas node, processor dialogs, controller service dialogs, and reporting task dialogs.
- Updating the formating of the bundle coordinates.
- Addressing text overflow in the configuration/details dialog.
- Fixing self referencing functions.
- Updating extension UI mapping to incorporate bundle coordinates.
- Discovering custom UIs through the supplied bundles.
- Adding verification methods for creating extensions through the rest api.
- Only returning extensions that are common amongst all nodes.
- Rendering the ghost processors using a dotted border.
- Adding bundle details to the flow.xml.
- Loading NiFi build and version details from the framework NAR.
- Removing properties for build and version details.
- Wiring together front end and back end changes.
- Including bundle coordinates in the component data model.
- Wiring together component data model and flow.xml.
- Addressing issue when resolve unvesioned dependent NARs.

Updating unit tests to pass based on framework changes
- Fixing logging of extension types during start up

- Allowing the application to start if there is a compatible bundle found. - Reporting missing bundle when the a compatible bundle is not found. - Fixing table height in new component dialogs.

Fixing chechstyle error and increasing test timeout for TestStandardControllerServiceProvider
- Adding ability to change processor type at runtime
- Adding backend code to change type for controller services

- Cleaning up instance classloaders for temp components.
- Creating a dialog for changing the version of a component.
- Updating the formatting of the component type and bundle throughout.
- Updating the new component dialogs to support selecting source group.
- Cleaning up new component dialogs.
- Cleaning up documentation in the cluster node endpoint.

Adding missing include in nifi-web-ui pom compressor plugin
- Refactoring so ConfigurableComponent provides getLogger() and so the nodes provide the ConfigurableComponent
- Creating LoggableComponent to pass around the component, logger, and coordinate with in the framework

- Finishing clean up following rebase.

Calling lifecycle methods for add and remove when changing versions of a component
- Introducing verifyCanUpdateBundle(coordinate) to ConfiguredComponent, and adding unit tests

- Ensuring documentation is available for all components. Including those of the same type that are loaded from different bundles.

Adding lookup from ClassLoader to Bundle, adding fix for instance class loading to include all parent NARs, and adding additional unit tests for FlowController
- Adding validation to ensure referenced controller services implement the required API
- Fixing template instantiation to look up compatible bundle

- Requiring services/reporting tasks to be disabled/stopped.
- Only supporting a change version option when the item has multiple versions available.
- Limiting the possible new controller services to the applicable API version.
- Showing the implemented API versions for Controller Services.
- Updating the property descriptor tooltip to indicate the required service requirements.
- Introducing version based sorting in the new component dialog, change version dialog, and new controller service dialog.
- Addressing remainder of the issues from recent rebase.

Ensuring bundles have been added to the flow before proposing a flow, and incorporating bundle information into flow fingerprinting
- Refactoring the way missing bundles work to retain the desired bundle if available
- Fixing logger.isDebugEnabled to be logger.isTraceEnabled

- Auditing when user changes the bundle. - Ensuring bundle details are present in templates.

Moving standard prioritizers to framework NAR and refactoring ExtensionManager logic to handle cases where an extension is in a JAR directly in the lib directory

- Ensuring all nodes attempt to instantiate the same template instance when the available bundles may differ. - Fixing the auditing of copy/paste and template instantiation. - Running addtional verification methods when running standalone.

Refactoring controller service invocation handler to allow updating the node used by the invocation handler
- Ensuring the bundles in a proposed flow are compatible with the current instance when the current instance has no flow is going to accept the proposed flow
- Merging whether multiple versions of the component are available
- Setting NAR plugin back to current released version
- Cleaning up DocGenerator to not process multiple times

Addressing incorrect usage of nf.Common. - Using formatType in the new component type dialogs.

Improving error messages when looking for bundles

Addressing comments from PR. - Fixing references to global nf namespace. - Fixing injection of nfProcessGroupConfiguration in nfComponentVersion. - Fixing web api integration tests.

Not rendering unversioned in help documentation. - Ensuring the isExtentionMissing flag is correct after changing the component type.

Adding synchronization in node classes to ensure changing component can't occur when component is running, introducing MissingBundleException for better reporting when a node can't join cluster due to a missing bundle, and bumping NAR plugin to released version 1.2.0

Adding concept of missing components to fingerprinting to ensure nodes agree on missing components when joining a cluster

NIFI-3380: NIFI-3520: - Fixing hive nar dependency. - Marking DBCPService as provided. - Skipping services that require instance classloading and are cobundled with their service API. - Skipping components that require instance classloading and reference service APIs that are cobundled. - Addressing UI issues in the new component dialogs when re-opening with a filter applied.

Fixing checkstyles issue and adding back assume checks to distributed cache server test

Ensuring new component types are sorted correctly when shown initially.

This closes #1585.
2017-03-24 11:06:44 -04:00
Scott Aslan a90a770244
[NIFI-3035] add deep linking URL to canvas components and PGs. This closes #1559 2017-03-22 14:23:02 -04:00
Scott Aslan 40acd4a6e1
[NIFI-2697] revert transmission switch toggle on failed update request. This closes #1600 2017-03-21 15:17:02 -04:00
Puspendu Banerjee 552148e9e7 NIFI-3579: Incorporated Review comments. This closes #1602. 2017-03-20 10:15:24 -04:00
Matt Gilman 47c6718fe2 NIFI-3615:
- Removing hidden control characters.

This closes #1599

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-03-17 11:46:25 -04:00
Matt Gilman 768e89b579 NIFI-3246:
- Preventing the editing of controller services that are defined in an ancestor process group.
- Adding a go to link for users to easily navigate to where services are actually defined.

This closes #1594

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-03-14 14:15:14 -04:00
Puspendu Banerjee 78382c66bc NIFI-3579 Fix for Windows FileStore issue
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1580
2017-03-14 13:58:06 -04:00
Matt Gilman 9d4239be1e NIFI-3245:
- Adding notes to the controller service tables to better define their availability.
- Clarifying support of Safari.

This closes #1593

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-03-13 13:48:11 -04:00
Matt Gilman 620c572703 NIFI-3244:
- Updating Controller Service scope header.
- Rendering the name of the parent when possible.
- Fixing the check if the parent Process Group is write-able when the parent is selected on the current canvas.

This closes #1590

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-03-13 12:35:46 -04:00
Matt Gilman 9bb31a70d9 NIFI-3243:
- Rendering the selected Process Group in the header if possible.

This closes #1591

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-03-13 12:18:22 -04:00
Matt Gilman 977aa6919c
NIFI-3575:
- Verify that when moving a snippet, we do not attempt to move a process group into itself.
- Update the UI to ensure a subsequent move event cannot be triggered while a previous move event is still in progress.

This closes #1582.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-03-10 17:56:57 -08:00
Aldrin Piri c9097e7db3
NIFI-3541 Add copying of local network interface for DtoFactory RPG copy. This closes #1574 2017-03-09 08:23:28 -05:00
James Wing 3c862a1515
NIFI-3334 Fix Update Run Duration. This closes #1572 2017-03-09 08:13:46 -05:00
Andy LoPresto 7f6373239f
NIFI-3313 Added explicit Java runtime argument to default bootstrap.conf to avoid blocking on VM deployment.
This closes #1579.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-03-08 19:24:43 -08:00
Koji Kawamura 27afd2e0cc NIFI-3163: Add new RPG settings to fingerprint
- Added timeout, yieldPeriod, transportProtocol, proxyHost, proxyPort,
  proxyUser and proxyPassword

- Removed unused fingerprint methods

FingerprintFactory has two types of fingerprinting method, from XML
elements and from DTO. However, the ones from DTO are not used by
anywhere. IDE didn't report those private methods unused because
addProcessGroupFingerprint and addSnippetFingerprint call each other,
but those are not used from outside actuallly.

This commit removes those private methods to keep the class clean to
avoid unnecessary code maintenance and tests.

This closes #1332.
2017-03-08 17:31:22 -05:00
Andy LoPresto 1376e5fbd0
NIFI-3483 Added import statement to resolve failing tests.
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-03-07 20:07:59 -05:00
Pierre Villard 01979aebec
NIFI-3483 - fixed one unit test relying on locale
This closes #1566.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-03-07 16:41:45 -05:00
Matt Gilman 16bde02ed0
NIFI-3541: - Allowing the user to specify the network interface to send/receive data for a Remote Process Group.
This closes #1550.

Signed-off-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-03-06 10:38:15 -05:00
Mark Payne 9e68f02f1f NIFI-3541: Add local network interface capability to site-to-site client and remote group and ports 2017-03-06 10:36:30 -05:00
Scott Aslan 9f669aa944
[NIFI-3550] inject nf.ConnectionConfiguration into the nf.Cannection module during nf.Graph init. This closes #1560 2017-03-03 09:38:29 -05:00
Mark Payne 4ed64e7561
NIFI-3548: Fixed bug that caused failed requests to not get removed from 'request map' and also results in that preventing the purging logic, which would then unintentially throw exceptions. This closes #1555 2017-03-03 09:13:28 -05:00
Scott Aslan c3dbbb845f
[NIFI-3038] Update cluster summary dialog layout. This closes #1534 2017-02-28 09:47:47 -05:00
Scott Aslan 1978c986b5
[NIFI-3465] change CS and RT warning tooltip viewports to a visible and connected DOM element. This closes #1545 2017-02-27 13:18:14 -05:00
Scott Aslan d98426cc3d
[NIFI-2941] allow users to click checkbox labels to toggle the checkbox. This closes #1538 2017-02-27 09:57:43 -05:00
Scott Aslan a76641b252
[NIFI-2891] persist selected tab for connection configuration dialog, except for when creating a new connection the dialog will open with the details tab visible since users will need to select a connection relationship. This closes #1535 2017-02-27 09:21:55 -05:00
Scott Aslan fba17159a9
[NIFI-3358] remove duplicate calls to nfProcessGroupConfiguration.showConfiguration(). This closes #1540 2017-02-24 08:05:34 -05:00
Scott Aslan 2c374bafaa
[NIFI-3358] update naming conventions to avoid conflicts. This closes #1533 2017-02-23 09:14:33 -05:00
Mark Payne 64379d2007 NIFI-3522: When creating a clone of a FlowFile, ensure that we properly set the 'updated attributes' on the RepositoryRecord to all attributes on the FlowFile itself, the same way we do when calling create(FlowFile)
This closes #1532
2017-02-22 17:16:14 -05:00
Mark Payne 96ed405d70 NIFI-3356: Initial implementation of writeahead provenance repository
- The idea behind NIFI-3356 was to improve the efficiency and throughput of the Provenance Repository, as it is often the bottleneck. While testing the newly designed repository,
  a handful of other, fairly minor, changes were made to improve efficiency as well, as these came to light when testing the new repository:

- Use a BufferedOutputStream within StandardProcessSession (via a ClaimCache abstraction) in order to avoid continually writing to FileOutputStream when writing many small FlowFiles
- Updated threading model of MinimalLockingWriteAheadLog - now performs serialization outside of lock and writes to a 'synchronized' OutputStream
- Change minimum scheduling period for components from 30 microseconds to 1 nanosecond. ScheduledExecutor is very inconsistent with timing of task scheduling. With the bored.yield.duration
  now present, this value doesn't need to be set to 30 microseconds. This was originally done to avoid processors that had no work from dominating the CPU. However, now that we will yield
  when processors have no work, this results in slowing down processors that are able to perform work.
- Allow nifi.properties to specify multiple directories for FlowFile Repository
- If backpressure is engaged while running a batch of sessions, then stop batch processing earlier. This helps FlowFiles to move through the system much more smoothly instead of the
  herky-jerky queuing that we previously saw at very high rates of FlowFiles.
- Added NiFi PID to log message when starting nifi. This was simply an update to the log message that provides helpful information.

NIFI-3356: Fixed bug in ContentClaimWriteCache that resulted in data corruption and fixed bug in RepositoryConfiguration that threw exception if cache warm duration was set to empty string

NIFI-3356: Fixed NPE

NIFI-3356: Added debug-level performance monitoring

NIFI-3356: Updates to unit tests that failed after rebasing against master

NIFI-3356: Incorporated PR review feedback

NIFI-3356: Fixed bug where we would delete index directories that are still in use; also added additional debug logging and a simple util class that can be used to textualize provenance event files - useful in debugging

This closes #1493
2017-02-22 12:40:06 -05:00
Koji Kawamura 8d467f3d1f
NIFI-3505: Fix nifi.sh restart
The 'exec' command added by NIFI-2689 affected restart behavior
negatively as 'exec' command will not execute subsequent commands in the
shell script.
This commit changes 'exec' is added only when 'run' is specified.

This closes #1523.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-02-22 10:47:39 -05:00
Scott Aslan 364efa96cc
[NIFI-3501] Upgrade D3 to 3.5.17 and allow npm to pull it down at build time. This closes #1519 2017-02-21 10:17:34 -05:00
Aldrin Piri 4f49095d75 NIFI-3294 Adjusting nifi.sh to invoke nifi-env.sh when running as another user such that properties are preserved across environments.
This closes #1405.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
Signed-off-by: ijokarumawak <ijokarumawak@apache.org>
2017-02-20 11:04:11 +09:00
Scott Aslan 19302263c3
[NIFI-3181] add operate palette actions to context menu. This closes #1516 2017-02-17 15:40:23 -05:00
Scott Aslan d9828c240b
[NIFI-3360] resolve clashing variable name for connection and nf.Connection. This closes #1506 2017-02-16 15:54:00 -05:00
Koji Kawamura 1eb98aefee NIFI-3373: Add nifi.flow.configuration.archive.max.count
- Add 'nifi.flow.configuration.archive.max.count' in nifi.properties
- Change default archive limit so that it uses archive max time(30 days)
  and storage (500MB) if no limitation is specified
- Simplified logic to delete old archives

This closes #1460.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-02-16 14:19:39 +09:00
Aldrin Piri 76fcf5def1 NIFI-3385 - This closes #1440. Updating copyright statements to reflect the new year. 2017-02-16 00:10:02 -05:00
Jeff Storck 8b90343715
NIFI-3355 Allows NiFi to bind to specific network interfaces, with separate interface lists for HTTP and HTTPS.
This closes #1508.

Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-02-15 18:39:26 -05:00
Mark Payne 39cfd03397 NIFI-3205: This closes #1336. Ensure that FlowFile Repository is updated with any Transient Content Claims when session rollback occurs 2017-02-15 13:15:56 -05:00
Pierre Villard 86fb67d55c NIFI-3405 - Add uptime to JVM section in System Diagnostics
renamed column for node connection date in cluster

This closes #1492.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-02-15 16:53:53 +09:00
Andy LoPresto bd88e4335a
Refactored user identity parsing and proxied entity chain formatting.
Added unit tests.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-02-14 13:39:05 -08:00
Bryan Rosander 8ffa1703ba NIFI-3389 - Using long string type for attribute name and value in FlowFileSchema
This closes #1446.
2017-02-14 13:04:09 -05:00
Hunter Morgan df91169512
NIFI-2689 - improve foreground run mode of nifi
* add exec to RUN_NIFI_CMD
* remove subshell for else
* tested compatible with runit with these changes

This closes #966.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-02-14 12:37:31 -05:00
Mike Moser 690130b063
NIFI-3362 update FlowConfiguration.xsd to allow all current time period units
This closes #1501.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-02-14 10:20:39 -05:00
Scott Aslan 2bc7d52626
[NIFI-3458] increase processor preview hieght to avoid bottom border being cut off. This closes #1498 2017-02-13 09:46:20 -05:00
Scott Aslan 4274481f1d
[NIFI-3450] update upload template dialog browse button. This closes #1495 2017-02-13 09:32:02 -05:00
Scott Aslan 932b5bb91b
[NIFI-3305] update hover text for change color on the operate pallete. This closes #1489 2017-02-13 09:02:54 -05:00
Scott Aslan febe6da4a2 [NIFI-3459] remove blue higlighting from bread crumbs
This closes #1500.
2017-02-11 15:36:19 +01:00
Scott Aslan e4b74b3d71
[NIFI-3410] and styles for incorrect Processor Details dialog relationship description in Summary page. This closes #1488 2017-02-10 17:01:33 -05:00
Scott Aslan bf3b1640fc
[NIFI-3360] taking bottom up approach to modularizing the canvas...wrapping modulaes with UMD and keep the app loading
- taking top down approach from this point and leveraging inversion of control desgin pattern
- This closes #1487
2017-02-10 16:03:23 -05:00
Matt Gilman 74ecc20f00 NIFI-3291:
- Ensuring slider step is non negative.

This closes #1486
2017-02-09 09:42:36 -05:00
Matt Gilman bc7b17a64c NIFI-3291:
- Fixing slider issue when there is only one event in the lineage graph.
- Fixing scollbar issue when accessing the queue listing.
2017-02-09 09:29:18 -05:00
Matt Gilman f0c6739a1f NIFI-3251:
- Ensuring read permissions to the ControllerService before attempting to check permissions to parent.

This closes #1483
2017-02-08 15:13:20 -05:00
Matt Gilman 83ee7590a6
- Fixing checkstyle violation. 2017-02-08 10:45:34 -05:00
Pierre Villard da5aafdf3f
NIFI-3121 Remove read permissions on proxy resource for Node Identities. This closes #1368 2017-02-07 17:01:51 -05:00
Koji Kawamura 5af6eb17b0
NIFI-3162: Audit RPG and RPG port config changes.
- Added configure audits for Transport Protocol, HTTP Proxy Server Host,
  Port, User and Password in RemoteProcessGroup configuration
- Added configure audits for enabling/disabling individual remote port
- Added configure audits for Concurrent Tasks and Compressed in Remote
  Port configuration
- This closes #1476
2017-02-07 16:22:51 -05:00
James Wing e4cee7ee0d NIFI-3427 Fix Provenance DateTime Sorting
This closes #1465.
2017-02-06 18:06:58 +01:00
Oleg Zhurakousky 6518778c11 NIFI-3180 Fixed NPE in TemplateUtils
added null check for ProcessorDTO.getRelationship()
removed deprecated usage of ByteArrayInputStream

This closes #1451.
2017-01-30 22:10:50 +01:00
Pierre Villard 89f1bd3189 NIFI-957 Added the possibility to use DefaultSchedule annotation in reporting tasks
This closes #1400
2017-01-30 08:35:39 -05:00
Matt Gilman f8f66fa22b NIFI-3291:
- Removing dead code.

This closes #1438
2017-01-27 11:50:56 -05:00
Matt Gilman 0950186fbb NIFI-3291:
- Fixing overflow calculation to determine if scrollbars are necessary.
- Fixing styles with jquery ui slider usage.
2017-01-27 11:47:09 -05:00
Jeff Storck bd4ea488bb NIFI-3387 Updated NOT_YET_CONNECTED value in DisconnectionCode enum
This closes #1448.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-01-27 08:44:11 +09:00
Pierre Villard c15111d985 NIFI-3390 Added support for multiple LDAP servers. This closes #1441 2017-01-26 08:59:18 -05:00
Pierre Villard 1a6802a016 NIFI-3295 - ensures node is disconnected before trying to remove it. This closes #1444 2017-01-25 12:24:45 -05:00
Pierre Villard e113511fef NIFI-3393 - replicates cluster/nodes/{id} to cluster coordinator. This closes #1443 2017-01-25 10:25:36 -05:00
Matt Gilman 7340078de2 NIFI-3251: Delete requires WRITE perms on parent
- Requiring WRITE permissions to the parent resource when attempting to remove a component.
- Updating expired certificates in the REST API integration tests.

This closes #1399.

Signed-off-by: James Wing <jvwing@gmail.com>
2017-01-24 13:24:29 -08:00
Mike Moser ddda602620 NIFI-3350 optimized documentation extraction to reduce startup time
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1416.
2017-01-22 14:27:19 -08:00
Matt Gilman 79ca30be4a NIFI-3301: Provenance UI Cursor Styling
- Addressing inconsistent cursor styling and drag behavior in lineage graph.

This closes #1430.

Signed-off-by: James Wing <jvwing@gmail.com>
2017-01-20 18:40:36 -08:00
Scott Aslan dc934cbb8e [NIFI-3359] Modularize all of nifi-web-ui except canvas directory
- Removing shell.jsp from summary.jsp.
- This closes #1428
2017-01-20 16:18:08 -05:00
Matt Gilman e62eeb7563 NIFI-3291:
- Fixing styles from our usage of jquery ui autocomplete.
- Fixing horizontal scroll bars.
- Fixing border around content repos.

This closes #1429
2017-01-19 11:13:44 -05:00
Matt Gilman e925b18fe6 NIFI-1135:
- Adding additional parameters to be able to limit the size of the provenance response. Specifically, whether the events should be summarized and whether events should be returned incrementally before the query has completed.
- Ensuring the cluster node address is included in provenance events returned.
- Ensuring there is a cluster coordinator before attempting to get the cluster node address.
- Removing exponential back off between provenance requests.
- Ensuring the content viewer url is retrieve before initializing the provenance table.

This closes #1413.
2017-01-18 10:34:56 -05:00
Matt Gilman 82cf0c6fa8 NIFI-3291:
- Ensuring we don't see a horizontal scrollbar.
- Ensuring slick-nifi-theme is bundled.

This closes #1408
2017-01-17 15:42:34 -05:00
Matt Gilman 6170f6442e NIFI-3291:
- Upgrading jQuery and it's plugins.
- Packaging at build time using npm.
2017-01-17 14:54:59 -05:00
Pierre Villard 2fbeabb95f
NIFI-3309 ensures that CS are deleted when a process group is deleted
This closes #1411.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-12 11:21:46 -05:00
Matt Gilman a794166d21 NIFI-3118 - Sorting the garbage collection stats and content repository entries client side. Opting to not sort server side as the property of the DTO does not allow deterministic sorting. Consequently, order would need to be implemented every time that DTO is (de)serializaed which may happen in a number of places with zero master clustering.
This closes #1337.
2017-01-09 18:09:25 +01:00
Bryan Rosander 474df053d6 NIFI-3276 - FileSystemRepository.getPath() only check exists if necessary
This closes #1388.
2017-01-05 21:44:59 +01:00
jpercivall 273e69f2cb NIFI-3274 Adding WriteAheadLog configuration options to WriteAheadLogLocalStateProvider
This closes #1386.
2017-01-05 19:59:58 +01:00
Pierre Villard 64bb55ef3c NIFI-2839 Add a confirmation dialog when deleting a Controller Service or Reporting Task. This closes #1384 2017-01-05 09:07:35 -05:00
Matt Gilman 083d4043e0 NIFI-2840:
- Sorting the templates to ensure that the newest templates are listed first.

This closes #1391.
2017-01-04 19:24:37 +01:00
Matt Gilman b1c9f0e764
NIFI-2695: - Providing more granular and meaningful authorization error messages.
This closes #1309.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-04 13:06:19 -05:00
Pierre Villard 2c0f1c348e
NIFI-3259 - Process group level option in Ambari reporting task
This closes #1360.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-03 16:18:53 -05:00
Pierre Villard be6bcf20ad
NIFI-2944 Check remote input hostname at startup.
Added unit test cases.

This closes #1379.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-02 20:25:03 -08:00
Scott Aslan 67cbef5df3
NIFI-2917: disable canvas refresh after ajax error and allow page refresh
This closes #1351.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-02 16:32:05 -08:00
Matt Gilman 0d14db72f5 NIFI-3247:
- Removing unnecessary authorization check during second phase of connection creation.
- Ensuring that the remote group port returns the correct resource type though not super critical since it is not possible to create policies for remote ports.

This closes #1353.
2016-12-30 16:05:06 +01:00
Pierre Villard 4986b83b83 NIFI-3164 Added NAR loading duration
This closes #1366.

Signed-off-by: James Wing <jvwing@gmail.com>
2016-12-29 10:29:03 -08:00
Pierre Villard 5c095f3a18 NIFI-3164 Added message at startup to log NAR loading
This closes #1365.

Signed-off-by: James Wing <jvwing@gmail.com>
2016-12-28 14:10:30 -08:00
Matt Gilman 2f3017638f
NIFI-3239:
- Indicating components are not restricted when appropriate.
- Updating unit tests.

This closes #1350.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-12-27 13:06:07 -05:00
Bryan Bende 978f483ba8
NIFI-3250 Fixing logic in StandardFlowFileQueue when migrating flow files to the active queue
This closes #3250.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-12-27 12:52:01 -05:00
Matt Gilman 6c5d4084d5 NIFI-3207: Fixed Template upload import URI
- Fixing the importUri when replicating a Template upload request. Previously was leveraging getResourceUri which considers proxy headers meant for client responses.

This closes #1334.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-27 15:44:25 +09:00
Scott Aslan 5ea17d30c5 [NIFI-96] add align horizontal and align vertical capability to components on the canvas. This closes #1354 2016-12-22 16:47:34 -05:00
Matt Gilman e65aad8fe6 NIFI-2994: - Setting the default position for remote process groups.
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1303
2016-12-22 14:39:56 -05:00
Matt Gilman acc9e0b45c NIFI-2967:
- Disabling the Add button in the new Processor, Controller Service, and Reporting Task dialog when no components match the filter.
This closes #1340
2016-12-22 11:52:20 -05:00
Koji Kawamura 908e7d3131
NIFI-2585: Add attributes to track s2s host and port
- Removed host and port field from Peer since the same information is
  available in PeerDescription
- Refactored variable names in SocketRemoteSiteListener to improve readability
- Changed how SocketRemoteSiteListener constructs PeerDescription
  instance. It used to use hard-coded 'localhost' as hostname, and
  getPort() which returns server's port. Since the peer is a remote peer,
  i.e the client, it should be client hostname and port.
- Added hostname resolution at DataTransferResource to make s2s.host
  value consistent with RAW transport. Without this, RAW uses hostname
  while HTTP uses IP address. It will be hard to be used from downstream flows.
- Replaced heavy use of mockito which was difficult to maintain, with
  nifi-mock
- Added SiteToSiteAttributes and more assertions in unit tests

This closes #1342.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-22 11:00:00 -05:00
Bryan Bende f7d761a28a
NIFI-2585 Moving attributes into loop in AbstractFlowFileServerProtocol, and also updating StandardRemoteGroupPort to apply the same attributes when doing a pull-based site-to-site.
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-22 10:59:56 -05:00
Randy Gelhausen 28e5d85493
NIFI-2585: Add attributes to track where a flow file came from when receiving over site-to-site
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-22 10:59:55 -05:00
Matt Gilman 721c9ee7f0 NIFI-3167: - Ensuring the DELETE button is visible for cluster nodes. - Removing unecessary wrapper element and non breaking spaces.
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1319
2016-12-21 12:02:44 -05:00
Scott Aslan aef17f9a8b [NIFI-3170] remove action details if user does not have read perms, also update action details styles to match other dialogs. This closes #1322 2016-12-19 10:07:15 -05:00
Mark Payne 5776c4b1f9 NIFI-3173: When a template is created with multiple components in different groups all referencing the same controller service, ensure that controller service is added to the template at a high enough level that all components needing hte service can access it.
- Ensure that controller services are added to child process groups when creating snippet

- Addressed issue related to modifying higher-level process groups' controller services in snippet after having already visited the process group

This closes #1318

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-14 14:10:59 -05:00
Scott Aslan 868795cdaa [NIFI-3159] Add ellipsis to long PG name in access policies shell. This closes #1310 2016-12-13 09:41:31 -05:00
Scott Aslan 45e4514a40 [NIFI-3160] reload canvas when updating PG name of current PG. This closes #1315 2016-12-12 11:45:10 -05:00
Scott Aslan 2c84b44f54 [NIFI-3154] display ellipsis when text is sufficiently long in connection details and connection configuration dialogs. This closes #1305 2016-12-08 12:52:01 -05:00
Koji Kawamura d15bd0c00c NIFI-3165: Update RPG revision when RPGPort is updated. This closes #1308 2016-12-08 08:34:07 -05:00
Bryan Rosander 9ce0af22af NIFI-3138 - Adding urls, transport, proxy settings to rpg portion of flow config xsd
This closes #1304.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-08 14:37:07 +09:00
Scott Aslan 6b82e25c74 [NIFI-3106] updating hover text for remove counter icon. This closes #1299 2016-12-07 16:42:19 -05:00
jpercivall e36b37692c NIFI-1582 added state to UpdateAttribute as well as updated a few parts that hadn't be touched in years (referenced the 'FlowFileMetadataEnhancer' processor'. Also added a 'NUMBER_VALIDATOR' to StandardValidators
NIFI-1582 removing the option to use cluster state

NIFI-1582 addressing Oleg's comments

NIFI-1582 No longer forcing numbers as the init value and adding getStateValue() to EL instead of using 'ATTRIBUTE_state'

NIFI-1582 Removing init state value

NIFI-1582 Adding documentation for the changes to Init State value

This closes #319
2016-12-06 16:52:02 -05:00
Bryan Rosander 97d2d30423
NIFI-3131 - Qualifying nifi-env in nifi bat scripts, removing popd from toolkit bat scripts
This closes #1293

Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-12-05 23:03:41 -05:00
Bryan Rosander d1f2492dec
NIFI-3132 - Using cygpath and quoting paths correctly in sh scripts when run in cygwin
This closes #1292

Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-12-05 22:16:24 -05:00
Matt Gilman 2d6bba080f NIFI-3133: - Ensuring that Remote Group Ports are always authorized according to their Remote Process Group.
NIFI-3133:
- Using getSourceAuthorizable() when accessing flow files and content.

NIFI-3133:
- Decouple local and remote connectable's to avoid ambiguity with self referencing RPGs.

NIFI-3133:
- Addressing comments from the PR.

NIFI-3133:
- Fixed check verifying source/destination when creating a connection.

NIFI-3133:
- Only showing the go to link when the source component is not a remote port.

NIFI-3133:
- Removing unnecessary checking of remote group port authorization since it's handled by the parent RPG.

NIFI-3133:
- Fixing issue showing the connection details dialog when the source component is a RPG.

NIFI-3133:
- Ensuring the local connectable was found.

This closes #1297

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-05 19:45:45 -05:00
jpercivall 7633fe35c1 NIFI-3149 Adding proper literal support for number operators ('-' and '+') to ANTLR parser and UI highlighting
This closes #1298
2016-12-05 13:34:54 -05:00
Matt Gilman c5ef076786
NIFI-2325:
- Adding support for LDAPS.

This closes #1275.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-12-02 12:41:03 -08:00
Koji Kawamura 7c5bd876bd NIFI-3026: Support multiple remote target URLs
- Added urls in addition to the existing url, to support multiple target
  URLs
- Backward compatibility is provided by returning the first url if
  multipe urls are specified, but component accessing the url doesn't
support multiple urls
- UI is not fully updated yet. Following UI components are planned to be updated
  by different commits
  - Search component: only the first URL is searchable and shown
  - Component status: RPG status shows only the first URL
  - Component action history: only the first URL is searchable and shown
  - Updated Search component to use URLs.

This closes #1208.
2016-12-02 14:01:39 -05:00
Matt Gilman d8d29811f5
NIFI-3135: - Authorizing restricted components on snippet usage.
- Updating REST API docs accordingly.
- Adding some integration tests to exercise the additional restricted component checks.

This closes #1287.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-02 12:55:23 -05:00
Bryan Bende 0297352350
NIFI-2017 Fixing failing test PermissionBasedStatusMergerSpec.groovy introduced in previous commit 2016-12-01 14:02:05 -05:00
Mark Payne 02f02b245a NIFI-2017: Fixed typo in nf-port.js that was referencing the wrong variable name to determine whether or not a port is transmitting
Fixed merging logic for root group status. Only consider a port transmitting when there is an active request, not when there is a 'queued' request
This closes #1279
2016-11-30 14:51:28 -05:00
Matt Gilman 1f40f298c0
NIFI-3130: - Loading the temporary instance from the correct type of component.
This closes #1285.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-30 14:13:43 -05:00
Mark Payne fff0148a0e NIFI-3129: When adding controller services to a snippet, ensure that we don't add the service multiple times, even when it's referenced by child process groups. This closes #1284 2016-11-30 13:07:51 -05:00
Matt Gilman bc223fa197
NIFI-3117: - Checking referenced services when performing an action with a snippet that requires it.
- Updating the SnippetManager to automatically expire unused snippets.
- Making the checking of referenced services consistent across component removal.
- Adding checking of referenced services for all nested components in a snippet.
- Updating the REST API docs to clarify when a referenced service is authorized.
- Conditionally authorizing transitive service references.

This closes #1277.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-30 12:50:25 -05:00
jpercivall e3c7611347
NIFI-3112 Revert "NIFI-2199 - allows nifi.sh restart through ssh"
This reverts commit 88d125137e.

This closes #1282.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-29 17:32:47 -08:00
Mark Payne 9d6ca6e1e6
NIFI-2975: Only start expiring FlowFiles after FlowFile Repository has been restored
This closes #1274.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-29 09:54:15 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
Andy LoPresto 2c3714536f
NIFI-3024 Added key migration for sensitive processor properties contained in flow.xml.gz. (nifi.sensitive.props.key)
This closes #1261.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-23 13:26:18 -08:00
Mark Payne 7ff14f7191 NIFI-3091: Ensure that we set the appropriate size on FlowFiles when modifying them
This closes #1267

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 12:07:44 -05:00
Mark Payne 91ff810dba NIFI-3088: Ensure that on recovery of FlowFile Repository, if we find a FlowFile that maps to an unknown queue that we log a warning that the queue is missing and drop the FlowFile, rather than throwing an NPE
This closes #1266

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 11:27:14 -05:00
Mark Payne aa99cc6822
NIFI-3079: Ensure that in all cases we increment session's bytesRead count when finished reading from Content Repo
This closes #3079.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-22 11:26:22 -05:00
Scott Aslan ead9205458 [NIFI-3075] remove fixed width from combo options and add max-width css style to display ellipsis when options text is too long. This closes #1253 2016-11-21 17:27:03 -05:00
Mike Moser 15af764dd8 NIFI-2996
- validate processors only when they are in STOPPED state
- report validation errors via REST API on processors/services/tasks/ports only when they are in the STOPPED state
- This closes #1192
2016-11-21 17:02:25 -05:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Gilman 7f5eabd603
NIFI-3050: Implemented access control logic for restricted components.
- Addressing comments from PR.
- Adding restricted tags to relevant components.
- Showing a restricted icon overlay on the processor node on the canvas. (+1 squashed commit)
Squashed commits:
[f487682] NIFI-3050:
- Introducing a Restricted annotation for components that require elevated privileges to use.
- Updating the new Processor, Controller Service, and Reporting Task dialogs to include these details and prevent unauthorized selection.
- Including the Restricted description in the generated component documentation.
- Updating processor access control integration test to verify restricted component creation.
- Updating the developer, user, and admin guide to include the restricted component policy.

This closes #1247.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-21 12:07:48 -08:00
Matt Gilman c8830742ee NIFI-3020:
- Introducing a strategy for identifying users.
- Fixing issue with the referral strategy error message.
- Adding code to shutdown the application when the authorizer or login identity provider are not initialized successfully.

NIFI-3020:
- Updating the admin guide to document the identity strategy.

NIFI-3020:
- Ensuring the request replicator attempts to shutdown regardless of whether the flow service properly terminates.

This closes #1236
2016-11-19 08:38:41 -05:00
Mark Payne 1be0871473 NIFI-2854: Refactor repositories and swap files to use schema-based serialization so that nifi can be rolled back to a previous version after an upgrade.
NIFI-2854: Incorporated PR review feedback

NIFI-2854: Implemented feedback from PR Review

NIFI-2854: Ensure that all resources are closed on CompressableRecordReader.close() even if an IOException is thrown when closing one of them

This closes #1202
2016-11-18 14:53:13 -05:00
Bryan Rosander e5eda63705
NIFI-2943 - Toolkit uses JKS type over PKCS12 when creating truststore because non-Bouncy Castle providers cannot read certificates from PKCS12 truststore.
Peer review feedback (+2 squashed commits)
Squashed commits:
[0102c8e] NIFI-2943 - Peer review feedback
[9bcd495] NIFI-2943 - pkcs12 keystore improvements

1. loading pkcs12 keystores with bouncy castle everywhere
2. tls-toolkit client using jks truststore when keystore type is specified differently
3. tests

This closes #1165.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-16 17:13:10 -08:00
Scott Aslan 878db82375 [NIFI-2949] update remote process group port styles. This closes #1226 2016-11-16 17:08:06 -05:00
Bryan Bende 2f9ec03242 NIFI-2909 Fix logic in AbstractConfiguredComponent setProperties() for setting classpath resources in the InstanceClassLoader
This closes #1232
2016-11-16 11:34:52 -05:00
Matt Gilman 49afacc3ab NIFI-3022:
- Returning the appropriate authorizable when accessing provenance events for a manual DROP event by emptying a queue.
- Populating the component details of a provenance event when the source is a connection.
2016-11-16 10:13:18 -05:00
joewitt 45a5f5295c NIFI-2374 This closes #712. updated to latest tika versions where possible, updated doc, commented why cannot update media nar 2016-11-15 23:18:55 -05:00
Mark Payne 721964b7d8 NIFI-3036: When we replay a FlowFile, ensure that we are using the 'golden copy' of the associated Resource Claim, if the claim is still writable. Ensure that StandardResourceClaimManager retains the 'golden copy' of a Resource Claim until it is no longer writable and has a claim count of 0
This closes #1223

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 16:51:34 -05:00
Scott Aslan 81357d4456 [NIFI-3042] Update class name for disabled combo option. This closes #1228 2016-11-15 16:43:27 -05:00
Mark Payne 9f3bf121f9 NIFI-3040: Fixed bug where we were generating a RepositoryRecord with an 'UPDATE' type instead of a 'CREATE' time for Replay of FlowFiles. This caused FlowFile to have no attributes when restored from the FlowFile Repository.
This closes #1224
2016-11-15 16:37:51 -05:00
Bryan Bende fe59b3415c NIFI-3003 Upgrading hadoop.version to 2.7.3 and fixing TDE issue with PutHDFS, ensuring clean up of instance class loaders, and adding classpath resource property to all HDFS processors
NIFI-3003 Addressing review feedback

NIFI-3003 added minor notice updates

This closes #1219
2016-11-15 16:23:27 -05:00
Pierre Villard 45bc3e054d NIFI-2751 - Pull batch in round-robin manner - fix for / by 0 2016-11-15 16:19:00 -05:00
Scott Aslan 45bf8430fc [NIFI-2844] Update CSS styles for Cluster Summary Dialog icons and refresh button. This closes #1104 2016-11-15 11:55:42 -05:00
Scott Aslan 8f928e5d6e NIFI-2926: add policy action item to the user table and add user centric policy dialog with user policy listing table compolete with GoTo action.
This closes #1188.
2016-11-15 09:58:58 -05:00
Andy LoPresto 59fea1cb4e NIFI-2654 Enabled encryption coverage for login-identity-providers.xml.
Squashed commits:
[5dd22a9] NIFI-2654 Updated administration guide with login-identity-providers.xml flags.

Exposed master key retrieval code in NiFiPropertiesLoader.
Added logic to decrypt login identity providers XML configuration.
Updated login-identity-providers.xsd to include encryption scheme attribute.
Added unit tests. (+18 squashed commits)
Squashed commits:
[57c815f] NIFI-2654 Resolved issue where empty LIP property elements could not be encrypted.
Added unit test and resource.
[27d7309] NIFI-2654 Wired in serialization logic to write logic for LIP.
Added comprehensive unit test for LIP & NFP in same test.
[b450eb2] NIFI-2654 Finalized logic for preserving comments in LIP parsing.
[5aa6c9c] NIFI-2654 Added logic for maintaining XML formatting (comments and whitespace) for LIP.
Added unit tests (w/o encryption works; w/ does not).
[b53461f] NIFI-2654 Added unit test for full tool invocation migrating a login-identity-providers.xml file and updating file and bootstrap.conf with key.
[2d9686c] NIFI-2654 Updated tool description and various logging statements.
Added unit test for full tool invocation encrypting a login-identity-providers.xml file and updating file and bootstrap.conf with key.
[8c67cb2] NIFI-2654 Added logic to encrypt LIP XML content.
Added unit tests.
[8682d19] NIFI-2654 Added logic to handle "empty" (commented) LIP files.
Added unit tests.
[077230e] NIFI-2654 Fixed logic to decrypt multiline and multiple-per-line XML elements.
Added unit tests and resources.
[d5bb8da] NIFI-2654 Ignored unit test for unreadable conf directory because directory was causing Maven build issues.
Removed test resources.
[7e50506] NIFI-2654 Fixed AESSensitivePropertyProvider bug handling cipher text with whitespace.
Added unit test.
[b69a661] NIFI-2654 Fixed AESSensitivePropertyProviderFactoryTest to reflect absence of key causes errors.
[6f821b9] NIFI-2654 Added standard password to arbitrary encryption test for use in test resources.
[d289ffa] NIFI-2654 Added LIP XML decryption.
Added unit tests.
[a482245] NIFI-2654 Added LIP test resources.
[7204df4] NIFI-2654 Changed logic to only perform properties encryption when file path is provided.
[729e1df] NIFI-2654 Removed population of default file locations for bootstrap.conf, nifi.properties, and login-identity-providers.xml as not all files may be desired.
Added/updated unit tests.
[7dba5ef] NIFI-2654 Started LIP work (arguments & parsing).
Added unit tests.

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1216
2016-11-14 22:39:06 -05:00
Andy LoPresto 4d1bcc808f
NIFI-3032 Resolved issue where multiple invocations of NiFiPropertiesLoader.withKey() used cached key.
Added unit tests and resources.

NIFI-3032 Fixed bug in AESSensitivePropertyProvider#getIdentifierKey where the result was always the max available key size, not the size of the current key.
Added unit test.

This closes #1220

Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-11-14 17:50:32 -05:00
Matt Gilman ae4f27a627 NIFI-3023:
- Ensuring there are no authorization issues prior to considering the remote process group's transmitting flag.
This closes #1205
2016-11-14 16:23:36 -05:00
Matt Gilman 2c91a1a33d NIFI-3023:
- Verifying permissions prior to checking Remote Process Group transmission status.
2016-11-14 16:03:47 -05:00
Mathias Tiberghien 65b7b377e3 NIFI-1526: DefaultSchedule annotation should be use on Custom Processor to set the default scheduling strategy, scheduling period or max number of concurrent task for each instance of the processor
DefaultSettings annotation should be use on Custom Processor to set the default penalty period, the yield duration or the bulletin log level for each instance of the processor
2016-11-14 12:04:21 -05:00
Mark Payne b73ba7f8d4 NIFI-2999: When Cluster Coordinator changes, purge any old heartbeats so that we don't disconnect a node due to very old heartbeats
This closes #1210
2016-11-11 15:13:49 -05:00
joewitt b9ef0fb847 NIFI-2818 This closes #1059. aligned read method with read/write method 2016-11-11 14:52:13 -05:00
Andre F de Miranda f32bdf7be9 NIFI-2818 - Minimise fs permission required by NiFi
1 - Replace a r/w test over $NIFI_HOME/lib that is performed
            but never utilised by a RO test
            2 - Rename ensureDirectoryExistAndCanAccess to
            ensureDirectoryExistAndCanReadAndWrite and deprecate the
            former
2016-11-11 14:49:33 -05:00
Scott Aslan 52cde9ad13 [NIFI-2898] restore ellipsis for processor type, controller servies type, and reporting task type descriptions. This closes #1191 2016-11-11 14:46:20 -05:00
Matt Gilman 9f417a84b9 NIFI-3002:
- Removing legacy code when retrieving site to site details when the target instance is this local NiFi.
- Ensures the UI accurately reflects available remote ports.
NIFI-2603:
- Fixing color of remote output port status in connection label.

This closes #1189.
2016-11-11 10:06:41 -05:00
Scott Aslan 4957b628fb [NIFI-3021] remove white-space:no-wrap on view configuration properties tables textareas
This closes #1204.
2016-11-10 22:12:08 +01:00
Matt Gilman f83863ebae NIFI-3009:
- Fixing NaN error when backpressure is not configured.
This closes #1200
2016-11-10 11:39:08 -05:00
Scott Aslan b426de1793 [NIFI-3012] update regex for the summary tables input, output, transferred, received, and sent column parse function. This closes #1197 2016-11-10 09:25:08 -05:00
Mark Payne c441a8696d NIFI-2850 This closes #1115. Added a migrate() method to ProcessSession and refactored BinFiles and MergeContent to use it 2016-11-09 16:25:03 -05:00
joewitt 3e892c55ec NIFI-2971 This closes #1172. addressed RPM bundled deps and handling exception for bootstrap cl construction 2016-11-09 11:08:43 -05:00
Matt Gilman bff89f17b3 NIFI-401: - Minor tweaks to PR #1117. - Ensuring existing configuraiton is retained and shown until the user explicits changes it. - Retaining, but disabling, deprecated options.
This closes #1185
This closes #1117
This closes #512

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-08 17:06:43 -05:00
Brian Eugley 7eca2037bd NIFI-401
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-08 17:06:36 -05:00
Bryan Bende d1d053725b NIFI-2909 Adding per-instance class loading capability through @RequiresInstanceClassLoading annotation
NIFI-1712 Applying per-instance class loading to HBaseClientService to allow specifying Phoenix Client JAR

-Refactoring the ClassLoading so that every processor, controller service, and reporting task gets an InstanceClassLoader with a parent of the NAR ClassLoader, and only components with @RequiresInstanceClassLoading will make a copy of the NAR ClassLoader resources, and addressing some review feedback

This closes #1156
2016-11-08 13:21:27 -05:00
Matt Gilman 2f0d9a34f1 NIFI-2982:
- Updating the labels in the Add Users/Groups to the Policy dialog..

This closes #1178.
2016-11-08 16:55:27 +01:00
Matt Gilman 9d3fe3f03e NIFI-2989:
- Updating the content of the delete policy dialog to make it a little more clear that the permissions for the component will revert back to the inherit policy.

This closes #1183.
2016-11-08 14:58:11 +01:00
Matt Gilman aa8ba0bd1c NIFI-2965:
- Ensuring the selection is cleared when going to the Process Group where the selected component policy is defined.
- Ensure that the selection context is updated when going to a component or group.

This closes #1174.
2016-11-08 14:49:12 +01:00
Pierre Villard 6aefc0b910 NIFI-2751 NIFI-2848 Get batch of flow files in a round-robin manner
This closes #1111
2016-11-07 14:01:18 -05:00
James Wing a486fefb1e NIFI-2115 Detailed Version Info in About Box
* Java version and vendor
* OS name and version
* Release Tag
* Build revision (commit SHA), branch, and timestamp
* Handles formal releases, ad-hoc builds, and non-release source builds
* Standalone UI presence in About dialog, Summary -> System Diagnostics
* Cluster UI as Versions tab in Cluster dialog
* Reduce About Dialog Content
* Fix Missing Property Display Bugs
* Marking the build time as type string.
* This closes #583
2016-11-03 11:16:20 -04:00
Matt Gilman edb0ebe52b
NIFI-2931: - Using the delete button state (which correctly checks if a policy is inherited) to drive the presence of the remove user button.
This closes #1153.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-03 09:47:26 -04:00
Scott Aslan 769530beae [NIFI-2603] applying color to highlight status changes
- Updating the colors of the target port status and ensuring that when one no longer exists it reports that it is not running.
- This closes #1171
2016-11-02 15:15:29 -04:00
Peter Wicks 60423f05b5 NIFI-2603
- Gui Icons
- Gui Icons - Fixing Orange Color
- Gui Icons - Fixing misc. colors
- Gui Icons - Summary page + spinner
- Gui Icons - Summary page again
2016-11-02 14:11:56 -04:00
Scott Aslan 05ea76dd6f [NIFI-2888] Display processor fill color when zoomed in/out. This closes #1151. 2016-11-02 12:54:58 -04:00
simplesteph 56da2b51e1 [NIFI-2900] transformed all datetime fields to string as they don't comply with ISO norms. This closes #1136. 2016-11-02 09:39:48 -04:00
Mark Payne e1f0ba5a43
NIFI-2925: When swapping in FlowFiles, do not assume that its Resource Claim is 'in use' but instead look up the canonical representation of the resource claim
This closes #1150.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-31 09:59:06 -04:00
Oleg Zhurakousky 7fd2c42b19 NIFI-2879,NIFI-2880 This closes #1120. fixed NarThreadContextClassLoader instantiation error handling 2016-10-28 12:15:12 -04:00
Matt Gilman 8dc60c72d4
NIFI-2884: - Adding support to selecting multiple users before updating a policy.
NIFI-2533: - Only including a user/group in the search results if they are not currently selected.
NIFI-2286: - Providing a tooltip for the add user and remove policy button.

This closes #1155.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-27 11:50:46 -04:00
jpercivall 1d74b5d3ce NIFI-2791 Adding 'math' expression language function
This closes #1157.
2016-10-25 19:45:38 +02:00
Michal Klempa 368ea7a2d2 NIFI-1069 Removing the exit directive
This closes #1159

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-10-25 12:44:19 -04:00
jpercivall e4a3e09643 NIFI-1662 Adding proper UI regex support for decimals in EL
This closes #1018
2016-10-24 10:31:16 -04:00
Andre F de Miranda 9b08f23b24
NIFI-1531 - Remove bogus .gitignore files from sub directories
This closes #1154.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-10-23 10:29:09 -04:00
Scott Aslan 6676e94a7c [NIFI-2929] remove canvas element names when zoomed out and view permissions are removed. This closes #1152 2016-10-21 16:11:27 -04:00
Matt Gilman af27e4070b NIFI-2843: - Removing the View Configuration menu item from the context menu on Process Groups.
This closes #1087

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-10-20 12:45:37 -04:00
Michal Klempa 99d3c39748 NIFI-1069 - improve init script exit codes so that results are LSB compliant
This closes: #1093

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-20 23:12:23 +11:00
Scott Aslan a8e1c775fd [NIFI-1459] add css translate3d to properties table editors in order to move the element along the z-axis of the 3D space and allow the scrollbars to properly be poistioned. This closes #1070 2016-10-19 15:39:58 -04:00
Andre F de Miranda 3914141c45
NIFI-1710 - Resolve path name to nifi.sh script
This closes #1137.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 16:43:03 -07:00
Scott Aslan f287bc9119
[NIFI-2913] update z-index of codemirror resize handle to match the z-index of the codemirror vert. and horz. scrollbars
This closes #1145.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 15:24:18 -07:00
Scott Aslan 9fb3039416 [NIFI-2898] Add Processor dialog processor descriptions now scrollable
This closes #1134.
2016-10-17 23:07:39 +02:00
Michal Klempa 88d125137e NIFI-2199 - allows nifi.sh restart through ssh
Closes: #1092

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-15 00:48:04 +11:00
Stephane Maarek 33ba1a822e
NIFI-2899 Updated swagger-maven-plugin to 3.0.1
Incorporates the fix from https://github.com/kongchen/swagger-maven-plugin/issues/141
Ensures the new swagger.json is spec 2.0 compliant, see https://github.com/swagger-api/swagger-codegen/issues/3976

This closes #1135.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-13 17:21:11 -07:00
Pierre Villard 26f46538b3 NIFI-766:
- Improved connection UI display when backpressure is enabled
- Updating the connection label to include backpressure indicators for object count and data size thresholds.
- Coloring the connection path and drop shadow once backpressure is engaged.
- Fixing bug with expiration icon tooltip.
- Including columns in the summary table for backpressure.
- Updating empty queue action to reload the connection status upon completion to ensure an updated count.

This closes #1080.
2016-10-13 12:14:16 -04:00
Koji Kawamura c470fae065 NIFI-2863: S2S to allow cluster URL more leniently. This closes #1122
- Consolidated the target cluster URL resolving logic into
  SiteToSiteRestApiClient's as a common method
- Changed to more descriptive error message
- Added more unit test cases
2016-10-13 09:50:50 -04:00
Matt Gilman a25b651da9
NIFI-2837: - Immediately hiding the template dialog after clicking the Upload button to prevent an accidental re-submission.
This closes #1086.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-12 09:18:58 -04:00
Matt Gilman 4a4c87fa15
NIFI-2849:
- Showing process group name when possible.
- Providing a link to jump to the process group defined in the effective policy.
- Preventing editing an inherited policy.
- When overriding a policy, allowing the user to indicate if the policy should be empty or should copy the user/groups of the inherited policy.

This closes #1090.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-11 00:06:09 -07:00
Koji Kawamura 540ef63efa NIFI-2855: Site-to-Site with port forwarding.
- Added following properties:
  - nifi.web.http.port.forwarding
  - nifi.web.https.port.forwarding

This closes #1100.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-10-07 15:00:37 +09:00
Mark Payne 09568d092b NIFI-2836:
- Ensure that we wait until a request is completed before unlocking the lock for request replication
- Ensure that failures do not trigger request completion logic unless the failure is the last node to report its status
- This closes #1109
2016-10-06 16:41:05 -04:00
Matt Gilman bb6c5d9d4e NIFI-2777:
NIFI-2856:
- Only performing response merging when the node is the cluster cooridinator even if there is a single response.
- Fixing PropertyDescriptor merging to ensure the 'choosen' descriptor is included in map of all responses.

This closes #1095.
2016-10-06 16:19:19 -04:00
Andrew Lim 53f7a21663 NIFI-2691 Replaced references to kerberos/spegno principle with principal in nifi.properties and admin guide
This closes: #1105

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-07 01:22:49 +11:00
Scott Aslan 8bd85e2085 [NIFI-1792] Clear the selected rule id when deleting the last rule in the list. Add scrollable styles when appropriate. Close popups when appropriate. This PR also adjusts the position of the table cell nfel and long text editors. This closes #1099. 2016-10-06 09:51:05 -04:00
Scott Aslan 6ad633d174 [NIFI-2838] update width of rule name and save message. This closes #1089 2016-10-05 16:40:06 -04:00
Scott Aslan e46fea920a [NIFI-1794] Update .dialog-content to wrap text. This closes #1094 2016-10-05 16:15:11 -04:00
Scott Aslan c764f83506 [NIFI-1904] If open, close hamburger menu on window resize. This closes #1106 2016-10-05 14:23:13 -04:00
Andre F de Miranda 3b408f5601 NIFI-2816 - Clean typos across the code - Part 2. This closes #1085 2016-10-05 13:07:57 -04:00
Byunghwa Yun 2c907c63af NIFI-2858:
- getSystemLoadAverage of OperatingSystemMXBean sometimes returns a negative value.
- ProcessorLoadAverage sets -1.0. It added a defensive logic.
- When load average is zero(load average: 0.00, 0.02, 0.04), systemLoad is zero.
- This closes #1091
2016-10-05 08:59:26 -04:00
Scott Aslan 44cc7e0072 [NIFI-2864] Update when shell empties content. This closes #1096 2016-10-05 08:14:15 -04:00
Koji Kawamura 17a36c6fd5
NIFI-2825: Fix S2S getPeers flow file count
- Added ClusterWorkload message to retrieve workload information from a
  cluster coordinator
- Use cluster workload to return queued flow file count to site-to-site
  client so that it can calculate distribution of data transfer

This closes #1084.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-03 13:28:01 -04:00
Pierre Villard d6867283b5 NIFI-2832 State management should be part of the documentation/usage. This closes #1074 2016-09-30 09:59:35 -04:00
Scott Aslan e230e50f9d [NIFI-1851] correctly display number of total process groups upon refresh. This closes #1079 2016-09-29 13:25:19 -04:00
Scott Aslan 1a24f5f34c [NIFI-2831] update auto terminate messages. This closes #1077 2016-09-29 13:09:29 -04:00
Scott Aslan 12e3315ae9 [NIFI-2833] Increase font size and line height for small dialogs. This closes #1078 2016-09-29 11:57:04 -04:00
Matt Gilman 833ec4409c NIFI-2758: - Updating move verification to account for Controller Service moving out of scope.
This closes #1064

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-09-28 15:01:38 -04:00
Scott Aslan c4826cac54 [NIFI-1757] remove iframe from shell dialog to prevent reoccurring requests, update fill color and label config dialog content margins to fit into their respective dialogs. This closes #1069 2016-09-27 15:38:10 -04:00
Scott Aslan d674cdfc79 [NIFI-2775] update Provenance table GoTo button visibility in FF. This closes #1040 2016-09-27 15:08:11 -04:00
Matt Gilman dd9ecc2907 NIFI-2824: - Updating replication logic to account for the potential replication target and then invoking the corresponding action.
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1068
2016-09-27 11:44:21 -04:00
James Wing 508b218b59 NIFI-2795 Sys Diagnostics in Cluster UI
- Cleaning up tab resize loop
- Pre-authorizing sys diagnostics api calls
- Addressing issues filtering the tables in the cluster table.
- Addressing issues sorting the tables in the cluster page.
2016-09-27 10:58:01 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code
This closes #1057.
2016-09-26 17:47:31 +02:00
Matt Gilman 1b88552b46 NIFI-2796:
- Fixing incorrect documentation for the cluster summary endpoint.

This closes #1063.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-09-26 11:43:33 -04:00
Scott Aslan 25150d4016 [NIFI-2788] update global hamburger menu to have fixed width icons and align text. This closes #1041 2016-09-23 14:35:38 -04:00
Scott Aslan f06aeaee2a [NIFI-2720] update view configuration properties tables dialogs to match editable configuration properties dialogs
This closes #1051.
2016-09-23 15:46:53 +02:00
Scott Aslan e973874793 [NIFI-2781] removing bower and allowing npm to manage client side resources in nifi-web-ui and nifi-jolt-transform-json-ui. This closes #1030 2016-09-22 14:50:21 -04:00
Matt Gilman 0218bc61ef
NIFI-1870: - Restoring the upstream/downstream connections dialog. - Correcting input port label when showing downstream components.
This closes #1028.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-22 11:32:19 -04:00
Matt Gilman 5198e70d14
NIFI-2707: - Ensuring that connections are always sorted accordingly to their zIndex. This preserves the 'bring to front' settings.
This closes #1023.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 17:20:44 -04:00
Matt Gilman b304f70f3e
NIFI-2785: - Ensure the URL is updated when uploading a template to ensure it's going to the appropriate Process Group.
This closes #1029.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 14:40:10 -04:00
Matt Gilman e10b4beb90
NIFI-2797: - Correcting download URIs for OTPs.
This closes #1038.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 10:33:39 -04:00
Matt Gilman 684f417406 NIFI-2792 - Ensuring the flow is saved when a template is deleted.
This closes #1031.
2016-09-21 16:31:40 +02:00
Koji Kawamura feaa4c9db8
NIFI-2757: Site-to-Site with DN mapping
Added DN identity mapping pattern support to Site-to-Site client
authorization.

This closes #1010.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-19 12:56:54 -04:00
Matt Gilman abcfbeb062 NIFI-2771:
- Using GzipHandler instead of GzipFilter.

This closes #1020
2016-09-15 10:27:39 -04:00
Peter Wicks 8a28395e9f NIFI-2754
- Migrating swap to active prior to swapping if necessary.
- This closes #1000.
2016-09-14 14:27:50 -04:00
Yolanda M. Davis 67a47dbead NIFI-2251
- Initial commit for client side provenance lineage svg download.
- css styling adjustments, changes for svg replace
- Addressing some style/spacing.
- This closes #982.
2016-09-14 14:23:46 -04:00
Koji Kawamura bc005e3398
NIFI-2772: Unsecure RAW Site-to-Site fails with User DN is not known
This closes #1019.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-14 10:39:11 -04:00
Matt Gilman 36846e0fe7
NIFI-2719: - Caching components recently added/removed in case ajax requests are received out of order. This is not an issue for modifications of existing components as we're able to leverage the revision.
This closes #1011.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-14 10:33:10 -04:00
Scott Aslan 02ca2a0d78 [NIFI-2770] fix action details dialog
This closes #1017.
2016-09-13 22:17:37 +02:00
Matt Gilman 5dd743947c
NIFI-2768: - Ensuring we correctly enforce authorization when the destination of a connection changes. This includes source, destination, and parent process group. - Ensuring the UI reseting accordingly when a request fails.
This closes #1014.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 11:41:51 -04:00
Matt Gilman b48355e75a
NIFI-2766: - Ensuring the root group is included in /resources.
This closes #1013.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 10:59:26 -04:00
Scott Aslan abaacfa5e5 [NIFI-2721] update CS GoTo. This closes #998 2016-09-09 12:31:46 -04:00
Koji Kawamura ae251c1a6f NIFI-2718: Show HTTP S2S Auth error on bulletin
This commit fixes following two issues, that happens when a Root Group Port
policy for S2S data transfer is removed at a remote NiFi, after a client NiFi has
connected to that port:

1. At client side, Remote Process Group should show that authorization
is failing on its bulletin, but the Exception is caught and
ignored. Nothing is shown on the UI with HTTP transport protocol.
RAW S2S shows error on RPG bulletin. This commit fixes HTTP S2S to
behave the same.

2. At server side, corresponding input-port or output-port should show
that it is accessed by an unauthorized client on its bulletin, but it's
not shown with HTTP transport protocol.
RAW S2S shows warning messages for this. This commit fixes HTTP S2S to
behave the same.

In order to fix the 2nd issue above, request authorization at
DataTransferResource is changed from using DataTransferAuthorizable
directly, to call RootGroupPort.checkUserAuthorization().

Because the blettin is tied to the Port instance and it's
difficult to produce blettin message from this resource.

Since RootGroupPort.checkUserAuthorization uses
DataTransferAuthorizable inside, the check logic stays the same as
before.

Adding a RootGroupPortAuthorizable to provide access to necessary components for performing the authorization.

This closes #996
2016-09-08 13:43:38 -04:00
Mark Payne bc7c42efa5
NIFI-1966: Recreated issue that is outlined in JIRA (the reason for re-opening the ticket) that results in 'java.util.NoSuchElementException: No value present' in unit test - Resolved issue where two flows that are both empty but have different fingerprints (due to root group id being different) causes vote election to fail
This closes #995.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-08 10:48:24 -04:00
Mark Payne 938e32ed97 NIFI-2746: Ensure that the FlowController is injected into all ResourceApplications. This closes #993 2016-09-07 14:11:46 -04:00
Mark Payne a7e76cc00a NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977 2016-09-06 16:31:37 -04:00
Mark Payne a9d029d74e NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side
This closes #978

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-06 10:57:53 +09:00
Jeff Storck 97e2f406da NIFI-2708 Added merging of SiteToSite details
NIFI-2708 Updated to include ports from clientDto for port merging.

This closes #981
2016-09-02 14:55:08 -04:00
Matt Gilman d37480eaff NIFI-2722:
- Updating the component entity as long as the proposed entity is not older than the current one since stats are bundled in the entity too.

This closes #983

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-02 22:25:25 +09:00
Scott Aslan 867c84f32c [NIFI-2649] Update CS table upon creation of a CS from the RT or CS properties table
- Ensuring the controller services table to correctly reloaded regardless if its the processor group or controller level controller services. This closes #968
2016-09-01 09:53:12 -04:00
Matt Gilman 96a766464c
NIFI-2678: - Ensuring the most recent version of each component is save for rendering on the canvas.
This closes #979.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-31 15:59:52 -04:00
Matt Gilman 9e10371c8a NIFI-2704:
- Re-using the DataTransferAuthorizable in the DataTransferResource.
- Removing use of the DataTransferResource when obtaining site to site details as it performs additional unnecessary checks.
- Code clean up.
- This closes #971.
2016-08-31 15:09:17 -04:00
Yolanda M. Davis 1bb909ebca NIFI-2703 - Added bootstrap.conf file for running integration tests. This closes #975 2016-08-31 09:28:08 -04:00
Scott Aslan 648ddb6158 [NIFI-2679] User is now able to disable/enable processors that are invalid or stopped through Operate palette. This closes #973 2016-08-31 09:11:46 -04:00
Mark Payne 1213b46632 NIFI-2628: Whenever a flow is inherited from cluster coordinator, save flow immediately to disk
This closes #967
2016-08-30 16:13:45 -04:00
Matt Gilman ba19238757
NIFI-2694: - Addressing instances where phase one objects were being referenced instead of phase two objects. - Code clean up.
This closes #970.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-30 15:50:48 -04:00
jpercivall 1752a57197 Merge branch 'NIFI-2676-rc1' of https://git-wip-us.apache.org/repos/asf/nifi 2016-08-31 14:01:57 +10:00
Koji Kawamura daf4855570 NIFI-2687: RPG Port ID was used instead of RPG ID
It caused "Error: Unable to find remote process group with id 'XXXX'" error with modifying the transmitting toggle switch of an Input or Output port.

This closes #962
2016-08-29 10:14:55 -04:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
Scott Aslan c8ae7fcbe1 [NIFI-2480] remove explicit angular $sanitize to fix multibyte chars in breadcrumbs and flow status bar. All values are escapoed through the angular ng-bind. This closes #957 2016-08-26 11:03:10 -04:00
Koji Kawamura 2ed58912b2 NIFI-2480: Fix for multibyte chars in breadcrumbs. This closes #956
Removed $sanitize from breadcrumbs controller, as it escapes multibyte
chars with numerical reference. Even without $sanitize, html tags can be
escaped when Angular binds the value to text content.
2016-08-26 10:27:27 -04:00
jpercivall e1da9fc11f NIFI-2667 Adding License and Notice information to Media Bundle Nar and Assembly
This closes #950
2016-08-25 22:42:37 -04:00
Oleg Zhurakousky 7879a99206
NIFI-2675 fixed NPE in template generation
This closes #951.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-25 16:44:02 -07:00
Bryan Bende 957c120343 NIFI-2664 Moving System.setProperty for krb5.conf to NiFi startup, and removing conflicting property from KerberosProvider config
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #946
2016-08-25 17:26:37 -04:00
Mark Payne f908ae3c3b NIFI-2669: This closes #949. Ensure that if Exception is thrown during Transaction initialization that the underlying client is closed/cleaned up. Also ensure that we generate bulletins when logging error/warn level log messages 2016-08-25 16:39:00 -04:00
Matt Gilman a6133d4ce3 NIFI-2635:
- Fixing contrib check issues.
- Clean up pom.
- Addressing issue where reporting task property descriptor using wrong scope.

NIFI-2635:
- Fixing issue with revisions when creating users and user groups.
- Forwarding requests to the coordinator instead of replicating.
- Tweaking verbage in dialog for removing users and groups.

This closes #943
2016-08-25 13:08:35 -04:00
joewitt 1745c1274b NIFI-2608 This closes #930. restructured the ConsumeKafka processor to follow new consumer API. Made nar classloading more precise to support spawned threads NIFI-2660. 2016-08-25 10:09:50 -04:00