1349 Commits

Author SHA1 Message Date
Rob Fellows
d14686cb3a
[NIFI-12415] Counters (#8077)
* [NIFI-12415] Counters page
* populate counter the table.
* support counter reset.
* filtering by name and by context
* sorting, including initial sort
* added basic tests

* Formatted with Prettier

* review feedback - removing unused things.

* align mat-table usage to a common style

* disable the Counter menu item if the user doesn't have counterPermissions.canRead

This closes #8077
2023-11-29 18:00:28 -05:00
Matt Gilman
05575364a3
NIFI-12417: Process Group Configuration (#8075)
* NIFI-12417:
- Process Group Configuration.
- Removed unnecessary module imports.

* NIFI-12417:
- Addressing review feedback.

This closes #8075
2023-11-29 17:21:35 -05:00
Matt Gilman
ebfb5bc12e
NIFI-12401: Allow combo editor to reference parameters (#8068)
* NIFI-12401:
- Allow combo editor to reference parameters.

* NIFI-12401:
- Addressing review feedback.
- Handling corner cases where there is no parameter context and where there are no parameters in a bound parameter context.

* NIFI-12401:
- Fixing formatting issues.

This closes #8068
2023-11-29 12:26:25 -05:00
Rob Fellows
4bba7e6188
[NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. (#8069)
* [NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. Also update the ci-workflow.yaml to activate that profile.

* add the profile activation to the Maven Build command

This closes #8069
2023-11-27 20:18:31 -05:00
Matt Gilman
b3b6d72924
NIFI-11481: Initial migration to Angular 16 (#8053)
* NIFI-11481:
- Initial project creation.

* NIFI-11481:
- Install material.
- Rename project from nifi-web-frontend to nifi.

* NIFI-11481:
- Install roboto through package.json.

* NIFI-11481:
- Add Tailwind.

* NIFI-11481:
- Basic layout.

* NIFI-11481:
- Introducing ngrx for storing flow.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.
- Adding draggable.
- Adding editable.
- Adding selectable.
- Adding flowfont.
- Adding Canvas View.
- Adding Transform in Store.
- Adding selected in Store.
- Adding transition in Store.
- Funnel Manager directly subscribes to store.

* NIFI-11481:
- Adding backend calls.
- Refactoring update positions to be for a single component.

* NIFI-11481:
- Process Group Manager.
- Adding font-awesome.
- Updating canvas/graph component visibility.
- Adding prettier/eslint.

* NIFI-11481:
- Adding support to enter a process group.

* NIFI-11481:
- Formatting source.

* NIFI-11481:
- Label Manager.
- Added generic update component.

* NIFI-11481:
- Processor Manager.

* NIFI-11481:
- Port Manager.

* NIFI-11481:
- Remote Process Group Manager.

* NIFI-11481:
- Adding draggable icons to the toolbar.

* NIFI-11481:
- Formatting.

* NIFI-11481:
- Draggable Toolbar.
- Create Label, Funnel.

* NIFI-11481:
- Connection Manager.
- Connectable Behavior.

* NIFI-11481:
- Draggable behavior with back end call for both components and connections.

* NIFI-11481:
- Selection box.

* NIFI-11481:
- Port creation.
- Port configuration.
- Quick Select.

* NIFI-11481:
- Canvas Tooltips.

* NIFI-11481:
- Context menu.

* NIFI-11481:
- Router State.
- Reorganization.
- Deep linking.

* NIFI-11481:
- Adding support for Delete.

* NIFI-11481:
- Flow status bar.

* NIFI-11481:
- Adding Current User State.
- Current user polling.
- Fixing Flow Status layout bug.

* NIFI-11481:
- Process Group Polling.

* NIFI-11481:
- Process Group Breadcrumbs.

* NIFI-11481:
- Global Menu.

* NIFI-11481:
- Search.

* NIFI-11481:
- Add support for centering components on the canvas.

* NIFI-11481:
- Add support for persisting and restoring the users view of the current PG.

* NIFI-11481:
- Fixing centering behavior.
- Fixing user view restoration.
- Bulk selection auto fit.

* NIFI-11481:
- Incorporating the new UI into the NiFi build with a build profile that is not active by default.
- The new UI is deployed to a different context path than the current UI and works side by side.

* NIFI-11481:
- Center component from context menu.
- Enter process group from context menu.

* NIFI-11481:
- Adding support to log in.
- LoginFilter, LogoutFilter.
- Moved the handling of 'include-new-ui' profile to make building with and within more straight forward.
- Splash screen while guard executing.
- Http request interceptor to show loading on the canvas.
- Http request interceptor to handle 401 responses.

* NIFI-11481:
- Extension Creation Component.
- Filter, Usage Restrictions, and selected type.

* NIFI-11481:
- Stopping polling when unable to connect to server.

* NIFI-11481:
- Settings - General.

* NIFI-11481:
- Settings - Management Controller Services.

* NIFI-11481:
- NiFi Tooltip directive.
- Usage Restriction Tip.
- Comments Tip.
- Validation Errors Tip.
- Bulletins Tip.

* NIFI-11481:
- Settings - Reporting Tasks.

* NIFI-11481:
- Avoiding unnecessary web requests in route guards.

* NIFI-11481:
- Edit Controller Service Dialog.
- View Property Table.
- Update component density.

* NIFI-11481:
- Supports Controller Service API tooltip and dialog content.

* NIFI-11481:
- Property table - NF Editor.
- Property table - Combo Editor.

* NIFI-11481:
- Making property table a control value accessor.
- Wiring up saving Controller Services from Edit Dialog.
- Handling Delete Property.
- Handling New Property.
- Updating how form submission is triggered throughout to address issue with incidental form submit events.

* NIFI-11481:
- Moving Settings into pages.

* NIFI-11481:
- Moving Canvas into pages.

* NIFI-11481:
- Moving Login into pages.

* NIFI-11481:
- Adding routing to the Controller Service listing and Reporting Task listing.
- Updating Canvas routing to follow similar pattern.

* NIFI-11481:
- Controller Service references.

* NIFI-11481:
- Create inline Controller Service.
- Edit Controller Service route.
- Go To Controller Service from Property Table.
- Switching to Event Emitter in New Property dialog.

* NIFI-11481:
- Saving spinner - Create Processor, Create Port, and Edit Port.

* NIFI-11481:
- Saving spinner - Create Controller Service, Edit Controller Service, and Create Reporting Task.

* NIFI-11481:
- Parameter Context Listing.
- Add new Parameter Context.
- Edit Parameter Context.

* NIFI-11481:
- New Paramter.
- Edit Parameter.
- Parameter table.

* NIFI-11481:
- Parameter references.
- Parameter Context update steps.
- Bound Process Group references.

* NIFI-11481:
- Parameter Context Inheritance.

* NIFI-11481:
- Processor configuration.
- Ensuring new Property names are unique.
- Trapping focus in nf and combo editors.
- Reloading component connections after updating a Processor.

* NIFI-11481:
- Navigation Control.
- Birdseye.
- Operation Control.

* NIFI-11481:
- Create Process Group.
- Upload Process Group.

* NIFI-11481:
- Implementing current Process Group context in operation palette.

* NIFI-11481:
- Connection creation.

* NIFI-11481:
- Connection configuration.

* NIFI-11481:
- Standardizing selection option model.
- Connection load balancing tooltip.
- Clean up.

* NIFI-11481:
- Move components in to/out of groups.
- Group components.

* NIFI-11481:
- Render connections for component action.

* NIFI-11481:
- CodeMirror for Parameter and EL configuration.

* NIFI-11481:
- Resizable.
- Moving tooltip directive.

* NIFI-11481:
- Ensuring all specs are bootstrapped and create successfully.

* NIFI-11481:
- Updating some interface names to avoid conflicting with various components in an attempt to better establish a naming convention.

* NIFI-11481:
- Show Source/Destination.
- Defaulting current Parameter Context in Create PG and Group dialogs.
- Handling disabled state in a few ControlValueAccessors.
- Ensuring Parameter Contest uri is set.
- Unit tests.

* NIFI-11481:
- Fixing checkstyle issue.

* NIFI-11481:
- LICENSE/NOTICE.

* NIFI-11481:
- RAT Plugin config.

* NIFI-12401:
- Addressing review feedback.

* NIFI-11481:
- Ensuring the option is disabled when there is no description.

* NIFI-11481:
- Only including parameters in the payload when they have been modified.
- Showing appropriate message after applying based on whether parameters were included or not.

* NIFI-11481:
- Fixing parameter deletion.
- Enforcing parameter name uniqueness.
- Preventing changing parameter sensitive.

* NIFI-11481:
- Only loading the service link once when considering updated property value.
- Ensuring existing parameter are set in all instances of opening the new Property dialog.

* NIFI-11481:
- Fixing tests that regressed.

* NIFI-11481:
- Adding default karma config which was needed in order to debug tests in IDE.

* NIFI-11481:
- Updating karma config to not watch for now. Can introduce new options for running in various contexts in the future.

This closes #8053
2023-11-27 10:39:51 -05:00
Bryan Bende
1cc346b63d
NIFI-12368 Clear versionedComponentId for copied Snippets
This closes #8025

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:52 -06:00
Mark Payne
b5c3e6f9aa
NIFI-12358 Fixed NPE in HostHeaderHandler
Fixed NPE in ThreadDumpTask and TrackedLeaderElectionManager

This closes #8032

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 16:57:18 -06:00
Paulette Hines-Cross pliszle
93d373f037
NIFI-12107 Fixed sorting in the cluster table
This closes #7923

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 08:37:29 -06:00
Nissim Shiman
ed9b23ef3f
NIFI-12315 Resolved issue preventing PG from being imported from
Registry

- Corrected component property reference in sorting of response objects

This closes #7977

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:33:10 -05:00
exceptionfactory
97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory
786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
exceptionfactory
2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Pierre Villard
1df9738f8f
NIFI-12281 Fix Go To in Parameter Providers to Provider Context
This closes #7939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 19:39:10 -05:00
Shane Ardell
c4ff8de412
NIFI-12260: Remove templates from frontend (#7924)
* remove templates from frontend

* remove more references to removed files

* removing more template references

* remove unused css template styles
2023-10-26 15:16:14 -04:00
exceptionfactory
f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 19:54:27 +01:00
Mark Payne
19993783e1
NIFI-12203: Ensure that when inheriting cluster flow on startup, we remove any Controller Services, Reporting Tasks, Parameter Contexts, etc. that are not in the proposed flow. Also removed overly aggressive timeout from RunOnceIT and performed minor code cleanup
Resolves #7907

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-24 10:45:58 -05:00
Mark Payne
1d5f2f626b NIFI-12245: Removed deprecations around flow registry clients
NIFI-12245: Removed null check that is no  longer necessary

NIFI-12245: Fixed checkstyle violation

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #7899
2023-10-24 14:08:03 +02:00
annanys23
6daf0abfd4
NIFI-5137 Fixed the path to Controller Service grid item's state
This closes #7833

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-21 20:05:10 -05:00
markobean
63a2503fc3
NIFI-11874 update Process Group configuration layout in the UI (#7591)
* NIFI-11874 update Process Group configuration layout in the UI

* NIFI-11874: relocate checkbox for recursive application of paramenter context

* NIFI-11874 remove comments tab from process group configuration

* NIFI-11874 minor cleanup of float CSS for process-group-parameter-context-combo

This closes #7591
2023-10-21 10:09:29 -04:00
Bryan Bende
fd2de5a151
NIFI-12198 Add API and CLI commands to import reporting task snapshots (#7875)
* NIFI-12198 Add API and CLI commands to import reporting task snapshots
2023-10-20 10:45:48 -04:00
Matt Gilman
9e5892780a
NIFI-12167:
- Renaming Usage to View Documentation.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7904.
2023-10-20 11:34:29 +02:00
Matt Gilman
98eef74dd8
NIFI-12250: (#7908)
- Fixing issue where the registry configuration dialog was being initialized twice.
2023-10-19 15:53:07 -04:00
Mark Payne
8bfb6be5ba
NIFI-4172: Renamed ClusteSummaryEntity to ClusterSummaryEntity
This closes #7900

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:46:18 -05:00
Matt Gilman
97dfe2d812
NIFI-11909 Cleared Password field after login
- Clearing the password in the login form when login fails or unable to verify access once authentication succeeds.

This closes #11909

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:40:27 -05:00
Matt Gilman
f2822a6bfb
NIFI-12247: (#7905)
- Reverting to the initial value if there is no selected parameter in the combo editor.
2023-10-19 14:25:06 -04:00
Matt Gilman
dc76d3896d
NIFI-12248: (#7906)
- Fixing arrow alignment in combo editor.
2023-10-19 13:56:55 -04:00
András Kovács
d4014c71ee
NIFI-12099 Repurpose Template icon in top left bar (#7811)
This closes #7811
2023-10-19 12:16:34 -04:00
Shane Ardell
e2bbcac8e1 This closes #7810
NIFI-12088: recalculate hidden property fields when new service is created

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2023-10-16 16:52:45 -04:00
Zackeus Bengtsson
0a47157640
NIFI-12122 Fixed persistence of Parameter Context descriptions
Fixed bug where parameter context descriptions were not loaded on NiFi startup and overwritten as empty

This closes: #7787

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-13 18:30:50 -05:00
exceptionfactory
22ad7d542d
NIFI-12206 Refactor Flow History using JetBrains Xodus (#7870)
* NIFI-12206 Refactored Flow History using JetBrains Xodus

- Replaced H2 Database Engine with JetBrains Xodus for persistent storage of FlowConfigurationHistory
- Added EntityStoreAuditService implementation using Xodus PersistentEntityStore
- Removed nifi.h2.url.append from properties
2023-10-12 14:50:25 -04:00
Mark Payne
abfc49e212
NIFI-12139: Implemented migrateProperties, migrateRelationships for processors, as well as migrateProperties for ReportingTasks and Controller Services. Added system tests to verify behavior.
- Ensure that after restoring nars in the lib/ directory we restart NiFi so that they take effect. This is important if this test is not the last one to run

This closes #7837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-12 11:40:18 -05:00
Bence Simon
3f13604c36
NIFI-11772 Removed flow.xml.gz support
- Created NIFI-12203 to evaluate issues with flow comparison surfaced in JoinClusterWithDifferentFlow

This closes #7661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 13:53:01 -05:00
timeabarna
d2aec89738
NIFI-12166 Add repo usage to the monitoring endpoint (#7836)
* NIFI-12166 Add repo usage to the monitoring endpoint
2023-10-10 14:55:33 -04:00
Bryan Bende
ae61ebb5ed
NIFI-12186 Add ability to export a versioned reporting task snapshot (#7853)
* NIFI-12186 Add ability to export a versioned reporting task snapshot
- Add CLI commands and optional query param to specify specific reporting task
2023-10-09 10:50:36 -04:00
Nissim Shiman
5afda79f28
NIFI-11782 Resolved NPE when moving snippet with label to process group
This closes #7838

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:05:40 -05:00
Tamas Palfy
9c425d273c
NIFI-12131 Fixed potential NPE related to FlowAnalyzer
Revamped RuleViolationsManager and FlowAnalyzer handling to make sure no issue occurs when these are not set. Fix ResourceNotFoundException: When determining the subject permissions for a rule violation the type of the subject is now known, so we try to lookup all possible types. Non-matching tpyes throw a ResourceNotFoundException exception though. Going to ignore those.

This closes #7809

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-02 15:35:05 -05:00
exceptionfactory
19b4be40aa
NIFI-12157 This closes #7826. Removed nifi-logging-utils and NiFiLog
- Replaced NiFiLog references with direct references to SLF4J LoggerFactory

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-02 08:17:51 -07:00
Emilio Setiadarma
a8c1bb1d9c
NIFI-10425 Corrected auto-reloading KeyStore files with symlinks
- Changed StoreScanner scanner instantiation to not report real paths

This closes #7821

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-30 12:28:54 -05:00
exceptionfactory
c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:56:53 -07:00
Mark Payne
db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Pierre Villard
43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Pierre Villard
2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne
713be8b539
NIFI-12101: This closes #7768. Fixed bugs that caused StatelessBasicsIT.testChangeFlowVersion to fail. There were a couple of related issues. Firstly, for Stateless Groups we were not waiting for the group to fully stop before attempting to update the flow but were waiting only for child/descendant groups to stop. This was due to misleading naming in the ProcessGroupUpdateStrategy enum. Renamed enum values to more clearly convey what they mean. Additionally, renamed the enum to more clearly convey what how it is used, since it is used not only for updating groups but also for retrieving groups. Additionally, when waiting for stateless groups to stop, we inadvertently checked the Set of affectedComponents' IDs against Process Group IDs so addressed the logic there and also ensured that we were consistent in setting the AffectedComponentEntity's ProcessGroup (i.e., its ProcessGroupNameDTO) as we were inconsistently setting it across the codebase.
Fixed issue in logic of LocalComponentLifecycle, which was waiting for all PGs to reach desired stateless run schedule, even when the group itself was not stateless

Fixed JavaScript to specify correct value for recursivity when updating process group parameter context
2023-09-22 09:00:52 -07:00
Peter Turcsanyi
ac80b9d900
NIFI-11595 StateProvider.replace() supports creating the initial state
- Extracted common logic from setState() and replace() into modifyState()
- Removed redundant code from createNode() because exceptions are handled on the caller side
- NodeExistsException and InterruptedException are handled in setState() and replace()
- Also used KeeperException's subclasses instead of KeeperException.code()

This closes #7324

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 10:06:38 -05:00
Joseph Witt
a1fca9b44e
NIFI-12064 Upgraded Maven Plugin versions
This closes #7731

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 19:35:51 -05:00
Joseph Witt
4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
exceptionfactory
6841aa6e99
NIFI-12047 Added HTTP/2 to Default Application Protocols
- Changed default value of nifi.web.https.application.protocols to include both h2 and http/1.1
- Changed default value of nifi.registry.web.https.application.protocols to include both h2 and http/1.1
- Updated HostHeaderHandler logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7684.
2023-09-14 13:50:01 +02:00
Timea Barna
c30fd9b66d
NIFI-12006 Removed Templates from Framework and UI
This closes #7658

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 14:52:41 -05:00
Freedom9339
2b330d9fee
NIFI-10904 Changed the font color for drop down menus to avoid the app… (#7502)
* NIFI-10904 Changed the font color for dropdown menus to avoid the appearance of menu items being disabled

* NIFI-10904 Changed the CSS tag used to set the color of the dropdown menu text

* NIFI-10904 Used a new css class to set the color of dropdown options

* nifi-10904 Changed the css class for create/reference drop down menu items.

Merged #7502 into main.
2023-08-31 09:41:08 -07:00
exceptionfactory
5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00