Commit Graph

9472 Commits

Author SHA1 Message Date
Scott Aslan 3c5b997ce7
[NIFI-12761] refresh RPG (#8401)
* [NIFI-12761] refresh RPG

* address feedback

* stop polling on error

* fix linting errors introduced in this PR

* reload the connections

* refresh rpg, if first call does not have updated timestamp start polling

* rename action

* final touches

This closes #8401
2024-02-16 11:15:44 -05:00
Matt Gilman 6f6ddf8960
NIFI-12795: (#8416)
- Including embedded help documentation.
- Support linking to specific help documentation from the canvas and component listings.
2024-02-16 10:01:04 -05:00
Mark Payne bd11031725
NIFI-12659 Respawn Python Processes on Unexpected Termination
Refactored so that when a Python Process dies, NiFi will detect this, respawn the process, recreate the Processors that exist in the process, re-initialize them, and restart them. In testing, found the PythonControllerInteractionIT had bugs that were causing Python Processors to be re-initialized many times; this resulted in threading issues that caused processors to be invalid, indicating that property descriptors didn't exist, etc. Addressed these concerns in the same commit, since they were necessary to properly run tests

Ensure that ClassLoader is consistently established for python processor proxies; ensure that if we re-initialize python processor the old initialization thread is stopped

This closes #8363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 21:30:55 -06:00
Alex Ethier 4b4ca30fc0
NIFI-12791 Added pillow-heif to ParseDocument Processor
- Set explicit dependency versions for ParseDocument Processor

This closes #8411

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 19:30:25 -06:00
dan-s1 fd4a74dbff
NIFI-12725 Upgraded json-schema-validator from 1.1.0 to 1.3.2
- Adjusted URIs for schemas Draft 4, Draft 6 and Draft 7 to match official values set on json-schema-validator 1.3.0

This closes #8405

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 15:11:01 -06:00
Mark Payne b8d7b9c677
NIFI-12757: Issue GC commands to Python for FlowFileTransformResults and RecordTransformResults when no longer needed on Java side
This closes #8375

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 15:07:03 -06:00
Rob Fellows e90c42d9cd
[NIFI-12790] Migrate to Angular 17 (#8410)
* [NIFI-12790] update version of typescript and zone.js
* remove override of dependency

* upgrade to angular 17

* migration to control-flow - used "ng generate @angular/core:control-flow"

* update the version of node used to build with

* add engine.node requirement to package.json

This closes #8410
2024-02-15 13:47:19 -05:00
Pierre Villard a1542affc3 NIFI-12789 - fix broken link in couchbase additional details 2024-02-15 10:29:48 -05:00
exceptionfactory 4d5f33804b
NIFI-12765 Removed Apache Ranger modules
This closes #8389

- Removed nifi-ranger-bundle modules
- Removed nifi-registry-ranger modules

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-14 17:11:50 -07:00
exceptionfactory fcaaa566e8
NIFI-12793 Removed deprecated nifi-spark-bundle
This closes #8409

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-14 17:10:50 -07:00
Rob Fellows 2792aa7038
[NIFI-12754] - Flow Configuration History (#8399)
* [NIFI-12754] - Flow Configuration History
* support selection
* support pagination
* support sorting
* added time controls, also updated provenance to use them too
* allow for clearing of filters
* use date range filter
* more details dialog for flow config history
* support purge history

* review feedback - use snackbar error where intended, add padding between header and page content

* don't use route for flow config history item selection

* Address review feedback

* remove unused style

* Review feedback * initial query is for the last 2 weeks * added timezone to purge confirmation message * reset pagination state on filter, clear filter, and purge * only resubmit query when filter by changes IF there is a filter term specified

This closes #8399
2024-02-14 16:35:58 -05:00
Scott Aslan 22de416ffc
[NIFI-12774] configure RPG (#8398)
* [NIFI-12774] configure RPG

* address review feedback

* conditionally dispatch selectComponents action

This closes #8398
2024-02-14 12:52:01 -05:00
Alex Ethier e03329e01f
NIFI-12739 - Import ProcessPoolExecutor to fix bug in python 3.9+ (#8357)
* NIFI-12739 Import ProcessPoolExecutor to fix bug in python 3.9+ that causes
Exceptions to be raised incorrectly in multi-threaded applications
(https://bugs.python.org/issue42647)

* Removed extraneous whitespace.
2024-02-14 12:50:01 -05:00
Matt Gilman da8f86b7e7
NIFI-12767: Error handling in Provenance and Lineage (#8386)
* NIFI-12767:
- Error handling in Provenance and Lineage.

* NIFI-12767:
- Addressing review feedback.

* NIFI-12767:
- Restoring empty initial state for completed request that allows showing a banner error over an empty table instead of an empty page.

* NIFI-12767:
- Restoring error state to ensure that the loading spinner stops on error.

This closes #8386
2024-02-14 11:11:26 -05:00
Ferenc Kis 4f030fefca
NIFI-12787 [MiNiFi] Update list of out-of-the-box supported processors in quickstart guide
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8402.
2024-02-14 13:44:31 +01:00
Peter Turcsanyi 9ba68edb5f
NIFI-12766 Fixed Region handling for AWS Assume Role Credentials
This closes #8382

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-12 18:05:09 -06:00
mr1716 6243d00158
NIFI-12779 Upgraded Okio from 3.7.0 to 3.8.0
This closes #8396

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-12 17:55:06 -06:00
Pierre Villard ecd6ed48a9
NIFI-12755 Upgraded Jetty from 12.0.5 to 12.0.6
- Refactored WebSocket Test Listener to avoid method visibility problem

This closes #8374

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-12 17:43:01 -06:00
Scott Aslan 25e24e0377
[NIFI-12759] go to RPG (#8378)
This closes #8378
2024-02-12 18:20:40 -05:00
lehelb d1af7ef0c5
NIFI-12781 Removed File Location from Provenance UPLOAD event
This closes #8397

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-12 16:31:41 -06:00
Scott Aslan 14fcc42d16
[NIFI-12758] create remote process group (#8376)
* [NIFI-12758] create remote process group

* address review feedback

* update unit test

This closes #8376
2024-02-12 15:27:14 -05:00
lehelb bf86103abf
NIFI-12775: Renamed provenance/FileResource to ProvenanceFileResource
This closes #8392.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-02-12 08:52:24 +01:00
Peter Turcsanyi b6b0b241c3
NIFI-12769 Updated copyright year to 2024 in NOTICE file headers
This closes #8384.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-09 14:23:39 -07:00
David Handermann e93fb17b66
NIFI-12768 Removed unstable filename assertion in TestListFile (#8383) 2024-02-09 16:00:22 -05:00
David Handermann 2ea4838157
NIFI-12764 Removed Commons Codec and Lang3 from security-utils (#8380) 2024-02-09 16:00:06 -05:00
Rob Fellows 7dc696ecdc
[NIFI-12665] fetch parameter provider parameters (#8367)
* [NIFI-12665] - fetch parameter provider parameters
* add permissions checks to parameter provider table actions for edit, delete, and fetch.
* error handling
* routing to fetch parameter provider dialog
* list the parameter groups
* parameter sensitivity selction/deselection
* show banner error if any affected/referencing components are not readable and writeable
* add indicators to parameters for changed, new, removed, ...
* refactored parameter-references component to the common area. leveraged it in the fetch dialog.
* validate the fetch form
* submit the fetch parameter provider parameters

* make the async update step completion icon color theme-aware

* add missing license header

* fixes for the initial round of review comments

* fixing issues found in review

* fix registry clients test

* stop polling when there is an api error

* use sort and join pipes in a couple of more places.

* protect references to parameter provider in the context for read permissions

* when full screen error is triggered, close any open dialog with the 'ROUTED' result to prevent unintended afterClosed actions taking place (like re-selection)

* handle fetch parameter provider error

* remove TODO comments

* call fullScreenError correctly

This closes #8367
2024-02-09 13:19:12 -05:00
Scott Aslan 16eadc88da
[NIFI-12746] keep search field open on backdrop click (#8372)
This closes #8372
2024-02-09 10:37:27 -05:00
Peter Turcsanyi d5206b1ddd
NIFI-12736 Fixed migration of credential properties in AWS processors
This closes #8353

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-09 08:39:29 -06:00
Matt Gilman 439c59e733
NIFI-12742: Error Handling in Summary, Users, and Queue Listing (#8366)
- Error handling in Users.
- Error handling in Summary.
- Error handling in Queue Listing.
- Addressing review feedback.
- Dispatching delete success to ensure the active request is reset upon completion.

This closes #8366
2024-02-09 09:37:07 -05:00
Mark Payne 4094c7f599
NIFI-12740 Fixed Threading Bug with Java to Python Bound Objects
Fixed a threading bug where Java makes a call to Python, Python create a Java object to return (ArrayList), Python returns the object and then cleans it up, notifying Java to remove it from 'bound objects', and then Java process the response and returns a null object because it's no longer bound

This closes #8356

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-09 08:34:49 -06:00
tpalfy 49e599385d
NIFI-12696 Added Component Type to Rule Violations for Authorization
RuleViolations (these objects only reside in memory only) now contain the type of the component that is responsible for the violation. This is used in StandardNiFiServiceFacade to fix and improve the authorization logic.

This closes #8318

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-09 08:27:43 -06:00
Mark Payne 5f534dcc42
NIFI-12710 Support microsecond precision for Timestamp Record fields
- PutDatabaseRecordIT supports operating systems with either nanosecond or microsecond precision

This closes #8332

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-09 08:19:51 -06:00
Bence Simon a519585b02
NIFI-12236 Improved Fault Tolerance in QuestDB Status Repository
- Moved QuestDB components to nifi-questdb-bundle

This closes #8152

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 17:27:05 -06:00
Joseph Witt 4dfbe05641
NIFI-12753 Updated GitHub Actions to current versions
- Upgraded cache from 3 to 4
- Upgraded CodeQL from 2 to 3
- Upgraded Codecov from 3 to 4
- Upgraded upload-artifact from 3 to 4
- Upgraded stale from 6 to 9

This closes #8373

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 16:20:50 -06:00
Pierre Villard 3afeac6341
NIFI-12636 - Upgrade dependencies for Pinecone, ChromaDB and OpenAI processors
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8293.
2024-02-08 16:05:45 -05:00
Rajmund Takacs 85dc637a96 NIFI-12745: Fix AvroReader silently dropping malformed records
This closes #8361.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-02-08 19:21:13 +01:00
Timea Barna 1781e16619
NIFI-12749 Handled Forward Slash in Flow Name for nifi-toolkit-cli
- The export-all-flows command fails when the Flow Name contains a forward slash

This closes #8369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 08:25:35 -06:00
lehelb 6a007f9159
NIFI-12270 Added UPLOAD Provenance Event Type to nifi-api
This closes #8094

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 08:16:46 -06:00
Ferenc Kis 84878df61a
NIFI-12751 [MiNiFi] Prefer IPv4 address when sending NetworkInfo to C2
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8370
2024-02-08 12:38:54 +01:00
Scott Aslan 43276acf55
[NIFI-12748] apply panelClass to snackbars to apply lighter color to … (#8365)
* [NIFI-12748] apply panelClass to snackbars to apply lighter color to the snackbar action text

* hover color for snackbar action button

* updates based on https://github.com/angular/components/issues/11426

This closes #8365
2024-02-07 15:23:26 -05:00
exceptionfactory 202ca3c638
NIFI-12752 Updated GitHub Workflows to use macos-14
- Upgraded setup-java action from v3 to v4
- Upgraded setup-python action from v4 to v5
- Updated system-tests to use Python 3.10 instead of Python 3.9

This closes #8371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Joe Witt <joewitt@apache.org>
2024-02-07 13:59:16 -06:00
Matt Gilman 7ec2dd07c9
NIFI-12734: Import from Registry (#8354)
* NIFI-12734:
- Import from Registry.

* NIFI-12734:
- Providing better guidance when there are no registry clients available based on user permissions.
- Showing form validation errors when there are no buckets or no flows.

This closes #8354
2024-02-07 12:02:13 -05:00
Umar Hussain e00d2b6d5e
NIFI-12708: add option in UnpackContent to specify encoding charset for filenames in zip unpacking
This closes #8350

The processor can now take a filename encoding parameter and pass it to zip unpacking. This will allow
user to unzip files with specific encoding to get correct filenames in output.

This for example help with zip files created on Windows which by default uses Cp437 for filename encoding.
If the filename contains special character like German alphabet ä, ü etc., decoding this with Linux's
default encoding usually UTF8 output will contain `?` in it. When the same file is processed with property
set with `Cp437`, the processor outputs correct filenames with special characters preserved.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-07 09:56:21 -07:00
Scott Aslan f39f3ea252
[NIFI-12727] Detect theme based on OS setting, allow user override (#8352)
* [NIFI-12727] Detect theme based on OS setting, allow user override

* update storage service types, introduce theming service for user selection of theme settings

* review feedback, update menu option disaplay names, update storage service types, delete expired local storage items on init

* check for existence of window.matchmedia

* rebase and address review comments

This closes #8352
2024-02-07 08:26:07 -05:00
Scott Aslan 72f6d8a680
[NIFI-12747] correct theming references (#8364)
This closes #8364
2024-02-06 16:08:01 -05:00
Matt Gilman 13c70c0f30
NIFI-12737: Removing all transitions when updating the Canvas transform (#8355)
* NIFI-12737:
- Recording last canvas URL in local storage.
- Using last canvas URL in global menu Canvas item.
- Conditionally applying transitions when centering components.
- Always applying transitions during zoom events (1:1, fit, zoom in/out).
- Adding support to center more than one component.

* NIFI-12737:
- Fixing bug when attempting to click on the search result of the currently selected component.
- Handling centering of a single selection different from a bulk selection as it performs betters with Connections.

This closes #8355
2024-02-06 15:04:35 -05:00
Matt Gilman 91f339bf0f
NIFI-12743: (#8358)
- Updating property editing so that Shift-Enter inserts a new line and Enter commits the edit.
- Fixing bug that prevented deleting a Property and then re-adding a new Property with the same name.

This closes #8358
2024-02-06 10:49:10 -05:00
Peter Turcsanyi 8f63e928a9 NIFI-12732 ListS3 resets its tracking state after configuration change
This closes #8348.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-02-06 14:52:16 +01:00
Matt Gilman 82c7cf65b5
NIFI-12723: Error Handling in Settings, Bulletin Board, and Counters (#8349)
* NIFI-12723:
- Error handling in General and Flow Analysis Rules.
- Fixed saving flag in management Controller Service listing.

* NIFI-12723:
- Error handling in Reporting Tasks and Registry Clients.

* NIFI-12723:
- Error handling in Bulletin Board.

* NIFI-12723:
- Error handling in Counters.

* NIFI-12723:
- Fixing lint issues.

* NIFI-12723:
- Addressing review feedback.

This closes #8349
2024-02-06 08:13:22 -05:00
mr1716 2950b43767
NIFI-12724 Upgraded Kubernetes Client from 6.9.2 to 6.10.0
This closes #8340

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:33:20 -06:00