Commit Graph

9380 Commits

Author SHA1 Message Date
Umar Hussain e00d2b6d5e
NIFI-12708: add option in UnpackContent to specify encoding charset for filenames in zip unpacking
This closes #8350

The processor can now take a filename encoding parameter and pass it to zip unpacking. This will allow
user to unzip files with specific encoding to get correct filenames in output.

This for example help with zip files created on Windows which by default uses Cp437 for filename encoding.
If the filename contains special character like German alphabet ä, ü etc., decoding this with Linux's
default encoding usually UTF8 output will contain `?` in it. When the same file is processed with property
set with `Cp437`, the processor outputs correct filenames with special characters preserved.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-07 09:56:21 -07:00
Scott Aslan f39f3ea252
[NIFI-12727] Detect theme based on OS setting, allow user override (#8352)
* [NIFI-12727] Detect theme based on OS setting, allow user override

* update storage service types, introduce theming service for user selection of theme settings

* review feedback, update menu option disaplay names, update storage service types, delete expired local storage items on init

* check for existence of window.matchmedia

* rebase and address review comments

This closes #8352
2024-02-07 08:26:07 -05:00
Scott Aslan 72f6d8a680
[NIFI-12747] correct theming references (#8364)
This closes #8364
2024-02-06 16:08:01 -05:00
Matt Gilman 13c70c0f30
NIFI-12737: Removing all transitions when updating the Canvas transform (#8355)
* NIFI-12737:
- Recording last canvas URL in local storage.
- Using last canvas URL in global menu Canvas item.
- Conditionally applying transitions when centering components.
- Always applying transitions during zoom events (1:1, fit, zoom in/out).
- Adding support to center more than one component.

* NIFI-12737:
- Fixing bug when attempting to click on the search result of the currently selected component.
- Handling centering of a single selection different from a bulk selection as it performs betters with Connections.

This closes #8355
2024-02-06 15:04:35 -05:00
Matt Gilman 91f339bf0f
NIFI-12743: (#8358)
- Updating property editing so that Shift-Enter inserts a new line and Enter commits the edit.
- Fixing bug that prevented deleting a Property and then re-adding a new Property with the same name.

This closes #8358
2024-02-06 10:49:10 -05:00
Peter Turcsanyi 8f63e928a9 NIFI-12732 ListS3 resets its tracking state after configuration change
This closes #8348.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-02-06 14:52:16 +01:00
Matt Gilman 82c7cf65b5
NIFI-12723: Error Handling in Settings, Bulletin Board, and Counters (#8349)
* NIFI-12723:
- Error handling in General and Flow Analysis Rules.
- Fixed saving flag in management Controller Service listing.

* NIFI-12723:
- Error handling in Reporting Tasks and Registry Clients.

* NIFI-12723:
- Error handling in Bulletin Board.

* NIFI-12723:
- Error handling in Counters.

* NIFI-12723:
- Fixing lint issues.

* NIFI-12723:
- Addressing review feedback.

This closes #8349
2024-02-06 08:13:22 -05:00
mr1716 2950b43767
NIFI-12724 Upgraded Kubernetes Client from 6.9.2 to 6.10.0
This closes #8340

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:33:20 -06:00
mr1716 00e5b454ab
NIFI-12728 Upgraded brotli4j from 1.13.0 to 1.16.0
This closes #8343

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:31:02 -06:00
mr1716 f70db0d235
NIFI-12729 Upgraded unboundid-ldapsdk from 6.0.10 to 6.0.11
This closes #8344

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:29:28 -06:00
mr1716 6d55e772c1
NIFI-12730 Upgraded Spring Integration from 5.5.18 to 5.5.20
This closes #8345

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:28:44 -06:00
Mark Payne e16286ef40
NIFI-12707 Allow LookupRecord to operate on multiple child-records
- In order to accommodate this, also needed to improve DataTypeUtils so that it knows that Record A is wider than Record B if Record A contains all fields of Record B and more.

- Removed unit tests and resources that are overly complex and no longer applicable
- Fixed issue in unit test based on different line endings between operating systems

This closes #8331

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:24:43 -06:00
mr1716 12531ef206
NIFI-12726 Update commons-email to 1.6.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8342.
2024-02-02 09:09:39 +04:00
Matt Burgess 2f42b44efa
NIFI-12731: Ensure state is updated in GetHBase whenever the session is committed
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8346.
2024-02-02 09:05:44 +04:00
Scott Aslan c6f1d771e8
[NIFI-12698] dark mode, [NIFI-12687] status history axis label fix (#8320)
* [NIFI-12698] dark mode, [NIFI-12687] status history axis label fix

* prettier

* lint fix

* update input form field styles to support dark mode

* adjust colors of flow status icons, and PG status icons, and softened the warn palette. Fix background of status history charts in dark mode

* fix provenance text color in dark mode

* leave the toggle for dark mode always visible to encourage testing

This closes #8320
2024-02-01 16:59:43 -05:00
mr1716 d5ed02ec59
NIFI-12715 Updated Snowflake SDKs
This closes #8335.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-02-01 20:23:40 +01:00
Mark Payne a587bad711
NIFI-12675 Fixed custom Relationships with Python Processors
Fixed bug that caused custom Relationships not to work on Python Processors. Added unit test to verify. Also addressed issue in PythonControllerInteractionIT where it did not wait for Processors to become valid (originally this wasn't necessary but when we refactored Processors to initialize in the background this was overlooked).

This closes #8316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 11:55:24 -06:00
mr1716 325a5a8043
NIFI-12719 Upgraded metrics-core from 4.2.22 to 4.2.25
This closes #8339

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 11:50:10 -06:00
mr1716 41817d8088
NIFI-12718 Upgraded greenmail from 1.6.14 to 1.6.15
This closes #8338

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 11:49:23 -06:00
mr1716 c71d9e531b
NIFI-12717 Upgraded Gremlin from 3.7.0 to 3.7.1
This closes #8337

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 11:48:18 -06:00
mr1716 a49428ae69
NIFI-12716 Upgraded Groovy from 4.0.16 to 4.0.18
This closes #8336

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 11:46:51 -06:00
mr1716 691666c36f
NIFI-12713 Upgraded mysql-binlog-connector from 0.28.3 to 0.29.0
This closes #8334

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 11:45:54 -06:00
mr1716 c93daaea33
NIFI-12714 Upgraded Solr from 9.4.0 to 9.4.1
This closes #8333

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 11:44:18 -06:00
Matt Gilman 102daa15f8
NIFI-12684: Handling error responses in the service listing on the canvas (#8321)
* NIFI-12684:
- Handling error responses in the service listing on the canvas.
- Handling error responses when converting a Property value to a Parameter.

* NIFI-12684:
- Introducing parameter helper to remove duplicated logic and error handling when fetching parameters and converting properties to parameters.

This closes #8321
2024-02-01 11:47:52 -05:00
Mark Payne 7edf0d4e2a
NIFI-12693: Moved notification of python process that a Processor was removed to a background (virtual) thread. Also noted in testing that in one instance a Python Processor never became
valid because it had cached property descriptors before the processor was fully initialized, so updated code to ensure that we do not cache values before initialization is completed.

This closes #8315

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 08:15:28 -06:00
Mark Bean e031e7e7a2
NIFI-12699 Set timeout to 10 seconds for TestStandardFlowFileQueue.testListFlowFilesResultsLimitedCollection
This closes #8330

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-01 08:07:55 -06:00
mr1716 9009df11f9
NIFI-12691 Update okio to 3.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8325.
2024-02-01 11:07:49 +04:00
mr1716 376283a856
NIFI-12706 Update reactor-test to 3.5.14
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8329.
2024-02-01 11:04:20 +04:00
exceptionfactory 547f338147
NIFI-12695 Enabled PKCE Support for OIDC Integration
- Added Spring Security PKCE OAuth2 Request Customizer to standard Resolver

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8324.
2024-02-01 10:57:32 +04:00
mr1716 3a1389ef9b
NIFI-12688 Upgrade mysql-connector-j to 8.3.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8327.
2024-02-01 10:54:58 +04:00
mr1716 001ada9536
NIFI-12705 Update metrics-jvm to 4.2.25
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8328.
2024-02-01 10:51:21 +04:00
mr1716 5187d0adb1
NIFI-12692 Update jline.version to 3.25.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8326.
2024-02-01 10:48:35 +04:00
Rob Fellows 4620afdbc4
[NIFI-12694] - Fix console errors when starting/stopping process groups (#8317)
This closes #8317
2024-01-31 09:36:45 -05:00
markobean 3116576494
NIFI-12701 add .prettierignore to exclude list (#8323)
This closes #8323
2024-01-31 08:55:50 -05:00
mr1716 4234f119dd
NIFI-12690 Upgraded opentelemetry-proto from 1.0.0 to 1.1.0
This closes #8314

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-30 15:26:36 -06:00
mr1716 fa6560a374
NIFI-12689 Upgraded Testcontainers from 1.19.3 to 1.19.4
This closes #8312

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-30 15:26:32 -06:00
Matt Gilman 304241f3c9
NIFI-12683: Considering current PG permissions in the new canvas item toolbox (#8311)
* NIFI-12683:
- Considering current PG permissions in the new canvas item toolbox.

* NIFI-12683:
- Prettier.

* NIFI-12683:
- Ignoring theme files from prettier check.

* NIFI-12683:
- Aligning button style.

This closes #8311
2024-01-30 15:47:55 -05:00
Rob Fellows d901253974
[NIFI-12686] eslint configuration (#8313)
* [NIFI-12686] eslint configuration for ts files
* add linting to the default maven build

* updates for RAT plugin

* remove .eslitrc as it wasn't needed. updated RAT config

This closes #8313
2024-01-30 12:26:18 -05:00
Scott Aslan 8b2758cd18
[NIFI-12655] theme NiFi following Material Design spec and leveraging Angular Material themes (#8294)
* [NIFI-12655] theme nifi following Material Design and leveraging Angular Material themes

* update accent palette usage to $nifi-canvas-accent-light-palette

* fix layout of create process group dialog

This closes #8294
2024-01-30 08:54:56 -05:00
Ferenc Erdei 13271d198f
NIFI-12682 Fix MiNiFi agent manifest hash swaps
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #8309.
2024-01-30 08:14:45 +01:00
dan-s1 592cc42059
NIFI-12677 Removed documentation of non-existent strategy for ExcelReader
This closes #8310

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-29 16:09:41 -06:00
Matt Gilman 03b925629e
NIFI-12679: (#8306)
- When overriding a policy prompting whether the new policy should copy the users and groups or if it should be empty.
2024-01-29 16:01:01 -05:00
Matt Gilman 8e0c68e5cc
NIFI-12663: Error Handling in CS Listing (#8305)
* NIFI-12663:
- Handling API error responses in the Management Controller Services page.

* NIFI-12679:
- Renaming components based on review feedback.
- Using ng-content in page-content component.
- Removing the problematic route when navigating to the error page.
- Fixing logic when handling service loading errors.
- Handling errors in the Property Table Helper service.

* NIFI-12679:
- Addressing review feedback.
2024-01-29 15:49:59 -05:00
Balázs Gerner c1a21ad078
NIFI-12642 Added support for FileResourceService in PutS3Object
This closes #8295.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-01-29 18:40:19 +01:00
exceptionfactory dff7ea3535
NIFI-12646 Set Python Processor versions to 2.0.0-SNAPSHOT 2024-01-29 08:12:42 -06:00
exceptionfactory da9aa33bf1
Merge branch 'NIFI-12646-RC4' 2024-01-29 08:07:59 -06:00
EndzeitBegins 5ba20b87c5
NIFI-12648 Refactor components in elasticsearch bundle using current API methods
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #8303.
2024-01-29 05:03:26 -05:00
bpaulin ddc12b94be
NIFI-12681: Remove standard services api nar version so it is inherited.
This closes #8308.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-01-27 14:45:57 -07:00
jsteinebrey 59ff1b6561 NIFI-9677 Fixed issue that an empty JSON array causes flow file to be considered unmatched even though it should be considered as a match.
Refactored to avoid streaming over the list twice.

Tweaked unit test, so it works in NiFi 1.x also.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8266
2024-01-26 21:54:43 -05:00
Rob Fellows 0e87032ef3
[NIFI-12622] - Parameter Providers - listing table (#8298)
* [NIFI-12622] - Parameter Providers - listing table
* Add a new Parameter Provider
* Delete parameter provider
* refactor to reduce duplicate code when creating new properties
* support editing parameter providers
* refactored inline service creation into PropertyTableHelperService
* added parameter provider linking to access policies.

* fix bugs in flow reducer not setting state properly when starting/stopping components and run once.

* address review feedback

* refactored nifiCommon to provide stripProtocol method that was implemented in loads of places. replaced all occurrences to the nifiCommon implementation.

This closes #8298
2024-01-26 12:58:33 -05:00