6771 Commits

Author SHA1 Message Date
Matt Gilman
d97c794696
NIFI-12902: Migrating to @angular-devkit/build-angular:application (#8507)
* NIFI-12902:
- Migrating to @angular-devkit/build-angular:application to avoid and avoid sporadic webpack build issues.
- Updating roboto dependencies.

* NIFI-12902:
- Clean up.

This closes #8507
2024-03-15 16:15:48 -04:00
emiliosetiadarma
3719fddf84 NIFI-12700: refactored PutKudu to optimize memory handling for AUTO_FLUSH_SYNC flush mode (unbatched flush)
NIFI-12700: made changes based on PR comments. Simplified statements involving determination of whether or not there are flowfile failures/rowErrors. Separated out getting rowErrors from OperationResponses into its own function

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8322
2024-03-15 11:45:01 -04:00
tpalfy
42bd5243bb
NIFI-12887 Added Binary String Format property to PutDatabaseRecord
- Supports handling Strings as hexadecimal character sequences or base64-encoded binary data when inserting into a binary type column

This closes #8493

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-14 23:10:18 -05:00
EndzeitBegins
27fa595b25
NIFI-12901 Removed time units in description of time period properties
This closes #8504

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-14 23:02:44 -05:00
Scott Aslan
69e7a884a3
[NIFI-12822] table, border, theming updates (#8499)
* [NIFI-12822] table, border, theming updates

* remove nifi-button and replace with mat-icon-button

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/assets/styles/_app.scss

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/ui/canvas/graph-controls/operation-control/operation-control.component.scss

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/app/pages/flow-designer/ui/canvas/graph-controls/navigation-control/navigation-control.component.scss

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

* review feedback

* final touches

---------

Co-authored-by: James Mingardi-Elliott <james-elliott@users.noreply.github.com>

This closes #8499
2024-03-14 18:13:10 -04:00
tpalfy
c093ea54b7
NIFI-12862 When building FlowAnalysisRuleViolationDTO objects (in StandardNiFiServiceFacade), violating component details will be left blank when user has no read permission for that component.
NIFI-12862 Expose subjectComponentType to frontend.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8475.
2024-03-14 18:31:07 +01:00
Peter Turcsanyi
f8d3fcd66c
NIFI-10707 Added proxy support in PutBigQuery
Bumped GCP client library version
Added grpc-* jars in service api nar in order to avoid CNFE warning in io.grpc.LoadBalancerRegistry
Dependency clean-up in GCP modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8491.
2024-03-14 18:12:03 +01:00
bob
275dcc1e50
NIFI-12891: Update ElasticSearchClientService member variables on verify
This closes #8496

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-03-14 09:25:13 +00:00
James Mingardi-Elliott
06c0113063
NIFI-12870 Semantic colors (#8480)
Next step to color theming

Update theming to reference colors semantically

Material and Canvas palettes are reordered so that in all cases they go from 50 = lightest / least amount of color to 900 = darkest / most amount of color applied.

Usage of color has been changed so that Material's primary, accent, and warn values are used by semantic reference of 'default', 'lighter' and 'darker' rather than explicit number values.

The Canvas palettes still have values referenced directly because they are a special case.

Added SASS utilities:
- To help ensure color contrast for text and backgrounds by checking for a 4.5:1 contrast ratio.
- To provide helper functions that somewhat replicate Material designs approach to Surface and On Surface concepts. This is how the same Canvas palettes can be used for light and dark modes.

Some minor tweaks to the styling of the flow canvas to bring custom NiFi components and the Angular Material components closer together visually.

Moved the Canvas theme declaration to a separate file so the Material themes can be more easily swapped out without needing to redeclare the Canvas themes.

This closes #8480
2024-03-13 17:29:29 -04:00
kapkiai
e96201ddd1
NIFI-12861 Documented that JASN1Reader requires the JDK
This closes #8469

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-11 19:47:45 -05:00
Mark Bathori
7e594d58dc
NIFI-12884 Corrected documentation for python debugging
This closes #8490

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-11 19:34:40 -05:00
exceptionfactory
90c7dba34f
NIFI-12871 Upgraded Commons Compress from 1.25.0 to 1.26.1
- Adjusted Excel Record Reader test failure to use OpenXML Exception instead of message matching

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8488.
2024-03-10 15:18:03 +01:00
dependabot[bot]
63cc0520dc
NIFI-12879 Upgraded Clojure from 1.11.1 to 1.11.2
This closes #8487

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 20:29:38 -06:00
EndzeitBegins
fabf6bf536
NIFI-12617 Set default nifi.web.https.host to localhost
This closes #8486

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 15:51:58 -06:00
dan-s1
942d13c118
NIFI-12785 Corrected InvokeHTTP URL handling to avoid double encoding
This closes #8458

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 08:20:07 -06:00
exceptionfactory
04d213a00c
NIFI-12872 Upgraded Groovy from 4.0.18 to 4.0.19
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8481.
2024-03-07 17:23:30 +01:00
Emilio Setiadarma
bee65b8447 NIFI-12825: implemented ListHBaseRegions processor
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8439
2024-03-06 18:56:40 -05:00
James Mingardi-Elliott
2a9c4c5de9
NIFI-12720 BUG - Dark mode skeleton loader styles (#8465)
* NIFI-12720

Set an explicit background color for the skeleton-loader element so there is sufficient contrast to show the animation in both light and dark themes.

* NIFI-12720

Updates based on comments

* Update nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-frontend/src/main/nifi/src/styles.scss

Co-authored-by: Scott Aslan <scottyaslan@users.noreply.github.com>

---------

Co-authored-by: Scott Aslan <scottyaslan@users.noreply.github.com>
2024-03-06 18:12:27 -05:00
James Mingardi-Elliott
cc64c7adc6
NIFI-12865 BUG - Checkboxes are inconsistently styled with primary or accent (#8472)
Updated all the checkboxes to use color="primary" to keep them consistent.

Revert "NIFI-12865 BUG - Checkboxes are inconsistently styled with primary or accent"

This reverts commit 5833cb1a39837b59de2c664c74c48a579234e284.

Removed Registry changes
2024-03-06 17:16:28 -05:00
James Mingardi-Elliott
e2e54f2bc8
NIFI-12721 Button UX (#8464)
* NIFI-12721 Button UX

Updated all the dialog buttons to change them from stroked and raised to basic. This better aligns with Angular Material guidelines and should address the confusion between disabled and cancelled.

* NiFi-12721 incremental update

Changed the combo editor and editor components to use the flat button styles. Missed them before because I was looking for dialogs.

Also caught a style bleed with button:disabled that should be button.nifi-button:disabled and updated that.

* Consolidated the button.nifi-button:disabled rules

Also ran Prettier to improve markup in a few spots
2024-03-06 17:11:07 -05:00
exceptionfactory
c6cbdd91cd
NIFI-12868 Upgraded Commons DBCP from 2.11.0 to 2.12.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8478.
2024-03-06 18:21:19 +01:00
Jim Steinebrey
bda9b6360d NIFI-12630 Fix NPE getLogger in ConsumeSlack and PublishSlack
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8474
2024-03-05 19:33:54 -05:00
David Handermann
26f5fa2be0
NIFI-11443 Route Python Framework Logging to SLF4J (#8407)
* NIFI-11443 Routed Python Framework Logging to SLF4J

- Changed Python logging to use standard output stream
- Adjusted Python logging format for simplified processing
- Updated PythonProcess to pipe standard error and standard output streams to reader
- Added Log Reader command with Virtual Thread for each Python Process
- Removed Python log properties from NiFi Properties configuration
2024-03-05 16:55:04 -05:00
Jim Steinebrey
97516de1e0 NIFI-12645 Fix to correctly invoke onStopped method of scripted processor
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8471
2024-03-04 16:30:14 -05:00
Mark Payne
55738f8522
NIFI-12740 Fixed Python to Java Object Binding
Fixed issue in NiFiPythonGateway that stems from the fact that the thread adding an object to the JavaObjectBindings was not necessarily the thread removing them. The algorithm that was in place assumed that the same thread would be used, in order to ensure that an object could be unbound before being accessed. The new algorithm binds each new object to all active method invocations and only unbinds the objects after all method invocations complete, regardless of thread. Additionally, found that many method calls could create new proxies on the Python side, just for getter methods whose values don't change. This is very expensive, so introduced a new @Idempotent annotation that can be added to interface methods such that we can cache the value and avoid the expensive overhead.

This closes #8456

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-04 15:28:12 -06:00
Scott Aslan
f9c1c3f042
[NIFI-12778] manage remote ports (#8433)
* [NIFI-12778] manage remote ports

* update last refreshed timestamp and loadedTimestamp

* address review feedback

* final touches

* address addition review comments

* formatDuration check isDurationBlank

This closes #8433
2024-02-29 16:09:32 -05:00
Rob Fellows
455159f6ac
[NIFI-12537] Open cluster/node dialog from Summary screen. (#8454)
* [NIFI-12537] - Summary screen cluster-related features

* common component status table

* cluster summary dialogs

* address review feedback

* ellisis for node columns in cluster dialogs, cluster node dropdown panel no longer wraps, shorted the dropdown width as well.

* prettier

This closes #8454
2024-02-29 16:08:47 -05:00
Pierre Villard
c3c1b834c7 NIFI-12850 - Prevent indexing of overly large filename attribute
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8457
2024-02-29 14:10:19 -05:00
ravisingh
8346bd7d0f NIFI-12828: Added Mapping for BIT type to return INT and handled boolean case for postgres
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8445
2024-02-29 14:06:57 -05:00
Paul Grey
b368c281e8
NIFI-12851 - ConsumeKafka, remove limitation on count of subscribed topics
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8460.
2024-02-29 12:01:07 +01:00
Rob Fellows
1cb0a53711
[NIFI-12848] - fixed ExpressionChanged error in Status History dialog (#8455)
* color the legend text to match the color of the corresponding line in the chart for each node

This closes #8455
2024-02-28 16:17:33 -05:00
Juldrixx
ecea18f796
NIFI-12733 Make Apicurio's groupId optional and configurable and use artifactId instead of name as key
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8351.
2024-02-28 14:42:17 +01:00
Mark Bathori
c29a744644
NIFI-12847: Add Enum data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8453.
2024-02-28 14:33:39 +01:00
Rajmund Takacs
f119c49c4d NIFI-12843: Fix incorrect read of parquet data, when record.count is inherited
This closes #8452.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-02-27 18:01:49 +01:00
Balázs Gerner
40d9750bb3
NIFI-12671 Added S3FileResourceService
This closes #8368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-02-26 17:23:35 +01:00
Balázs Gerner
03bba7049a
NIFI-12672 Added AzureFileResourceService
This closes #8359.

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-02-26 17:04:50 +01:00
Mark Payne
ae423fc6ba
NIFI-12832 Removed unnecessary dependencies from nifi-mock
- Moved StandardValidators to nifi-api
- Moved URL creation method from UriUtils to URLValidator
- Separated FormatUtils into FormatUtils and DurationFormat classes
- Added DurationFormat to nifi-api

This closes #8442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-23 15:13:21 -06:00
bob
3c74aa460e
NIFI-11859: Ensure Hazelcast can not join a network when Cluster is NONE
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8440.
2024-02-23 13:20:00 +01:00
Mark Payne
064e15b7be
NIFI-12834 Fixed ConsumeSlack NPE for latestReply field
This closes #8446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-22 16:46:37 -06:00
Joseph Witt
9e7e39fc2a
NIFI-12826 Added timing lag in TestFTP method for improved stability
This closes #8443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-22 10:58:07 -06:00
Matt Gilman
6c76ecadd4
NIFI-12807: Handle clustering in Provenance, Lineage, and Queue Listing (#8431)
* NIFI-12807:
- Handling cluster node id in provenance listing, lineage graph, and queue listing.

* NIFI-12807:
- Addressing review feedback.

This closes #8431
2024-02-21 11:20:49 -05:00
dan-s1
0a2ba317c0
NIFI-12784 Set Path Not Found as a Dependent Property in EvaluateJsonPath
This closes #8420

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 22:14:52 -06:00
Robert
043e2dd3ff
NIFI-12633 Avoid resetting state in GetSolr on restart
This closes #8267

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:52:30 -06:00
dependabot[bot]
47290eb39f
NIFI-12827 Upgraded PostgreSQL JDBC test driver from 42.7.1 to 42.7.2
This closes #8437

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:28:47 -06:00
Joseph Witt
3f2f5a02e0
NIFI-12768 Removed unstable assertions from TestListFile
Additional assertion removals which assumed ordering that isn't guaranteed or enforced by the tests

This closes #8438

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:09:07 -06:00
exceptionfactory
014d539b5e
NIFI-12824 Removed ExecuteStateless Processor and NAR
This closes #8434

Removed nifi-stateless-nar from nifi-assembly

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 17:02:05 -07:00
Tom Brisland
89b618cc05
NIFI-12772 Expose REMOTE_POLL_BATCH_SIZE property for ListSFTP
This closes #8390.

revert max results optimisation + unnecessary import

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 12:52:35 -07:00
Bryan Bende
d35247b7b1
NIFI-12788 Avoid host URI encoding errors for Jetty Server Connector
This closes #8404

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 12:59:12 -06:00
dependabot[bot]
154fd87b79
Bump undici and @angular-devkit/build-angular (#8418)
Bumps [undici](https://github.com/nodejs/undici) to 6.6.2 and updates ancestor dependency [@angular-devkit/build-angular](https://github.com/angular/angular-cli). These dependencies need to be updated together.


Updates `undici` from 6.2.1 to 6.6.2
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v6.2.1...v6.6.2)

Updates `@angular-devkit/build-angular` from 17.1.3 to 17.2.0
- [Release notes](https://github.com/angular/angular-cli/releases)
- [Changelog](https://github.com/angular/angular-cli/blob/main/CHANGELOG.md)
- [Commits](https://github.com/angular/angular-cli/compare/17.1.3...17.2.0)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: indirect
- dependency-name: "@angular-devkit/build-angular"
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-20 13:18:41 -05:00
Mark Payne
a821966a87
NIFI-12232 Corrected Group Component ID Handling for Clustered Flows
Ensured that if a Process Group doesn't have a Versioned Component ID we use the ComponentIdLookup to create one based on its Instance ID in the same way that is done when serializing the flow; this ensures matching ID's when we synchronize flows across the cluster. Also included some code cleanup around failure handling on startup

This closes #8406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 11:25:56 -06:00