Commit Graph

6602 Commits

Author SHA1 Message Date
dan-s1 3b8ff2299f
NIFI-12513 Added UriUtils to nifi-utils and updated InvokeHTTP
The UriUtils class allows the construction of a valid java.net.URI with a single string even though there maybe illegal characters in the path, query and/or fragment sections(s) of the URI. The create method uses regular expressions from Spring Framework UriComponentsBuilder and provides capabilities closer to the deprecated constructor for java.net.URL.

This closes #8189

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-26 16:53:29 -06:00
EndzeitBegins ccf3f35076
NIFI-12546 Updated nifi-snowflake-bundle using current API methods
This closes #8187

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-26 16:48:40 -06:00
EndzeitBegins 499b63e544
NIFI-12545 Updated nifi-iceberg-bundle using current API methods
This closes #8186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-26 16:46:04 -06:00
dan-s1 6bca79cb37
NIFI-11627 Added JsonSchemaRegistry for ValidateJson
- Added nifi-json-schema-api to nifi-commons
- Added StandardJsonSchemaRegistry implementation of JsonSchemaRegistry
- Added strategy configuration properties to ValidateJson

This closes #8005

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-26 16:28:30 -06:00
Mark Bathori 69df3f0f66
NIFI-12334 Added GCSFileResourceService
This closes #7999

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-22 13:33:11 -06:00
Rob Fellows 30419c8dd8
[NIFI-12504] Remaining views on Summary page (#8174)
* [NIFI-12504] process group summary tab
* ellipsify data/headers in table
* input and output port summary tabs
* connections summary tab
* rpg summary tab

* address review feedback including a filtering approach that doesn't rely on splitting strings by some arbitray character.

* remove unnecessary try/catch blocks

This closes #8174
2023-12-22 14:22:10 -05:00
EndzeitBegins 553a36c088
NIFI-12542 Updated Zendesk Components using Current APIs
This closes #8170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-22 13:13:53 -06:00
Mark Payne c670161cb0
NIFI-12532: This closes #8179. Ensure that when CommunicateAction completes (exceptionally or otherwise) that it gets removed from the list of all CommunicationActions
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-21 19:21:41 -07:00
Mark Payne c41b273e82
NIFI-12528: This closes #8180. Fixed bug that resulted in StackOverflowError when deleting loop containing only funnels
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-21 10:59:30 -07:00
Matt Gilman 1f54d5d1fc
NIFI-12481: Filtering out unauthorized registry clients to avoid unhandled error (#8147)
* NIFI-12481:
- Filtering out unauthorized registry clients to avoid unhandled error.

* NIFI-12481:
- Using es5 syntax.

This closes #8147
2023-12-21 11:34:57 -05:00
Matt Gilman e6d09c3b3d
NIFI-12485: Lineage Graph (#8173)
* NIFI-12485:
- Lineage.

* NIFI-12485:
- Adding context menu to lineage graph.
- Refactoring canvas context menu to promote reuse.

* NIFI-12485:
- Lineage timeline slider.

* NIFI-12485:
- Addressing review feedback.

* NIFI-12485:
- Addressing review feedback.

This closes #8173
2023-12-21 11:10:11 -05:00
Peter Turcsanyi 02d563eefc
NIFI-12525: Added property migration for the removed Consumer Hostname property in ConsumeAzureEventHub
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8171.
2023-12-21 13:23:35 +01:00
Peter Turcsanyi ca4ee2407c
NIFI-12515 Removed deprecated Client Auth property from AMQP processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8162.
2023-12-21 13:18:58 +01:00
Peter Turcsanyi 4727d591d1
NIFI-12527: Removed deprecated Session Cache Size property from JMS processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8172.
2023-12-21 13:16:20 +01:00
Rob Fellows 703948b1d6
[NIFI-12519] - deselect parameter when it is deleted. (#8166)
* [NIFI-12519] - deselect parameter when it is deleted. also, enable goto controller service linking

* Added confirmation dialog in controller service edit when the form is dirty and the user attempts to route away using a referencing component link

* Reset state when closing the summary and counter pages.

This closes #8166
2023-12-19 10:16:50 -05:00
David Handermann 6b7b7cccf8
NIFI-12493 Update Documentation References to Java 21 (#8144)
* NIFI-12493 Updated Documentation References to Java 21

- Removed Apache Maven download step from Custom Distribution instructions and referenced Apache Maven Wrapper in command
- Updated Java Documentation links to Java 21

* NIFI-12493 Updated additional Java version references
2023-12-19 09:49:00 -05:00
Matt Gilman 49bbc38b6b
NIFI-12502: Handle additional Property Table capabilities (#8159)
* NIFI-12502:
- Go To Service.
- Save before navigating if form dirty.
- Go To Parameter.
- Convert To Parameter.

* NIFI-12502:
- Ensuring tests are still bootstrapped correctly.

* NIFI-12502:
- Addressing review feedback.

This closes #8159
2023-12-18 14:22:07 -05:00
David Handermann 80700cc6c6
NIFI-12418 Corrected Provider Groups Missing in Refreshed Tokens (#8126)
- Updated OidcBearerTokenRefreshFilter to maintain current Identity Provider Groups when generating refreshed application Bearer Tokens
- Refactored LoginAuthenticationToken to remove unnecessary optional constructors and use java.time.Instant for expiration
- Added Issuer Provider with implementation for Bearer Token Issuer based on host and port properties
2023-12-18 11:53:23 -05:00
annanys23 93c9efe527
NIFI-11308 Added nifi.framework.version System Property for EL
- Updated Expression Language Guide to note the available system property providing the current framework version according to the Framework NAR version

This closes #8101

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-18 08:46:55 -06:00
Mark Payne ba599d29c2
NIFI-12480 Updated MapRecord's toString() method to use the SerializedForm of the record when available and fixed bugs around ensuring that the serialized form is properly set
This closes #8132

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-18 08:25:09 -06:00
dan-s1 1ddb5c185a
NIFI-12408 Added Pretty Print Property to AttributesToJSON
This closes #8156

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-16 14:45:30 -06:00
Pierre Villard ee2368e0ae
NIFI-12371 Support tombstone messages in non-record Kafka processors
This closes #8076

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-16 14:34:12 -06:00
EndzeitBegins 4f399c9bb9
NIFI-12446 Refactor FilterAttribute to align with code conventions
This closes #8161

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-16 12:18:39 -06:00
Mark Bathori 16d170fdfd
NIFI-12520: ExtractHL7Attributes processor ignores repeatable field values
This closes #8167.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-16 18:47:52 +01:00
exceptionfactory 6f456ebbd4 NIFI-12518 Upgraded Calcite Avatica from 1.23.0 to 1.24.0
This closes #8164

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-12-16 10:05:15 -05:00
Rob Fellows 5e3239f8c1
[NIFI-12437] - Summary (#8143)
* [NIFI-12437] - Summary
* Processors Status Snapshot Listing
  * initial processors status snapshot table
  * sorting
  * goto processor
  * multi-valued sort for processors status listing summary
  * add filtering to the processors status snapshot tab of the summary
  * created a re-usable summary-table-filter componennt
  * moved status history to common location
  * status history
  * status history chart
  * resize
  * display insufficient data message if there isn't enough data to render the history

* moved status history chart into its own component

* update missing licenses

* review feedback

* removing use of <label> for non-form elements in status-history component, also updated vertical spacing

* review feedback

* remove unused items from processor-status-listing.component.ts

* fixed tests. added  npm script

* fixed routing to processor after initial load of the processors summary table

* turn of debug route tracing

This closes #8143
2023-12-15 16:06:44 -05:00
Mark Payne 231dbde4b3
NIFI-12516 Corrected Cluster Replicated Response Headers for HTTP/2
The headers in the map that come back when replicating a request used to be in the case given; however they can be lowercased in the OkHttp Headers object when using HTTP/2 instead of HTTP/1.1. As a result, we need to ensure that we always use lower-case header names or check the map case-insensitive.

This closes #8163

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-15 13:43:06 -06:00
Matt Gilman b0f30d6860
NIFI-12486: Registry Clients (#8142)
* NIFI-12486:
- Registry Clients.
- General authorization guard.
- Additional authorization checks in the existing Settings tabs.

* NIFI-12486:
- Adding authorization guard to /counters.

* NIFI-12486:
- Enabling some debug build out to attempt to track down a sporadic build failure.

* NIFI-12486:
- Addressing review feedback.

* NIFI-12486:
- Fixing unit test and running prettier.

This closes #8142
2023-12-15 10:43:50 -05:00
Mikhail Sapozhnikov 76613a0ed4
NIFI-6730 AMQP QoS support
This closes #8146.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-14 21:39:25 +01:00
Bence Simon 3c4ccd2c64
NIFI-12509 Changing default TTL of HazelcastMapCacheClient
This closes #8154.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-14 13:04:47 +01:00
EndzeitBegins c272574dcc
NIFI-12452 Improved support for DescribedValue in Descriptors
- Removed calls to Builder.defaultValue(null) in several Components

This closes #8102

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:45:45 -06:00
Bence Simon 5b664147ee
NIFI-12508 Cleaning up remainders of the Event Driven Strategy
This closes #8153

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:15:29 -06:00
Emilio Setiadarma 2691ad0451
NIFI-12474: remove TriggerWhenEmpty for DeleteHDFS (#8125) 2023-12-13 11:42:40 -05:00
Matt Gilman 4f59f46ce4
NIFI-12445: Provenance Event Listing (#8133)
- Provenance Event Listing.
- View Provenance Event dialog.
- Provenance routing.
- Provenance search.
- Replay.
- Download content.
- View content.
- Addressing review feedback.
- Addressing review feedback.

This closes #8133
2023-12-11 17:36:42 -05:00
Peter Gyori 78b822c452
NIFI-12105: remove unnecessary checking of compressed content from testAdditionalNarDirectoriesSpecified test case
This closes #8150.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-11 19:33:39 +01:00
Peter Turcsanyi 718d7e0461
NIFI-12497 Upgraded snowflake-jdbc to 3.14.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8149.
2023-12-11 15:54:02 +01:00
Rajmund Takacs 9a5ec83baa NIFI-12241 Efficient Parquet Splitting
This closes #7893.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-12-10 22:03:37 +01:00
exceptionfactory a126f6a7df NIFI-12492 Moved QuestDB Status Repository to Separate NAR
- Added nifi-framework-status-history-shared module for common components
- Added include-questdb build profile for including the QuestDB NAR
- Upgraded QuestDB from 7.2 to 7.3.7 for NIFI-12435

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #8141
2023-12-08 14:12:54 +01:00
exceptionfactory ec3da7144c
NIFI-12475 Disabled Bypass Validation by Default in PutMongoRecord
- Updated property description to indicate that bypass validation is a Privilege Action that can cause authorization errors.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8139.
2023-12-08 14:08:54 +01:00
David Handermann f73888e7dd
NIFI-12478 Return Message Type as body for JMS Object Messages (#8131) 2023-12-07 16:41:34 -05:00
exceptionfactory b9dbcab160
NIFI-12489 Upgraded Apache POI from 5.2.4 to 5.2.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8140.
2023-12-07 18:28:55 +01:00
Peter Gyori 5675d37bed
NIFI-12105: ExecuteStateless processor accepts additional NAR directories
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8129.
2023-12-07 16:03:05 +01:00
exceptionfactory 5c1b0a1140
NIFI-12483 Streamlined JMX Metrics Filtering Parameters
- Added bean name filter processing and added test cases

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8134.
2023-12-07 15:59:32 +01:00
Matt Gilman 17a331b9e1
NIFI-12484: Bumping dependency to latest minor/incremental release (#8135)
- Bumping dependency to latest minor/incremental release.
- Adding an explicit override for vite which is needed until Angular can be upgraded to version 17.

This closes #8135
2023-12-07 09:02:48 -05:00
Matt Gilman 414eea805f
NIFI-12470: Fixing forEach callback for usage with Object.entries() to address layout issue in Status History (#8121)
* NIFI-12470:
- Fixing forEach callback for usage with Object.entries() to address layout issue in Status History.
- Using es5 syntax.

This closes #8121
2023-12-07 08:19:25 -05:00
exceptionfactory 34aebc1f69
NIFI-12473 Deleted removeByPattern Methods from Cache Services
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8124.
2023-12-07 12:42:08 +01:00
Mark Payne 1d06185f13
NIFI-12453 Added cluster-status command to nifi.sh
NIFI-12454 Allow decommissioning cluster node without shutdown

This closes #8100

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 22:12:55 -06:00
Mark Payne a21993ef72
NIFI-12331 Added PublishSlack Processor
- Removed deprecated PutSlack and PostSlack

This closes #8120

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 15:10:12 -06:00
dan-s1 ab8a82b997
NIFI-12410 Support EL for Starting Row in ExcelReader
This closes #8119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 08:56:00 -06:00
Peter Turcsanyi 8645088e1d
NIFI-12412 Support Proxies for Blob Checkpoints in ConsumeAzureEventHub
This closes #8107

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 08:23:59 -06:00
Pierre Villard d0dd4e03e0
NIFI-12427 Add channel name attribute to ConsumeSlack
This closes #8078

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 07:42:54 -06:00
Matt Burgess eeb2b1a644
NIFI-12318: Fixed byte array generation in GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8109.
2023-12-05 14:41:22 +01:00
mr1716 d1c7e6c6b8
NIFI-12466 Upgraded MongoDB Driver from 4.10.2 to 4.11.1
This closes #8118

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:09:03 -06:00
mr1716 d6bac808ba
NIFI-12465 Upgraded mysql-binlog-connector-java from 0.28.1 to 0.28.3
This closes #8117

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:08:21 -06:00
mr1716 29dda4208a
NIFI-12463 Upgraded maven-artifact from 3.8.5 to 3.8.8
This closes #8115

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:03:38 -06:00
exceptionfactory 456cf7d88d
NIFI-12451 This closes #8104. Removed Bootstrap Notification Services
- Refactored Security Property handling and bootstrap certificate generation
- Removed unnecessary dependencies from nifi-bootstrap
- Removed unnecessary and unused settings from bootstrap.conf

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-04 15:09:45 -07:00
Mark Payne 283abadf97
NIFI-12457: Added additional use case based documentation and fixed some typos/made some clarifications in related docs
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8108.
2023-12-04 14:59:53 +01:00
Mark Bathori 7770a17a6c
NIFI-11992: Processor and sink service for filing tickets in Zendesk
This closes #7644.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-04 09:42:36 +01:00
Matt Gilman 387a101931
NIFI-12425: Controller Service Listing (#8091)
* NIFI-12425:
- Controller Service Listing.
- Adding lazy loading to the Canvas with the introduction of the Controller Service listing.
- Reorganizing existing components in the Flow Designer.
- Allowing the current Process Group to be configured.
- Inline Service creation.

* NIFI-12425:
- Removing unused imports.

This closes #8091
2023-12-01 13:50:30 -05:00
Matt Gilman d40bb3eda6
NIFI-12419: (#8097)
- Applying a copy of the nifi-web-frontend rat config in the parent module when the new ui profile is not activated. Previously, if the new ui profile was not activated, the rat check would fail.

This closes #8097
2023-12-01 12:58:46 -05:00
exceptionfactory 2ac3988881
NIFI-12448 Removed InfluxDB Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8093.
2023-12-01 16:21:20 +01:00
mr1716 d7cb4a4b1c
NIFI-12440 Upgraded HikariCP from 5.0.1 to 5.1.0
This closes #8089

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:55:12 -06:00
Sebastian Rothbucher 685700ad7c
NIFI-11129 Added PutMongoBulkOperations Processor
This closes #6918

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:36:44 -06:00
EndzeitBegins edca4cd347 NIFI-12386 Adds processor FilterAttribute
attribute uuid is not removed by removeAttribute(s) in MockProcessSession

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8049
2023-11-30 19:21:08 +00:00
mr1716 0430974783
NIFI-12436 Upgraded datafaker from 2.0.1 to 2.0.2
This closes #8084

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:45:26 -06:00
mr1716 6255a98b22
NIFI-12430 Upgraded unboundid-ldapsdk from 6.0.9 to 6.0.10
This closes #8080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:42:10 -06:00
Rob Fellows d14686cb3a
[NIFI-12415] Counters (#8077)
* [NIFI-12415] Counters page
* populate counter the table.
* support counter reset.
* filtering by name and by context
* sorting, including initial sort
* added basic tests

* Formatted with Prettier

* review feedback - removing unused things.

* align mat-table usage to a common style

* disable the Counter menu item if the user doesn't have counterPermissions.canRead

This closes #8077
2023-11-29 18:00:28 -05:00
Matt Gilman 05575364a3
NIFI-12417: Process Group Configuration (#8075)
* NIFI-12417:
- Process Group Configuration.
- Removed unnecessary module imports.

* NIFI-12417:
- Addressing review feedback.

This closes #8075
2023-11-29 17:21:35 -05:00
Matt Gilman ebfb5bc12e
NIFI-12401: Allow combo editor to reference parameters (#8068)
* NIFI-12401:
- Allow combo editor to reference parameters.

* NIFI-12401:
- Addressing review feedback.
- Handling corner cases where there is no parameter context and where there are no parameters in a bound parameter context.

* NIFI-12401:
- Fixing formatting issues.

This closes #8068
2023-11-29 12:26:25 -05:00
dan-s1 9154b708cc
NIFI-12404 Added documentation indicating this controller service does not resolve YAML aliases.
This closes #8070.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2023-11-29 11:21:18 +01:00
dan-s1 e61665675b
NIFI-12416 Relocated the additionalDetails.html to the appropriate bundle in order for it to be seen when generating the documentation.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8067.
2023-11-28 18:36:54 +01:00
mr1716 1a7790b4a1
NIFI-12423 Update iotdb.sdk.version to 1.2.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8074.
2023-11-28 18:28:41 +01:00
mr1716 df33ca04a9
NIFI-12422 Update excel-streaming-reader to 4.2.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8073.
2023-11-28 18:25:53 +01:00
mr1716 0311221eb9
NIFI-12421 Update metrics-core to 4.2.22
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8072.
2023-11-28 18:22:31 +01:00
Rob Fellows 4bba7e6188
[NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. (#8069)
* [NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. Also update the ci-workflow.yaml to activate that profile.

* add the profile activation to the Maven Build command

This closes #8069
2023-11-27 20:18:31 -05:00
Matt Gilman b3b6d72924
NIFI-11481: Initial migration to Angular 16 (#8053)
* NIFI-11481:
- Initial project creation.

* NIFI-11481:
- Install material.
- Rename project from nifi-web-frontend to nifi.

* NIFI-11481:
- Install roboto through package.json.

* NIFI-11481:
- Add Tailwind.

* NIFI-11481:
- Basic layout.

* NIFI-11481:
- Introducing ngrx for storing flow.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.
- Adding draggable.
- Adding editable.
- Adding selectable.
- Adding flowfont.
- Adding Canvas View.
- Adding Transform in Store.
- Adding selected in Store.
- Adding transition in Store.
- Funnel Manager directly subscribes to store.

* NIFI-11481:
- Adding backend calls.
- Refactoring update positions to be for a single component.

* NIFI-11481:
- Process Group Manager.
- Adding font-awesome.
- Updating canvas/graph component visibility.
- Adding prettier/eslint.

* NIFI-11481:
- Adding support to enter a process group.

* NIFI-11481:
- Formatting source.

* NIFI-11481:
- Label Manager.
- Added generic update component.

* NIFI-11481:
- Processor Manager.

* NIFI-11481:
- Port Manager.

* NIFI-11481:
- Remote Process Group Manager.

* NIFI-11481:
- Adding draggable icons to the toolbar.

* NIFI-11481:
- Formatting.

* NIFI-11481:
- Draggable Toolbar.
- Create Label, Funnel.

* NIFI-11481:
- Connection Manager.
- Connectable Behavior.

* NIFI-11481:
- Draggable behavior with back end call for both components and connections.

* NIFI-11481:
- Selection box.

* NIFI-11481:
- Port creation.
- Port configuration.
- Quick Select.

* NIFI-11481:
- Canvas Tooltips.

* NIFI-11481:
- Context menu.

* NIFI-11481:
- Router State.
- Reorganization.
- Deep linking.

* NIFI-11481:
- Adding support for Delete.

* NIFI-11481:
- Flow status bar.

* NIFI-11481:
- Adding Current User State.
- Current user polling.
- Fixing Flow Status layout bug.

* NIFI-11481:
- Process Group Polling.

* NIFI-11481:
- Process Group Breadcrumbs.

* NIFI-11481:
- Global Menu.

* NIFI-11481:
- Search.

* NIFI-11481:
- Add support for centering components on the canvas.

* NIFI-11481:
- Add support for persisting and restoring the users view of the current PG.

* NIFI-11481:
- Fixing centering behavior.
- Fixing user view restoration.
- Bulk selection auto fit.

* NIFI-11481:
- Incorporating the new UI into the NiFi build with a build profile that is not active by default.
- The new UI is deployed to a different context path than the current UI and works side by side.

* NIFI-11481:
- Center component from context menu.
- Enter process group from context menu.

* NIFI-11481:
- Adding support to log in.
- LoginFilter, LogoutFilter.
- Moved the handling of 'include-new-ui' profile to make building with and within more straight forward.
- Splash screen while guard executing.
- Http request interceptor to show loading on the canvas.
- Http request interceptor to handle 401 responses.

* NIFI-11481:
- Extension Creation Component.
- Filter, Usage Restrictions, and selected type.

* NIFI-11481:
- Stopping polling when unable to connect to server.

* NIFI-11481:
- Settings - General.

* NIFI-11481:
- Settings - Management Controller Services.

* NIFI-11481:
- NiFi Tooltip directive.
- Usage Restriction Tip.
- Comments Tip.
- Validation Errors Tip.
- Bulletins Tip.

* NIFI-11481:
- Settings - Reporting Tasks.

* NIFI-11481:
- Avoiding unnecessary web requests in route guards.

* NIFI-11481:
- Edit Controller Service Dialog.
- View Property Table.
- Update component density.

* NIFI-11481:
- Supports Controller Service API tooltip and dialog content.

* NIFI-11481:
- Property table - NF Editor.
- Property table - Combo Editor.

* NIFI-11481:
- Making property table a control value accessor.
- Wiring up saving Controller Services from Edit Dialog.
- Handling Delete Property.
- Handling New Property.
- Updating how form submission is triggered throughout to address issue with incidental form submit events.

* NIFI-11481:
- Moving Settings into pages.

* NIFI-11481:
- Moving Canvas into pages.

* NIFI-11481:
- Moving Login into pages.

* NIFI-11481:
- Adding routing to the Controller Service listing and Reporting Task listing.
- Updating Canvas routing to follow similar pattern.

* NIFI-11481:
- Controller Service references.

* NIFI-11481:
- Create inline Controller Service.
- Edit Controller Service route.
- Go To Controller Service from Property Table.
- Switching to Event Emitter in New Property dialog.

* NIFI-11481:
- Saving spinner - Create Processor, Create Port, and Edit Port.

* NIFI-11481:
- Saving spinner - Create Controller Service, Edit Controller Service, and Create Reporting Task.

* NIFI-11481:
- Parameter Context Listing.
- Add new Parameter Context.
- Edit Parameter Context.

* NIFI-11481:
- New Paramter.
- Edit Parameter.
- Parameter table.

* NIFI-11481:
- Parameter references.
- Parameter Context update steps.
- Bound Process Group references.

* NIFI-11481:
- Parameter Context Inheritance.

* NIFI-11481:
- Processor configuration.
- Ensuring new Property names are unique.
- Trapping focus in nf and combo editors.
- Reloading component connections after updating a Processor.

* NIFI-11481:
- Navigation Control.
- Birdseye.
- Operation Control.

* NIFI-11481:
- Create Process Group.
- Upload Process Group.

* NIFI-11481:
- Implementing current Process Group context in operation palette.

* NIFI-11481:
- Connection creation.

* NIFI-11481:
- Connection configuration.

* NIFI-11481:
- Standardizing selection option model.
- Connection load balancing tooltip.
- Clean up.

* NIFI-11481:
- Move components in to/out of groups.
- Group components.

* NIFI-11481:
- Render connections for component action.

* NIFI-11481:
- CodeMirror for Parameter and EL configuration.

* NIFI-11481:
- Resizable.
- Moving tooltip directive.

* NIFI-11481:
- Ensuring all specs are bootstrapped and create successfully.

* NIFI-11481:
- Updating some interface names to avoid conflicting with various components in an attempt to better establish a naming convention.

* NIFI-11481:
- Show Source/Destination.
- Defaulting current Parameter Context in Create PG and Group dialogs.
- Handling disabled state in a few ControlValueAccessors.
- Ensuring Parameter Contest uri is set.
- Unit tests.

* NIFI-11481:
- Fixing checkstyle issue.

* NIFI-11481:
- LICENSE/NOTICE.

* NIFI-11481:
- RAT Plugin config.

* NIFI-12401:
- Addressing review feedback.

* NIFI-11481:
- Ensuring the option is disabled when there is no description.

* NIFI-11481:
- Only including parameters in the payload when they have been modified.
- Showing appropriate message after applying based on whether parameters were included or not.

* NIFI-11481:
- Fixing parameter deletion.
- Enforcing parameter name uniqueness.
- Preventing changing parameter sensitive.

* NIFI-11481:
- Only loading the service link once when considering updated property value.
- Ensuring existing parameter are set in all instances of opening the new Property dialog.

* NIFI-11481:
- Fixing tests that regressed.

* NIFI-11481:
- Adding default karma config which was needed in order to debug tests in IDE.

* NIFI-11481:
- Updating karma config to not watch for now. Can introduce new options for running in various contexts in the future.

This closes #8053
2023-11-27 10:39:51 -05:00
exceptionfactory 00fd7d7cca NIFI-12361-RC6 prepare for next development iteration 2023-11-22 18:35:27 -06:00
exceptionfactory 49fa0d8674 NIFI-12361-RC6 prepare release nifi-2.0.0-M1-RC6 2023-11-22 18:35:26 -06:00
David Handermann 50efc55df6
NIFI-12403 Improve Jolt UI Parameter Processing (#8060)
* Improved Jolt UI Parameter Processing

* Changed double quotes to single quotes per review

This closes #8060
2023-11-22 14:37:02 -05:00
Mark Payne d0c7ebb196
NIFI-11671: Allow FlowFile attributes to be referenced in SQL for JoinEnrichment
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8059.
2023-11-22 14:37:18 +01:00
exceptionfactory 6617fe8fe2
NIFI-12384 This closes #8044. Upgraded Registry to Spring Framework 6
- Upgraded Spring from 5.3.30 to 6.0.13
- Upgraded Spring Boot from 2.7.16 to 3.1.5
- Upgraded Spring Security from 5.8.7 to 6.1.5
- Upgraded Jetty from 10.0.18 to 11.0.18
- Upgraded Servlet API from 3.1.0 to 5.0.0
- Upgraded JAX-RS from 2.1.1 to 3.1.0
- Upgraded Jersey from 2.41 to 3.1.3
- Upgraded JAXB from 2.3.2 to 4.0.4
- Upgraded Java Validation from 2.0.1 to 3.0.2
- Upgraded Flyway from 8.5.13 to 9.22.3
- Upgraded ASM from 9.3 to 9.6 for Java 21
- Upgraded NiFi Toolkit CLI to JAX RS 3 and Jersey 3
- Set Jersey 3 and JAX RS 3 dependency versions in nifi-flow-registry-client-bundle to align with updates to nifi-registry-client classes

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-21 09:06:51 -07:00
exceptionfactory e5e76d0161
NIFI-12393 Upgraded OWASP Check from 8.4.2 to 8.4.3
- Upgraded Azure SDK BOM from 1.2.17 to 1.2.18
- Upgraded Reactor Netty HTTP from 1.0.34 to 1.0.39 for Azure Identity
- Upgraded MSAL4J from 1.13.10 to 1.14.0
- Upgraded Box Java SDK from 4.4.0 to 4.6.1
- Relocated Apache Ant managed versions to bundle parent modules
- Added okio-fakefilesystem to managed dependencies
- Suppressed vulnerability for Picocli misidentified as LINE library
- Added managed dependencies to nifi-code-coverage to avoid false positives due to different parent modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8054.
2023-11-21 12:16:12 +01:00
exceptionfactory d5c7fcb5dd
NIFI-12392 Corrected Component Documentation NAR Unpacking
- Corrected component documentation directory comparison for finding bundled documentation in a JAR
- Added unit test for unpacking of component documentation from JAR included in NAR

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8052.
2023-11-20 14:55:42 +01:00
Matt Burgess e81d7254ec
NIFI-12389: Add variance and standard deviation to AttributeRollingWindow
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8048.
2023-11-20 11:23:51 +01:00
Zoltan Kornel Torok 63364687d8 NIFI-12383 Replication client should handle accept encoding with lowercase
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #8043
2023-11-17 08:02:07 +01:00
Joseph Witt 9cfdebc3e8
NIFI-12378 Removed Jython
This closes #8040

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
mr1716 a3983ae248
NIFI-12380 Upgraded Iceberg from 1.4.0 to 1.4.2
This closes #8039

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Ferenc Gerlits ceeb0deb3d
NIFI-12381 Fixed CR and LF documentation in SplitText
This closes #8041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Bryan Bende 1cc346b63d
NIFI-12368 Clear versionedComponentId for copied Snippets
This closes #8025

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:52 -06:00
Mark Payne e1942a8346
NIFI-12374: Added use case based documentation to explain how to perform incremental / full loads from databases
This closes #8030

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 19:28:10 -06:00
Mark Payne b5c3e6f9aa
NIFI-12358 Fixed NPE in HostHeaderHandler
Fixed NPE in ThreadDumpTask and TrackedLeaderElectionManager

This closes #8032

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 16:57:18 -06:00
Matt Burgess 685c6861b3
NIFI-12376: Fix logic error with bitwise operator in AvroReader
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8034.
2023-11-15 22:55:56 +01:00
exceptionfactory 76a27b0ad8
NIFI-12375 Removed maxFileSize from non-applicable policies in Logback
- Removed the non-applicable maxFileSize from TimeBasedRollingPolicy configurations in default logback.xml files to avoid warnings on shutdown

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8033.
2023-11-15 22:36:34 +01:00
exceptionfactory 9b6120187a
NIFI-12373 Added LICENSE and NOTICE for nifi-standard-shared-nar
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8029.
2023-11-15 20:36:38 +01:00
EndzeitBegins 6c333cdb7e
NIFI-1874 Added Character Set Detection to IdentifyMimeType
NIFI-4550 New Processor not required based on improvements to IdentifyMimeType

- Added mime.charset FlowFile attribute when not null for text MIME types

This closes #8011

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 09:11:30 -06:00
exceptionfactory 5815d83207
NIFI-12370 Fixed Distributed Map Cache Client Service Shutdown
- Moved EventLoopGroup from CacheClientChannelPoolFactory to DistributedCacheClient to enable closing the EventLoopGroup after closing the ChannelPool

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8027.
2023-11-15 08:28:39 +01:00
mr1716 e0527a81bb
NIFI-12364 Upgrade snowflake-ingest-sdk to 2.0.4 and snowflake-jdbc to 3.14.3
This closes #8022.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-11-14 22:07:05 +01:00
mr1716 db827b88b2
NIFI-12360 Upgraded brotli4j from 1.12.0 to 1.13.0
This closes #8020

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:58:08 -06:00
mr1716 2c00d73ce9
NIFI-12359 Upgraded json-schema-validator from 1.0.86 to 1.0.87
This closes #8019

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:56:46 -06:00
mr1716 d98ba74504
NIFI-12356 Upgraded icu4j from 73.2 to 74.1
This closes #8018

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:19:01 -06:00
mr1716 44f62c9b29
NIFI-12355 Upgraded AMQP Client from 5.19.0 to 5.20.0
This closes #8017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:17:25 -06:00
mr1716 0c4de923ba
NIFI-12353 Upgraded json-flattener from 0.16.4 to 0.16.6
This closes #8014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:16:06 -06:00
Mike Thomsen 6447aea258
NIFI-11788 Modified APP_FILE logback configuration to have better cleanup
NIFI-11788 Standardized Logback maximum settings
- Set MiNiFi maxHistory to 10 and totalSizeCap to 10MB
- Set NiFi maxHistory to 30 and totalSizeCap to 3GB except for deprecation log
- Set Stateless maxHistory to 30 and totalSizeCap to 3GB
- Set Registry maxHistory to 30 and totalSizeCap to 3GB
NIFI-11788 Increased MiNiFi maxFileSize to 10MB and cap to 100MB

This closes #7465. Coauthored by David Handermann and Mike Thomsen

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-13 09:48:40 -07:00
Paulette Hines-Cross pliszle 93d373f037
NIFI-12107 Fixed sorting in the cluster table
This closes #7923

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 08:37:29 -06:00
Joe Gresock ec884ac091
NIFI-12212 Upgraded DynamoDB Processors to AWS SDK 2
This closes #7911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:30:30 -06:00
mr1716 582c3ac7cc
NIFI-12347 Upgraded AWS Kinesis from 2.5.2 to 2.5.3
This closes #8007

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:28:11 -06:00
mr1716 246ffe4ee9
NIFI-12346 Upgraded Apache Calcite from 1.35.0 to 1.36.0
This closes #8009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:27:07 -06:00
mr1716 4a4eb2c109
NIFI-12345 Upgraded Commons DBCP from 2.10.0 to 2.11.0
This closes #8006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:25:57 -06:00
Umar Hussain 4f4e99085d
NIFI-11995 Added Header Format configuration to ConsumeAMQP
This closes #7652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:32:13 -06:00
Pierre Villard eb7d49cdff
NIFI-12344 PutKudu Operation should accept Debezium Types
This closes #8004

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:02:55 -06:00
Pierre Villard 279084ddfe
NIFI-12233 Added Parameter Provider for 1Password
This closes #7884

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 11:57:16 -06:00
David Handermann dabdf94bf1
NIFI-12339 Fixed Property Decryption for Migrated Components (#8002)
- Updated StandardVersionedComponentSynchronizer to decrypt properties when creating extension references for subsequent migration
2023-11-10 11:50:03 -05:00
Mike Moser 832d4455c1
NIFI-12121 Added Transform Result Filter to JSLTTransformJSON
This closes #7922

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 10:37:17 -06:00
Mark Payne aff4e5fd1b
NIFI-12340: Only call PythonBridge.onProcessorRemoved for python based processors, not all processors. Do so in a background virtual thread. Also specified explicit versions for openai dependencies to ensure correctness, since the newly released 1.x is not yet compatible with the latest langchain
This closes #8001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 08:41:53 -06:00
exceptionfactory 3dcfc919bb
NIFI-12261 Added Schema Reference Reader and Writer Services (#7991)
- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
2023-11-08 08:55:58 -05:00
markap14 8b0abd45df
NIFI-12330: When synchronizing flow, pause component scheduling until after property migration has completed (#7994) 2023-11-07 16:46:27 -05:00
Malthe Borch 0fe9d2b56f
NIFI-9972 Added CopyAzureBlobStorage_v12 Processor
This closes #6941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 13:13:25 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:07:59 -06:00
Bryan Bende 940c9276c5
NIFI-12323 Removed String Length Limits from JSON Flow Configuration
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow

This closes #7985

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:03:13 -06:00
exceptionfactory a89fb17f9f
NIFI-12328 Updated OpenPGP test Key Generator Settings
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7992.
2023-11-07 13:03:07 +01:00
exceptionfactory b50557b854
NIFI-12321 Avoid Exceptions when removing Python Processors (#7984)
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
2023-11-06 16:17:41 -05:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 12:01:49 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
lehelb 21387316e3
NIFI-10222 Added Apicurio Schema Registry Service
This closes #7913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 15:30:08 -05:00
exceptionfactory 309061ca2d
NIFI-12310 Validate Python Component Type for Processes (#7972)
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
2023-11-03 14:42:08 -04:00
lehelb 514c8d8a6a
NIFI-12314 Fix EL for SQL Query Property in QueryNiFiReportingTask
This closes #7976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:34:01 -05:00
Nissim Shiman ed9b23ef3f
NIFI-12315 Resolved issue preventing PG from being imported from
Registry

- Corrected component property reference in sorting of response objects

This closes #7977

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:33:10 -05:00
Joe Gresock 77834c92df
NIFI-12263 Upgraded AWS Machine Learning processors to SDK 2
This closes #7953

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:05:22 -05:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 754baf0a37
NIFI-12308: Create Python Environment in background thread instead of during Processor creation
This closes #7971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 15:45:43 -05:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00
exceptionfactory 945d8b54bc
NIFI-12294 Standardized NAR Entry Loading (#7958)
- Consolidated duplicative NAR file entry normalization
2023-11-01 14:10:00 -04:00
Paul Grey 75c661bbbe
NIFI-12194 Added Yield on Exceptions in Kafka Processors
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers

This closes #7955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:08:44 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
Mark Payne 9b33d54f53
NIFI-12301 Corrected hasProperty() check when Migrating Properties
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties

This closes #7964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:41:51 -05:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-31 14:20:50 -05:00
dependabot[bot] 5c98b7cce0
NIFI-12295 Upgraded ActiveMQ Client from 5.18.2 to 5.18.3
This closes #7956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-30 17:34:59 -05:00
exceptionfactory 786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
nathluu 8e301cfdef
NIFI-12265 Fixed OpenPGP Hexadecimal Key Formatting with leading 0
- Replaced Long.toHexString() with String.format() using pattern with leading 0

This closes #7926

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 15:48:18 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-28 09:23:23 -07:00
Mark Bathori b2c4baf429
NIFI-12277 Added SSLContextService to Slack Processors
This closes #7936

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 20:51:50 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Mark Bean 5ecc12f405
NIFI-12285 Added py4j.url build property
The py4j.url property allows the URL for downloading py4j to be specified by a Maven command-line option

This closes #7946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:25:53 -05:00
Matt Burgess 880770f992
NIFI-12273 Fixed command.argument references in ExecuteStreamCommand docs
This closes #7941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:52:26 -05:00
Pierre Villard 1d125e9906
NIFI-11677 Removed non required yield in DeleteHDFS
This closes #7937

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:50:59 -05:00
Pierre Villard 1df9738f8f
NIFI-12281 Fix Go To in Parameter Providers to Provider Context
This closes #7939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 19:39:10 -05:00
Mark Bathori 4fa0299f8b NIFI-12130: Ability to configure snapshot properties via dynamic attributes in PutIceberg
Fix dynamic field expression language handling

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7849
2023-10-26 19:26:24 -04:00
lehelb a3e4f89fe3
NIFI-12271 Fix PutAzureBlobStorage_v12 rollback on failure with FileResourceService
This closes #7930

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 14:52:15 -05:00
Shane Ardell c4ff8de412
NIFI-12260: Remove templates from frontend (#7924)
* remove templates from frontend

* remove more references to removed files

* removing more template references

* remove unused css template styles
2023-10-26 15:16:14 -04:00
exceptionfactory 2eb5b79353
NIFI-12275 Disabled Keepalive in SFTP Tests
This closes #7932

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:28:02 +01:00
Mike Moser 9eb2038585
NIFI-12038 add UseCase documentation to PackageFlowFile
This closes #7896

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:00:55 +01:00
exceptionfactory f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 19:54:27 +01:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925)
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
2023-10-25 13:22:26 -04:00
Mark Payne 19993783e1
NIFI-12203: Ensure that when inheriting cluster flow on startup, we remove any Controller Services, Reporting Tasks, Parameter Contexts, etc. that are not in the proposed flow. Also removed overly aggressive timeout from RunOnceIT and performed minor code cleanup
Resolves #7907

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-24 10:45:58 -05:00
Mark Payne a44b633252
NIFI-12220 Added ability to create Controller Services from migrateProperties
- Added ability to get raw property values from PropertyConfiguration instead of just effective values
- Updated TestRunner to allow for testing these migration methods
- Auto-enable newly created controller services if they are valid
- Eliminated Proxy properties in all AWS processors and instead just make use of the Proxy Configuration controller service
- Eliminated authentication properties from AWS processors and migrated all processors to using Controller Service or authentication

This closes #7874

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-24 09:14:19 -05:00
Mark Payne 1d5f2f626b NIFI-12245: Removed deprecations around flow registry clients
NIFI-12245: Removed null check that is no  longer necessary

NIFI-12245: Fixed checkstyle violation

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #7899
2023-10-24 14:08:03 +02:00
exceptionfactory dc5cd92aa8
NIFI-12264 Upgraded Apache Tika from 2.9.0 to 2.9.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7921.
2023-10-24 11:03:32 +02:00
dan-s1 4b95129f96
NIFI-11197 Added YamlTreeReader
- Adjusted JsonTreeReader implementation for sharing common Jackson components

This closes #7665

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-23 14:37:40 -05:00
dan-s1 7f7e3f0e7a
NIFI-12165 Changed the properties "Custom Transformation Class Name" and "Custom Module Directory" to depend on the "Jolt Transformation DSL" property when its value is "Custom"
This closes #7890

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-23 18:13:20 +01:00
exceptionfactory fc6677153f
NIFI-12259 Upgraded Apache Santuario from 2.3.3 to 2.3.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7916.
2023-10-23 10:28:57 +02:00
exceptionfactory f352857e42
NIFI-12243 Refactored encrypt-config using picocli
- Replaced Groovy implementation with Java classes
- Added StandardEncryptConfig and RegistryEncryptConfig command implementations
- Added FileTransformer interface with implementations for configuration files
- Changed -A to -u for output authorizers.xml when targeting Registry
- Removed --newFlowProvider option not used
- Removed --translateCli option
- Removed --decrypt option

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7901.
2023-10-22 04:54:45 -04:00
annanys23 6daf0abfd4
NIFI-5137 Fixed the path to Controller Service grid item's state
This closes #7833

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-21 20:05:10 -05:00
markobean 63a2503fc3
NIFI-11874 update Process Group configuration layout in the UI (#7591)
* NIFI-11874 update Process Group configuration layout in the UI

* NIFI-11874: relocate checkbox for recursive application of paramenter context

* NIFI-11874 remove comments tab from process group configuration

* NIFI-11874 minor cleanup of float CSS for process-group-parameter-context-combo

This closes #7591
2023-10-21 10:09:29 -04:00
exceptionfactory f9615414bd
NIFI-12258 Upgraded MINA SSHD from 2.10.0 to 2.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7915.
2023-10-20 18:22:07 +02:00
Mark Payne 40ac38dfe3 NIFI-12242: Added ability to route data that exceeds the configured threshold in ControlRate to be routed to 'rate exceeded' instead of just staying in the queue. Added Use Case documentation to ControlRate.
This closes #7895

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-20 15:19:04 +00:00
Bryan Bende fd2de5a151
NIFI-12198 Add API and CLI commands to import reporting task snapshots (#7875)
* NIFI-12198 Add API and CLI commands to import reporting task snapshots
2023-10-20 10:45:48 -04:00
Pierre Villard 184757fede
NIFI-12230 Add configurable Log Level for IP not found in GeoEnrichIP
NIFI-12253 Route to not found relationship instead of rolling back in GeoEnrichIPRecord

This closes #7909

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-20 08:58:07 -05:00
Chris Sampson 6c7d02e22e
NIFI-12254 clarify Bulk operation header documentation for PutElasticsearchRecord and PutElasticsearchJson processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7912.
2023-10-20 12:04:16 +02:00
Matt Gilman 9e5892780a
NIFI-12167:
- Renaming Usage to View Documentation.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7904.
2023-10-20 11:34:29 +02:00
exceptionfactory 15c3bdeac1
NIFI-12252 Removed Legacy FileAuthorizer
- Removed Legacy Authorized Users File property from FileUserGroupProvider
- Removed unused methods from FileAccessPolicyProvider and FileUserGroupProvider

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7910.
2023-10-20 10:31:48 +02:00
Matt Gilman 98eef74dd8
NIFI-12250: (#7908)
- Fixing issue where the registry configuration dialog was being initialized twice.
2023-10-19 15:53:07 -04:00
Mark Payne 015b721800
NIFI-7643 Removed absolute.path attribute from UnpackContent
- Do not include the absolute.path attribute from Zip/Tar files in UnpackContent; some code cleanup

This closes #7902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:51:27 -05:00
Mark Payne 8bfb6be5ba
NIFI-4172: Renamed ClusteSummaryEntity to ClusterSummaryEntity
This closes #7900

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:46:18 -05:00
Matt Gilman 97dfe2d812
NIFI-11909 Cleared Password field after login
- Clearing the password in the login form when login fails or unable to verify access once authentication succeeds.

This closes #11909

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:40:27 -05:00
Matt Gilman f2822a6bfb
NIFI-12247: (#7905)
- Reverting to the initial value if there is no selected parameter in the combo editor.
2023-10-19 14:25:06 -04:00
Matt Gilman dc76d3896d
NIFI-12248: (#7906)
- Fixing arrow alignment in combo editor.
2023-10-19 13:56:55 -04:00
Chris Sampson aac71c5aa1 NIFI-8135 allow CHOICE data types in conversion of Records to Java Maps
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7746
2023-10-19 13:13:58 -04:00
András Kovács d4014c71ee
NIFI-12099 Repurpose Template icon in top left bar (#7811)
This closes #7811
2023-10-19 12:16:34 -04:00
Pierre Villard 814e94b2ac
NIFI-12244 - UpdateRecord invalid because of migrateProperties (#7898) 2023-10-19 09:34:55 -04:00
Gabor Gyimesi 91e4b453b4
NIFI-12238 Fix SplitText endline trimming with max fragment size (#7892) 2023-10-18 12:40:52 -04:00
exceptionfactory 574c2b2168 NIFI-12234 Upgraded SSHJ from 0.35.0 to 0.37.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7886
2023-10-17 02:10:51 -04:00
Shane Ardell e2bbcac8e1 This closes #7810
NIFI-12088: recalculate hidden property fields when new service is created

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2023-10-16 16:52:45 -04:00
exceptionfactory 20283fd7ec
NIFI-12235 Upgraded Solr from 9.3.0 to 9.4.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7887.
2023-10-16 19:42:13 +02:00
Mark Payne cbdf32ab79
NIFI-12205: Moved loading of Python dependencies into background thread when processor created instead of during startup. Some code cleanup.
This closes #7863

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-14 15:05:17 -05:00
exceptionfactory 61c856a54c
NIFI-12122 Corrected test for Parameter Context updating
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-13 22:55:53 -05:00
Zackeus Bengtsson 0a47157640
NIFI-12122 Fixed persistence of Parameter Context descriptions
Fixed bug where parameter context descriptions were not loaded on NiFi startup and overwritten as empty

This closes: #7787

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-13 18:30:50 -05:00
Mark Payne 3ae0eedee6
NIFI-12124: This closes #7791. Added a new RenameRecordField processor. In testing, also noticed that the Descendant Wildcard operator (//*) and Descendant Field Path Operator (//name, for instance) did not properly account for array of records or map elements, so addressed those concerns.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 14:02:55 -07:00
Mark Payne f4ae292a45
NIFI-12221: This closes #7876. Be more lenient about which Disconnection Codes we allow a node to be reconnected to a cluster vs. when we notify the node to disconnect again. Also updated the timeout for OffloadIT because it occasionally times ou out while running properly.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 13:59:05 -07:00
Mark Payne 0eabbcdf19
NIFI-12228: This closes #7881. Fixed issue with FlowFile Concucrrency that can occasionally bring in more data than it should.
Code cleanup, fixing logback to avoid INFO-level stack trace from xodus

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 13:36:09 -07:00
Bryan Bende 96eb1d825a
NIFI-12222 Protect against missing parameter context when syncing a PG in component synchronizer (#7877) 2023-10-13 13:51:47 -04:00
exceptionfactory 22ad7d542d
NIFI-12206 Refactor Flow History using JetBrains Xodus (#7870)
* NIFI-12206 Refactored Flow History using JetBrains Xodus

- Replaced H2 Database Engine with JetBrains Xodus for persistent storage of FlowConfigurationHistory
- Added EntityStoreAuditService implementation using Xodus PersistentEntityStore
- Removed nifi.h2.url.append from properties
2023-10-12 14:50:25 -04:00
Mark Payne abfc49e212
NIFI-12139: Implemented migrateProperties, migrateRelationships for processors, as well as migrateProperties for ReportingTasks and Controller Services. Added system tests to verify behavior.
- Ensure that after restoring nars in the lib/ directory we restart NiFi so that they take effect. This is important if this test is not the last one to run

This closes #7837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-12 11:40:18 -05:00
exceptionfactory a849ca044c
NIFI-12218 Removed SensitiveValueEncoder and SecureHasher
- SensitiveValueEncoder and SecureHasher are no longer required following the removal of support for flow.xml.gz

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7873.
2023-10-12 17:39:43 +02:00
levilentz 1a0f509ffc
NIFI-12211: This closes #7868. add Validator.VALID to username/password on TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:38:02 -07:00
Chris Sampson 584b3fc165
NIFI-12214 This closes #7869. ConsumeElasticsearch Query Builder properties do not dependOn the Query Definition Style
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:37:40 -07:00