Commit Graph

6476 Commits

Author SHA1 Message Date
Mark Payne 231dbde4b3
NIFI-12516 Corrected Cluster Replicated Response Headers for HTTP/2
The headers in the map that come back when replicating a request used to be in the case given; however they can be lowercased in the OkHttp Headers object when using HTTP/2 instead of HTTP/1.1. As a result, we need to ensure that we always use lower-case header names or check the map case-insensitive.

This closes #8163

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-15 13:43:06 -06:00
Matt Gilman b0f30d6860
NIFI-12486: Registry Clients (#8142)
* NIFI-12486:
- Registry Clients.
- General authorization guard.
- Additional authorization checks in the existing Settings tabs.

* NIFI-12486:
- Adding authorization guard to /counters.

* NIFI-12486:
- Enabling some debug build out to attempt to track down a sporadic build failure.

* NIFI-12486:
- Addressing review feedback.

* NIFI-12486:
- Fixing unit test and running prettier.

This closes #8142
2023-12-15 10:43:50 -05:00
Mikhail Sapozhnikov 76613a0ed4
NIFI-6730 AMQP QoS support
This closes #8146.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-14 21:39:25 +01:00
Bence Simon 3c4ccd2c64
NIFI-12509 Changing default TTL of HazelcastMapCacheClient
This closes #8154.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-14 13:04:47 +01:00
EndzeitBegins c272574dcc
NIFI-12452 Improved support for DescribedValue in Descriptors
- Removed calls to Builder.defaultValue(null) in several Components

This closes #8102

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:45:45 -06:00
Bence Simon 5b664147ee
NIFI-12508 Cleaning up remainders of the Event Driven Strategy
This closes #8153

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:15:29 -06:00
Emilio Setiadarma 2691ad0451
NIFI-12474: remove TriggerWhenEmpty for DeleteHDFS (#8125) 2023-12-13 11:42:40 -05:00
Matt Gilman 4f59f46ce4
NIFI-12445: Provenance Event Listing (#8133)
- Provenance Event Listing.
- View Provenance Event dialog.
- Provenance routing.
- Provenance search.
- Replay.
- Download content.
- View content.
- Addressing review feedback.
- Addressing review feedback.

This closes #8133
2023-12-11 17:36:42 -05:00
Peter Gyori 78b822c452
NIFI-12105: remove unnecessary checking of compressed content from testAdditionalNarDirectoriesSpecified test case
This closes #8150.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-11 19:33:39 +01:00
Peter Turcsanyi 718d7e0461
NIFI-12497 Upgraded snowflake-jdbc to 3.14.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8149.
2023-12-11 15:54:02 +01:00
Rajmund Takacs 9a5ec83baa NIFI-12241 Efficient Parquet Splitting
This closes #7893.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-12-10 22:03:37 +01:00
exceptionfactory a126f6a7df NIFI-12492 Moved QuestDB Status Repository to Separate NAR
- Added nifi-framework-status-history-shared module for common components
- Added include-questdb build profile for including the QuestDB NAR
- Upgraded QuestDB from 7.2 to 7.3.7 for NIFI-12435

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #8141
2023-12-08 14:12:54 +01:00
exceptionfactory ec3da7144c
NIFI-12475 Disabled Bypass Validation by Default in PutMongoRecord
- Updated property description to indicate that bypass validation is a Privilege Action that can cause authorization errors.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8139.
2023-12-08 14:08:54 +01:00
David Handermann f73888e7dd
NIFI-12478 Return Message Type as body for JMS Object Messages (#8131) 2023-12-07 16:41:34 -05:00
exceptionfactory b9dbcab160
NIFI-12489 Upgraded Apache POI from 5.2.4 to 5.2.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8140.
2023-12-07 18:28:55 +01:00
Peter Gyori 5675d37bed
NIFI-12105: ExecuteStateless processor accepts additional NAR directories
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8129.
2023-12-07 16:03:05 +01:00
exceptionfactory 5c1b0a1140
NIFI-12483 Streamlined JMX Metrics Filtering Parameters
- Added bean name filter processing and added test cases

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8134.
2023-12-07 15:59:32 +01:00
Matt Gilman 17a331b9e1
NIFI-12484: Bumping dependency to latest minor/incremental release (#8135)
- Bumping dependency to latest minor/incremental release.
- Adding an explicit override for vite which is needed until Angular can be upgraded to version 17.

This closes #8135
2023-12-07 09:02:48 -05:00
Matt Gilman 414eea805f
NIFI-12470: Fixing forEach callback for usage with Object.entries() to address layout issue in Status History (#8121)
* NIFI-12470:
- Fixing forEach callback for usage with Object.entries() to address layout issue in Status History.
- Using es5 syntax.

This closes #8121
2023-12-07 08:19:25 -05:00
exceptionfactory 34aebc1f69
NIFI-12473 Deleted removeByPattern Methods from Cache Services
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8124.
2023-12-07 12:42:08 +01:00
Mark Payne 1d06185f13
NIFI-12453 Added cluster-status command to nifi.sh
NIFI-12454 Allow decommissioning cluster node without shutdown

This closes #8100

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 22:12:55 -06:00
Mark Payne a21993ef72
NIFI-12331 Added PublishSlack Processor
- Removed deprecated PutSlack and PostSlack

This closes #8120

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 15:10:12 -06:00
dan-s1 ab8a82b997
NIFI-12410 Support EL for Starting Row in ExcelReader
This closes #8119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 08:56:00 -06:00
Peter Turcsanyi 8645088e1d
NIFI-12412 Support Proxies for Blob Checkpoints in ConsumeAzureEventHub
This closes #8107

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 08:23:59 -06:00
Pierre Villard d0dd4e03e0
NIFI-12427 Add channel name attribute to ConsumeSlack
This closes #8078

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 07:42:54 -06:00
Matt Burgess eeb2b1a644
NIFI-12318: Fixed byte array generation in GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8109.
2023-12-05 14:41:22 +01:00
mr1716 d1c7e6c6b8
NIFI-12466 Upgraded MongoDB Driver from 4.10.2 to 4.11.1
This closes #8118

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:09:03 -06:00
mr1716 d6bac808ba
NIFI-12465 Upgraded mysql-binlog-connector-java from 0.28.1 to 0.28.3
This closes #8117

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:08:21 -06:00
mr1716 29dda4208a
NIFI-12463 Upgraded maven-artifact from 3.8.5 to 3.8.8
This closes #8115

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:03:38 -06:00
exceptionfactory 456cf7d88d
NIFI-12451 This closes #8104. Removed Bootstrap Notification Services
- Refactored Security Property handling and bootstrap certificate generation
- Removed unnecessary dependencies from nifi-bootstrap
- Removed unnecessary and unused settings from bootstrap.conf

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-04 15:09:45 -07:00
Mark Payne 283abadf97
NIFI-12457: Added additional use case based documentation and fixed some typos/made some clarifications in related docs
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8108.
2023-12-04 14:59:53 +01:00
Mark Bathori 7770a17a6c
NIFI-11992: Processor and sink service for filing tickets in Zendesk
This closes #7644.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-04 09:42:36 +01:00
Matt Gilman 387a101931
NIFI-12425: Controller Service Listing (#8091)
* NIFI-12425:
- Controller Service Listing.
- Adding lazy loading to the Canvas with the introduction of the Controller Service listing.
- Reorganizing existing components in the Flow Designer.
- Allowing the current Process Group to be configured.
- Inline Service creation.

* NIFI-12425:
- Removing unused imports.

This closes #8091
2023-12-01 13:50:30 -05:00
Matt Gilman d40bb3eda6
NIFI-12419: (#8097)
- Applying a copy of the nifi-web-frontend rat config in the parent module when the new ui profile is not activated. Previously, if the new ui profile was not activated, the rat check would fail.

This closes #8097
2023-12-01 12:58:46 -05:00
exceptionfactory 2ac3988881
NIFI-12448 Removed InfluxDB Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8093.
2023-12-01 16:21:20 +01:00
mr1716 d7cb4a4b1c
NIFI-12440 Upgraded HikariCP from 5.0.1 to 5.1.0
This closes #8089

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:55:12 -06:00
Sebastian Rothbucher 685700ad7c
NIFI-11129 Added PutMongoBulkOperations Processor
This closes #6918

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:36:44 -06:00
EndzeitBegins edca4cd347 NIFI-12386 Adds processor FilterAttribute
attribute uuid is not removed by removeAttribute(s) in MockProcessSession

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8049
2023-11-30 19:21:08 +00:00
mr1716 0430974783
NIFI-12436 Upgraded datafaker from 2.0.1 to 2.0.2
This closes #8084

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:45:26 -06:00
mr1716 6255a98b22
NIFI-12430 Upgraded unboundid-ldapsdk from 6.0.9 to 6.0.10
This closes #8080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:42:10 -06:00
Rob Fellows d14686cb3a
[NIFI-12415] Counters (#8077)
* [NIFI-12415] Counters page
* populate counter the table.
* support counter reset.
* filtering by name and by context
* sorting, including initial sort
* added basic tests

* Formatted with Prettier

* review feedback - removing unused things.

* align mat-table usage to a common style

* disable the Counter menu item if the user doesn't have counterPermissions.canRead

This closes #8077
2023-11-29 18:00:28 -05:00
Matt Gilman 05575364a3
NIFI-12417: Process Group Configuration (#8075)
* NIFI-12417:
- Process Group Configuration.
- Removed unnecessary module imports.

* NIFI-12417:
- Addressing review feedback.

This closes #8075
2023-11-29 17:21:35 -05:00
Matt Gilman ebfb5bc12e
NIFI-12401: Allow combo editor to reference parameters (#8068)
* NIFI-12401:
- Allow combo editor to reference parameters.

* NIFI-12401:
- Addressing review feedback.
- Handling corner cases where there is no parameter context and where there are no parameters in a bound parameter context.

* NIFI-12401:
- Fixing formatting issues.

This closes #8068
2023-11-29 12:26:25 -05:00
dan-s1 9154b708cc
NIFI-12404 Added documentation indicating this controller service does not resolve YAML aliases.
This closes #8070.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2023-11-29 11:21:18 +01:00
dan-s1 e61665675b
NIFI-12416 Relocated the additionalDetails.html to the appropriate bundle in order for it to be seen when generating the documentation.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8067.
2023-11-28 18:36:54 +01:00
mr1716 1a7790b4a1
NIFI-12423 Update iotdb.sdk.version to 1.2.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8074.
2023-11-28 18:28:41 +01:00
mr1716 df33ca04a9
NIFI-12422 Update excel-streaming-reader to 4.2.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8073.
2023-11-28 18:25:53 +01:00
mr1716 0311221eb9
NIFI-12421 Update metrics-core to 4.2.22
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8072.
2023-11-28 18:22:31 +01:00
Rob Fellows 4bba7e6188
[NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. (#8069)
* [NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. Also update the ci-workflow.yaml to activate that profile.

* add the profile activation to the Maven Build command

This closes #8069
2023-11-27 20:18:31 -05:00
Matt Gilman b3b6d72924
NIFI-11481: Initial migration to Angular 16 (#8053)
* NIFI-11481:
- Initial project creation.

* NIFI-11481:
- Install material.
- Rename project from nifi-web-frontend to nifi.

* NIFI-11481:
- Install roboto through package.json.

* NIFI-11481:
- Add Tailwind.

* NIFI-11481:
- Basic layout.

* NIFI-11481:
- Introducing ngrx for storing flow.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.
- Adding draggable.
- Adding editable.
- Adding selectable.
- Adding flowfont.
- Adding Canvas View.
- Adding Transform in Store.
- Adding selected in Store.
- Adding transition in Store.
- Funnel Manager directly subscribes to store.

* NIFI-11481:
- Adding backend calls.
- Refactoring update positions to be for a single component.

* NIFI-11481:
- Process Group Manager.
- Adding font-awesome.
- Updating canvas/graph component visibility.
- Adding prettier/eslint.

* NIFI-11481:
- Adding support to enter a process group.

* NIFI-11481:
- Formatting source.

* NIFI-11481:
- Label Manager.
- Added generic update component.

* NIFI-11481:
- Processor Manager.

* NIFI-11481:
- Port Manager.

* NIFI-11481:
- Remote Process Group Manager.

* NIFI-11481:
- Adding draggable icons to the toolbar.

* NIFI-11481:
- Formatting.

* NIFI-11481:
- Draggable Toolbar.
- Create Label, Funnel.

* NIFI-11481:
- Connection Manager.
- Connectable Behavior.

* NIFI-11481:
- Draggable behavior with back end call for both components and connections.

* NIFI-11481:
- Selection box.

* NIFI-11481:
- Port creation.
- Port configuration.
- Quick Select.

* NIFI-11481:
- Canvas Tooltips.

* NIFI-11481:
- Context menu.

* NIFI-11481:
- Router State.
- Reorganization.
- Deep linking.

* NIFI-11481:
- Adding support for Delete.

* NIFI-11481:
- Flow status bar.

* NIFI-11481:
- Adding Current User State.
- Current user polling.
- Fixing Flow Status layout bug.

* NIFI-11481:
- Process Group Polling.

* NIFI-11481:
- Process Group Breadcrumbs.

* NIFI-11481:
- Global Menu.

* NIFI-11481:
- Search.

* NIFI-11481:
- Add support for centering components on the canvas.

* NIFI-11481:
- Add support for persisting and restoring the users view of the current PG.

* NIFI-11481:
- Fixing centering behavior.
- Fixing user view restoration.
- Bulk selection auto fit.

* NIFI-11481:
- Incorporating the new UI into the NiFi build with a build profile that is not active by default.
- The new UI is deployed to a different context path than the current UI and works side by side.

* NIFI-11481:
- Center component from context menu.
- Enter process group from context menu.

* NIFI-11481:
- Adding support to log in.
- LoginFilter, LogoutFilter.
- Moved the handling of 'include-new-ui' profile to make building with and within more straight forward.
- Splash screen while guard executing.
- Http request interceptor to show loading on the canvas.
- Http request interceptor to handle 401 responses.

* NIFI-11481:
- Extension Creation Component.
- Filter, Usage Restrictions, and selected type.

* NIFI-11481:
- Stopping polling when unable to connect to server.

* NIFI-11481:
- Settings - General.

* NIFI-11481:
- Settings - Management Controller Services.

* NIFI-11481:
- NiFi Tooltip directive.
- Usage Restriction Tip.
- Comments Tip.
- Validation Errors Tip.
- Bulletins Tip.

* NIFI-11481:
- Settings - Reporting Tasks.

* NIFI-11481:
- Avoiding unnecessary web requests in route guards.

* NIFI-11481:
- Edit Controller Service Dialog.
- View Property Table.
- Update component density.

* NIFI-11481:
- Supports Controller Service API tooltip and dialog content.

* NIFI-11481:
- Property table - NF Editor.
- Property table - Combo Editor.

* NIFI-11481:
- Making property table a control value accessor.
- Wiring up saving Controller Services from Edit Dialog.
- Handling Delete Property.
- Handling New Property.
- Updating how form submission is triggered throughout to address issue with incidental form submit events.

* NIFI-11481:
- Moving Settings into pages.

* NIFI-11481:
- Moving Canvas into pages.

* NIFI-11481:
- Moving Login into pages.

* NIFI-11481:
- Adding routing to the Controller Service listing and Reporting Task listing.
- Updating Canvas routing to follow similar pattern.

* NIFI-11481:
- Controller Service references.

* NIFI-11481:
- Create inline Controller Service.
- Edit Controller Service route.
- Go To Controller Service from Property Table.
- Switching to Event Emitter in New Property dialog.

* NIFI-11481:
- Saving spinner - Create Processor, Create Port, and Edit Port.

* NIFI-11481:
- Saving spinner - Create Controller Service, Edit Controller Service, and Create Reporting Task.

* NIFI-11481:
- Parameter Context Listing.
- Add new Parameter Context.
- Edit Parameter Context.

* NIFI-11481:
- New Paramter.
- Edit Parameter.
- Parameter table.

* NIFI-11481:
- Parameter references.
- Parameter Context update steps.
- Bound Process Group references.

* NIFI-11481:
- Parameter Context Inheritance.

* NIFI-11481:
- Processor configuration.
- Ensuring new Property names are unique.
- Trapping focus in nf and combo editors.
- Reloading component connections after updating a Processor.

* NIFI-11481:
- Navigation Control.
- Birdseye.
- Operation Control.

* NIFI-11481:
- Create Process Group.
- Upload Process Group.

* NIFI-11481:
- Implementing current Process Group context in operation palette.

* NIFI-11481:
- Connection creation.

* NIFI-11481:
- Connection configuration.

* NIFI-11481:
- Standardizing selection option model.
- Connection load balancing tooltip.
- Clean up.

* NIFI-11481:
- Move components in to/out of groups.
- Group components.

* NIFI-11481:
- Render connections for component action.

* NIFI-11481:
- CodeMirror for Parameter and EL configuration.

* NIFI-11481:
- Resizable.
- Moving tooltip directive.

* NIFI-11481:
- Ensuring all specs are bootstrapped and create successfully.

* NIFI-11481:
- Updating some interface names to avoid conflicting with various components in an attempt to better establish a naming convention.

* NIFI-11481:
- Show Source/Destination.
- Defaulting current Parameter Context in Create PG and Group dialogs.
- Handling disabled state in a few ControlValueAccessors.
- Ensuring Parameter Contest uri is set.
- Unit tests.

* NIFI-11481:
- Fixing checkstyle issue.

* NIFI-11481:
- LICENSE/NOTICE.

* NIFI-11481:
- RAT Plugin config.

* NIFI-12401:
- Addressing review feedback.

* NIFI-11481:
- Ensuring the option is disabled when there is no description.

* NIFI-11481:
- Only including parameters in the payload when they have been modified.
- Showing appropriate message after applying based on whether parameters were included or not.

* NIFI-11481:
- Fixing parameter deletion.
- Enforcing parameter name uniqueness.
- Preventing changing parameter sensitive.

* NIFI-11481:
- Only loading the service link once when considering updated property value.
- Ensuring existing parameter are set in all instances of opening the new Property dialog.

* NIFI-11481:
- Fixing tests that regressed.

* NIFI-11481:
- Adding default karma config which was needed in order to debug tests in IDE.

* NIFI-11481:
- Updating karma config to not watch for now. Can introduce new options for running in various contexts in the future.

This closes #8053
2023-11-27 10:39:51 -05:00
exceptionfactory 00fd7d7cca NIFI-12361-RC6 prepare for next development iteration 2023-11-22 18:35:27 -06:00
exceptionfactory 49fa0d8674 NIFI-12361-RC6 prepare release nifi-2.0.0-M1-RC6 2023-11-22 18:35:26 -06:00
David Handermann 50efc55df6
NIFI-12403 Improve Jolt UI Parameter Processing (#8060)
* Improved Jolt UI Parameter Processing

* Changed double quotes to single quotes per review

This closes #8060
2023-11-22 14:37:02 -05:00
Mark Payne d0c7ebb196
NIFI-11671: Allow FlowFile attributes to be referenced in SQL for JoinEnrichment
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8059.
2023-11-22 14:37:18 +01:00
exceptionfactory 6617fe8fe2
NIFI-12384 This closes #8044. Upgraded Registry to Spring Framework 6
- Upgraded Spring from 5.3.30 to 6.0.13
- Upgraded Spring Boot from 2.7.16 to 3.1.5
- Upgraded Spring Security from 5.8.7 to 6.1.5
- Upgraded Jetty from 10.0.18 to 11.0.18
- Upgraded Servlet API from 3.1.0 to 5.0.0
- Upgraded JAX-RS from 2.1.1 to 3.1.0
- Upgraded Jersey from 2.41 to 3.1.3
- Upgraded JAXB from 2.3.2 to 4.0.4
- Upgraded Java Validation from 2.0.1 to 3.0.2
- Upgraded Flyway from 8.5.13 to 9.22.3
- Upgraded ASM from 9.3 to 9.6 for Java 21
- Upgraded NiFi Toolkit CLI to JAX RS 3 and Jersey 3
- Set Jersey 3 and JAX RS 3 dependency versions in nifi-flow-registry-client-bundle to align with updates to nifi-registry-client classes

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-21 09:06:51 -07:00
exceptionfactory e5e76d0161
NIFI-12393 Upgraded OWASP Check from 8.4.2 to 8.4.3
- Upgraded Azure SDK BOM from 1.2.17 to 1.2.18
- Upgraded Reactor Netty HTTP from 1.0.34 to 1.0.39 for Azure Identity
- Upgraded MSAL4J from 1.13.10 to 1.14.0
- Upgraded Box Java SDK from 4.4.0 to 4.6.1
- Relocated Apache Ant managed versions to bundle parent modules
- Added okio-fakefilesystem to managed dependencies
- Suppressed vulnerability for Picocli misidentified as LINE library
- Added managed dependencies to nifi-code-coverage to avoid false positives due to different parent modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8054.
2023-11-21 12:16:12 +01:00
exceptionfactory d5c7fcb5dd
NIFI-12392 Corrected Component Documentation NAR Unpacking
- Corrected component documentation directory comparison for finding bundled documentation in a JAR
- Added unit test for unpacking of component documentation from JAR included in NAR

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8052.
2023-11-20 14:55:42 +01:00
Matt Burgess e81d7254ec
NIFI-12389: Add variance and standard deviation to AttributeRollingWindow
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8048.
2023-11-20 11:23:51 +01:00
Zoltan Kornel Torok 63364687d8 NIFI-12383 Replication client should handle accept encoding with lowercase
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #8043
2023-11-17 08:02:07 +01:00
Joseph Witt 9cfdebc3e8
NIFI-12378 Removed Jython
This closes #8040

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
mr1716 a3983ae248
NIFI-12380 Upgraded Iceberg from 1.4.0 to 1.4.2
This closes #8039

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Ferenc Gerlits ceeb0deb3d
NIFI-12381 Fixed CR and LF documentation in SplitText
This closes #8041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Bryan Bende 1cc346b63d
NIFI-12368 Clear versionedComponentId for copied Snippets
This closes #8025

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:52 -06:00
Mark Payne e1942a8346
NIFI-12374: Added use case based documentation to explain how to perform incremental / full loads from databases
This closes #8030

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 19:28:10 -06:00
Mark Payne b5c3e6f9aa
NIFI-12358 Fixed NPE in HostHeaderHandler
Fixed NPE in ThreadDumpTask and TrackedLeaderElectionManager

This closes #8032

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 16:57:18 -06:00
Matt Burgess 685c6861b3
NIFI-12376: Fix logic error with bitwise operator in AvroReader
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8034.
2023-11-15 22:55:56 +01:00
exceptionfactory 76a27b0ad8
NIFI-12375 Removed maxFileSize from non-applicable policies in Logback
- Removed the non-applicable maxFileSize from TimeBasedRollingPolicy configurations in default logback.xml files to avoid warnings on shutdown

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8033.
2023-11-15 22:36:34 +01:00
exceptionfactory 9b6120187a
NIFI-12373 Added LICENSE and NOTICE for nifi-standard-shared-nar
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8029.
2023-11-15 20:36:38 +01:00
EndzeitBegins 6c333cdb7e
NIFI-1874 Added Character Set Detection to IdentifyMimeType
NIFI-4550 New Processor not required based on improvements to IdentifyMimeType

- Added mime.charset FlowFile attribute when not null for text MIME types

This closes #8011

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 09:11:30 -06:00
exceptionfactory 5815d83207
NIFI-12370 Fixed Distributed Map Cache Client Service Shutdown
- Moved EventLoopGroup from CacheClientChannelPoolFactory to DistributedCacheClient to enable closing the EventLoopGroup after closing the ChannelPool

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8027.
2023-11-15 08:28:39 +01:00
mr1716 e0527a81bb
NIFI-12364 Upgrade snowflake-ingest-sdk to 2.0.4 and snowflake-jdbc to 3.14.3
This closes #8022.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-11-14 22:07:05 +01:00
mr1716 db827b88b2
NIFI-12360 Upgraded brotli4j from 1.12.0 to 1.13.0
This closes #8020

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:58:08 -06:00
mr1716 2c00d73ce9
NIFI-12359 Upgraded json-schema-validator from 1.0.86 to 1.0.87
This closes #8019

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:56:46 -06:00
mr1716 d98ba74504
NIFI-12356 Upgraded icu4j from 73.2 to 74.1
This closes #8018

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:19:01 -06:00
mr1716 44f62c9b29
NIFI-12355 Upgraded AMQP Client from 5.19.0 to 5.20.0
This closes #8017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:17:25 -06:00
mr1716 0c4de923ba
NIFI-12353 Upgraded json-flattener from 0.16.4 to 0.16.6
This closes #8014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:16:06 -06:00
Mike Thomsen 6447aea258
NIFI-11788 Modified APP_FILE logback configuration to have better cleanup
NIFI-11788 Standardized Logback maximum settings
- Set MiNiFi maxHistory to 10 and totalSizeCap to 10MB
- Set NiFi maxHistory to 30 and totalSizeCap to 3GB except for deprecation log
- Set Stateless maxHistory to 30 and totalSizeCap to 3GB
- Set Registry maxHistory to 30 and totalSizeCap to 3GB
NIFI-11788 Increased MiNiFi maxFileSize to 10MB and cap to 100MB

This closes #7465. Coauthored by David Handermann and Mike Thomsen

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-13 09:48:40 -07:00
Paulette Hines-Cross pliszle 93d373f037
NIFI-12107 Fixed sorting in the cluster table
This closes #7923

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 08:37:29 -06:00
Joe Gresock ec884ac091
NIFI-12212 Upgraded DynamoDB Processors to AWS SDK 2
This closes #7911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:30:30 -06:00
mr1716 582c3ac7cc
NIFI-12347 Upgraded AWS Kinesis from 2.5.2 to 2.5.3
This closes #8007

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:28:11 -06:00
mr1716 246ffe4ee9
NIFI-12346 Upgraded Apache Calcite from 1.35.0 to 1.36.0
This closes #8009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:27:07 -06:00
mr1716 4a4eb2c109
NIFI-12345 Upgraded Commons DBCP from 2.10.0 to 2.11.0
This closes #8006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:25:57 -06:00
Umar Hussain 4f4e99085d
NIFI-11995 Added Header Format configuration to ConsumeAMQP
This closes #7652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:32:13 -06:00
Pierre Villard eb7d49cdff
NIFI-12344 PutKudu Operation should accept Debezium Types
This closes #8004

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:02:55 -06:00
Pierre Villard 279084ddfe
NIFI-12233 Added Parameter Provider for 1Password
This closes #7884

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 11:57:16 -06:00
David Handermann dabdf94bf1
NIFI-12339 Fixed Property Decryption for Migrated Components (#8002)
- Updated StandardVersionedComponentSynchronizer to decrypt properties when creating extension references for subsequent migration
2023-11-10 11:50:03 -05:00
Mike Moser 832d4455c1
NIFI-12121 Added Transform Result Filter to JSLTTransformJSON
This closes #7922

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 10:37:17 -06:00
Mark Payne aff4e5fd1b
NIFI-12340: Only call PythonBridge.onProcessorRemoved for python based processors, not all processors. Do so in a background virtual thread. Also specified explicit versions for openai dependencies to ensure correctness, since the newly released 1.x is not yet compatible with the latest langchain
This closes #8001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 08:41:53 -06:00
exceptionfactory 3dcfc919bb
NIFI-12261 Added Schema Reference Reader and Writer Services (#7991)
- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
2023-11-08 08:55:58 -05:00
markap14 8b0abd45df
NIFI-12330: When synchronizing flow, pause component scheduling until after property migration has completed (#7994) 2023-11-07 16:46:27 -05:00
Malthe Borch 0fe9d2b56f
NIFI-9972 Added CopyAzureBlobStorage_v12 Processor
This closes #6941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 13:13:25 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:07:59 -06:00
Bryan Bende 940c9276c5
NIFI-12323 Removed String Length Limits from JSON Flow Configuration
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow

This closes #7985

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:03:13 -06:00
exceptionfactory a89fb17f9f
NIFI-12328 Updated OpenPGP test Key Generator Settings
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7992.
2023-11-07 13:03:07 +01:00
exceptionfactory b50557b854
NIFI-12321 Avoid Exceptions when removing Python Processors (#7984)
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
2023-11-06 16:17:41 -05:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 12:01:49 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
lehelb 21387316e3
NIFI-10222 Added Apicurio Schema Registry Service
This closes #7913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 15:30:08 -05:00
exceptionfactory 309061ca2d
NIFI-12310 Validate Python Component Type for Processes (#7972)
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
2023-11-03 14:42:08 -04:00