Commit Graph

6724 Commits

Author SHA1 Message Date
Mikhail Sapozhnikov 76613a0ed4
NIFI-6730 AMQP QoS support
This closes #8146.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-14 21:39:25 +01:00
Bence Simon 3c4ccd2c64
NIFI-12509 Changing default TTL of HazelcastMapCacheClient
This closes #8154.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-14 13:04:47 +01:00
EndzeitBegins c272574dcc
NIFI-12452 Improved support for DescribedValue in Descriptors
- Removed calls to Builder.defaultValue(null) in several Components

This closes #8102

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:45:45 -06:00
Bence Simon 5b664147ee
NIFI-12508 Cleaning up remainders of the Event Driven Strategy
This closes #8153

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:15:29 -06:00
Emilio Setiadarma 2691ad0451
NIFI-12474: remove TriggerWhenEmpty for DeleteHDFS (#8125) 2023-12-13 11:42:40 -05:00
Matt Gilman 4f59f46ce4
NIFI-12445: Provenance Event Listing (#8133)
- Provenance Event Listing.
- View Provenance Event dialog.
- Provenance routing.
- Provenance search.
- Replay.
- Download content.
- View content.
- Addressing review feedback.
- Addressing review feedback.

This closes #8133
2023-12-11 17:36:42 -05:00
Peter Gyori 78b822c452
NIFI-12105: remove unnecessary checking of compressed content from testAdditionalNarDirectoriesSpecified test case
This closes #8150.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-11 19:33:39 +01:00
Peter Turcsanyi 718d7e0461
NIFI-12497 Upgraded snowflake-jdbc to 3.14.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8149.
2023-12-11 15:54:02 +01:00
Rajmund Takacs 9a5ec83baa NIFI-12241 Efficient Parquet Splitting
This closes #7893.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-12-10 22:03:37 +01:00
exceptionfactory a126f6a7df NIFI-12492 Moved QuestDB Status Repository to Separate NAR
- Added nifi-framework-status-history-shared module for common components
- Added include-questdb build profile for including the QuestDB NAR
- Upgraded QuestDB from 7.2 to 7.3.7 for NIFI-12435

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #8141
2023-12-08 14:12:54 +01:00
exceptionfactory ec3da7144c
NIFI-12475 Disabled Bypass Validation by Default in PutMongoRecord
- Updated property description to indicate that bypass validation is a Privilege Action that can cause authorization errors.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8139.
2023-12-08 14:08:54 +01:00
David Handermann f73888e7dd
NIFI-12478 Return Message Type as body for JMS Object Messages (#8131) 2023-12-07 16:41:34 -05:00
exceptionfactory b9dbcab160
NIFI-12489 Upgraded Apache POI from 5.2.4 to 5.2.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8140.
2023-12-07 18:28:55 +01:00
Peter Gyori 5675d37bed
NIFI-12105: ExecuteStateless processor accepts additional NAR directories
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8129.
2023-12-07 16:03:05 +01:00
exceptionfactory 5c1b0a1140
NIFI-12483 Streamlined JMX Metrics Filtering Parameters
- Added bean name filter processing and added test cases

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8134.
2023-12-07 15:59:32 +01:00
Matt Gilman 17a331b9e1
NIFI-12484: Bumping dependency to latest minor/incremental release (#8135)
- Bumping dependency to latest minor/incremental release.
- Adding an explicit override for vite which is needed until Angular can be upgraded to version 17.

This closes #8135
2023-12-07 09:02:48 -05:00
Matt Gilman 414eea805f
NIFI-12470: Fixing forEach callback for usage with Object.entries() to address layout issue in Status History (#8121)
* NIFI-12470:
- Fixing forEach callback for usage with Object.entries() to address layout issue in Status History.
- Using es5 syntax.

This closes #8121
2023-12-07 08:19:25 -05:00
exceptionfactory 34aebc1f69
NIFI-12473 Deleted removeByPattern Methods from Cache Services
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8124.
2023-12-07 12:42:08 +01:00
Mark Payne 1d06185f13
NIFI-12453 Added cluster-status command to nifi.sh
NIFI-12454 Allow decommissioning cluster node without shutdown

This closes #8100

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 22:12:55 -06:00
Mark Payne a21993ef72
NIFI-12331 Added PublishSlack Processor
- Removed deprecated PutSlack and PostSlack

This closes #8120

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 15:10:12 -06:00
dan-s1 ab8a82b997
NIFI-12410 Support EL for Starting Row in ExcelReader
This closes #8119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 08:56:00 -06:00
Peter Turcsanyi 8645088e1d
NIFI-12412 Support Proxies for Blob Checkpoints in ConsumeAzureEventHub
This closes #8107

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 08:23:59 -06:00
Pierre Villard d0dd4e03e0
NIFI-12427 Add channel name attribute to ConsumeSlack
This closes #8078

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-05 07:42:54 -06:00
Matt Burgess eeb2b1a644
NIFI-12318: Fixed byte array generation in GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8109.
2023-12-05 14:41:22 +01:00
mr1716 d1c7e6c6b8
NIFI-12466 Upgraded MongoDB Driver from 4.10.2 to 4.11.1
This closes #8118

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:09:03 -06:00
mr1716 d6bac808ba
NIFI-12465 Upgraded mysql-binlog-connector-java from 0.28.1 to 0.28.3
This closes #8117

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:08:21 -06:00
mr1716 29dda4208a
NIFI-12463 Upgraded maven-artifact from 3.8.5 to 3.8.8
This closes #8115

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-04 17:03:38 -06:00
exceptionfactory 456cf7d88d
NIFI-12451 This closes #8104. Removed Bootstrap Notification Services
- Refactored Security Property handling and bootstrap certificate generation
- Removed unnecessary dependencies from nifi-bootstrap
- Removed unnecessary and unused settings from bootstrap.conf

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-04 15:09:45 -07:00
Mark Payne 283abadf97
NIFI-12457: Added additional use case based documentation and fixed some typos/made some clarifications in related docs
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8108.
2023-12-04 14:59:53 +01:00
Mark Bathori 7770a17a6c
NIFI-11992: Processor and sink service for filing tickets in Zendesk
This closes #7644.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-12-04 09:42:36 +01:00
Matt Gilman 387a101931
NIFI-12425: Controller Service Listing (#8091)
* NIFI-12425:
- Controller Service Listing.
- Adding lazy loading to the Canvas with the introduction of the Controller Service listing.
- Reorganizing existing components in the Flow Designer.
- Allowing the current Process Group to be configured.
- Inline Service creation.

* NIFI-12425:
- Removing unused imports.

This closes #8091
2023-12-01 13:50:30 -05:00
Matt Gilman d40bb3eda6
NIFI-12419: (#8097)
- Applying a copy of the nifi-web-frontend rat config in the parent module when the new ui profile is not activated. Previously, if the new ui profile was not activated, the rat check would fail.

This closes #8097
2023-12-01 12:58:46 -05:00
exceptionfactory 2ac3988881
NIFI-12448 Removed InfluxDB Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8093.
2023-12-01 16:21:20 +01:00
mr1716 d7cb4a4b1c
NIFI-12440 Upgraded HikariCP from 5.0.1 to 5.1.0
This closes #8089

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:55:12 -06:00
Sebastian Rothbucher 685700ad7c
NIFI-11129 Added PutMongoBulkOperations Processor
This closes #6918

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:36:44 -06:00
EndzeitBegins edca4cd347 NIFI-12386 Adds processor FilterAttribute
attribute uuid is not removed by removeAttribute(s) in MockProcessSession

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8049
2023-11-30 19:21:08 +00:00
mr1716 0430974783
NIFI-12436 Upgraded datafaker from 2.0.1 to 2.0.2
This closes #8084

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:45:26 -06:00
mr1716 6255a98b22
NIFI-12430 Upgraded unboundid-ldapsdk from 6.0.9 to 6.0.10
This closes #8080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:42:10 -06:00
Rob Fellows d14686cb3a
[NIFI-12415] Counters (#8077)
* [NIFI-12415] Counters page
* populate counter the table.
* support counter reset.
* filtering by name and by context
* sorting, including initial sort
* added basic tests

* Formatted with Prettier

* review feedback - removing unused things.

* align mat-table usage to a common style

* disable the Counter menu item if the user doesn't have counterPermissions.canRead

This closes #8077
2023-11-29 18:00:28 -05:00
Matt Gilman 05575364a3
NIFI-12417: Process Group Configuration (#8075)
* NIFI-12417:
- Process Group Configuration.
- Removed unnecessary module imports.

* NIFI-12417:
- Addressing review feedback.

This closes #8075
2023-11-29 17:21:35 -05:00
Matt Gilman ebfb5bc12e
NIFI-12401: Allow combo editor to reference parameters (#8068)
* NIFI-12401:
- Allow combo editor to reference parameters.

* NIFI-12401:
- Addressing review feedback.
- Handling corner cases where there is no parameter context and where there are no parameters in a bound parameter context.

* NIFI-12401:
- Fixing formatting issues.

This closes #8068
2023-11-29 12:26:25 -05:00
dan-s1 9154b708cc
NIFI-12404 Added documentation indicating this controller service does not resolve YAML aliases.
This closes #8070.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2023-11-29 11:21:18 +01:00
dan-s1 e61665675b
NIFI-12416 Relocated the additionalDetails.html to the appropriate bundle in order for it to be seen when generating the documentation.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8067.
2023-11-28 18:36:54 +01:00
mr1716 1a7790b4a1
NIFI-12423 Update iotdb.sdk.version to 1.2.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8074.
2023-11-28 18:28:41 +01:00
mr1716 df33ca04a9
NIFI-12422 Update excel-streaming-reader to 4.2.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8073.
2023-11-28 18:25:53 +01:00
mr1716 0311221eb9
NIFI-12421 Update metrics-core to 4.2.22
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8072.
2023-11-28 18:22:31 +01:00
Rob Fellows 4bba7e6188
[NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. (#8069)
* [NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. Also update the ci-workflow.yaml to activate that profile.

* add the profile activation to the Maven Build command

This closes #8069
2023-11-27 20:18:31 -05:00
Matt Gilman b3b6d72924
NIFI-11481: Initial migration to Angular 16 (#8053)
* NIFI-11481:
- Initial project creation.

* NIFI-11481:
- Install material.
- Rename project from nifi-web-frontend to nifi.

* NIFI-11481:
- Install roboto through package.json.

* NIFI-11481:
- Add Tailwind.

* NIFI-11481:
- Basic layout.

* NIFI-11481:
- Introducing ngrx for storing flow.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.
- Adding draggable.
- Adding editable.
- Adding selectable.
- Adding flowfont.
- Adding Canvas View.
- Adding Transform in Store.
- Adding selected in Store.
- Adding transition in Store.
- Funnel Manager directly subscribes to store.

* NIFI-11481:
- Adding backend calls.
- Refactoring update positions to be for a single component.

* NIFI-11481:
- Process Group Manager.
- Adding font-awesome.
- Updating canvas/graph component visibility.
- Adding prettier/eslint.

* NIFI-11481:
- Adding support to enter a process group.

* NIFI-11481:
- Formatting source.

* NIFI-11481:
- Label Manager.
- Added generic update component.

* NIFI-11481:
- Processor Manager.

* NIFI-11481:
- Port Manager.

* NIFI-11481:
- Remote Process Group Manager.

* NIFI-11481:
- Adding draggable icons to the toolbar.

* NIFI-11481:
- Formatting.

* NIFI-11481:
- Draggable Toolbar.
- Create Label, Funnel.

* NIFI-11481:
- Connection Manager.
- Connectable Behavior.

* NIFI-11481:
- Draggable behavior with back end call for both components and connections.

* NIFI-11481:
- Selection box.

* NIFI-11481:
- Port creation.
- Port configuration.
- Quick Select.

* NIFI-11481:
- Canvas Tooltips.

* NIFI-11481:
- Context menu.

* NIFI-11481:
- Router State.
- Reorganization.
- Deep linking.

* NIFI-11481:
- Adding support for Delete.

* NIFI-11481:
- Flow status bar.

* NIFI-11481:
- Adding Current User State.
- Current user polling.
- Fixing Flow Status layout bug.

* NIFI-11481:
- Process Group Polling.

* NIFI-11481:
- Process Group Breadcrumbs.

* NIFI-11481:
- Global Menu.

* NIFI-11481:
- Search.

* NIFI-11481:
- Add support for centering components on the canvas.

* NIFI-11481:
- Add support for persisting and restoring the users view of the current PG.

* NIFI-11481:
- Fixing centering behavior.
- Fixing user view restoration.
- Bulk selection auto fit.

* NIFI-11481:
- Incorporating the new UI into the NiFi build with a build profile that is not active by default.
- The new UI is deployed to a different context path than the current UI and works side by side.

* NIFI-11481:
- Center component from context menu.
- Enter process group from context menu.

* NIFI-11481:
- Adding support to log in.
- LoginFilter, LogoutFilter.
- Moved the handling of 'include-new-ui' profile to make building with and within more straight forward.
- Splash screen while guard executing.
- Http request interceptor to show loading on the canvas.
- Http request interceptor to handle 401 responses.

* NIFI-11481:
- Extension Creation Component.
- Filter, Usage Restrictions, and selected type.

* NIFI-11481:
- Stopping polling when unable to connect to server.

* NIFI-11481:
- Settings - General.

* NIFI-11481:
- Settings - Management Controller Services.

* NIFI-11481:
- NiFi Tooltip directive.
- Usage Restriction Tip.
- Comments Tip.
- Validation Errors Tip.
- Bulletins Tip.

* NIFI-11481:
- Settings - Reporting Tasks.

* NIFI-11481:
- Avoiding unnecessary web requests in route guards.

* NIFI-11481:
- Edit Controller Service Dialog.
- View Property Table.
- Update component density.

* NIFI-11481:
- Supports Controller Service API tooltip and dialog content.

* NIFI-11481:
- Property table - NF Editor.
- Property table - Combo Editor.

* NIFI-11481:
- Making property table a control value accessor.
- Wiring up saving Controller Services from Edit Dialog.
- Handling Delete Property.
- Handling New Property.
- Updating how form submission is triggered throughout to address issue with incidental form submit events.

* NIFI-11481:
- Moving Settings into pages.

* NIFI-11481:
- Moving Canvas into pages.

* NIFI-11481:
- Moving Login into pages.

* NIFI-11481:
- Adding routing to the Controller Service listing and Reporting Task listing.
- Updating Canvas routing to follow similar pattern.

* NIFI-11481:
- Controller Service references.

* NIFI-11481:
- Create inline Controller Service.
- Edit Controller Service route.
- Go To Controller Service from Property Table.
- Switching to Event Emitter in New Property dialog.

* NIFI-11481:
- Saving spinner - Create Processor, Create Port, and Edit Port.

* NIFI-11481:
- Saving spinner - Create Controller Service, Edit Controller Service, and Create Reporting Task.

* NIFI-11481:
- Parameter Context Listing.
- Add new Parameter Context.
- Edit Parameter Context.

* NIFI-11481:
- New Paramter.
- Edit Parameter.
- Parameter table.

* NIFI-11481:
- Parameter references.
- Parameter Context update steps.
- Bound Process Group references.

* NIFI-11481:
- Parameter Context Inheritance.

* NIFI-11481:
- Processor configuration.
- Ensuring new Property names are unique.
- Trapping focus in nf and combo editors.
- Reloading component connections after updating a Processor.

* NIFI-11481:
- Navigation Control.
- Birdseye.
- Operation Control.

* NIFI-11481:
- Create Process Group.
- Upload Process Group.

* NIFI-11481:
- Implementing current Process Group context in operation palette.

* NIFI-11481:
- Connection creation.

* NIFI-11481:
- Connection configuration.

* NIFI-11481:
- Standardizing selection option model.
- Connection load balancing tooltip.
- Clean up.

* NIFI-11481:
- Move components in to/out of groups.
- Group components.

* NIFI-11481:
- Render connections for component action.

* NIFI-11481:
- CodeMirror for Parameter and EL configuration.

* NIFI-11481:
- Resizable.
- Moving tooltip directive.

* NIFI-11481:
- Ensuring all specs are bootstrapped and create successfully.

* NIFI-11481:
- Updating some interface names to avoid conflicting with various components in an attempt to better establish a naming convention.

* NIFI-11481:
- Show Source/Destination.
- Defaulting current Parameter Context in Create PG and Group dialogs.
- Handling disabled state in a few ControlValueAccessors.
- Ensuring Parameter Contest uri is set.
- Unit tests.

* NIFI-11481:
- Fixing checkstyle issue.

* NIFI-11481:
- LICENSE/NOTICE.

* NIFI-11481:
- RAT Plugin config.

* NIFI-12401:
- Addressing review feedback.

* NIFI-11481:
- Ensuring the option is disabled when there is no description.

* NIFI-11481:
- Only including parameters in the payload when they have been modified.
- Showing appropriate message after applying based on whether parameters were included or not.

* NIFI-11481:
- Fixing parameter deletion.
- Enforcing parameter name uniqueness.
- Preventing changing parameter sensitive.

* NIFI-11481:
- Only loading the service link once when considering updated property value.
- Ensuring existing parameter are set in all instances of opening the new Property dialog.

* NIFI-11481:
- Fixing tests that regressed.

* NIFI-11481:
- Adding default karma config which was needed in order to debug tests in IDE.

* NIFI-11481:
- Updating karma config to not watch for now. Can introduce new options for running in various contexts in the future.

This closes #8053
2023-11-27 10:39:51 -05:00
exceptionfactory 00fd7d7cca NIFI-12361-RC6 prepare for next development iteration 2023-11-22 18:35:27 -06:00
exceptionfactory 49fa0d8674 NIFI-12361-RC6 prepare release nifi-2.0.0-M1-RC6 2023-11-22 18:35:26 -06:00
David Handermann 50efc55df6
NIFI-12403 Improve Jolt UI Parameter Processing (#8060)
* Improved Jolt UI Parameter Processing

* Changed double quotes to single quotes per review

This closes #8060
2023-11-22 14:37:02 -05:00
Mark Payne d0c7ebb196
NIFI-11671: Allow FlowFile attributes to be referenced in SQL for JoinEnrichment
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8059.
2023-11-22 14:37:18 +01:00
exceptionfactory 6617fe8fe2
NIFI-12384 This closes #8044. Upgraded Registry to Spring Framework 6
- Upgraded Spring from 5.3.30 to 6.0.13
- Upgraded Spring Boot from 2.7.16 to 3.1.5
- Upgraded Spring Security from 5.8.7 to 6.1.5
- Upgraded Jetty from 10.0.18 to 11.0.18
- Upgraded Servlet API from 3.1.0 to 5.0.0
- Upgraded JAX-RS from 2.1.1 to 3.1.0
- Upgraded Jersey from 2.41 to 3.1.3
- Upgraded JAXB from 2.3.2 to 4.0.4
- Upgraded Java Validation from 2.0.1 to 3.0.2
- Upgraded Flyway from 8.5.13 to 9.22.3
- Upgraded ASM from 9.3 to 9.6 for Java 21
- Upgraded NiFi Toolkit CLI to JAX RS 3 and Jersey 3
- Set Jersey 3 and JAX RS 3 dependency versions in nifi-flow-registry-client-bundle to align with updates to nifi-registry-client classes

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-21 09:06:51 -07:00
exceptionfactory e5e76d0161
NIFI-12393 Upgraded OWASP Check from 8.4.2 to 8.4.3
- Upgraded Azure SDK BOM from 1.2.17 to 1.2.18
- Upgraded Reactor Netty HTTP from 1.0.34 to 1.0.39 for Azure Identity
- Upgraded MSAL4J from 1.13.10 to 1.14.0
- Upgraded Box Java SDK from 4.4.0 to 4.6.1
- Relocated Apache Ant managed versions to bundle parent modules
- Added okio-fakefilesystem to managed dependencies
- Suppressed vulnerability for Picocli misidentified as LINE library
- Added managed dependencies to nifi-code-coverage to avoid false positives due to different parent modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8054.
2023-11-21 12:16:12 +01:00
exceptionfactory d5c7fcb5dd
NIFI-12392 Corrected Component Documentation NAR Unpacking
- Corrected component documentation directory comparison for finding bundled documentation in a JAR
- Added unit test for unpacking of component documentation from JAR included in NAR

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8052.
2023-11-20 14:55:42 +01:00
Matt Burgess e81d7254ec
NIFI-12389: Add variance and standard deviation to AttributeRollingWindow
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8048.
2023-11-20 11:23:51 +01:00
Zoltan Kornel Torok 63364687d8 NIFI-12383 Replication client should handle accept encoding with lowercase
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #8043
2023-11-17 08:02:07 +01:00
Joseph Witt 9cfdebc3e8
NIFI-12378 Removed Jython
This closes #8040

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
mr1716 a3983ae248
NIFI-12380 Upgraded Iceberg from 1.4.0 to 1.4.2
This closes #8039

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Ferenc Gerlits ceeb0deb3d
NIFI-12381 Fixed CR and LF documentation in SplitText
This closes #8041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Bryan Bende 1cc346b63d
NIFI-12368 Clear versionedComponentId for copied Snippets
This closes #8025

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:52 -06:00
Mark Payne e1942a8346
NIFI-12374: Added use case based documentation to explain how to perform incremental / full loads from databases
This closes #8030

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 19:28:10 -06:00
Mark Payne b5c3e6f9aa
NIFI-12358 Fixed NPE in HostHeaderHandler
Fixed NPE in ThreadDumpTask and TrackedLeaderElectionManager

This closes #8032

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 16:57:18 -06:00
Matt Burgess 685c6861b3
NIFI-12376: Fix logic error with bitwise operator in AvroReader
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8034.
2023-11-15 22:55:56 +01:00
exceptionfactory 76a27b0ad8
NIFI-12375 Removed maxFileSize from non-applicable policies in Logback
- Removed the non-applicable maxFileSize from TimeBasedRollingPolicy configurations in default logback.xml files to avoid warnings on shutdown

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8033.
2023-11-15 22:36:34 +01:00
exceptionfactory 9b6120187a
NIFI-12373 Added LICENSE and NOTICE for nifi-standard-shared-nar
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8029.
2023-11-15 20:36:38 +01:00
EndzeitBegins 6c333cdb7e
NIFI-1874 Added Character Set Detection to IdentifyMimeType
NIFI-4550 New Processor not required based on improvements to IdentifyMimeType

- Added mime.charset FlowFile attribute when not null for text MIME types

This closes #8011

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 09:11:30 -06:00
exceptionfactory 5815d83207
NIFI-12370 Fixed Distributed Map Cache Client Service Shutdown
- Moved EventLoopGroup from CacheClientChannelPoolFactory to DistributedCacheClient to enable closing the EventLoopGroup after closing the ChannelPool

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8027.
2023-11-15 08:28:39 +01:00
mr1716 e0527a81bb
NIFI-12364 Upgrade snowflake-ingest-sdk to 2.0.4 and snowflake-jdbc to 3.14.3
This closes #8022.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-11-14 22:07:05 +01:00
mr1716 db827b88b2
NIFI-12360 Upgraded brotli4j from 1.12.0 to 1.13.0
This closes #8020

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:58:08 -06:00
mr1716 2c00d73ce9
NIFI-12359 Upgraded json-schema-validator from 1.0.86 to 1.0.87
This closes #8019

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:56:46 -06:00
mr1716 d98ba74504
NIFI-12356 Upgraded icu4j from 73.2 to 74.1
This closes #8018

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:19:01 -06:00
mr1716 44f62c9b29
NIFI-12355 Upgraded AMQP Client from 5.19.0 to 5.20.0
This closes #8017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:17:25 -06:00
mr1716 0c4de923ba
NIFI-12353 Upgraded json-flattener from 0.16.4 to 0.16.6
This closes #8014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:16:06 -06:00
Mike Thomsen 6447aea258
NIFI-11788 Modified APP_FILE logback configuration to have better cleanup
NIFI-11788 Standardized Logback maximum settings
- Set MiNiFi maxHistory to 10 and totalSizeCap to 10MB
- Set NiFi maxHistory to 30 and totalSizeCap to 3GB except for deprecation log
- Set Stateless maxHistory to 30 and totalSizeCap to 3GB
- Set Registry maxHistory to 30 and totalSizeCap to 3GB
NIFI-11788 Increased MiNiFi maxFileSize to 10MB and cap to 100MB

This closes #7465. Coauthored by David Handermann and Mike Thomsen

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-13 09:48:40 -07:00
Paulette Hines-Cross pliszle 93d373f037
NIFI-12107 Fixed sorting in the cluster table
This closes #7923

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 08:37:29 -06:00
Joe Gresock ec884ac091
NIFI-12212 Upgraded DynamoDB Processors to AWS SDK 2
This closes #7911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:30:30 -06:00
mr1716 582c3ac7cc
NIFI-12347 Upgraded AWS Kinesis from 2.5.2 to 2.5.3
This closes #8007

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:28:11 -06:00
mr1716 246ffe4ee9
NIFI-12346 Upgraded Apache Calcite from 1.35.0 to 1.36.0
This closes #8009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:27:07 -06:00
mr1716 4a4eb2c109
NIFI-12345 Upgraded Commons DBCP from 2.10.0 to 2.11.0
This closes #8006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:25:57 -06:00
Umar Hussain 4f4e99085d
NIFI-11995 Added Header Format configuration to ConsumeAMQP
This closes #7652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:32:13 -06:00
Pierre Villard eb7d49cdff
NIFI-12344 PutKudu Operation should accept Debezium Types
This closes #8004

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:02:55 -06:00
Pierre Villard 279084ddfe
NIFI-12233 Added Parameter Provider for 1Password
This closes #7884

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 11:57:16 -06:00
David Handermann dabdf94bf1
NIFI-12339 Fixed Property Decryption for Migrated Components (#8002)
- Updated StandardVersionedComponentSynchronizer to decrypt properties when creating extension references for subsequent migration
2023-11-10 11:50:03 -05:00
Mike Moser 832d4455c1
NIFI-12121 Added Transform Result Filter to JSLTTransformJSON
This closes #7922

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 10:37:17 -06:00
Mark Payne aff4e5fd1b
NIFI-12340: Only call PythonBridge.onProcessorRemoved for python based processors, not all processors. Do so in a background virtual thread. Also specified explicit versions for openai dependencies to ensure correctness, since the newly released 1.x is not yet compatible with the latest langchain
This closes #8001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 08:41:53 -06:00
exceptionfactory 3dcfc919bb
NIFI-12261 Added Schema Reference Reader and Writer Services (#7991)
- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
2023-11-08 08:55:58 -05:00
markap14 8b0abd45df
NIFI-12330: When synchronizing flow, pause component scheduling until after property migration has completed (#7994) 2023-11-07 16:46:27 -05:00
Malthe Borch 0fe9d2b56f
NIFI-9972 Added CopyAzureBlobStorage_v12 Processor
This closes #6941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 13:13:25 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:07:59 -06:00
Bryan Bende 940c9276c5
NIFI-12323 Removed String Length Limits from JSON Flow Configuration
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow

This closes #7985

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:03:13 -06:00
exceptionfactory a89fb17f9f
NIFI-12328 Updated OpenPGP test Key Generator Settings
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7992.
2023-11-07 13:03:07 +01:00
exceptionfactory b50557b854
NIFI-12321 Avoid Exceptions when removing Python Processors (#7984)
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
2023-11-06 16:17:41 -05:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 12:01:49 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
lehelb 21387316e3
NIFI-10222 Added Apicurio Schema Registry Service
This closes #7913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 15:30:08 -05:00
exceptionfactory 309061ca2d
NIFI-12310 Validate Python Component Type for Processes (#7972)
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
2023-11-03 14:42:08 -04:00
lehelb 514c8d8a6a
NIFI-12314 Fix EL for SQL Query Property in QueryNiFiReportingTask
This closes #7976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:34:01 -05:00
Nissim Shiman ed9b23ef3f
NIFI-12315 Resolved issue preventing PG from being imported from
Registry

- Corrected component property reference in sorting of response objects

This closes #7977

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:33:10 -05:00
Joe Gresock 77834c92df
NIFI-12263 Upgraded AWS Machine Learning processors to SDK 2
This closes #7953

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:05:22 -05:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 754baf0a37
NIFI-12308: Create Python Environment in background thread instead of during Processor creation
This closes #7971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 15:45:43 -05:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00
exceptionfactory 945d8b54bc
NIFI-12294 Standardized NAR Entry Loading (#7958)
- Consolidated duplicative NAR file entry normalization
2023-11-01 14:10:00 -04:00
Paul Grey 75c661bbbe
NIFI-12194 Added Yield on Exceptions in Kafka Processors
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers

This closes #7955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:08:44 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
Mark Payne 9b33d54f53
NIFI-12301 Corrected hasProperty() check when Migrating Properties
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties

This closes #7964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:41:51 -05:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-31 14:20:50 -05:00
dependabot[bot] 5c98b7cce0
NIFI-12295 Upgraded ActiveMQ Client from 5.18.2 to 5.18.3
This closes #7956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-30 17:34:59 -05:00
exceptionfactory 786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
nathluu 8e301cfdef
NIFI-12265 Fixed OpenPGP Hexadecimal Key Formatting with leading 0
- Replaced Long.toHexString() with String.format() using pattern with leading 0

This closes #7926

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 15:48:18 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-28 09:23:23 -07:00
Mark Bathori b2c4baf429
NIFI-12277 Added SSLContextService to Slack Processors
This closes #7936

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 20:51:50 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Mark Bean 5ecc12f405
NIFI-12285 Added py4j.url build property
The py4j.url property allows the URL for downloading py4j to be specified by a Maven command-line option

This closes #7946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:25:53 -05:00
Matt Burgess 880770f992
NIFI-12273 Fixed command.argument references in ExecuteStreamCommand docs
This closes #7941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:52:26 -05:00
Pierre Villard 1d125e9906
NIFI-11677 Removed non required yield in DeleteHDFS
This closes #7937

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:50:59 -05:00
Pierre Villard 1df9738f8f
NIFI-12281 Fix Go To in Parameter Providers to Provider Context
This closes #7939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 19:39:10 -05:00
Mark Bathori 4fa0299f8b NIFI-12130: Ability to configure snapshot properties via dynamic attributes in PutIceberg
Fix dynamic field expression language handling

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7849
2023-10-26 19:26:24 -04:00
lehelb a3e4f89fe3
NIFI-12271 Fix PutAzureBlobStorage_v12 rollback on failure with FileResourceService
This closes #7930

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 14:52:15 -05:00
Shane Ardell c4ff8de412
NIFI-12260: Remove templates from frontend (#7924)
* remove templates from frontend

* remove more references to removed files

* removing more template references

* remove unused css template styles
2023-10-26 15:16:14 -04:00
exceptionfactory 2eb5b79353
NIFI-12275 Disabled Keepalive in SFTP Tests
This closes #7932

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:28:02 +01:00
Mike Moser 9eb2038585
NIFI-12038 add UseCase documentation to PackageFlowFile
This closes #7896

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:00:55 +01:00
exceptionfactory f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 19:54:27 +01:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925)
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
2023-10-25 13:22:26 -04:00
Mark Payne 19993783e1
NIFI-12203: Ensure that when inheriting cluster flow on startup, we remove any Controller Services, Reporting Tasks, Parameter Contexts, etc. that are not in the proposed flow. Also removed overly aggressive timeout from RunOnceIT and performed minor code cleanup
Resolves #7907

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-24 10:45:58 -05:00
Mark Payne a44b633252
NIFI-12220 Added ability to create Controller Services from migrateProperties
- Added ability to get raw property values from PropertyConfiguration instead of just effective values
- Updated TestRunner to allow for testing these migration methods
- Auto-enable newly created controller services if they are valid
- Eliminated Proxy properties in all AWS processors and instead just make use of the Proxy Configuration controller service
- Eliminated authentication properties from AWS processors and migrated all processors to using Controller Service or authentication

This closes #7874

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-24 09:14:19 -05:00
Mark Payne 1d5f2f626b NIFI-12245: Removed deprecations around flow registry clients
NIFI-12245: Removed null check that is no  longer necessary

NIFI-12245: Fixed checkstyle violation

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #7899
2023-10-24 14:08:03 +02:00
exceptionfactory dc5cd92aa8
NIFI-12264 Upgraded Apache Tika from 2.9.0 to 2.9.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7921.
2023-10-24 11:03:32 +02:00
dan-s1 4b95129f96
NIFI-11197 Added YamlTreeReader
- Adjusted JsonTreeReader implementation for sharing common Jackson components

This closes #7665

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-23 14:37:40 -05:00
dan-s1 7f7e3f0e7a
NIFI-12165 Changed the properties "Custom Transformation Class Name" and "Custom Module Directory" to depend on the "Jolt Transformation DSL" property when its value is "Custom"
This closes #7890

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-23 18:13:20 +01:00
exceptionfactory fc6677153f
NIFI-12259 Upgraded Apache Santuario from 2.3.3 to 2.3.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7916.
2023-10-23 10:28:57 +02:00
exceptionfactory f352857e42
NIFI-12243 Refactored encrypt-config using picocli
- Replaced Groovy implementation with Java classes
- Added StandardEncryptConfig and RegistryEncryptConfig command implementations
- Added FileTransformer interface with implementations for configuration files
- Changed -A to -u for output authorizers.xml when targeting Registry
- Removed --newFlowProvider option not used
- Removed --translateCli option
- Removed --decrypt option

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7901.
2023-10-22 04:54:45 -04:00
annanys23 6daf0abfd4
NIFI-5137 Fixed the path to Controller Service grid item's state
This closes #7833

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-21 20:05:10 -05:00
markobean 63a2503fc3
NIFI-11874 update Process Group configuration layout in the UI (#7591)
* NIFI-11874 update Process Group configuration layout in the UI

* NIFI-11874: relocate checkbox for recursive application of paramenter context

* NIFI-11874 remove comments tab from process group configuration

* NIFI-11874 minor cleanup of float CSS for process-group-parameter-context-combo

This closes #7591
2023-10-21 10:09:29 -04:00
exceptionfactory f9615414bd
NIFI-12258 Upgraded MINA SSHD from 2.10.0 to 2.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7915.
2023-10-20 18:22:07 +02:00
Mark Payne 40ac38dfe3 NIFI-12242: Added ability to route data that exceeds the configured threshold in ControlRate to be routed to 'rate exceeded' instead of just staying in the queue. Added Use Case documentation to ControlRate.
This closes #7895

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-20 15:19:04 +00:00
Bryan Bende fd2de5a151
NIFI-12198 Add API and CLI commands to import reporting task snapshots (#7875)
* NIFI-12198 Add API and CLI commands to import reporting task snapshots
2023-10-20 10:45:48 -04:00
Pierre Villard 184757fede
NIFI-12230 Add configurable Log Level for IP not found in GeoEnrichIP
NIFI-12253 Route to not found relationship instead of rolling back in GeoEnrichIPRecord

This closes #7909

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-20 08:58:07 -05:00
Chris Sampson 6c7d02e22e
NIFI-12254 clarify Bulk operation header documentation for PutElasticsearchRecord and PutElasticsearchJson processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7912.
2023-10-20 12:04:16 +02:00
Matt Gilman 9e5892780a
NIFI-12167:
- Renaming Usage to View Documentation.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7904.
2023-10-20 11:34:29 +02:00
exceptionfactory 15c3bdeac1
NIFI-12252 Removed Legacy FileAuthorizer
- Removed Legacy Authorized Users File property from FileUserGroupProvider
- Removed unused methods from FileAccessPolicyProvider and FileUserGroupProvider

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7910.
2023-10-20 10:31:48 +02:00
Matt Gilman 98eef74dd8
NIFI-12250: (#7908)
- Fixing issue where the registry configuration dialog was being initialized twice.
2023-10-19 15:53:07 -04:00
Mark Payne 015b721800
NIFI-7643 Removed absolute.path attribute from UnpackContent
- Do not include the absolute.path attribute from Zip/Tar files in UnpackContent; some code cleanup

This closes #7902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:51:27 -05:00
Mark Payne 8bfb6be5ba
NIFI-4172: Renamed ClusteSummaryEntity to ClusterSummaryEntity
This closes #7900

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:46:18 -05:00
Matt Gilman 97dfe2d812
NIFI-11909 Cleared Password field after login
- Clearing the password in the login form when login fails or unable to verify access once authentication succeeds.

This closes #11909

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:40:27 -05:00
Matt Gilman f2822a6bfb
NIFI-12247: (#7905)
- Reverting to the initial value if there is no selected parameter in the combo editor.
2023-10-19 14:25:06 -04:00
Matt Gilman dc76d3896d
NIFI-12248: (#7906)
- Fixing arrow alignment in combo editor.
2023-10-19 13:56:55 -04:00
Chris Sampson aac71c5aa1 NIFI-8135 allow CHOICE data types in conversion of Records to Java Maps
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7746
2023-10-19 13:13:58 -04:00
András Kovács d4014c71ee
NIFI-12099 Repurpose Template icon in top left bar (#7811)
This closes #7811
2023-10-19 12:16:34 -04:00
Pierre Villard 814e94b2ac
NIFI-12244 - UpdateRecord invalid because of migrateProperties (#7898) 2023-10-19 09:34:55 -04:00
Gabor Gyimesi 91e4b453b4
NIFI-12238 Fix SplitText endline trimming with max fragment size (#7892) 2023-10-18 12:40:52 -04:00
exceptionfactory 574c2b2168 NIFI-12234 Upgraded SSHJ from 0.35.0 to 0.37.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7886
2023-10-17 02:10:51 -04:00
Shane Ardell e2bbcac8e1 This closes #7810
NIFI-12088: recalculate hidden property fields when new service is created

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2023-10-16 16:52:45 -04:00
exceptionfactory 20283fd7ec
NIFI-12235 Upgraded Solr from 9.3.0 to 9.4.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7887.
2023-10-16 19:42:13 +02:00
Mark Payne cbdf32ab79
NIFI-12205: Moved loading of Python dependencies into background thread when processor created instead of during startup. Some code cleanup.
This closes #7863

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-14 15:05:17 -05:00
exceptionfactory 61c856a54c
NIFI-12122 Corrected test for Parameter Context updating
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-13 22:55:53 -05:00
Zackeus Bengtsson 0a47157640
NIFI-12122 Fixed persistence of Parameter Context descriptions
Fixed bug where parameter context descriptions were not loaded on NiFi startup and overwritten as empty

This closes: #7787

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-13 18:30:50 -05:00
Mark Payne 3ae0eedee6
NIFI-12124: This closes #7791. Added a new RenameRecordField processor. In testing, also noticed that the Descendant Wildcard operator (//*) and Descendant Field Path Operator (//name, for instance) did not properly account for array of records or map elements, so addressed those concerns.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 14:02:55 -07:00
Mark Payne f4ae292a45
NIFI-12221: This closes #7876. Be more lenient about which Disconnection Codes we allow a node to be reconnected to a cluster vs. when we notify the node to disconnect again. Also updated the timeout for OffloadIT because it occasionally times ou out while running properly.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 13:59:05 -07:00
Mark Payne 0eabbcdf19
NIFI-12228: This closes #7881. Fixed issue with FlowFile Concucrrency that can occasionally bring in more data than it should.
Code cleanup, fixing logback to avoid INFO-level stack trace from xodus

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 13:36:09 -07:00
Bryan Bende 96eb1d825a
NIFI-12222 Protect against missing parameter context when syncing a PG in component synchronizer (#7877) 2023-10-13 13:51:47 -04:00
exceptionfactory 22ad7d542d
NIFI-12206 Refactor Flow History using JetBrains Xodus (#7870)
* NIFI-12206 Refactored Flow History using JetBrains Xodus

- Replaced H2 Database Engine with JetBrains Xodus for persistent storage of FlowConfigurationHistory
- Added EntityStoreAuditService implementation using Xodus PersistentEntityStore
- Removed nifi.h2.url.append from properties
2023-10-12 14:50:25 -04:00
Mark Payne abfc49e212
NIFI-12139: Implemented migrateProperties, migrateRelationships for processors, as well as migrateProperties for ReportingTasks and Controller Services. Added system tests to verify behavior.
- Ensure that after restoring nars in the lib/ directory we restart NiFi so that they take effect. This is important if this test is not the last one to run

This closes #7837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-12 11:40:18 -05:00
exceptionfactory a849ca044c
NIFI-12218 Removed SensitiveValueEncoder and SecureHasher
- SensitiveValueEncoder and SecureHasher are no longer required following the removal of support for flow.xml.gz

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7873.
2023-10-12 17:39:43 +02:00
levilentz 1a0f509ffc
NIFI-12211: This closes #7868. add Validator.VALID to username/password on TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:38:02 -07:00
Chris Sampson 584b3fc165
NIFI-12214 This closes #7869. ConsumeElasticsearch Query Builder properties do not dependOn the Query Definition Style
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:37:40 -07:00
Mike Moser f2927525f3
NIFI-12213 This closes #7871. add nifi-utils dependency to NARs that do not use nifi-standard-services-api-nar as a parent
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:37:19 -07:00
Joe Gresock 9627c4c0e8
NIFI-12174 Upgraded AWS PutLambda Processor to SDK 2
This closes #7851

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 16:41:39 -05:00
Bence Simon 3f13604c36
NIFI-11772 Removed flow.xml.gz support
- Created NIFI-12203 to evaluate issues with flow comparison surfaced in JoinClusterWithDifferentFlow

This closes #7661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 13:53:01 -05:00
Mark Payne 0fd4ec50ad
NIFI-12144: Eliminated deprecation warnings by moving to newer Amazon SDK APIs. Eliminated several abstract classes that provided no value. Code cleanup. Refactored many of the integration tests to make use of Test Containers. Removed some tests that were incorrect
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7854.
2023-10-10 20:32:49 -04:00
Mark Payne ce2a156b9c NIFI-12140: Updated dependency to include nifi-property-utils in nifi-redis-utils module as a result of merging NIFI-12185 2023-10-10 16:08:26 -04:00
timeabarna d2aec89738
NIFI-12166 Add repo usage to the monitoring endpoint (#7836)
* NIFI-12166 Add repo usage to the monitoring endpoint
2023-10-10 14:55:33 -04:00
Bryan Bende 5a42d7245b
NIFI-12140 Add optional properties to RedisConnectionPoolService for Username and Sentinel Username (#7862) 2023-10-10 14:39:41 -04:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852)
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
2023-10-10 13:55:22 -04:00
Chris Sampson c091347795
NIFI-11985: Add ConsumeElasticsearch processor
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7671.
2023-10-10 06:00:52 -04:00
Nandor Soma Abonyi 87b8f230d2
NIFI-11940 Added SSLContextService to GetSplunk
- Included ClassLoader isolation to work around Splunk Service static configuration limitations

This closes #7668

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 15:59:27 -05:00
mkalavala 2b41b07489
NIFI-6240 Added Proxy Support for WebSocket Transport in Azure EventHubs
This closes #7740

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:19:24 -05:00
dan-s1 66b68140e2
NIFI-12116 Documented lack of NDJSON support in ValidateJson
This closes #7782

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:12:02 -05:00
Chris Sampson 099ceec7ed
NIFI-12153 Added Allow Comments and Max String Length to JSON Readers
This closes #7823

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 10:43:08 -05:00
Bryan Bende ae61ebb5ed
NIFI-12186 Add ability to export a versioned reporting task snapshot (#7853)
* NIFI-12186 Add ability to export a versioned reporting task snapshot
- Add CLI commands and optional query param to specify specific reporting task
2023-10-09 10:50:36 -04:00
exceptionfactory 457973d133
NIFI-12188 Upgraded Commons Net from 3.9.0 to 3.10.0
- Removed ProxyFTPClient extension of standard FTPClient no longer required following changes implemented in NET-650

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7855.
2023-10-09 12:21:23 +02:00
Joe Gresock a584251f0a
NIFI-12189: Upgrading PutCloudwatchMetric to use AWS SDK 2.x
This closes #7857

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-08 18:24:37 +01:00
mr1716 d2fb81d1d6
NIFI-12182 Upgraded AMQP from 5.18.0 to 5.19.0
This closes #7847

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:29 -05:00
mr1716 226bf273a1
NIFI-12179 Upgraded Accumulo from 2.1.1 to 2.1.2
This closes #7843

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:29 -05:00
mr1716 1e5c491433
NIFI-12184 Upgraded Iceberg from 1.3.1 to 1.4.0
This closes #7848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
mr1716 a8b56949d7
NIFI-12183 Upgraded zstd-jni from 1.5.5-5 to 1.5.5-6
This closes #7850

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
mr1716 db0407cda6
NIFI-12181 Upgraded HiveMQ MQTT Client from 1.3.1 to 1.3.3
This closes #7846

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:27 -05:00
Bryan Bende 551625f7bf
NIFI-12149 Create nifi-redis-utils and minor improvements to util methods
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7812.
2023-10-06 15:32:00 -04:00
mr1716 7ddcb91605
NIFI-12171 Upgraded excel-streaming-reader from 4.1.2 to 4.2.0
This closes #7841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:09:58 -05:00
Nissim Shiman 5afda79f28
NIFI-11782 Resolved NPE when moving snippet with label to process group
This closes #7838

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:05:40 -05:00
Lehel Boer 7e4ca9365f NIFI-12092 Add backoff parameters to JettyWebsocketClient reconnect
This closes #7761.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-10-04 18:22:15 +02:00
Mark Payne 711f2f1188
NIFI-12137: This closes #7808. Fixed name of Expression Language Scope from LIMITED to ENVIRONMENT, ; fixed issue in which flowfiles routed to failure by FlowFileTransform were also being routed to original; defined 'identifier' and 'logger' as member variables for FlowFileTransform and RecordTransform so that IDEs know about them
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-04 09:16:04 -07:00
Mark Payne 1d9ccb3857
NIFI-12161: This closes #7829. Ensuring framework threads use lightweight threads instead of a capped thread pool. This prevents framework threads from livelocking in the event enough framework threads are holding threads while those needing to run cannot get them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-04 08:48:12 -07:00
exceptionfactory da4c6f6e25
NIFI-12163 This closes #7835. Improved Syslog 5424 Line Handling
- Eliminated unused parseEvent method signatures from StrictSyslog5424Parser in favor of a single String line method
- Eliminated intermediate conversion from String to byte array and back to String for Syslog Parser

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:26:06 -07:00
exceptionfactory 6394912cce
NIFI-12115 This closes #7830. Added ListenOTLP to collect OpenTelemetry
- Added ListenOTLP Processor supporting OpenTelemetry OTLP 1.0.0 Specification with gRPC and HTTP
- Updated nifi-event-transport to support configurable SSLParameters for configurable Cipher Suites

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:21:15 -07:00
Matt Burgess 3f7b1de6b8
NIFI-11739 - Add ability to ignore missing fields in PutIceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7421.
2023-10-03 14:41:12 +03:00
Tamas Palfy 9c425d273c
NIFI-12131 Fixed potential NPE related to FlowAnalyzer
Revamped RuleViolationsManager and FlowAnalyzer handling to make sure no issue occurs when these are not set. Fix ResourceNotFoundException: When determining the subject permissions for a rule violation the type of the subject is now known, so we try to lookup all possible types. Non-matching tpyes throw a ResourceNotFoundException exception though. Going to ignore those.

This closes #7809

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-02 15:35:05 -05:00
exceptionfactory 19b4be40aa
NIFI-12157 This closes #7826. Removed nifi-logging-utils and NiFiLog
- Replaced NiFiLog references with direct references to SLF4J LoggerFactory

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-02 08:17:51 -07:00
Joe Gresock ff8f1ff686
NIFI-8531: This closes #7529. Upgrading Kinesis processors to AWS SDK 2.x
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 16:26:51 -07:00
levilentz 9228036e1d
NIFI-7355: This closes #7677. TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 11:17:58 -07:00
annanys23 9b9dd4bae3
NIFI-6721: This closes #7789. jms_expiration attribute problem fix
Originally authored in part by sjyang18 <ilsong02@hotmail.com>

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 11:11:56 -07:00
Mark Payne 342fb0d876
NIFI-12143: This closes #7820. Introduced a new nifi-calcite-utils module and refactored the nifi-sql-reporting-tasks to mamke use of it. This uses the newer calcite api instead of deprecated classes/methods
- Refactored QueryRecord / JoinEnrichment to use new nifi-calcite-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 13:28:03 -07:00
exceptionfactory 1561eb2506 NIFI-12155 Upgraded Apache Commons IO from 2.13.0 to 2.14.0
- Upgraded Apache POI from 5.2.3 to 5.2.4

This closes #7825

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-30 16:25:23 -04:00
Emilio Setiadarma a8c1bb1d9c
NIFI-10425 Corrected auto-reloading KeyStore files with symlinks
- Changed StoreScanner scanner instantiation to not report real paths

This closes #7821

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-30 12:28:54 -05:00
Peter Turcsanyi 8c5d85a28d
NIFI-12151 Fixed StandardPrivateKeyService fails due to missing BouncyCastleProvider
This closes #7817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-30 11:01:40 -05:00
Mike Moser e93586df11
NIFI-12038 This closes #7760. introduce PackageFlowFile processor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 08:51:46 -07:00
exceptionfactory c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:56:53 -07:00
exceptionfactory 75c3b19979
NIFI-12142 This closes #7822. Corrected Cluster Pool Size Method Reference
- Set getClusterNodeProtocolMaxPoolSize method reference in place of deprecated getClusterNodeProtocolThreads

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:54:13 -07:00
dan-s1 e9b532bd32 NIFI-12100 Removed the ConvertExcelToCSVProcessor
This closes #7802

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-29 14:09:00 -04:00
Bryan Bende a74c411079 NIFI-12104 Separate a non-atomic Redis DMC implementation from the existing one for use in Put/Fetch DMC when Redis is clustered
This closes #7796

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-29 10:54:16 -04:00
Joe Witt 476f30813d
NIFI-12132 change default content repo archive percentage and age to 90 percent and 3 hours to better align to default user needs (#7797) 2023-09-28 17:32:21 -04:00
Mark Payne 1046fdf79d
NIFI-11938: This closes #7673. Created ConsumeSlack Processor to consume conversation history message events from Slack
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:14:35 -07:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Arpad Boda dbcc223b40 NIFI-12134 - Disable Directory Listing property is duplicated on PutSFTP processor
Signed-off-by: Bejan Csaba <bejan.csaba@gmail.com>

This closes #7798.
2023-09-27 17:44:24 +02:00
Bryan Bende 1ac833654b NIFI-12127 Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath
This closes #7794

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-27 08:48:11 -04:00
Mark Payne 16c527271b
NIFI-11271: This closes #7795. Removed deprecated Kerberos-related properties and updated to make use of KerberosUserService; some code cleanup to bring up-to-date with Java 21 recommendations such as Stream.toList() instead of Stream.collect(Collectors.toList()) and using enhanced switch statements
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-26 10:51:59 -07:00
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
2023-09-26 13:01:13 +02:00
Joseph Witt 81dc36a473
NIFI-12128 updated cassandra, jgit, and netty
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7793.
2023-09-26 11:44:15 +02:00
Matt Burgess e7da2ab5b8
NIFI-11177: Add defensive code for null values for Iceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
2023-09-26 11:30:08 +02:00
Matt Burgess 3f5661232e
NIFI-12024: Add CSV Writer property to CSVRecordSetWriter and a FastCSV writer implementation
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7686.
2023-09-26 11:22:52 +02:00
Peter Turcsanyi 5644fdd725
NIFI-12126: Downgrade snowflake-jdbc to 3.13.33
snowflake-ingest-sdk:2.0.3 is not compatible with snowflake-jdbc:3.14.x

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7790.
2023-09-26 11:07:14 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
exceptionfactory bcc54953c4
NIFI-12120 This closes #7784. Removed Obsolete Framework Integration Tests
- Removed integration tests from org.apache.nifi.integration in nifi-framework-core

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-24 15:48:47 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-09-23 14:02:09 +01:00
Pierre Villard 4b9eb8361c
NIFI-12113 Replaced Validate.notNull() with Objects.requireNonNull()
This closes #7779

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-22 15:18:50 -05:00
Mark Payne 140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 10:47:47 -07:00
exceptionfactory d354c88f57
NIFI-12112 This closes #7778. Removed Unmaintained Components and Modules
- nifi-cybersecurity-bundle
- nifi-html-bundle
- nifi-hl7-bundle
- nifi-metrics-reporting-bundle
- nifi-riemann-bundle
- nifi-tcp-bundle
- nifi-rules-action-handler-bundle
- nifi-rules-engine-service-api

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 09:46:28 -07:00
Mark Payne 713be8b539
NIFI-12101: This closes #7768. Fixed bugs that caused StatelessBasicsIT.testChangeFlowVersion to fail. There were a couple of related issues. Firstly, for Stateless Groups we were not waiting for the group to fully stop before attempting to update the flow but were waiting only for child/descendant groups to stop. This was due to misleading naming in the ProcessGroupUpdateStrategy enum. Renamed enum values to more clearly convey what they mean. Additionally, renamed the enum to more clearly convey what how it is used, since it is used not only for updating groups but also for retrieving groups. Additionally, when waiting for stateless groups to stop, we inadvertently checked the Set of affectedComponents' IDs against Process Group IDs so addressed the logic there and also ensured that we were consistent in setting the AffectedComponentEntity's ProcessGroup (i.e., its ProcessGroupNameDTO) as we were inconsistently setting it across the codebase.
Fixed issue in logic of LocalComponentLifecycle, which was waiting for all PGs to reach desired stateless run schedule, even when the group itself was not stateless

Fixed JavaScript to specify correct value for recursivity when updating process group parameter context
2023-09-22 09:00:52 -07:00
Nandor Soma Abonyi 9ae6921272
NIFI-12095 This closes #7762. Increase default Xmx to 1g
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:48:34 -07:00
exceptionfactory a832b134b1
NIFI-12109 This closes #7774. Removed SpringContextProcessor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:41:52 -07:00
dan-s1 9b591a2fe3
NIFI-12041 Converted Groovy tests to Java in nifi-scripting-processors
This closes #7752

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:45:26 -05:00
Pierre Villard 5405a3b08b
NIFI-12102 Fixed deprecation warnings when instantiating primitive types
This closes #7769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:41:30 -05:00
Nandor Soma Abonyi badbc1aca6
NIFI-12022 Extract verification logic from JMSConnectionFactoryProvider
This closes #7667.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-21 19:24:41 +02:00
exceptionfactory ebe8b9a2e7
NIFI-12033 Added EncryptContentAge and DecryptContentAge Processors
This closes #7676
Signed-off-by: Paul Grey <greyp@apache.org>
2023-09-21 13:00:16 -04:00
Pierre Villard 9c19656f5b
NIFI-12097 Upgraded Snowflake ingest SDK to 2.0.3 and JDBC to 3.14.1
This closes #7764

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:46:19 -05:00
Joseph Witt 4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:38:22 -05:00
exceptionfactory 11d8519914
NIFI-12086 This closes #7757. Removed unused jgit dependency from framework-core
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 14:28:38 -07:00
exceptionfactory 2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 13:54:44 -07:00
Joseph Witt e5894cf943
NIFI-12053 Updated Minimum Build Version to Java 21
- Configured GitHub Workflows with Azul Zulu and Amazon Corretto
- Added bootstrap.conf option for reflective access supporting Hive 3

This closes #7744

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 22:59:59 -05:00
Joe Witt 017b16254b
NIFI-11903 disable if windows (#7566) 2023-09-19 16:22:49 -04:00
Peter Turcsanyi 520840d93b
NIFI-12076 Removed ComponentLog methods with Object[] and Throwable
This closes #7759

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 13:10:19 -05:00
Peter Turcsanyi ac80b9d900
NIFI-11595 StateProvider.replace() supports creating the initial state
- Extracted common logic from setState() and replace() into modifyState()
- Removed redundant code from createNode() because exceptions are handled on the caller side
- NodeExistsException and InterruptedException are handled in setState() and replace()
- Also used KeeperException's subclasses instead of KeeperException.code()

This closes #7324

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 10:06:38 -05:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
Joe Witt cbf5bb98f9
NIFI-12072 moved to StackWalker API elimnating usage of SecurityManager (#7742) 2023-09-16 17:05:22 -04:00
Joe Witt 019e16c728
NIFI-12069 removed nifi grpc bundle and build related config. Cleaned up brittle test check for command line text which varies. (#7739) 2023-09-15 18:15:02 -04:00
Joseph Witt c042a48c86
NIFI-12070 Removed nifi-easyrules-bundle
This closes #7738

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 16:41:06 -05:00
Joseph Witt bd2276260e
NIFI-12051 Upgraded Groovy from 3.0.19 to 4.0.15
- Adjusted Groovy Maven coordinates to org.apache.groovy
- Adjusted build configuration and tests for Groovy 4

This closes #7692

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:38:24 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
Chris Sampson 94bb8aec97
NIFI-12063 Clarified Elasticsearch Query Documentation
Clarify paginated Elasticsearch with SCROLL does not use query parameters from dynamic properties

This closes #7695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 20:01:50 -05:00
Joseph Witt a1fca9b44e
NIFI-12064 Upgraded Maven Plugin versions
This closes #7731

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 19:35:51 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:21:17 -07:00
exceptionfactory 98fa7d0290
NIFI-12060 This closes #7694. Removed Groovy Tests using Spock Framework
- Added org.spockframework to the list of banned dependencies
- Removed several other Groovy tests and associated build profiles

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 11:22:54 -07:00
Justin 7a79e8c01f
NIFI-12037 Update AzureUserGroupProvider to allow configuration of the graph endpoint and API scope to support regional clouds.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7675.
2023-09-14 19:39:03 +02:00
Matt Burgess a7a281c215
NIFI-12023: Add FastCSV parser to CSVReader
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7685.
2023-09-14 19:33:58 +02:00
Mark Payne f27ace1ccf
NIFI-12016: This closes #7662. Allow use of compatible NAR bundles when loading flow from cluster connection; when determining what bundles are compatible, consider not just any bundle if it's the only one but also any bundle whose version matches the framework version so that when NiFi is upgraded, it is handled more gracefully.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 10:29:23 -07:00
exceptionfactory 292b5d18a0
NIFI-12058 This closes #7693. Upgraded Apache Kudu from 1.16.0 to 1.17.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 09:57:37 -07:00
exceptionfactory 591c323f0a
NIFI-12057 Refactored Groovy tests to Java in nifi-lookup-services
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 08:39:00 -07:00
Mark Bathori ea4c2055d6
NIFI-12054: PutIceberg should produce a provenance send event
This closes #7690.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-14 16:53:32 +02:00
Joseph Witt 4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
exceptionfactory 6841aa6e99
NIFI-12047 Added HTTP/2 to Default Application Protocols
- Changed default value of nifi.web.https.application.protocols to include both h2 and http/1.1
- Changed default value of nifi.registry.web.https.application.protocols to include both h2 and http/1.1
- Updated HostHeaderHandler logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7684.
2023-09-14 13:50:01 +02:00
Matt Burgess 24736f6276
NIFI-12011 Added MIME Type to ExecuteStreamCommand and ExecuteProcess
This closes #7660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 16:39:41 -05:00
mr1716 8c68e5d8cc
NIFI-12046 Upgraded box-java-sdk from 4.2.0 to 4.4.0
This closes #7683

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 16:30:02 -05:00
dan-s1 09c1c8b2b3
NIFI-12042 Refactored Groovy test to Java in nifi-mock-record-utils
This closes #7681

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 09:03:51 -05:00
exceptionfactory f0b7775203
NIFI-12040 Upgraded Apache IoTDB from 1.1.2 to 1.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7680.
2023-09-12 10:41:43 +02:00
exceptionfactory 73a2d27b12
NIFI-12039 Upgraded Apache Commons DBCP from 2.9.0 to 2.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7679.
2023-09-12 10:39:07 +02:00
dan-s1 0280497c62
NIFI-11959 Corrected single-line comment handling for Jolt JSON
Added new lines back to the read in JSON spec to allow for single line comments to be parsed correctly and ignored.

This closes #7678

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 17:00:12 -05:00
Timea Barna c30fd9b66d
NIFI-12006 Removed Templates from Framework and UI
This closes #7658

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 14:52:41 -05:00
Pierre Villard 47f4c8ce2e NIFI-12028 - Add s3.region attribute to ListS3 generated flow files
This closes #7672

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-10 12:22:35 -04:00
Matt Burgess 932cfe22a3
NIFI-12010: Handle auto-commit and commit based on driver capabilities in SQL components
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #7663
2023-09-09 11:13:31 +02:00
Peter Turcsanyi 6cffc78ad2
NIFI-12025: Fixed duplicated bulletin messages (#7670) 2023-09-08 13:16:44 -04:00
krisztina-zsihovszki 75cfe21e4c
NIFI-12014 NullPointerException in PutSQL when adding error attributes
This closes #7666.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-05 11:38:14 +02:00
Freedom9339 2b330d9fee
NIFI-10904 Changed the font color for drop down menus to avoid the app… (#7502)
* NIFI-10904 Changed the font color for dropdown menus to avoid the appearance of menu items being disabled

* NIFI-10904 Changed the CSS tag used to set the color of the dropdown menu text

* NIFI-10904 Used a new css class to set the color of dropdown options

* nifi-10904 Changed the css class for create/reference drop down menu items.

Merged #7502 into main.
2023-08-31 09:41:08 -07:00
p-kimberley a9ac8fb707
NIFI-11945 Add Cache Entry Identifier property to DeduplicateRecord
This closes #7603

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-30 16:59:05 -05:00
exceptionfactory 5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
dan-s1 8c045268ba
NIFI-11778 refactored Groovy tests in nifi-elasticsearch-restapi-processors to Java (and JUnit 5)
This closes #7537

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-29 05:56:15 +01:00
Emilio Setiadarma af365414e9
NIFI-11519 Fixed DBCPConnectionPool Sensitive Dynamic Properties
- Added handling for property names marked as sensitive but not having the SENSITIVE prefix for backward compatibility

This closes #7646

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:37:23 -05:00
mr1716 a5ca73b2da
NIFI-12005 Upgraded Apache Ant from 1.10.13 to 1.10.14
This closes #7656

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:16:28 -05:00
mr1716 88a5ac6f0d
NIFI-12003 Upgraded Solr from 9.2.1 to 9.3.0
This closes #7657

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:43 -05:00
mr1716 77ed641ee2
NIFI-12002 Upgraded javax.servlet.jsp-api from 2.3.1 to 2.3.3
This closes #7653

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:00 -05:00
mr1716 5d961eafce
NIFI-12000 Upgraded Hazelcast from 5.3.1 to 5.3.2
This closes #7649

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:13:18 -05:00
mr1716 49dd9ec03f
NIFI-11993 Upgraded Groovy from 3.0.18 to 3.0.19
This closes #7654

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:12:34 -05:00
mr1716 eb6a5a2f47
NIFI-11998 Update spring.data.redis.version to 2.7.15
This closes #7648

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-08-25 23:36:05 +02:00
Mark Bean d1b77018b2
NIFI-11934 Allow FlowFile filename to be sent in header for InvokeHTTP
This closes #7639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:21:28 -05:00
mr1716 bf3c9ed4cb
NIFI-11994 Upgraded socketbroker from 1.0.2 to 1.1.0
This closes #7645

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:15:12 -05:00
Peter Turcsanyi 68983cef42
NIFI-11987: Set read buffer size in PutAzureBlobStorage_v12
Increased the read buffer size in order to avoid OOME due to too many buffer allocations (exceeding vm.max_map_count on Linux).

This closes #7640

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-08-24 15:55:55 +02:00
Nandor Soma Abonyi e9b62f7b83
NIFI-11912 Added Proxy support to StandardOauth2AccessTokenProvider
This closes #7609

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 16:22:42 -05:00
Chris Sampson fb502cdf9a NIFI-11480 add option to group PutElasticsearchRecord errors by Elasticsearch _bulk error type
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7441
2023-08-23 16:00:28 -04:00
Tamas Palfy 1e12800912
NIFI-11978 Fix: NPE when trying to disable Management Controller Service
This closes #7637

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 13:58:58 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
Paul Grey c0c1b386f6 NIFI-11981 - PublishGCPubSub failure / Record-based processing / AVRO
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7638
2023-08-23 14:29:19 -04:00
exceptionfactory 016834efaa NIFI-11976 Removed error log check in TestListenTCPRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7635
2023-08-22 15:16:25 -04:00
dependabot[bot] 680acf89ed
NIFI-11980 Upgraded Apache Ivy from 2.5.1 to 2.5.2
This closes #7633
This closes #7632

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 11:52:48 -05:00
Mark Bean 9432f302c6
NIFI-11877 Added Comments field for Rules in UpdateAttribute
This closes #7541

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 09:49:19 -05:00
Bence Simon 7340bb8153
NIFI-11924 Closing FileSystem after using in HDFSExternalResourceProvider
This closes #7588.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-22 13:18:10 +02:00
Mark Payne baea7ffee9
NIFI-11971: Ensure that when creating a new content claim that we always treat an existing claim length of -1 as 0, to ensure that we never add -1 to our offset
This closes #7631

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 12:07:16 -05:00
Freedom9339 52cc831a2a
NIFI-11303 Added a go-to entry on the right click context menu for th… (#7461)
* NIFI-11303 Added a go-to entry on the right click context menu for the provenance lineage tree to take you to the specified component in the graph

* nifi-11303 Removed unused variable.

Merged #7461 into main.
2023-08-21 09:23:38 -07:00
Emilio Setiadarma 5d90c9c14b
NIFI-9164 Refactored tests in nifi-windows-event-log to JUnit 5
- Used LauncherInterceptor to handle custom class loading

This closes #7623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:12:29 -05:00
mr1716 96ae5252f5
NIFI-11970 Upgraded gRPC from 1.57.1 to 1.57.2
This closes #7628

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:04:11 -05:00
mr1716 83cba2c5ad
NIFI-11969 Upgraded excel-streaming-reader from 4.1.0 to 4.1.1
This closes #7627

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:03:37 -05:00
mr1716 e83fc230ac
NIFI-11968 Upgraded zstd-jni to 1.5.5-5 for compress-processors
This closes #7626

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:02:00 -05:00
Mark Payne 5e2a10c328
NIFI-11971: Ensure that if we do not write any bytes to a file after calling ProcessSession.write() that we set content claim's length to 0 when closing OutputStream; otherwise it remains -1, which causes issues, since the length will later be added to the offset to determine the position in the ste stream
This closes #7629

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 07:56:57 -05:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
mr1716 a9f29f209e NIFI-11928 Update gremlin.version to 3.7.0
This closes #7592

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-18 09:04:10 -04:00
Ferenc Kis 3aa02a022e
NIFI-11514 Flow JSON support and deprecating YAML format. Revised parameter generation. Generic refactors.
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #7344
2023-08-18 11:33:23 +02:00
mr1716 0d119f6f39
NIFI-11955 Upgraded maven-clean-plugin from 3.2.0 to 3.3.1
This closes #7616

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:05:01 -05:00
mr1716 46cdcf9dac
NIFI-11954 Upgraded license-maven-plugin from 2.0.0 to 2.2.0
This closes #7614

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:04:26 -05:00
mr1716 70c756ff78
NIFI-11953 Upgraded download-maven-plugin from 1.6.8 to 1.7.1
This closes #7613

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:03:41 -05:00
exceptionfactory 71abd77727 NIFI-11944 Removed validation warning from ExecuteStreamCommand
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7607
2023-08-14 16:34:49 -04:00
mr1716 b55b712b38
NIFI-11949 Upgraded Spring Integration from 5.5.15 to 5.5.18
This closes #7605

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-14 12:20:58 -05:00
mr1716 12f736a6b0 NIFI-11943 Update activemq-client and broker to 5.18.2
This closes #7602

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 21:51:30 -04:00
mr1716 b78dc5ca57 NIFI-11942 Update zstd-jni to 1.5.5-5
This closes #7601

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
mr1716 c0156e3429 NIFI-11936 Update msal4j.version to 1.13.10
This closes #7599

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:48:41 -04:00
mr1716 99a590ec0c NIFI-11935 Update Redis spring.data.redis.version to 2.7.14
This closes #7598

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:47:33 -04:00
mr1716 0c03521676 NIFI-11933 Update spring.integration.version For Email Bundle To 5.5.18
This closes #7597

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:46:06 -04:00
mr1716 53f64badbf NIFI-11931 Update iotdb.sdk.version to 1.1.2
This closes #7595

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:43:55 -04:00
mr1716 c878310e36 NIFI-11930 Update aws-kinesis-client-library-version to 1.15.0
This closes #7594

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:42:14 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Peter Turcsanyi 2e6eaaeb38
NIFI-11926: Added proxy handling in Azure Storage Credentials Services
Added Proxy Configuration Service property in AzureStorageCredentialsControllerService_v12 and ADLSCredentialsControllerService used by Service Principal and Managed Identity authentication modes.

This closes #7590

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:46:31 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
mr1716 0643e1db96
NIFI-11925 Upgraded smbj from 0.12.1 to 0.12.2
This closes #7589

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 14:46:17 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
exceptionfactory 84326ba4b2 NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7586
2023-08-09 13:00:55 -04:00
Mike Thomsen cba6b00271
NIFI-11383 Updated Java documentation links from 8 to 17
This closes #7581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 09:17:48 -05:00
exceptionfactory bbd8fb6f63
NIFI-11895 Removed deprecated Repository Encryption configuration
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7557.
2023-08-09 07:07:31 -04:00
krisztina-zsihovszki 0446990d54
NIFI-11916 Iceberg processor extensibility improvement
This closes #7583.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-08 22:31:52 +02:00
Peter Turcsanyi 2a3ce1cb69
NIFI-11918 Used java.security.cert in ListenGRPC
This closes #7580

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-08 10:04:52 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
exceptionfactory ff87060b16 NIFI-11915 Upgraded gRPC from 1.57.0 to 1.57.1
This closes #7577

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-07 17:22:47 -04:00
Pierre Villard 62487f575a
NIFI-11891 Added No Tracking listing strategy to ListGCS
This closes #7570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 14:06:17 -05:00
Mike Thomsen 5cb15b484c
NIFI-11913 Added enum handling to StandardSchemaValidator
This closes #7576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 13:58:43 -05:00
Pierre Villard b056bf8f7b
NIFI-11823 - fix NUMERIC support in PutBigQuery
This closes #7489.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-05 23:21:48 +02:00
Mark Payne 485112e54f
NIFI-11911 Updated FetchGoogleDrive to support Export Types
- Export API support includes Google Docs, Presentations, Spreadsheets, Drawings, and AppScripts

This closes #7575

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 16:28:44 -05:00
Yolanda M. Davis f8e3b9ebac
NIFI-11899 Correct Bulletin Metrics Registry to return latest Bulletins
This closes #7567

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:20:00 -05:00
Pierre Villard 572e661d12
NIFI-11901 Added name and version subtitle in Processor Details view
This closes #7563

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:14:14 -05:00
exceptionfactory 5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
Matt Burgess 63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
This closes #7561

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
mr1716 1fda6bca7a
NIFI-11906 Updated nifi-resources description for consistency
This closes #7571

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 13:02:30 -05:00
mr1716 66fc11d7c5
NIFI-11905 Update snowflake-jdbc to 3.14.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7569.
2023-08-03 17:33:59 +02:00
exceptionfactory 04cd6c216e
NIFI-11896 Corrected QuestDB Status Repository Shutdown handling
- Updated QuestDB Status Repository shutdown method to cancel scheduled tasks before immediate shutdown of Scheduled Executor Service
- Updated QuestDB Scheduled Tasks to include initial delay to avoid unnecessary execution when starting
- Updated QuestDB test class to minimize logging for QuestDB 7
- Improved logging and exception messages

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7564.
2023-08-03 17:25:52 +02:00
Lehel Boer 6a8a8caa4c
NIFI-11902: Fix ListHDFS closes FileSystem in first run
This closes #7565.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-03 16:02:42 +02:00
Mike Thomsen 49a350a765
NIFI-11900 Catch RuntimeException in ResizeImage failures
This closes #7558

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-02 14:02:56 -05:00