Commit Graph

6444 Commits

Author SHA1 Message Date
Matt Gilman 387a101931
NIFI-12425: Controller Service Listing (#8091)
* NIFI-12425:
- Controller Service Listing.
- Adding lazy loading to the Canvas with the introduction of the Controller Service listing.
- Reorganizing existing components in the Flow Designer.
- Allowing the current Process Group to be configured.
- Inline Service creation.

* NIFI-12425:
- Removing unused imports.

This closes #8091
2023-12-01 13:50:30 -05:00
Matt Gilman d40bb3eda6
NIFI-12419: (#8097)
- Applying a copy of the nifi-web-frontend rat config in the parent module when the new ui profile is not activated. Previously, if the new ui profile was not activated, the rat check would fail.

This closes #8097
2023-12-01 12:58:46 -05:00
exceptionfactory 2ac3988881
NIFI-12448 Removed InfluxDB Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8093.
2023-12-01 16:21:20 +01:00
mr1716 d7cb4a4b1c
NIFI-12440 Upgraded HikariCP from 5.0.1 to 5.1.0
This closes #8089

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:55:12 -06:00
Sebastian Rothbucher 685700ad7c
NIFI-11129 Added PutMongoBulkOperations Processor
This closes #6918

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-30 14:36:44 -06:00
EndzeitBegins edca4cd347 NIFI-12386 Adds processor FilterAttribute
attribute uuid is not removed by removeAttribute(s) in MockProcessSession

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8049
2023-11-30 19:21:08 +00:00
mr1716 0430974783
NIFI-12436 Upgraded datafaker from 2.0.1 to 2.0.2
This closes #8084

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:45:26 -06:00
mr1716 6255a98b22
NIFI-12430 Upgraded unboundid-ldapsdk from 6.0.9 to 6.0.10
This closes #8080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:42:10 -06:00
Rob Fellows d14686cb3a
[NIFI-12415] Counters (#8077)
* [NIFI-12415] Counters page
* populate counter the table.
* support counter reset.
* filtering by name and by context
* sorting, including initial sort
* added basic tests

* Formatted with Prettier

* review feedback - removing unused things.

* align mat-table usage to a common style

* disable the Counter menu item if the user doesn't have counterPermissions.canRead

This closes #8077
2023-11-29 18:00:28 -05:00
Matt Gilman 05575364a3
NIFI-12417: Process Group Configuration (#8075)
* NIFI-12417:
- Process Group Configuration.
- Removed unnecessary module imports.

* NIFI-12417:
- Addressing review feedback.

This closes #8075
2023-11-29 17:21:35 -05:00
Matt Gilman ebfb5bc12e
NIFI-12401: Allow combo editor to reference parameters (#8068)
* NIFI-12401:
- Allow combo editor to reference parameters.

* NIFI-12401:
- Addressing review feedback.
- Handling corner cases where there is no parameter context and where there are no parameters in a bound parameter context.

* NIFI-12401:
- Fixing formatting issues.

This closes #8068
2023-11-29 12:26:25 -05:00
dan-s1 9154b708cc
NIFI-12404 Added documentation indicating this controller service does not resolve YAML aliases.
This closes #8070.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2023-11-29 11:21:18 +01:00
dan-s1 e61665675b
NIFI-12416 Relocated the additionalDetails.html to the appropriate bundle in order for it to be seen when generating the documentation.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8067.
2023-11-28 18:36:54 +01:00
mr1716 1a7790b4a1
NIFI-12423 Update iotdb.sdk.version to 1.2.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8074.
2023-11-28 18:28:41 +01:00
mr1716 df33ca04a9
NIFI-12422 Update excel-streaming-reader to 4.2.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8073.
2023-11-28 18:25:53 +01:00
mr1716 0311221eb9
NIFI-12421 Update metrics-core to 4.2.22
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8072.
2023-11-28 18:22:31 +01:00
Rob Fellows 4bba7e6188
[NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. (#8069)
* [NIFI-12419] - Only include the new UI module when building if the 'include-new-ui' profile is active. Also update the ci-workflow.yaml to activate that profile.

* add the profile activation to the Maven Build command

This closes #8069
2023-11-27 20:18:31 -05:00
Matt Gilman b3b6d72924
NIFI-11481: Initial migration to Angular 16 (#8053)
* NIFI-11481:
- Initial project creation.

* NIFI-11481:
- Install material.
- Rename project from nifi-web-frontend to nifi.

* NIFI-11481:
- Install roboto through package.json.

* NIFI-11481:
- Add Tailwind.

* NIFI-11481:
- Basic layout.

* NIFI-11481:
- Introducing ngrx for storing flow.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.

* NIFI-11481:
- Introducing d3.
- Adding svg.
- Adding defs.
- Funnel Manager.
- Adding draggable.
- Adding editable.
- Adding selectable.
- Adding flowfont.
- Adding Canvas View.
- Adding Transform in Store.
- Adding selected in Store.
- Adding transition in Store.
- Funnel Manager directly subscribes to store.

* NIFI-11481:
- Adding backend calls.
- Refactoring update positions to be for a single component.

* NIFI-11481:
- Process Group Manager.
- Adding font-awesome.
- Updating canvas/graph component visibility.
- Adding prettier/eslint.

* NIFI-11481:
- Adding support to enter a process group.

* NIFI-11481:
- Formatting source.

* NIFI-11481:
- Label Manager.
- Added generic update component.

* NIFI-11481:
- Processor Manager.

* NIFI-11481:
- Port Manager.

* NIFI-11481:
- Remote Process Group Manager.

* NIFI-11481:
- Adding draggable icons to the toolbar.

* NIFI-11481:
- Formatting.

* NIFI-11481:
- Draggable Toolbar.
- Create Label, Funnel.

* NIFI-11481:
- Connection Manager.
- Connectable Behavior.

* NIFI-11481:
- Draggable behavior with back end call for both components and connections.

* NIFI-11481:
- Selection box.

* NIFI-11481:
- Port creation.
- Port configuration.
- Quick Select.

* NIFI-11481:
- Canvas Tooltips.

* NIFI-11481:
- Context menu.

* NIFI-11481:
- Router State.
- Reorganization.
- Deep linking.

* NIFI-11481:
- Adding support for Delete.

* NIFI-11481:
- Flow status bar.

* NIFI-11481:
- Adding Current User State.
- Current user polling.
- Fixing Flow Status layout bug.

* NIFI-11481:
- Process Group Polling.

* NIFI-11481:
- Process Group Breadcrumbs.

* NIFI-11481:
- Global Menu.

* NIFI-11481:
- Search.

* NIFI-11481:
- Add support for centering components on the canvas.

* NIFI-11481:
- Add support for persisting and restoring the users view of the current PG.

* NIFI-11481:
- Fixing centering behavior.
- Fixing user view restoration.
- Bulk selection auto fit.

* NIFI-11481:
- Incorporating the new UI into the NiFi build with a build profile that is not active by default.
- The new UI is deployed to a different context path than the current UI and works side by side.

* NIFI-11481:
- Center component from context menu.
- Enter process group from context menu.

* NIFI-11481:
- Adding support to log in.
- LoginFilter, LogoutFilter.
- Moved the handling of 'include-new-ui' profile to make building with and within more straight forward.
- Splash screen while guard executing.
- Http request interceptor to show loading on the canvas.
- Http request interceptor to handle 401 responses.

* NIFI-11481:
- Extension Creation Component.
- Filter, Usage Restrictions, and selected type.

* NIFI-11481:
- Stopping polling when unable to connect to server.

* NIFI-11481:
- Settings - General.

* NIFI-11481:
- Settings - Management Controller Services.

* NIFI-11481:
- NiFi Tooltip directive.
- Usage Restriction Tip.
- Comments Tip.
- Validation Errors Tip.
- Bulletins Tip.

* NIFI-11481:
- Settings - Reporting Tasks.

* NIFI-11481:
- Avoiding unnecessary web requests in route guards.

* NIFI-11481:
- Edit Controller Service Dialog.
- View Property Table.
- Update component density.

* NIFI-11481:
- Supports Controller Service API tooltip and dialog content.

* NIFI-11481:
- Property table - NF Editor.
- Property table - Combo Editor.

* NIFI-11481:
- Making property table a control value accessor.
- Wiring up saving Controller Services from Edit Dialog.
- Handling Delete Property.
- Handling New Property.
- Updating how form submission is triggered throughout to address issue with incidental form submit events.

* NIFI-11481:
- Moving Settings into pages.

* NIFI-11481:
- Moving Canvas into pages.

* NIFI-11481:
- Moving Login into pages.

* NIFI-11481:
- Adding routing to the Controller Service listing and Reporting Task listing.
- Updating Canvas routing to follow similar pattern.

* NIFI-11481:
- Controller Service references.

* NIFI-11481:
- Create inline Controller Service.
- Edit Controller Service route.
- Go To Controller Service from Property Table.
- Switching to Event Emitter in New Property dialog.

* NIFI-11481:
- Saving spinner - Create Processor, Create Port, and Edit Port.

* NIFI-11481:
- Saving spinner - Create Controller Service, Edit Controller Service, and Create Reporting Task.

* NIFI-11481:
- Parameter Context Listing.
- Add new Parameter Context.
- Edit Parameter Context.

* NIFI-11481:
- New Paramter.
- Edit Parameter.
- Parameter table.

* NIFI-11481:
- Parameter references.
- Parameter Context update steps.
- Bound Process Group references.

* NIFI-11481:
- Parameter Context Inheritance.

* NIFI-11481:
- Processor configuration.
- Ensuring new Property names are unique.
- Trapping focus in nf and combo editors.
- Reloading component connections after updating a Processor.

* NIFI-11481:
- Navigation Control.
- Birdseye.
- Operation Control.

* NIFI-11481:
- Create Process Group.
- Upload Process Group.

* NIFI-11481:
- Implementing current Process Group context in operation palette.

* NIFI-11481:
- Connection creation.

* NIFI-11481:
- Connection configuration.

* NIFI-11481:
- Standardizing selection option model.
- Connection load balancing tooltip.
- Clean up.

* NIFI-11481:
- Move components in to/out of groups.
- Group components.

* NIFI-11481:
- Render connections for component action.

* NIFI-11481:
- CodeMirror for Parameter and EL configuration.

* NIFI-11481:
- Resizable.
- Moving tooltip directive.

* NIFI-11481:
- Ensuring all specs are bootstrapped and create successfully.

* NIFI-11481:
- Updating some interface names to avoid conflicting with various components in an attempt to better establish a naming convention.

* NIFI-11481:
- Show Source/Destination.
- Defaulting current Parameter Context in Create PG and Group dialogs.
- Handling disabled state in a few ControlValueAccessors.
- Ensuring Parameter Contest uri is set.
- Unit tests.

* NIFI-11481:
- Fixing checkstyle issue.

* NIFI-11481:
- LICENSE/NOTICE.

* NIFI-11481:
- RAT Plugin config.

* NIFI-12401:
- Addressing review feedback.

* NIFI-11481:
- Ensuring the option is disabled when there is no description.

* NIFI-11481:
- Only including parameters in the payload when they have been modified.
- Showing appropriate message after applying based on whether parameters were included or not.

* NIFI-11481:
- Fixing parameter deletion.
- Enforcing parameter name uniqueness.
- Preventing changing parameter sensitive.

* NIFI-11481:
- Only loading the service link once when considering updated property value.
- Ensuring existing parameter are set in all instances of opening the new Property dialog.

* NIFI-11481:
- Fixing tests that regressed.

* NIFI-11481:
- Adding default karma config which was needed in order to debug tests in IDE.

* NIFI-11481:
- Updating karma config to not watch for now. Can introduce new options for running in various contexts in the future.

This closes #8053
2023-11-27 10:39:51 -05:00
exceptionfactory 00fd7d7cca NIFI-12361-RC6 prepare for next development iteration 2023-11-22 18:35:27 -06:00
exceptionfactory 49fa0d8674 NIFI-12361-RC6 prepare release nifi-2.0.0-M1-RC6 2023-11-22 18:35:26 -06:00
David Handermann 50efc55df6
NIFI-12403 Improve Jolt UI Parameter Processing (#8060)
* Improved Jolt UI Parameter Processing

* Changed double quotes to single quotes per review

This closes #8060
2023-11-22 14:37:02 -05:00
Mark Payne d0c7ebb196
NIFI-11671: Allow FlowFile attributes to be referenced in SQL for JoinEnrichment
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8059.
2023-11-22 14:37:18 +01:00
exceptionfactory 6617fe8fe2
NIFI-12384 This closes #8044. Upgraded Registry to Spring Framework 6
- Upgraded Spring from 5.3.30 to 6.0.13
- Upgraded Spring Boot from 2.7.16 to 3.1.5
- Upgraded Spring Security from 5.8.7 to 6.1.5
- Upgraded Jetty from 10.0.18 to 11.0.18
- Upgraded Servlet API from 3.1.0 to 5.0.0
- Upgraded JAX-RS from 2.1.1 to 3.1.0
- Upgraded Jersey from 2.41 to 3.1.3
- Upgraded JAXB from 2.3.2 to 4.0.4
- Upgraded Java Validation from 2.0.1 to 3.0.2
- Upgraded Flyway from 8.5.13 to 9.22.3
- Upgraded ASM from 9.3 to 9.6 for Java 21
- Upgraded NiFi Toolkit CLI to JAX RS 3 and Jersey 3
- Set Jersey 3 and JAX RS 3 dependency versions in nifi-flow-registry-client-bundle to align with updates to nifi-registry-client classes

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-21 09:06:51 -07:00
exceptionfactory e5e76d0161
NIFI-12393 Upgraded OWASP Check from 8.4.2 to 8.4.3
- Upgraded Azure SDK BOM from 1.2.17 to 1.2.18
- Upgraded Reactor Netty HTTP from 1.0.34 to 1.0.39 for Azure Identity
- Upgraded MSAL4J from 1.13.10 to 1.14.0
- Upgraded Box Java SDK from 4.4.0 to 4.6.1
- Relocated Apache Ant managed versions to bundle parent modules
- Added okio-fakefilesystem to managed dependencies
- Suppressed vulnerability for Picocli misidentified as LINE library
- Added managed dependencies to nifi-code-coverage to avoid false positives due to different parent modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8054.
2023-11-21 12:16:12 +01:00
exceptionfactory d5c7fcb5dd
NIFI-12392 Corrected Component Documentation NAR Unpacking
- Corrected component documentation directory comparison for finding bundled documentation in a JAR
- Added unit test for unpacking of component documentation from JAR included in NAR

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8052.
2023-11-20 14:55:42 +01:00
Matt Burgess e81d7254ec
NIFI-12389: Add variance and standard deviation to AttributeRollingWindow
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8048.
2023-11-20 11:23:51 +01:00
Zoltan Kornel Torok 63364687d8 NIFI-12383 Replication client should handle accept encoding with lowercase
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #8043
2023-11-17 08:02:07 +01:00
Joseph Witt 9cfdebc3e8
NIFI-12378 Removed Jython
This closes #8040

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
mr1716 a3983ae248
NIFI-12380 Upgraded Iceberg from 1.4.0 to 1.4.2
This closes #8039

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Ferenc Gerlits ceeb0deb3d
NIFI-12381 Fixed CR and LF documentation in SplitText
This closes #8041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Bryan Bende 1cc346b63d
NIFI-12368 Clear versionedComponentId for copied Snippets
This closes #8025

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:52 -06:00
Mark Payne e1942a8346
NIFI-12374: Added use case based documentation to explain how to perform incremental / full loads from databases
This closes #8030

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 19:28:10 -06:00
Mark Payne b5c3e6f9aa
NIFI-12358 Fixed NPE in HostHeaderHandler
Fixed NPE in ThreadDumpTask and TrackedLeaderElectionManager

This closes #8032

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 16:57:18 -06:00
Matt Burgess 685c6861b3
NIFI-12376: Fix logic error with bitwise operator in AvroReader
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8034.
2023-11-15 22:55:56 +01:00
exceptionfactory 76a27b0ad8
NIFI-12375 Removed maxFileSize from non-applicable policies in Logback
- Removed the non-applicable maxFileSize from TimeBasedRollingPolicy configurations in default logback.xml files to avoid warnings on shutdown

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8033.
2023-11-15 22:36:34 +01:00
exceptionfactory 9b6120187a
NIFI-12373 Added LICENSE and NOTICE for nifi-standard-shared-nar
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8029.
2023-11-15 20:36:38 +01:00
EndzeitBegins 6c333cdb7e
NIFI-1874 Added Character Set Detection to IdentifyMimeType
NIFI-4550 New Processor not required based on improvements to IdentifyMimeType

- Added mime.charset FlowFile attribute when not null for text MIME types

This closes #8011

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 09:11:30 -06:00
exceptionfactory 5815d83207
NIFI-12370 Fixed Distributed Map Cache Client Service Shutdown
- Moved EventLoopGroup from CacheClientChannelPoolFactory to DistributedCacheClient to enable closing the EventLoopGroup after closing the ChannelPool

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8027.
2023-11-15 08:28:39 +01:00
mr1716 e0527a81bb
NIFI-12364 Upgrade snowflake-ingest-sdk to 2.0.4 and snowflake-jdbc to 3.14.3
This closes #8022.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-11-14 22:07:05 +01:00
mr1716 db827b88b2
NIFI-12360 Upgraded brotli4j from 1.12.0 to 1.13.0
This closes #8020

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:58:08 -06:00
mr1716 2c00d73ce9
NIFI-12359 Upgraded json-schema-validator from 1.0.86 to 1.0.87
This closes #8019

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:56:46 -06:00
mr1716 d98ba74504
NIFI-12356 Upgraded icu4j from 73.2 to 74.1
This closes #8018

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:19:01 -06:00
mr1716 44f62c9b29
NIFI-12355 Upgraded AMQP Client from 5.19.0 to 5.20.0
This closes #8017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:17:25 -06:00
mr1716 0c4de923ba
NIFI-12353 Upgraded json-flattener from 0.16.4 to 0.16.6
This closes #8014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:16:06 -06:00
Mike Thomsen 6447aea258
NIFI-11788 Modified APP_FILE logback configuration to have better cleanup
NIFI-11788 Standardized Logback maximum settings
- Set MiNiFi maxHistory to 10 and totalSizeCap to 10MB
- Set NiFi maxHistory to 30 and totalSizeCap to 3GB except for deprecation log
- Set Stateless maxHistory to 30 and totalSizeCap to 3GB
- Set Registry maxHistory to 30 and totalSizeCap to 3GB
NIFI-11788 Increased MiNiFi maxFileSize to 10MB and cap to 100MB

This closes #7465. Coauthored by David Handermann and Mike Thomsen

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-13 09:48:40 -07:00
Paulette Hines-Cross pliszle 93d373f037
NIFI-12107 Fixed sorting in the cluster table
This closes #7923

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 08:37:29 -06:00
Joe Gresock ec884ac091
NIFI-12212 Upgraded DynamoDB Processors to AWS SDK 2
This closes #7911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:30:30 -06:00
mr1716 582c3ac7cc
NIFI-12347 Upgraded AWS Kinesis from 2.5.2 to 2.5.3
This closes #8007

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:28:11 -06:00
mr1716 246ffe4ee9
NIFI-12346 Upgraded Apache Calcite from 1.35.0 to 1.36.0
This closes #8009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:27:07 -06:00
mr1716 4a4eb2c109
NIFI-12345 Upgraded Commons DBCP from 2.10.0 to 2.11.0
This closes #8006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:25:57 -06:00
Umar Hussain 4f4e99085d
NIFI-11995 Added Header Format configuration to ConsumeAMQP
This closes #7652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:32:13 -06:00
Pierre Villard eb7d49cdff
NIFI-12344 PutKudu Operation should accept Debezium Types
This closes #8004

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:02:55 -06:00
Pierre Villard 279084ddfe
NIFI-12233 Added Parameter Provider for 1Password
This closes #7884

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 11:57:16 -06:00
David Handermann dabdf94bf1
NIFI-12339 Fixed Property Decryption for Migrated Components (#8002)
- Updated StandardVersionedComponentSynchronizer to decrypt properties when creating extension references for subsequent migration
2023-11-10 11:50:03 -05:00
Mike Moser 832d4455c1
NIFI-12121 Added Transform Result Filter to JSLTTransformJSON
This closes #7922

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 10:37:17 -06:00
Mark Payne aff4e5fd1b
NIFI-12340: Only call PythonBridge.onProcessorRemoved for python based processors, not all processors. Do so in a background virtual thread. Also specified explicit versions for openai dependencies to ensure correctness, since the newly released 1.x is not yet compatible with the latest langchain
This closes #8001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 08:41:53 -06:00
exceptionfactory 3dcfc919bb
NIFI-12261 Added Schema Reference Reader and Writer Services (#7991)
- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
2023-11-08 08:55:58 -05:00
markap14 8b0abd45df
NIFI-12330: When synchronizing flow, pause component scheduling until after property migration has completed (#7994) 2023-11-07 16:46:27 -05:00
Malthe Borch 0fe9d2b56f
NIFI-9972 Added CopyAzureBlobStorage_v12 Processor
This closes #6941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 13:13:25 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:07:59 -06:00
Bryan Bende 940c9276c5
NIFI-12323 Removed String Length Limits from JSON Flow Configuration
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow

This closes #7985

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:03:13 -06:00
exceptionfactory a89fb17f9f
NIFI-12328 Updated OpenPGP test Key Generator Settings
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7992.
2023-11-07 13:03:07 +01:00
exceptionfactory b50557b854
NIFI-12321 Avoid Exceptions when removing Python Processors (#7984)
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
2023-11-06 16:17:41 -05:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 12:01:49 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
lehelb 21387316e3
NIFI-10222 Added Apicurio Schema Registry Service
This closes #7913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 15:30:08 -05:00
exceptionfactory 309061ca2d
NIFI-12310 Validate Python Component Type for Processes (#7972)
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
2023-11-03 14:42:08 -04:00
lehelb 514c8d8a6a
NIFI-12314 Fix EL for SQL Query Property in QueryNiFiReportingTask
This closes #7976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:34:01 -05:00
Nissim Shiman ed9b23ef3f
NIFI-12315 Resolved issue preventing PG from being imported from
Registry

- Corrected component property reference in sorting of response objects

This closes #7977

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:33:10 -05:00
Joe Gresock 77834c92df
NIFI-12263 Upgraded AWS Machine Learning processors to SDK 2
This closes #7953

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:05:22 -05:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 754baf0a37
NIFI-12308: Create Python Environment in background thread instead of during Processor creation
This closes #7971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 15:45:43 -05:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00
exceptionfactory 945d8b54bc
NIFI-12294 Standardized NAR Entry Loading (#7958)
- Consolidated duplicative NAR file entry normalization
2023-11-01 14:10:00 -04:00
Paul Grey 75c661bbbe
NIFI-12194 Added Yield on Exceptions in Kafka Processors
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers

This closes #7955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:08:44 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
Mark Payne 9b33d54f53
NIFI-12301 Corrected hasProperty() check when Migrating Properties
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties

This closes #7964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:41:51 -05:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-31 14:20:50 -05:00
dependabot[bot] 5c98b7cce0
NIFI-12295 Upgraded ActiveMQ Client from 5.18.2 to 5.18.3
This closes #7956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-30 17:34:59 -05:00
exceptionfactory 786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
nathluu 8e301cfdef
NIFI-12265 Fixed OpenPGP Hexadecimal Key Formatting with leading 0
- Replaced Long.toHexString() with String.format() using pattern with leading 0

This closes #7926

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 15:48:18 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-28 09:23:23 -07:00
Mark Bathori b2c4baf429
NIFI-12277 Added SSLContextService to Slack Processors
This closes #7936

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 20:51:50 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Mark Bean 5ecc12f405
NIFI-12285 Added py4j.url build property
The py4j.url property allows the URL for downloading py4j to be specified by a Maven command-line option

This closes #7946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:25:53 -05:00
Matt Burgess 880770f992
NIFI-12273 Fixed command.argument references in ExecuteStreamCommand docs
This closes #7941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:52:26 -05:00
Pierre Villard 1d125e9906
NIFI-11677 Removed non required yield in DeleteHDFS
This closes #7937

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:50:59 -05:00
Pierre Villard 1df9738f8f
NIFI-12281 Fix Go To in Parameter Providers to Provider Context
This closes #7939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 19:39:10 -05:00
Mark Bathori 4fa0299f8b NIFI-12130: Ability to configure snapshot properties via dynamic attributes in PutIceberg
Fix dynamic field expression language handling

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7849
2023-10-26 19:26:24 -04:00
lehelb a3e4f89fe3
NIFI-12271 Fix PutAzureBlobStorage_v12 rollback on failure with FileResourceService
This closes #7930

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 14:52:15 -05:00
Shane Ardell c4ff8de412
NIFI-12260: Remove templates from frontend (#7924)
* remove templates from frontend

* remove more references to removed files

* removing more template references

* remove unused css template styles
2023-10-26 15:16:14 -04:00
exceptionfactory 2eb5b79353
NIFI-12275 Disabled Keepalive in SFTP Tests
This closes #7932

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:28:02 +01:00
Mike Moser 9eb2038585
NIFI-12038 add UseCase documentation to PackageFlowFile
This closes #7896

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:00:55 +01:00
exceptionfactory f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 19:54:27 +01:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925)
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
2023-10-25 13:22:26 -04:00