10397 Commits

Author SHA1 Message Date
Pierre Villard
0cad418874
NIFI-13544 Align number of Executors with Concurrent Tasks in PublishGCPubSub (#9454)
Co-authored-by: Paul-Adrien Cordonnier <pauladrien@adaltas.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-28 09:43:42 -05:00
Pierre Villard
8b6bf16929
NIFI-13936 Removed GCP PubSub Lite Processors (#9455)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-28 09:36:40 -05:00
exceptionfactory
63b0456bad
NIFI-13935 Removed HBase 2 Processors and Services
This closes #9453

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-28 07:20:47 -07:00
Peter Turcsanyi
eb8d4ee06f
NIFI-13930 PutAzureDataLakeStorage sets close flag on file write so that Azure can emit FlushWithClose event
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9451.
2024-10-27 08:48:45 +01:00
exceptionfactory
b6952f1246
NIFI-13933 Upgraded Spring Security to 6.3.4 and other dependencies
This closes #9450

- Upgraded Spring Security from 6.3.3 to 6.3.4
- Upgraded Hadoop from 3.4.0 to 3.4.1
- Upgraded Velocity Engine Core from 2.3.0 to 2.4.1
- Upgraded Parquet Avro from 1.13.1 to 1.14.3
- Upgraded Google Libraries from 26.47.0 to 26.49.0
- Set protobuf-java to 3.25.5 for calcite-core and amazon-kinesis-client libraries
- Updated Dependency Check suppressions

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-26 14:14:14 -07:00
Pierre Villard
31d92b5115
NIFI-13927 Use synchronized lists in PublishGCPubSub (#9449)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-26 11:44:29 -05:00
Mark Payne
6d6adfeaeb
NIFI-13929 Fixed Provenance Event Handling for Stateless Engine (#9446)
Removed Provenance Repository from the stateless RepositoryContextFactory and added it to the DataflowTriggerContext. This was necessary because the previous design overlooked the possibility of many threads concurrently running the same dataflow. They all shared the same StatelessProvenanceRepository, but the code was designed as if only a single thread would be using the repository. As a result, the events that were registered with the stateless prov repo were being copied many times into NiFi's underlying provenance repository. This refactoring also led to the discovery of some old Java 8 syntax that could be cleaned up, and it led to the discovery of some methods that were no longer being used and could be cleaned up. Finally, in testing, I found that when a Stateless Group was scheduled, it scheduled the triggering of the stateless group before marking the state as RUNNING; as a result, the second thread could run, determine that the state is STARTING instead of RUNNING, and return without triggering the stateless group. This was addressed by ensuring that we set the state to RUNNING before triggering the stateless group to be triggered.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-26 09:23:50 -05:00
Ferenc Gerlits
3b3e74d46b
NIFI-13824 Installed Python Processor Dependencies with one command
If a Python processor defines dependencies both inline and in a
requirements.txt file, then we need to install the two groups of
dependencies in a single `pip install` command, otherwise pip is
not able to resolve the web of dependencies correctly.

- Added setup-python step with Python 3.12 to ci-workflow for consistent version behavior

This closes #9429

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-26 09:15:30 -05:00
Bence Simon
5be2cd73e6
NIFI-13932 Calling super #migrateProperty in JsonRecordSetWriter
This closes #9448.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-10-25 17:08:15 +02:00
exceptionfactory
efb1093a85
NIFI-13931 Updated README.md Guide Links to nifi-latest URLs (#9447)
Closes #9447

Signed-off-by: Marton Szasz <szaszm@apache.org>
2024-10-25 07:19:41 +02:00
Pierre Villard
d1f4048b06
NIFI-13904 Fixed CLI commands to set/remove parameter context inheritance (#9437)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-24 14:41:50 -05:00
Pierre Villard
d474c831ae
NIFI-13924 Fixed NiFi CLI delete-param command (#9440)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-24 14:27:52 -05:00
Scott Aslan
7b8d3fece2
[NIFI-13917] update sidenav font color to match applicaiton font color (#9442)
This closes #9442
2024-10-24 13:55:43 -04:00
Matt Gilman
29a3baba81
NIFI-249: Auto wrapping label text. (#9441)
This closes #9441
2024-10-24 12:58:25 -04:00
Matt Gilman
a2be354733
NIFI-13916: Removing width on action select in GlobalAccessPolicies. (#9436)
This closes #9436
2024-10-24 12:54:03 -04:00
Scott Aslan
c3f4905eca
[NIFI-13920] fix draggable icon color while dragging (#9438)
This closes #9438
2024-10-24 12:53:36 -04:00
Matt Gilman
63d9e1d170
NIFI-13921: Routing away from the edit path when closing the EditProcessGroup dialog. (#9435)
This closes #9435
2024-10-24 12:53:18 -04:00
Matt Gilman
a5f2881d02
NIFI-13926: Removed used of default branch name in favor of null in Import From Registry and Start Version Control. (#9443)
- Reset form fields as necessary when queries to load buckets, branches, etc fail.

This closes #9443
2024-10-24 12:52:53 -04:00
Scott Aslan
f39666da16
[NIFI-13925] update codemirror cursor and matching brackets (#9444)
This closes #9444
2024-10-24 12:52:35 -04:00
Nicolae Puica
35219052e1
NIFI-13869: Enhance QuerySalesforceObject Processor to Support Querying Deleted Records
- Added a new boolean property `Include Deleted Records` to allow users to include deleted (soft-deleted) records in Salesforce queries.
- Modified the query construction to include the `IsDeleted` field and use the `queryAll` API endpoint when `Include Deleted Records` is enabled.
- Updated `SalesforceRestClient` to support the `queryAll` API by adding a new `queryAll` method.
- Ensured backward compatibility by defaulting `Include Deleted Records` to `false`, maintaining existing behavior unless explicitly enabled.
- Updated processor documentation and annotations to reflect the new functionality.
- Adjusted state management to reset state when `Include Deleted Records` property is modified.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9434.
2024-10-22 18:37:45 +02:00
Lehel Boér
a44fb528f6
NIFI-13896 Removed legacy state migration from TailFile (#9425)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-21 15:51:09 -05:00
Hunter Goller
d693293c43
NIFI-13853: Added the ability to filter by all to the Advanced Rules page (#9371)
* NIFI-13853: Added the ability to filter by all to the Advanced Rules pag

* NIFI-13853: Fixed formatting

* NIFI-13853: Removed labels in filter by everything

Removed 'Name, Comments, Condition, Action' labels

Co-authored-by: Rob Fellows <rob.fellows@gmail.com>

* NIFI-13853: Fixed indentation

* NIFI-13853:Fixed the indentation

For some reason my last commit didn't fix the indentation

---------

Co-authored-by: Rob Fellows <rob.fellows@gmail.com>

This closes #9371
2024-10-21 16:46:56 -04:00
Mark Payne
39ca75d868
NIFI-13914 Fixed FlowFile Prioritization for Stateless Execution (#9432)
Ensure that when data is enqueued in the StatelessFlowFileQueue we order the data properly before adding to its internal queue. Added system tests to verify that the data is properly ordered while running within stateless and properly ordered when coming out, if using a FIFO prioritizer.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-21 15:39:12 -05:00
Rob Fellows
1711f3d5e1
[NIFI-13911] - force change detection after setting local variables intended to drive the visibility of the overlay to prevent slow response when opening nf-editor of a dependent property (#9428) 2024-10-21 15:13:44 -04:00
Bryan Bende
ab28464ef0
NIFI-13913 Set provided scope on slf4-api in nifi-registry-web-api (#9431)
- The slf4j-api library is provided in the project lib directory and should not be packaged in the WAR

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-21 12:16:30 -05:00
Michael Moser
29ed3e7d7c
NIFI-13912 Corrected formatting and URLs in MiNiFi Quick Start Guide (#9430)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-21 11:45:43 -05:00
Dye357
11ceb45783
NIFI-13724 - Added additional metadata to events (#9239) 2024-10-21 12:05:48 -04:00
exceptionfactory
cc2cdddd49
NIFI-13910 Upgraded Apache Tika from 2.9.2 to 3.0.0
This closes #9427

- Removed unused dependency from nifi-framework-bundle
- Aligned custom-mimetypes.xml location with Tika 3 default location

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-21 07:38:13 -07:00
exceptionfactory
e3ac4089c5
NIFI-13909 Refreshed and Streamlined Project README
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9426.
2024-10-21 14:17:01 +02:00
Mike
e37cd2b5e6
NIFI-13776 Updated CopyS3Object to Handle Files over 5 GB
This closes #9418

- Added multipart copying for files over 5 GB

Co-authored-by: Mike Thomsen <mthomsen@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 16:24:38 -07:00
Mike Moser
80e889305f
NIFI-7085 add flowFile batching to ConsumeJMS and PublishJMS
This closes #8584

load some configuration in onScheduled instead of a loop, reinstated and fixed a failing integration test
2024-10-18 16:23:22 -07:00
exceptionfactory
1bcc61ebb4
NIFI-13898 Upgraded Lucene from 9.12.0 to 10.0.0
This closes #9420

- Adjusted TotalHits.value() references aligning with Lucene 10 changes

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 14:54:27 -07:00
exceptionfactory
082b5aefef
NIFI-13899 Upgraded Maven from 3.9.8 to 3.9.9
This closes #9421

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 14:53:26 -07:00
exceptionfactory
069d892bc1
NIFI-13900 Fixed Jetty Servlet Mapping Log Warnings
This closes #9422

- Switched from DefaultServlet to ResourceServlet for documentation resources
- Added Server instance to RewriteHandler

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 14:39:32 -07:00
exceptionfactory
062b8910d5
NIFI-13901 Fixed Additional Details Section Title
This closes #9423.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 14:38:33 -07:00
jrsteinebrey
1aabc615ce
NIFI-13755 Improved Controller Service Enabling Process (#9273)
- Updated Standard Controller Service Provider to enable requested Controller Services that do not depend on a disabled Controller Service, instead of failing to enable the entire set of requested Controller Services
- Updated enabling process improves behavior when restarting NiFi and attempting to enable large numbers of Controller Services, some of which depend on disabled Services

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-18 13:05:50 -05:00
Pierre Villard
56f859f37f
NIFI-13890 Fixed referencing components for quoted parameter names (#9411)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-18 07:56:51 -05:00
Joe Witt
811af23343
NIFI-13895 Upgraded AWS SDK to 1.12.775 and 2.28.25 along with others (#9416)
- Upgraded AWS SDK from 1.12.774 to 1.12.775
- Upgraded AWS SDK from 2.28.24 to 2.28.25
- Upgraded Box API from 4.11.1 to 4.12.0
- Upgraded nimbus-jose-jwt from 9.40 to 9.41.2
- Upgraded oauth2-oidc-sdk from 11.14 to 11.20.1
- Upgraded reactor-netty-heep from 1.1.22 to 1.1.23
- Upgraded Elasticsearch Client from 8.15.1 to 8.15.3
- Upgraded Google API from v3-rev20240903-2.0.0 to v3-rev20240914-2.0.0
- Upgraded MySQL Driver from 9.0.0 to 9.1.0
- Upgraded Slack bolt-socket-mode from 1.42.1 to 1.44.0
- Upgraded Project Reactor from 3.6.10 to 3.6.11
- Upgraded Flyway DB from 10.18.2 to 10.20.0
- Upgraded gitlab4j-api from 6.0.0-rc.5 to 6.0.0-rc.6
- Upgraded JLine from 3.27.0 to 3.27.1
- Upgraded Neo4j Driver from 5.25.0 to 5.26.0

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-18 00:11:52 -05:00
exceptionfactory
b719e8728e
NIFI-13893 Removed Outdated Encryption Configuration from Admin Guide
This closes #9414

- Removed unsupported sensitive properties algorithms
- Removed historical sensitive property provider configuration for bootstrap.conf

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-17 14:29:51 -07:00
exceptionfactory
f9fb4223a7
NIFI-13894 Removed protected and additional keys properties
This closes #9415

- Removed nifi.sensitive.props.key.protected placeholder
- Removed nifi.sensitive.props.additional.keys placeholder

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-17 14:28:04 -07:00
exceptionfactory
927baa858f
NIFI-13891 Updated Documentation for Bootstrap Network Address
- Removed unused nifi.listener.bootstrap.port property from nifi.properties
- Added documentation for management.server.address property in bootstrap.conf
- Corrected location of nifi.diagnostics.on.shutdown property documentation
- Added localized handling to bootstrap port property in StandardMiNiFiServer

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9413.
2024-10-17 21:32:00 +02:00
exceptionfactory
570a3dc71c
NIFI-13892 Suppressed JVM Logging for Lucene Vectorization
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9412.
2024-10-17 20:12:19 +02:00
exceptionfactory
7aabef305c
NIFI-13889 Removed Unused Protected Properties abstraction
- Removed unused methods from nifi-property-utils components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9410.
2024-10-17 20:10:55 +02:00
Scott Aslan
09e5b030db
[NIFI-13887] update styles of disabled drag/drop new canvas items (#9406)
This closes #9406
2024-10-17 12:45:38 -04:00
Scott Aslan
5db02e24cb
[NIFI-12964] fix the alignment of the date picker icon (#9408)
This closes #9408
2024-10-17 12:23:31 -04:00
exceptionfactory
784a95c398
NIFI-13888 Increased Timeout to 15 seconds in TestEventIndexTask
- Increasing the timeout from 5 seconds to 15 seconds should provide greater build stability when running multi-thread builds

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9409.
2024-10-17 18:19:50 +02:00
exceptionfactory
d42b110474
NIFI-13886 Upgraded Spring from 6.1.13 to 6.1.14 and others
- Upgraded Apache MINA SSHD from 2.13.2 to 2.14.0
- Upgraded Dropwizard Metrics from 4.2.27 to 4.2.28
- Upgraded Guava from 33.2.1 to 33.3.1
- Upgraded ASM from 9.7 to 9.7.1
- Upgraded Apache JSP from 10.1.16 to 10.1.31
- Upgraded Apache EL from 10.1.16 to 10.1.31
- Upgraded Data Faker from 2.3.1 to 2.4.0
- Upgraded JSON Flattener from 0.16.6 to 0.17.0
- Upgraded Check Qual from 3.47.0 to 3.48.1
- Upgraded error-prone-annotations from 2.28.0 to 2.33.0
- Upgraded frontend-maven-plugin from 1.15.0 to 1.15.1
- Upgraded AWS SDK from 1.12.772 to 1.2.774
- Upgraded AWS SDK from 2.28.13 to 2.28.24
- Upgraded JSON Smart from 2.5.0 to 2.5.1
- Upgraded Jersey from 3.1.8 to 3.1.9
- Upgraded Logback from 1.5.8 to 1.5.11
- Upgraded Servlet API from 6.0.0 to 6.1.0
- Upgraded Swagger Annotations from 2.2.24 to 2.2.25

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9407.
2024-10-17 18:04:51 +02:00
Mark Bathori
7e1789d6f0
NIFI-13877 Closed Catalog after processing in PutIceberg (#9395)
- Resolved JdbcCatalog being created but not closed

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:36:32 -05:00
Rob Fellows
a53e0ab81e
[NIFI-13876] - Adding context aware error banners (#9396) 2024-10-17 10:13:22 -04:00
Mark Bathori
1823a52e36
NIFI-13884 Removed File IO Implementation Property from PutIceberg (#9403)
- Removed pending further testing and evaluation of runtime behavior

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:00:36 -05:00