Commit Graph

10356 Commits

Author SHA1 Message Date
Mark Payne d04d38fc44
NIFI-13787 Fixed error and record handling in ConsumeKafka
Eliminated unnecessary connection pooling at the service layer so that a single Consumer is made available to the processor. This allows the processor to rollback offsets and provides a simpler API.

This closes #9298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 17:33:54 -05:00
Mark Payne dee455a802
NIFI-13789 Fixed StatelessFlowManager Process Group Tracking (#9299)
The StatelessFlowManager should register any Process Group that it creates in its internal map in the same way that StandardFlowManager does; this ensures that the Process Group can be retrieved by ID during flow synchronization.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 16:43:17 -05:00
Mark Payne 6ddae78b6f
NIFI-13784 Fixed Kafka Publishing Behavior creating multiple Producers (#9297)
Fixed error handling in several situations. Cleaned up leaky abstraction. Some code cleanup, fixed default values for time-based properties to use 'sec' instead of 's' to adhere to typical conventions.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-21 16:45:36 -05:00
exceptionfactory a43135ce0c
NIFI-13783 Removed commons-codec from Kafka Processors
This closes #9295

- Replaced Commons Codec Hex with Java HexFormat

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-21 10:06:33 -07:00
Gabor Gyimesi 426b8feaa3
NIFI-13714 Fixed RecordTransform Python Processor Partition Handling (#9253)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-21 08:18:42 -05:00
Matt Gilman 729247976d
NIFI-13766: Fixed spacing of checkboxes in Prov Search Dialog. (#9284)
NIFI-13774: Accessed form controls using array notation in case the search field contains a dot.

This closes #9284
2024-09-20 15:42:10 -04:00
Mark Payne e9577ded29
NIFI-13777 Fixed Stateless Group Startup around Controller Services (#9291)
Fixed stateless group startup around Controller Services by changing the startup logic in two ways. First, we enable Controller Services before we create the Stateless Flow. Secondly, we do not bother enabling the ephemeral Controller Services that are created during the Stateless Flow creation/synchronization. This ensures that if Processors make use of a Controller Service during its @OnScheduled method (which is part of the Stateless Flow initialization process) that the Controller Service is Enabled. It also avoids calling @OnEnabled methods of Controller Services that will never actually be used, as Processors make use of the existing Controller Services when running within standard NiFi .

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-20 13:47:47 -05:00
Rob Fellows c6103519eb
[NIFI-13747] - Add a delay before displaying tooltips (#9269)
This closes #9269
2024-09-20 14:43:00 -04:00
Joe Witt 29307dbf71
NIFI-13775 Fixed NoClassDefFoundError with ArrayUtils in ConsumeKafka (#9287)
- Upgraded Kafka Clients from 3.7.1 to 3.8.0
- Inheriting from the correct base services-api instead of shared-bundle then identifying missing explicit dependencies of Kafka processors commons-lang3 and commons-codec

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-20 13:39:26 -05:00
Scott Aslan 981cb0fb4e
[NIFI-13735] update codemirror to use height 100% and fix jolt advanced ui scrollbar issue (#9255)
This closes #9255
2024-09-20 14:20:31 -04:00
Rob Fellows 445d34f91e
[NIFI-13749] - Improve the UX for purging flow configuation history (#9265)
This closes #9265
2024-09-20 13:14:55 -04:00
David Handermann 563d7ea614
NIFI-13770 Removed Placeholder Prefix from Python Component Types (#9283)
This closes #9283
2024-09-20 11:26:41 -04:00
Joseph Witt e155e6bb26
NIFI-13769 bump various deps for logback, amazon, spring, and more
ch.qos.logback 1.5.7 1.5.8
com.amazonaws 1.12.770 1.12.772
com.github.luben 1.5.6-4 1.5.6-5
commons-io 2.16.1 2.17.0
io.netty 4.1.112.Final 4.1.113.Final
org.apache.ant 1.10.14 1.10.15
org.apache.logging.log4j 2.23.1 2.24.0  (why is this here!?)
org.eclipse.jetty 12.0.12 12.0.13
org.springframework 6.1.12 6.1.13
org.xerial.snappy 1.1.10.6 1.1.10.7
software.amazon.awssdk 2.27.14 2.28.4
com.google.apis v3-rev20240730-2.0.0	 v3-rev20240903-2.0.0
com.slack.api bolt-socket-mode 1.42.0 1.42.1
com.squareup.wire wire-schema-jvm 5.0.0 5.1.0
io.projectreactor (core/test) 3.6.9 3.6.10
net.java.dev.jna (jna/jna-platform) 5.14.0 5.15.0
org.apache.groovy 4.0.22 4.0.23
org.apache.maven maven-artifact 3.9.8 3.9.9
org.eclipse.jgit 6.10.0.202406032230-r	 7.0.0.202409031743-r
org.flywaydb 10.17.2 10.18.0
org.kosuke 1.324 1.326
org.mongodb 4.11.3 4.11.4
org.neo4j.driver 5.23.0 5.24.0
org.postgresql 42.7.3 42.7.4
org.springframework.boot 3.3.3 3.3.4
org.springframework.integration 6.3.3 6.3.4
org.springframework.retry 2.0.8 2.0.9

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9280.
2024-09-20 13:46:02 +01:00
Lucas c71c13ce31
NIFI-13750 Abort SFTP listing once maxResults is reached (#9267)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 16:16:10 -05:00
timeabarna e125d8cdbb
NIFI-13763 Fixed HashSet Filtering for DeduplicateRecord (#9277)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:57:44 -05:00
Peter Turcsanyi 58184683df
NIFI-13758 Upgraded Google Cloud Libraries to 26.46.0 (#9275)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:54:03 -05:00
dependabot[bot] d455c00387
NIFI-13768 Upgraded protobuf from 3.25.3 to 3.25.5
This closes #9278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:06:28 -05:00
dependabot[bot] 973728d3e4
NIFI-13767 Upgraded express from 4.19.2 to 4.21.0 for Registry (#9271)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 14:57:53 -05:00
Bryan Bende 44abe39983
NIFI-13757 Improve handling when a NAR contains an extension that produces an Error (#9274)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-17 21:41:45 -05:00
markobean 9b7b246dcc
NIFI-13736 Updated Expression Language Guide join function example (#9256)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 15:07:48 -05:00
Eric Secules 80b3cde95c
NIFI-7583 Document that Prioritizers do not fully sort a queue when swapping (#9263)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 15:03:25 -05:00
Lucas 00c7a78119
NIFI-13751 Upgraded SSHJ from 0.38.0 to 0.39.0 (#9266)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 14:59:29 -05:00
Matt Gilman 6e308f2cf1
NIFI-13743: Ensuring the mime type is set when navigating to the content viewer from Provenance. (#9262)
- Adding a trailing slash when loading the external viewer to eliminate an unneeded redirection.

This closes #9262
2024-09-12 16:41:49 -04:00
David Handermann 6e5a276cb2
NIFI-13718 Switched Request Replication to Web Client Service (#9234)
- Added Request Replication Header enumeration with lowercased header names for HTTP/2
2024-09-12 13:50:03 -04:00
Peter Turcsanyi 6355812a77
NIFI-13733 Migrated FTP and SFTP processors' Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9252.
2024-09-12 11:54:04 +02:00
Matt Gilman 0db408c0fa
NIFI-13740: Fixing default build profile. (#9259) 2024-09-11 10:19:19 -04:00
Bryan Bende f20857d87e
NIFI-13737 Include branch when calling getFlowVersions for change version dialog
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9257.
2024-09-11 13:53:41 +02:00
David Handermann 1101d4d995
NIFI-13734 Removed getTook assertions from Elasticsearch Test (#9254) 2024-09-10 17:21:25 -04:00
Lucas c4d11feda5
NIFI-13730 Refactor TestUpdateAttribute using current API methods (#9249)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-10 13:58:23 -05:00
EndzeitBegins 821e5d23c9
NIFI-13372 Add processor DeleteSFTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9012.
2024-09-09 16:03:24 +02:00
Bryan Bende 68b74547e8
NIFI-13713 Use Asynchronous Loading for Extension UIs in Jetty Server (#9231)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-09 07:47:35 -05:00
EndzeitBegins bb7cce50d2
NIFI-13703 Remove deprecated property DISTRIBUTED_CACHE_SERVICE in AbstractListProcessor
This closes #9246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 14:09:25 +02:00
Chris Sampson 2ead001d14
NIFI-13719 allow Elasticsearch response to contain Long values for the took field
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9244.
2024-09-09 14:00:23 +02:00
EndzeitBegins 657e75c667
NIFI-13729 Remove deprecated property MAX_RECV_THREAD_POOL_SIZE from ListenTCP
This closes #9248.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 10:17:07 +02:00
EndzeitBegins 61aeb7af39
NIFI-13728 Remove deprecated property KERBEROS_RELOGIN_PERIOD in AbstractHadoopProcessor
This closes #9247.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 09:42:09 +02:00
David Handermann fafdb96a50
NIFI-13725 Disabled Spring Logging System in Content Viewer (#9240)
This closes #9240
2024-09-06 18:34:49 -04:00
EndzeitBegins 6ac5a96dd0
NIFI-13468 Add standalone RecordPath function recordOf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9018.
2024-09-06 17:45:13 +02:00
Peter Turcsanyi a7112a60ec
NIFI-13583 Overrode google-auth-library-oauth2-http version to 1.25.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9235.
2024-09-06 17:42:33 +02:00
Matt Gilman 39ab3129f0
NIFI-13632: Updating content access. (#9221)
* NIFI-13632: Updating content access.
- Removing existing content viewer application.
- Introduced new front end based content viewer applicaiton.
- Introduced new bundled content viewers for hex and images.
- Deleted previous image content viewer.
- Migrated existing standard content viewer (which handles json, xml, yaml, csv, and text) to utilize new content access interface.
- Moved standard content viewer into its own NAR.
- Moved and renamed custom ui utils and content viewer utils into nifi-common.
- Added mime type to FlowFileSummary response payload to help drive the initially opened content viewer.

* NIFI-13632: Fixing rat issue.

* NIFI-13632: Fixing CI issue.

* NIFI-13632: Removing standard content viewer war from code coverage.

* NIFI-13632: Addressing review feedback.

* NIFI-13632: Fixing import.

* NIFI-13632: Further simplification of content viewer state.

* NIFI-13632: Removing unneeded code.

* NIFI-13632: Adding a min height around codemirror.

* NIFI-13632: Addressing review feedback.
- Rendering mime type in the content viewer.
- Preventing additions to the browser history as the user changes how the content is viewed.
- Appending forward slash to content viewer UIs to prevent unnecessary redirect.
- Removing Standard Content Viewer title based on review feedback.
- Fixing double scroll bar in the Standard Content Viewer on small browser heights.
- Removed unnecessary application.yml.
- Bumping spring boot version.

This closes #9221
2024-09-06 09:12:38 -04:00
Peter Turcsanyi 85ca96cc90
NIFI-13715 Fixed StandardProvenanceEventRecord.hashCode() to sort Parent/Child FlowFiles as equals() does
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9233.
2024-09-06 14:27:20 +02:00
David Handermann 448d84dff0
NIFI-13705 Refactored Stateless Engine using Web Client Service API (#9226)
- Removed dependencies on OkHttp and nifi-security-utils
- Added dependencies on nifi-web-client-api and nifi-security-ssl
2024-09-05 13:50:32 -04:00
David Handermann d56f92d738
NIFI-13707 Switched Kubernetes HTTP Client from OkHttp to JDK (#9228) 2024-09-05 11:31:15 -04:00
dan-s1 727b0ba106
NIFI-13709 Added more meaningful message when validation fails with non-compliant XML is validated and no schema is provided.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9229.
2024-09-05 12:06:23 +02:00
Peter Gyori 5f0cbed5a6
NIFI-13660 ProcessContext.yieldResources() can be called from Python code
Closes #9182

Signed-off-by: Marton Szasz <szaszm@apache.org>
2024-09-04 20:26:32 +02:00
David Handermann 0510e716b4
NIFI-13706 Handled Exceptions Fetching Parameters on Startup (#9227) 2024-09-03 16:29:32 -05:00
Kalman Jantner 5c3e22aa44
NIFI-13614: populate failure cause in operation state
This closes #9136.

Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>
2024-09-03 12:03:41 +02:00
EndzeitBegins d1432d6be9
NIFI-13702 Remove deprecated property STATE_UPDATE_INTERVAL from CaptureChangeMySQL
This closes #9225

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:30 -05:00
EndzeitBegins 1ad9d86a26
NIFI-13701 Remove deprecated property CACHE_SCHEMA from QueryRecord
This closes #9224

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:07 -05:00
EndzeitBegins b80ef7eed9
NIFI-12852 Refactor TestRecordPath to improve expressiveness and reduce duplication
This closes #9198

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:01:49 -05:00
EndzeitBegins 6b78c42928
NIFI-13697 Clarify documentation in ProcessSession regarding StateManager interactions
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9223.
2024-09-01 14:15:31 +02:00