232 Commits

Author SHA1 Message Date
dan-s1
44ae874032 NIFI-13726 Set cell style copy policy to false in order to avoid exceeding the maximum number of cell styles (64000) in a .xlsx Workbook
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9326
2024-10-11 16:54:39 -04:00
dan-s1
f41f6fea4f
NIFI-13850 Simplified TextXMLReader using Current Language and Library Practices (#9361)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-09 13:06:05 -05:00
Mike Moser
4ecd743693
NIFI-12762 Added Request Header Size to ListenHTTP and HandleHttpRequest
This closes #9304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 14:28:55 -05:00
Vincenzo Abate
0719a8113f
NIFI-13827 Added Reply-To Property to PutEmail (#9332)
Co-authored-by: Vincenzo Abate <vincenzo.abate@teratecnologies.es>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 10:56:51 -05:00
Pierre Villard
7188155d50
NIFI-13847 - Typos in ReplaceText properties descriptions
This closes #9354.

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-10-08 14:33:21 +02:00
Peter Turcsanyi
2cb8411d4f
NIFI-13848 Migrated AWSCredentialsProviderControllerService's Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9357.
2024-10-08 10:54:49 +02:00
dan-s1
92c6ddd98e
NIFI-13335 Added ability for the XMLRecordReader to handle where an array of data has different types.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9356.
2024-10-08 10:47:34 +02:00
Peter Turcsanyi
5f6bdc6243
NIFI-13841 Restored proxy support in AWS PutSNS processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9351.
2024-10-08 10:35:53 +02:00
Peter Turcsanyi
17c8a6bed8
NIFI-13840 Fixed proxy setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9345.
2024-10-07 16:22:28 +02:00
Rajmund Takacs
7da06aab62 NIFI-13829: Mitigate false positive reports of MonitorActivity, in case of infrequent Flow Files
This closes #9333.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-10-07 11:37:46 +02:00
Peter Turcsanyi
ae2277478a
NIFI-13842 Fixed truststore/keystore setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9346.
2024-10-07 11:30:21 +02:00
Matt Burgess
e6e7e22465 NIFI-13790: Report SEND provenance event in PublishKafka
This closes #9349

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-06 12:42:24 -04:00
lehelb
8424e3428a
NIFI-13798: Renamed Airtable's API Key property to Personal Access Token and updated docs due to API Keys deprecation
This closes #9308.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-10-03 08:53:15 +02:00
Pierre Villard
3af800a017
NIFI-13826 Upgraded Jetty to 12.0.14 and Jackson to 2.18.0 along with others (#9331)
- Jackson from 2.17.2 to 2.18.0
- zstd-jni from 1.5.6-5 to 1.5.6-6
- gson from 2.10.1 to 2.11.0
- okio from 3.9.0 to 3.9.1
- Fabric8 Kubernetes from 6.13.1 to 6.13.4
- Netty from 4.1.113.Final to 4.1.114.Final
- swagger-annotations from 2.2.23 to 2.2.24
- avro from 1.11.3 to 1.11.4
- commons-lang3 from 3.16.0 to 3.17.0
- log4j from 2.24.0 to 2.24.1
- Jetty from 12.0.13 to 12.0.14
- junit-bom from 5.10.3 to 5.10.4
- junit-platform-commons from 1.10.3 to 1.10.4
- mockito from 5.13.0 to 5.14.1
- testcontainers from 1.20.1 to 1.20.2
- snakeyaml from 2.2 to 2.3
- AWS SDK v2 from 2.28.4 to 2.28.13
- flyway from 10.18.0 to 10.18.2
- jline from 3.26.3 to 3.27.0
- neo4j driver from 5.24.0 to 5.25.0
- maxmind from 3.1.0 to 3.1.1
- geoip2 from 4.2.0 to 4.2.1
- amqp-client from 5.21.0 to 5.22.0
- commons-csv from 1.11.0 to 1.12.0
- splunk from 1.9.4 to 1.9.5
- lucene from 9.11.1 to 9.12.0
- Google BOM from 26.46.0 to 26.47.0
- Azure BOM from 1.2.26 to 1.2.28
- msal4j from 1.16.1 to 1.17.1
- json-schema-validator from 1.5.1 to 1.5.2
- checker-qual from 3.45.0 to 3.47.0
- checkstyle from 10.16.0 to 10.18.2

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-02 18:13:08 -05:00
dan-s1
dd8681e3a2 NIFI-13819 Provided a row number and sheet name if ExcelReader throws exception when it fails to convert a value.
This closes #9327

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-01 09:17:14 -04:00
Matt Gilman
fb2a82c035
NIFI-13721: Migrating documentation into the NiFi UI (#9288)
* NIFI-13721: Migrating additional details to markdown.

* NIFI-13721: Rebuilding documentation to generate mark up on the client.

* NIFI-13721: Removing old documentation approach.

* NIFI-13721: Rebase main and final fixing button colors.

* NIFI-13721: Fixing rat issues.

* NIFI-13721: Removing generated comonent documentation.
- Removing links and images from additional details markdown.

* NIFI-13721: Recreating package lock following rebase.

* NIFI-13721: Updating documentation for M3.

* NIFI-13721: Fixing broken test.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Ensuring the selected item is visible after routing.

* NIFI-13721: Fixing reportingTaskTypes in finding extensions for a given type.

* NIFI-13721: Updating the see also component to handle when the referenced extension is not installed.

* NIFI-13721: Fixing expansion panel header styles.
2024-09-27 11:11:55 -04:00
Bob Paulin
34aa764132
NIFI-13779 Improved Provenance Lineage for Python FlowFileTransform (#9292)
- Transform input FlowFile instead of cloned FlowFile

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-26 12:39:19 -05:00
Mark Payne
6b4daa2ec2
NIFI-13801: Fixed counter for ConsumeKafka to correctly indicate number of messages received using using a demarcator
This closes #9311.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-24 21:31:14 -04:00
Pierre Villard
150cba8bef
NIFI-13712 Added Receive Channel Join Events to ListenSlack (#9230)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-23 10:35:07 -05:00
Mark Bathori
07611ded2b
NIFI-13722: Kerberos ticket renewal issue due static thread pool in Iceberg library
This closes #9258.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 12:08:19 +02:00
Peter Gyori
e5a80e6ba6
NIFI-13771 Python source processor default Run Duration 0 ms and Run Schedule 1 min
This closes #9282.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 11:50:39 +02:00
Mark Payne
1b525aef0c
NIFI-13791 Added Counters to PublishKafka and ConsumeKafka for Records per Topic (#9300)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 20:58:03 -05:00
Mark Payne
d04d38fc44
NIFI-13787 Fixed error and record handling in ConsumeKafka
Eliminated unnecessary connection pooling at the service layer so that a single Consumer is made available to the processor. This allows the processor to rollback offsets and provides a simpler API.

This closes #9298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 17:33:54 -05:00
Mark Payne
6ddae78b6f
NIFI-13784 Fixed Kafka Publishing Behavior creating multiple Producers (#9297)
Fixed error handling in several situations. Cleaned up leaky abstraction. Some code cleanup, fixed default values for time-based properties to use 'sec' instead of 's' to adhere to typical conventions.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-21 16:45:36 -05:00
exceptionfactory
a43135ce0c
NIFI-13783 Removed commons-codec from Kafka Processors
This closes #9295

- Replaced Commons Codec Hex with Java HexFormat

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-21 10:06:33 -07:00
Joe Witt
29307dbf71
NIFI-13775 Fixed NoClassDefFoundError with ArrayUtils in ConsumeKafka (#9287)
- Upgraded Kafka Clients from 3.7.1 to 3.8.0
- Inheriting from the correct base services-api instead of shared-bundle then identifying missing explicit dependencies of Kafka processors commons-lang3 and commons-codec

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-20 13:39:26 -05:00
Joseph Witt
e155e6bb26
NIFI-13769 bump various deps for logback, amazon, spring, and more
ch.qos.logback 1.5.7 1.5.8
com.amazonaws 1.12.770 1.12.772
com.github.luben 1.5.6-4 1.5.6-5
commons-io 2.16.1 2.17.0
io.netty 4.1.112.Final 4.1.113.Final
org.apache.ant 1.10.14 1.10.15
org.apache.logging.log4j 2.23.1 2.24.0  (why is this here!?)
org.eclipse.jetty 12.0.12 12.0.13
org.springframework 6.1.12 6.1.13
org.xerial.snappy 1.1.10.6 1.1.10.7
software.amazon.awssdk 2.27.14 2.28.4
com.google.apis v3-rev20240730-2.0.0	 v3-rev20240903-2.0.0
com.slack.api bolt-socket-mode 1.42.0 1.42.1
com.squareup.wire wire-schema-jvm 5.0.0 5.1.0
io.projectreactor (core/test) 3.6.9 3.6.10
net.java.dev.jna (jna/jna-platform) 5.14.0 5.15.0
org.apache.groovy 4.0.22 4.0.23
org.apache.maven maven-artifact 3.9.8 3.9.9
org.eclipse.jgit 6.10.0.202406032230-r	 7.0.0.202409031743-r
org.flywaydb 10.17.2 10.18.0
org.kosuke 1.324 1.326
org.mongodb 4.11.3 4.11.4
org.neo4j.driver 5.23.0 5.24.0
org.postgresql 42.7.3 42.7.4
org.springframework.boot 3.3.3 3.3.4
org.springframework.integration 6.3.3 6.3.4
org.springframework.retry 2.0.8 2.0.9

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9280.
2024-09-20 13:46:02 +01:00
Lucas
c71c13ce31
NIFI-13750 Abort SFTP listing once maxResults is reached (#9267)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 16:16:10 -05:00
timeabarna
e125d8cdbb
NIFI-13763 Fixed HashSet Filtering for DeduplicateRecord (#9277)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:57:44 -05:00
Peter Turcsanyi
58184683df
NIFI-13758 Upgraded Google Cloud Libraries to 26.46.0 (#9275)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:54:03 -05:00
dependabot[bot]
d455c00387
NIFI-13768 Upgraded protobuf from 3.25.3 to 3.25.5
This closes #9278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:06:28 -05:00
Lucas
00c7a78119
NIFI-13751 Upgraded SSHJ from 0.38.0 to 0.39.0 (#9266)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 14:59:29 -05:00
Peter Turcsanyi
6355812a77
NIFI-13733 Migrated FTP and SFTP processors' Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9252.
2024-09-12 11:54:04 +02:00
David Handermann
1101d4d995
NIFI-13734 Removed getTook assertions from Elasticsearch Test (#9254) 2024-09-10 17:21:25 -04:00
Lucas
c4d11feda5
NIFI-13730 Refactor TestUpdateAttribute using current API methods (#9249)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-10 13:58:23 -05:00
EndzeitBegins
821e5d23c9
NIFI-13372 Add processor DeleteSFTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9012.
2024-09-09 16:03:24 +02:00
EndzeitBegins
bb7cce50d2
NIFI-13703 Remove deprecated property DISTRIBUTED_CACHE_SERVICE in AbstractListProcessor
This closes #9246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 14:09:25 +02:00
Chris Sampson
2ead001d14
NIFI-13719 allow Elasticsearch response to contain Long values for the took field
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9244.
2024-09-09 14:00:23 +02:00
EndzeitBegins
657e75c667
NIFI-13729 Remove deprecated property MAX_RECV_THREAD_POOL_SIZE from ListenTCP
This closes #9248.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 10:17:07 +02:00
EndzeitBegins
61aeb7af39
NIFI-13728 Remove deprecated property KERBEROS_RELOGIN_PERIOD in AbstractHadoopProcessor
This closes #9247.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 09:42:09 +02:00
David Handermann
fafdb96a50
NIFI-13725 Disabled Spring Logging System in Content Viewer (#9240)
This closes #9240
2024-09-06 18:34:49 -04:00
Peter Turcsanyi
a7112a60ec
NIFI-13583 Overrode google-auth-library-oauth2-http version to 1.25.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9235.
2024-09-06 17:42:33 +02:00
Matt Gilman
39ab3129f0
NIFI-13632: Updating content access. (#9221)
* NIFI-13632: Updating content access.
- Removing existing content viewer application.
- Introduced new front end based content viewer applicaiton.
- Introduced new bundled content viewers for hex and images.
- Deleted previous image content viewer.
- Migrated existing standard content viewer (which handles json, xml, yaml, csv, and text) to utilize new content access interface.
- Moved standard content viewer into its own NAR.
- Moved and renamed custom ui utils and content viewer utils into nifi-common.
- Added mime type to FlowFileSummary response payload to help drive the initially opened content viewer.

* NIFI-13632: Fixing rat issue.

* NIFI-13632: Fixing CI issue.

* NIFI-13632: Removing standard content viewer war from code coverage.

* NIFI-13632: Addressing review feedback.

* NIFI-13632: Fixing import.

* NIFI-13632: Further simplification of content viewer state.

* NIFI-13632: Removing unneeded code.

* NIFI-13632: Adding a min height around codemirror.

* NIFI-13632: Addressing review feedback.
- Rendering mime type in the content viewer.
- Preventing additions to the browser history as the user changes how the content is viewed.
- Appending forward slash to content viewer UIs to prevent unnecessary redirect.
- Removing Standard Content Viewer title based on review feedback.
- Fixing double scroll bar in the Standard Content Viewer on small browser heights.
- Removed unnecessary application.yml.
- Bumping spring boot version.

This closes #9221
2024-09-06 09:12:38 -04:00
dan-s1
727b0ba106
NIFI-13709 Added more meaningful message when validation fails with non-compliant XML is validated and no schema is provided.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9229.
2024-09-05 12:06:23 +02:00
EndzeitBegins
d1432d6be9
NIFI-13702 Remove deprecated property STATE_UPDATE_INTERVAL from CaptureChangeMySQL
This closes #9225

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:30 -05:00
EndzeitBegins
1ad9d86a26
NIFI-13701 Remove deprecated property CACHE_SCHEMA from QueryRecord
This closes #9224

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:07 -05:00
Juldrixx
f92f6f1def
NIFI-13578 Add Schema Branch Name and Schema Version in ValidateRecord (#9108)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 10:54:26 -05:00
Pierre Villard
f828907df5
NIFI-12080 Added support for KV_2 in HashiCorp Parameter Provider
This closes #9209

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 09:12:12 -05:00
Mike
2fc0ca1b7b
NIFI-13692 Catch All Exceptions in ResizeImage (#9213)
Widening the scope of caught Exceptions for routing to failure ensures that the Processor can catch pretty much everything a user could throw at this processor.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-29 09:29:15 -05:00
Joseph Witt
a8e204aceb
NIFI-13690 Upgraded AWS SDK to 2.27.14 and other dependencies
- Upgraded Logback from 1.5.6 to 1.5.7
- Upgraded brotli4j from 1.16.0 to 1.17.0
- Upgraded AWS SDK from 1.12.767 to 1.12.770
- Upgraded AWS SDK from 2.27.1 to 2.27.14
- Upgraded H2 from 2.3.230 to 2.3.232
- Upgraded Commons CLI from 1.8.0 to 1.9.0
- Upgraded Dropwizard Metrics from 4.2.26 to 4.2.27
- Upgraded Kubernetes Client from 6.13.2 to 6.13.3
- Upgraded Reactor Netty from 1.1.21 to 1.1.22
- Upgraded Commons Compress from 1.27.0 to 1.27.1
- Upgraded Mockito from 5.12.0 to 5.13.0
- Upgraded Slack API from 1.40.3 to 1.42.0
- Upgraded Project Reactor Core from 3.6.8 to 3.6.9
- Upgraded Iceberg from 1.6.0 to 1.6.1
- Upgraded FlywayDB from 10.17.0 to 10.17.2
- Upgraded GitHub API 1.323 to 1.324
- Upgraded PostgreSQL from 42.7.3 to 42.7.4
- Upgraded Spring Integration from 6.3.2 to 6.3.3
- Upgraded Spring Retry 2.0.7 to 2.0.8
- Upgraded Spring Vault from 3.1.1 to 3.1.2

This closes #9206

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-28 14:17:37 -05:00