Commit Graph

248 Commits

Author SHA1 Message Date
Mark Bathori 7e1789d6f0
NIFI-13877 Closed Catalog after processing in PutIceberg (#9395)
- Resolved JdbcCatalog being created but not closed

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:36:32 -05:00
Mark Bathori 1823a52e36
NIFI-13884 Removed File IO Implementation Property from PutIceberg (#9403)
- Removed pending further testing and evaluation of runtime behavior

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:00:36 -05:00
exceptionfactory babfd5a559
NIFI-13881 Upgraded JUnit from 5.10.4 to 5.11.2 along with Plugins
- Upgraded Apache Parent from 32 to 33
- Upgraded Surefire Plugin from 3.2.5 to 3.5.1
- Upgraded Mockito from 5.14.1 to 5.14.2
- Upgraded JUnit Platform from 1.10.4 to 1.11.2
- Upgraded Exec Maven Plugin from 3.2.0 o 3.4.1
- Upgraded Buildnumber Maven Plugin from 3.2.0
- Upgraded Maven Checkstyle Plugin from 3.3.1 to 3.5.0
- Upgraded Checkstyle from 10.16.0 to 10.18.2
- Upgraded Versions Maven Plugin from 2.16.2 to 2.17.1
- Upgraded Nexus Staging Plugin from 1.6.13 to 1.7.00
- Upgraded JAXB Maven Plugin from 2.2.0 to 2.2.1
- Upgraded Swagger Maven Plugin from 2.2.23 to 2.2.25
- Upgraded Swagger Codegen Plugin from 3.0.55 to 3.0.63
- Upgraded Maven JAR Plugin from 3.4.1 to 3.4.2
- Upgraded Dependency Check Plugin from 10.0.3 to 10.0.4
- Upgraded Jagged BOM from 0.4.0 to 1.0.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9400.
2024-10-17 12:12:43 +02:00
exceptionfactory d23bf2ce4f
NIFI-13596 Renamed Distributed Cache Server and Client Services
- Renamed DistributedMapCacheServer to MapCacheServer
- Renamed DistributedSetCacheServer to SetCacheServer
- Renamed DistributedMapCacheClientService to MapCacheClientService
- Renamed DistributedSetCacheClientService to SetCacheClientService

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9398.
2024-10-17 12:09:00 +02:00
Bryan Bende 1fe54f060b
NIFI-13644 Added GitLab Flow Registry Client (#9264)
- Refactoring to create base class for other git-based flow registry clients
- Implement GitLabRepositoryClient
- Implement GitLabFlowRegistryClient

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 15:03:21 -05:00
exceptionfactory cb2117f8e6 NIFI-13579 Improved Timestamp Zone Offset Formatting and Parsing
- Improved Timestamp to String formatting to support patterns with zone offsets
- Improved String to Timestamp parsing to support adjusted hours and minutes when zone offset is included
2024-10-16 18:37:30 +00:00
exceptionfactory 1b37d78403
NIFI-13874 Refactored KeyStore and SSLContext Creation for Tests
This closes #9392

- Added EphemeralKeyStoreBuilder to nifi-security-ssl
- Removed nifi-security-utils
- Moved StandardTlsConfiguration to nifi-ssl-context-service
- Refactored tests to use EphemeralKeyStoreBuilder and nifi-security-cert-builder for TLS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-16 09:18:59 -07:00
exceptionfactory ea2cfb102f NIFI-13744 Corrected Excel Reader Cell Type Inferencing
- Added Cell Field Type Reader with Timestamp detection

Signed-off-by: dan-s1 <dstieg1@gmail.com>

This closes #9379.
2024-10-16 15:52:19 +00:00
tpalfy 6fb229b23c
NIFI-13860 Avoid Throwing Exceptions for Failures in IPLookupService (#9372)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 09:03:42 -05:00
exceptionfactory 988b4a1a7e
NIFI-13875 Upgraded Calcite from 1.37.0 to 1.38.0
- Upgraded Curator from 5.7.0 to 5.7.1
- Updated TestQueryRecord expected value to align with Calcite 1.38.0 decimal handling

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9394.
2024-10-16 15:29:41 +02:00
exceptionfactory 6a53010390
NIFI-10002 Validated Directory Path in ListFile
- Throw IOException for null or blank directories to avoid invalid directory expressions

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9393.
2024-10-16 12:27:06 +02:00
Peter Turcsanyi c3122b281b
NIFI-13867 Removed legacy code component Proxy Properties (#9381)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-12 11:34:03 -05:00
Mark Payne 0f8b570718
NIFI-13811 Fixed CalculateRecordStats Nested Record Array Handling
This closes #9321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 17:14:35 -05:00
dan-s1 f7d5bd7774
NIFI-13674 Added merge.competion.reason Attribute for MergeRecord (#9363)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 17:00:34 -05:00
Michael Moser 1bfdf3c107
NIFI-12304 Added FlowFileV3 Unpacking to ListenHTTP as a documented UseCase (#9369)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 16:12:15 -05:00
Peter Turcsanyi 4c243bd877
NIFI-13851 Migrated SiteToSiteReportingTask Proxy properties to ProxyConfigurationService (#9359)
- Fixed Reporting Task property migration: in case of sensitive properties the encrypted form was migrated to the new property value

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 16:09:39 -05:00
dan-s1 44ae874032 NIFI-13726 Set cell style copy policy to false in order to avoid exceeding the maximum number of cell styles (64000) in a .xlsx Workbook
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9326
2024-10-11 16:54:39 -04:00
dan-s1 f41f6fea4f
NIFI-13850 Simplified TextXMLReader using Current Language and Library Practices (#9361)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-09 13:06:05 -05:00
Mike Moser 4ecd743693
NIFI-12762 Added Request Header Size to ListenHTTP and HandleHttpRequest
This closes #9304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 14:28:55 -05:00
Vincenzo Abate 0719a8113f
NIFI-13827 Added Reply-To Property to PutEmail (#9332)
Co-authored-by: Vincenzo Abate <vincenzo.abate@teratecnologies.es>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 10:56:51 -05:00
Pierre Villard 7188155d50
NIFI-13847 - Typos in ReplaceText properties descriptions
This closes #9354.

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-10-08 14:33:21 +02:00
Peter Turcsanyi 2cb8411d4f
NIFI-13848 Migrated AWSCredentialsProviderControllerService's Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9357.
2024-10-08 10:54:49 +02:00
dan-s1 92c6ddd98e
NIFI-13335 Added ability for the XMLRecordReader to handle where an array of data has different types.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9356.
2024-10-08 10:47:34 +02:00
Peter Turcsanyi 5f6bdc6243
NIFI-13841 Restored proxy support in AWS PutSNS processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9351.
2024-10-08 10:35:53 +02:00
Peter Turcsanyi 17c8a6bed8
NIFI-13840 Fixed proxy setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9345.
2024-10-07 16:22:28 +02:00
Rajmund Takacs 7da06aab62 NIFI-13829: Mitigate false positive reports of MonitorActivity, in case of infrequent Flow Files
This closes #9333.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-10-07 11:37:46 +02:00
Peter Turcsanyi ae2277478a
NIFI-13842 Fixed truststore/keystore setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9346.
2024-10-07 11:30:21 +02:00
Matt Burgess e6e7e22465 NIFI-13790: Report SEND provenance event in PublishKafka
This closes #9349

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-06 12:42:24 -04:00
lehelb 8424e3428a
NIFI-13798: Renamed Airtable's API Key property to Personal Access Token and updated docs due to API Keys deprecation
This closes #9308.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-10-03 08:53:15 +02:00
Pierre Villard 3af800a017
NIFI-13826 Upgraded Jetty to 12.0.14 and Jackson to 2.18.0 along with others (#9331)
- Jackson from 2.17.2 to 2.18.0
- zstd-jni from 1.5.6-5 to 1.5.6-6
- gson from 2.10.1 to 2.11.0
- okio from 3.9.0 to 3.9.1
- Fabric8 Kubernetes from 6.13.1 to 6.13.4
- Netty from 4.1.113.Final to 4.1.114.Final
- swagger-annotations from 2.2.23 to 2.2.24
- avro from 1.11.3 to 1.11.4
- commons-lang3 from 3.16.0 to 3.17.0
- log4j from 2.24.0 to 2.24.1
- Jetty from 12.0.13 to 12.0.14
- junit-bom from 5.10.3 to 5.10.4
- junit-platform-commons from 1.10.3 to 1.10.4
- mockito from 5.13.0 to 5.14.1
- testcontainers from 1.20.1 to 1.20.2
- snakeyaml from 2.2 to 2.3
- AWS SDK v2 from 2.28.4 to 2.28.13
- flyway from 10.18.0 to 10.18.2
- jline from 3.26.3 to 3.27.0
- neo4j driver from 5.24.0 to 5.25.0
- maxmind from 3.1.0 to 3.1.1
- geoip2 from 4.2.0 to 4.2.1
- amqp-client from 5.21.0 to 5.22.0
- commons-csv from 1.11.0 to 1.12.0
- splunk from 1.9.4 to 1.9.5
- lucene from 9.11.1 to 9.12.0
- Google BOM from 26.46.0 to 26.47.0
- Azure BOM from 1.2.26 to 1.2.28
- msal4j from 1.16.1 to 1.17.1
- json-schema-validator from 1.5.1 to 1.5.2
- checker-qual from 3.45.0 to 3.47.0
- checkstyle from 10.16.0 to 10.18.2

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-02 18:13:08 -05:00
dan-s1 dd8681e3a2 NIFI-13819 Provided a row number and sheet name if ExcelReader throws exception when it fails to convert a value.
This closes #9327

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-01 09:17:14 -04:00
Matt Gilman fb2a82c035
NIFI-13721: Migrating documentation into the NiFi UI (#9288)
* NIFI-13721: Migrating additional details to markdown.

* NIFI-13721: Rebuilding documentation to generate mark up on the client.

* NIFI-13721: Removing old documentation approach.

* NIFI-13721: Rebase main and final fixing button colors.

* NIFI-13721: Fixing rat issues.

* NIFI-13721: Removing generated comonent documentation.
- Removing links and images from additional details markdown.

* NIFI-13721: Recreating package lock following rebase.

* NIFI-13721: Updating documentation for M3.

* NIFI-13721: Fixing broken test.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Ensuring the selected item is visible after routing.

* NIFI-13721: Fixing reportingTaskTypes in finding extensions for a given type.

* NIFI-13721: Updating the see also component to handle when the referenced extension is not installed.

* NIFI-13721: Fixing expansion panel header styles.
2024-09-27 11:11:55 -04:00
Bob Paulin 34aa764132
NIFI-13779 Improved Provenance Lineage for Python FlowFileTransform (#9292)
- Transform input FlowFile instead of cloned FlowFile

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-26 12:39:19 -05:00
Mark Payne 6b4daa2ec2
NIFI-13801: Fixed counter for ConsumeKafka to correctly indicate number of messages received using using a demarcator
This closes #9311.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-24 21:31:14 -04:00
Pierre Villard 150cba8bef
NIFI-13712 Added Receive Channel Join Events to ListenSlack (#9230)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-23 10:35:07 -05:00
Mark Bathori 07611ded2b
NIFI-13722: Kerberos ticket renewal issue due static thread pool in Iceberg library
This closes #9258.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 12:08:19 +02:00
Peter Gyori e5a80e6ba6
NIFI-13771 Python source processor default Run Duration 0 ms and Run Schedule 1 min
This closes #9282.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 11:50:39 +02:00
Mark Payne 1b525aef0c
NIFI-13791 Added Counters to PublishKafka and ConsumeKafka for Records per Topic (#9300)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 20:58:03 -05:00
Mark Payne d04d38fc44
NIFI-13787 Fixed error and record handling in ConsumeKafka
Eliminated unnecessary connection pooling at the service layer so that a single Consumer is made available to the processor. This allows the processor to rollback offsets and provides a simpler API.

This closes #9298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 17:33:54 -05:00
Mark Payne 6ddae78b6f
NIFI-13784 Fixed Kafka Publishing Behavior creating multiple Producers (#9297)
Fixed error handling in several situations. Cleaned up leaky abstraction. Some code cleanup, fixed default values for time-based properties to use 'sec' instead of 's' to adhere to typical conventions.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-21 16:45:36 -05:00
exceptionfactory a43135ce0c
NIFI-13783 Removed commons-codec from Kafka Processors
This closes #9295

- Replaced Commons Codec Hex with Java HexFormat

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-21 10:06:33 -07:00
Joe Witt 29307dbf71
NIFI-13775 Fixed NoClassDefFoundError with ArrayUtils in ConsumeKafka (#9287)
- Upgraded Kafka Clients from 3.7.1 to 3.8.0
- Inheriting from the correct base services-api instead of shared-bundle then identifying missing explicit dependencies of Kafka processors commons-lang3 and commons-codec

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-20 13:39:26 -05:00
Joseph Witt e155e6bb26
NIFI-13769 bump various deps for logback, amazon, spring, and more
ch.qos.logback 1.5.7 1.5.8
com.amazonaws 1.12.770 1.12.772
com.github.luben 1.5.6-4 1.5.6-5
commons-io 2.16.1 2.17.0
io.netty 4.1.112.Final 4.1.113.Final
org.apache.ant 1.10.14 1.10.15
org.apache.logging.log4j 2.23.1 2.24.0  (why is this here!?)
org.eclipse.jetty 12.0.12 12.0.13
org.springframework 6.1.12 6.1.13
org.xerial.snappy 1.1.10.6 1.1.10.7
software.amazon.awssdk 2.27.14 2.28.4
com.google.apis v3-rev20240730-2.0.0	 v3-rev20240903-2.0.0
com.slack.api bolt-socket-mode 1.42.0 1.42.1
com.squareup.wire wire-schema-jvm 5.0.0 5.1.0
io.projectreactor (core/test) 3.6.9 3.6.10
net.java.dev.jna (jna/jna-platform) 5.14.0 5.15.0
org.apache.groovy 4.0.22 4.0.23
org.apache.maven maven-artifact 3.9.8 3.9.9
org.eclipse.jgit 6.10.0.202406032230-r	 7.0.0.202409031743-r
org.flywaydb 10.17.2 10.18.0
org.kosuke 1.324 1.326
org.mongodb 4.11.3 4.11.4
org.neo4j.driver 5.23.0 5.24.0
org.postgresql 42.7.3 42.7.4
org.springframework.boot 3.3.3 3.3.4
org.springframework.integration 6.3.3 6.3.4
org.springframework.retry 2.0.8 2.0.9

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9280.
2024-09-20 13:46:02 +01:00
Lucas c71c13ce31
NIFI-13750 Abort SFTP listing once maxResults is reached (#9267)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 16:16:10 -05:00
timeabarna e125d8cdbb
NIFI-13763 Fixed HashSet Filtering for DeduplicateRecord (#9277)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:57:44 -05:00
Peter Turcsanyi 58184683df
NIFI-13758 Upgraded Google Cloud Libraries to 26.46.0 (#9275)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:54:03 -05:00
dependabot[bot] d455c00387
NIFI-13768 Upgraded protobuf from 3.25.3 to 3.25.5
This closes #9278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:06:28 -05:00
Lucas 00c7a78119
NIFI-13751 Upgraded SSHJ from 0.38.0 to 0.39.0 (#9266)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 14:59:29 -05:00
Peter Turcsanyi 6355812a77
NIFI-13733 Migrated FTP and SFTP processors' Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9252.
2024-09-12 11:54:04 +02:00
David Handermann 1101d4d995
NIFI-13734 Removed getTook assertions from Elasticsearch Test (#9254) 2024-09-10 17:21:25 -04:00