Commit Graph

309 Commits

Author SHA1 Message Date
exceptionfactory b6952f1246
NIFI-13933 Upgraded Spring Security to 6.3.4 and other dependencies
This closes #9450

- Upgraded Spring Security from 6.3.3 to 6.3.4
- Upgraded Hadoop from 3.4.0 to 3.4.1
- Upgraded Velocity Engine Core from 2.3.0 to 2.4.1
- Upgraded Parquet Avro from 1.13.1 to 1.14.3
- Upgraded Google Libraries from 26.47.0 to 26.49.0
- Set protobuf-java to 3.25.5 for calcite-core and amazon-kinesis-client libraries
- Updated Dependency Check suppressions

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-26 14:14:14 -07:00
Pierre Villard 31d92b5115
NIFI-13927 Use synchronized lists in PublishGCPubSub (#9449)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-26 11:44:29 -05:00
Bence Simon 5be2cd73e6
NIFI-13932 Calling super #migrateProperty in JsonRecordSetWriter
This closes #9448.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-10-25 17:08:15 +02:00
Nicolae Puica 35219052e1
NIFI-13869: Enhance QuerySalesforceObject Processor to Support Querying Deleted Records
- Added a new boolean property `Include Deleted Records` to allow users to include deleted (soft-deleted) records in Salesforce queries.
- Modified the query construction to include the `IsDeleted` field and use the `queryAll` API endpoint when `Include Deleted Records` is enabled.
- Updated `SalesforceRestClient` to support the `queryAll` API by adding a new `queryAll` method.
- Ensured backward compatibility by defaulting `Include Deleted Records` to `false`, maintaining existing behavior unless explicitly enabled.
- Updated processor documentation and annotations to reflect the new functionality.
- Adjusted state management to reset state when `Include Deleted Records` property is modified.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9434.
2024-10-22 18:37:45 +02:00
Lehel Boér a44fb528f6
NIFI-13896 Removed legacy state migration from TailFile (#9425)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-21 15:51:09 -05:00
Hunter Goller d693293c43
NIFI-13853: Added the ability to filter by all to the Advanced Rules page (#9371)
* NIFI-13853: Added the ability to filter by all to the Advanced Rules pag

* NIFI-13853: Fixed formatting

* NIFI-13853: Removed labels in filter by everything

Removed 'Name, Comments, Condition, Action' labels

Co-authored-by: Rob Fellows <rob.fellows@gmail.com>

* NIFI-13853: Fixed indentation

* NIFI-13853:Fixed the indentation

For some reason my last commit didn't fix the indentation

---------

Co-authored-by: Rob Fellows <rob.fellows@gmail.com>

This closes #9371
2024-10-21 16:46:56 -04:00
exceptionfactory cc2cdddd49
NIFI-13910 Upgraded Apache Tika from 2.9.2 to 3.0.0
This closes #9427

- Removed unused dependency from nifi-framework-bundle
- Aligned custom-mimetypes.xml location with Tika 3 default location

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-21 07:38:13 -07:00
Mike e37cd2b5e6
NIFI-13776 Updated CopyS3Object to Handle Files over 5 GB
This closes #9418

- Added multipart copying for files over 5 GB

Co-authored-by: Mike Thomsen <mthomsen@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 16:24:38 -07:00
Mike Moser 80e889305f
NIFI-7085 add flowFile batching to ConsumeJMS and PublishJMS
This closes #8584

load some configuration in onScheduled instead of a loop, reinstated and fixed a failing integration test
2024-10-18 16:23:22 -07:00
Joe Witt 811af23343
NIFI-13895 Upgraded AWS SDK to 1.12.775 and 2.28.25 along with others (#9416)
- Upgraded AWS SDK from 1.12.774 to 1.12.775
- Upgraded AWS SDK from 2.28.24 to 2.28.25
- Upgraded Box API from 4.11.1 to 4.12.0
- Upgraded nimbus-jose-jwt from 9.40 to 9.41.2
- Upgraded oauth2-oidc-sdk from 11.14 to 11.20.1
- Upgraded reactor-netty-heep from 1.1.22 to 1.1.23
- Upgraded Elasticsearch Client from 8.15.1 to 8.15.3
- Upgraded Google API from v3-rev20240903-2.0.0 to v3-rev20240914-2.0.0
- Upgraded MySQL Driver from 9.0.0 to 9.1.0
- Upgraded Slack bolt-socket-mode from 1.42.1 to 1.44.0
- Upgraded Project Reactor from 3.6.10 to 3.6.11
- Upgraded Flyway DB from 10.18.2 to 10.20.0
- Upgraded gitlab4j-api from 6.0.0-rc.5 to 6.0.0-rc.6
- Upgraded JLine from 3.27.0 to 3.27.1
- Upgraded Neo4j Driver from 5.25.0 to 5.26.0

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-18 00:11:52 -05:00
exceptionfactory d42b110474
NIFI-13886 Upgraded Spring from 6.1.13 to 6.1.14 and others
- Upgraded Apache MINA SSHD from 2.13.2 to 2.14.0
- Upgraded Dropwizard Metrics from 4.2.27 to 4.2.28
- Upgraded Guava from 33.2.1 to 33.3.1
- Upgraded ASM from 9.7 to 9.7.1
- Upgraded Apache JSP from 10.1.16 to 10.1.31
- Upgraded Apache EL from 10.1.16 to 10.1.31
- Upgraded Data Faker from 2.3.1 to 2.4.0
- Upgraded JSON Flattener from 0.16.6 to 0.17.0
- Upgraded Check Qual from 3.47.0 to 3.48.1
- Upgraded error-prone-annotations from 2.28.0 to 2.33.0
- Upgraded frontend-maven-plugin from 1.15.0 to 1.15.1
- Upgraded AWS SDK from 1.12.772 to 1.2.774
- Upgraded AWS SDK from 2.28.13 to 2.28.24
- Upgraded JSON Smart from 2.5.0 to 2.5.1
- Upgraded Jersey from 3.1.8 to 3.1.9
- Upgraded Logback from 1.5.8 to 1.5.11
- Upgraded Servlet API from 6.0.0 to 6.1.0
- Upgraded Swagger Annotations from 2.2.24 to 2.2.25

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9407.
2024-10-17 18:04:51 +02:00
Mark Bathori 7e1789d6f0
NIFI-13877 Closed Catalog after processing in PutIceberg (#9395)
- Resolved JdbcCatalog being created but not closed

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:36:32 -05:00
Mark Bathori 1823a52e36
NIFI-13884 Removed File IO Implementation Property from PutIceberg (#9403)
- Removed pending further testing and evaluation of runtime behavior

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:00:36 -05:00
exceptionfactory babfd5a559
NIFI-13881 Upgraded JUnit from 5.10.4 to 5.11.2 along with Plugins
- Upgraded Apache Parent from 32 to 33
- Upgraded Surefire Plugin from 3.2.5 to 3.5.1
- Upgraded Mockito from 5.14.1 to 5.14.2
- Upgraded JUnit Platform from 1.10.4 to 1.11.2
- Upgraded Exec Maven Plugin from 3.2.0 o 3.4.1
- Upgraded Buildnumber Maven Plugin from 3.2.0
- Upgraded Maven Checkstyle Plugin from 3.3.1 to 3.5.0
- Upgraded Checkstyle from 10.16.0 to 10.18.2
- Upgraded Versions Maven Plugin from 2.16.2 to 2.17.1
- Upgraded Nexus Staging Plugin from 1.6.13 to 1.7.00
- Upgraded JAXB Maven Plugin from 2.2.0 to 2.2.1
- Upgraded Swagger Maven Plugin from 2.2.23 to 2.2.25
- Upgraded Swagger Codegen Plugin from 3.0.55 to 3.0.63
- Upgraded Maven JAR Plugin from 3.4.1 to 3.4.2
- Upgraded Dependency Check Plugin from 10.0.3 to 10.0.4
- Upgraded Jagged BOM from 0.4.0 to 1.0.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9400.
2024-10-17 12:12:43 +02:00
exceptionfactory d23bf2ce4f
NIFI-13596 Renamed Distributed Cache Server and Client Services
- Renamed DistributedMapCacheServer to MapCacheServer
- Renamed DistributedSetCacheServer to SetCacheServer
- Renamed DistributedMapCacheClientService to MapCacheClientService
- Renamed DistributedSetCacheClientService to SetCacheClientService

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9398.
2024-10-17 12:09:00 +02:00
Bryan Bende 1fe54f060b
NIFI-13644 Added GitLab Flow Registry Client (#9264)
- Refactoring to create base class for other git-based flow registry clients
- Implement GitLabRepositoryClient
- Implement GitLabFlowRegistryClient

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 15:03:21 -05:00
exceptionfactory cb2117f8e6 NIFI-13579 Improved Timestamp Zone Offset Formatting and Parsing
- Improved Timestamp to String formatting to support patterns with zone offsets
- Improved String to Timestamp parsing to support adjusted hours and minutes when zone offset is included
2024-10-16 18:37:30 +00:00
exceptionfactory 1b37d78403
NIFI-13874 Refactored KeyStore and SSLContext Creation for Tests
This closes #9392

- Added EphemeralKeyStoreBuilder to nifi-security-ssl
- Removed nifi-security-utils
- Moved StandardTlsConfiguration to nifi-ssl-context-service
- Refactored tests to use EphemeralKeyStoreBuilder and nifi-security-cert-builder for TLS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-16 09:18:59 -07:00
exceptionfactory ea2cfb102f NIFI-13744 Corrected Excel Reader Cell Type Inferencing
- Added Cell Field Type Reader with Timestamp detection

Signed-off-by: dan-s1 <dstieg1@gmail.com>

This closes #9379.
2024-10-16 15:52:19 +00:00
tpalfy 6fb229b23c
NIFI-13860 Avoid Throwing Exceptions for Failures in IPLookupService (#9372)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 09:03:42 -05:00
exceptionfactory 988b4a1a7e
NIFI-13875 Upgraded Calcite from 1.37.0 to 1.38.0
- Upgraded Curator from 5.7.0 to 5.7.1
- Updated TestQueryRecord expected value to align with Calcite 1.38.0 decimal handling

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9394.
2024-10-16 15:29:41 +02:00
exceptionfactory 6a53010390
NIFI-10002 Validated Directory Path in ListFile
- Throw IOException for null or blank directories to avoid invalid directory expressions

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9393.
2024-10-16 12:27:06 +02:00
Peter Turcsanyi c3122b281b
NIFI-13867 Removed legacy code component Proxy Properties (#9381)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-12 11:34:03 -05:00
Mark Payne 0f8b570718
NIFI-13811 Fixed CalculateRecordStats Nested Record Array Handling
This closes #9321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 17:14:35 -05:00
dan-s1 f7d5bd7774
NIFI-13674 Added merge.competion.reason Attribute for MergeRecord (#9363)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 17:00:34 -05:00
Michael Moser 1bfdf3c107
NIFI-12304 Added FlowFileV3 Unpacking to ListenHTTP as a documented UseCase (#9369)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 16:12:15 -05:00
Peter Turcsanyi 4c243bd877
NIFI-13851 Migrated SiteToSiteReportingTask Proxy properties to ProxyConfigurationService (#9359)
- Fixed Reporting Task property migration: in case of sensitive properties the encrypted form was migrated to the new property value

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 16:09:39 -05:00
dan-s1 44ae874032 NIFI-13726 Set cell style copy policy to false in order to avoid exceeding the maximum number of cell styles (64000) in a .xlsx Workbook
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9326
2024-10-11 16:54:39 -04:00
dan-s1 f41f6fea4f
NIFI-13850 Simplified TextXMLReader using Current Language and Library Practices (#9361)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-09 13:06:05 -05:00
Mike Moser 4ecd743693
NIFI-12762 Added Request Header Size to ListenHTTP and HandleHttpRequest
This closes #9304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 14:28:55 -05:00
Vincenzo Abate 0719a8113f
NIFI-13827 Added Reply-To Property to PutEmail (#9332)
Co-authored-by: Vincenzo Abate <vincenzo.abate@teratecnologies.es>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 10:56:51 -05:00
Pierre Villard 7188155d50
NIFI-13847 - Typos in ReplaceText properties descriptions
This closes #9354.

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-10-08 14:33:21 +02:00
Peter Turcsanyi 2cb8411d4f
NIFI-13848 Migrated AWSCredentialsProviderControllerService's Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9357.
2024-10-08 10:54:49 +02:00
dan-s1 92c6ddd98e
NIFI-13335 Added ability for the XMLRecordReader to handle where an array of data has different types.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9356.
2024-10-08 10:47:34 +02:00
Peter Turcsanyi 5f6bdc6243
NIFI-13841 Restored proxy support in AWS PutSNS processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9351.
2024-10-08 10:35:53 +02:00
Peter Turcsanyi 17c8a6bed8
NIFI-13840 Fixed proxy setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9345.
2024-10-07 16:22:28 +02:00
Rajmund Takacs 7da06aab62 NIFI-13829: Mitigate false positive reports of MonitorActivity, in case of infrequent Flow Files
This closes #9333.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-10-07 11:37:46 +02:00
Peter Turcsanyi ae2277478a
NIFI-13842 Fixed truststore/keystore setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9346.
2024-10-07 11:30:21 +02:00
Matt Burgess e6e7e22465 NIFI-13790: Report SEND provenance event in PublishKafka
This closes #9349

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-06 12:42:24 -04:00
lehelb 8424e3428a
NIFI-13798: Renamed Airtable's API Key property to Personal Access Token and updated docs due to API Keys deprecation
This closes #9308.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-10-03 08:53:15 +02:00
Pierre Villard 3af800a017
NIFI-13826 Upgraded Jetty to 12.0.14 and Jackson to 2.18.0 along with others (#9331)
- Jackson from 2.17.2 to 2.18.0
- zstd-jni from 1.5.6-5 to 1.5.6-6
- gson from 2.10.1 to 2.11.0
- okio from 3.9.0 to 3.9.1
- Fabric8 Kubernetes from 6.13.1 to 6.13.4
- Netty from 4.1.113.Final to 4.1.114.Final
- swagger-annotations from 2.2.23 to 2.2.24
- avro from 1.11.3 to 1.11.4
- commons-lang3 from 3.16.0 to 3.17.0
- log4j from 2.24.0 to 2.24.1
- Jetty from 12.0.13 to 12.0.14
- junit-bom from 5.10.3 to 5.10.4
- junit-platform-commons from 1.10.3 to 1.10.4
- mockito from 5.13.0 to 5.14.1
- testcontainers from 1.20.1 to 1.20.2
- snakeyaml from 2.2 to 2.3
- AWS SDK v2 from 2.28.4 to 2.28.13
- flyway from 10.18.0 to 10.18.2
- jline from 3.26.3 to 3.27.0
- neo4j driver from 5.24.0 to 5.25.0
- maxmind from 3.1.0 to 3.1.1
- geoip2 from 4.2.0 to 4.2.1
- amqp-client from 5.21.0 to 5.22.0
- commons-csv from 1.11.0 to 1.12.0
- splunk from 1.9.4 to 1.9.5
- lucene from 9.11.1 to 9.12.0
- Google BOM from 26.46.0 to 26.47.0
- Azure BOM from 1.2.26 to 1.2.28
- msal4j from 1.16.1 to 1.17.1
- json-schema-validator from 1.5.1 to 1.5.2
- checker-qual from 3.45.0 to 3.47.0
- checkstyle from 10.16.0 to 10.18.2

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-02 18:13:08 -05:00
dan-s1 dd8681e3a2 NIFI-13819 Provided a row number and sheet name if ExcelReader throws exception when it fails to convert a value.
This closes #9327

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-01 09:17:14 -04:00
Matt Gilman fb2a82c035
NIFI-13721: Migrating documentation into the NiFi UI (#9288)
* NIFI-13721: Migrating additional details to markdown.

* NIFI-13721: Rebuilding documentation to generate mark up on the client.

* NIFI-13721: Removing old documentation approach.

* NIFI-13721: Rebase main and final fixing button colors.

* NIFI-13721: Fixing rat issues.

* NIFI-13721: Removing generated comonent documentation.
- Removing links and images from additional details markdown.

* NIFI-13721: Recreating package lock following rebase.

* NIFI-13721: Updating documentation for M3.

* NIFI-13721: Fixing broken test.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Ensuring the selected item is visible after routing.

* NIFI-13721: Fixing reportingTaskTypes in finding extensions for a given type.

* NIFI-13721: Updating the see also component to handle when the referenced extension is not installed.

* NIFI-13721: Fixing expansion panel header styles.
2024-09-27 11:11:55 -04:00
Bob Paulin 34aa764132
NIFI-13779 Improved Provenance Lineage for Python FlowFileTransform (#9292)
- Transform input FlowFile instead of cloned FlowFile

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-26 12:39:19 -05:00
Mark Payne 6b4daa2ec2
NIFI-13801: Fixed counter for ConsumeKafka to correctly indicate number of messages received using using a demarcator
This closes #9311.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-24 21:31:14 -04:00
Pierre Villard 150cba8bef
NIFI-13712 Added Receive Channel Join Events to ListenSlack (#9230)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-23 10:35:07 -05:00
Mark Bathori 07611ded2b
NIFI-13722: Kerberos ticket renewal issue due static thread pool in Iceberg library
This closes #9258.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 12:08:19 +02:00
Peter Gyori e5a80e6ba6
NIFI-13771 Python source processor default Run Duration 0 ms and Run Schedule 1 min
This closes #9282.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-23 11:50:39 +02:00
Mark Payne 1b525aef0c
NIFI-13791 Added Counters to PublishKafka and ConsumeKafka for Records per Topic (#9300)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 20:58:03 -05:00
Mark Payne d04d38fc44
NIFI-13787 Fixed error and record handling in ConsumeKafka
Eliminated unnecessary connection pooling at the service layer so that a single Consumer is made available to the processor. This allows the processor to rollback offsets and provides a simpler API.

This closes #9298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-22 17:33:54 -05:00
Mark Payne 6ddae78b6f
NIFI-13784 Fixed Kafka Publishing Behavior creating multiple Producers (#9297)
Fixed error handling in several situations. Cleaned up leaky abstraction. Some code cleanup, fixed default values for time-based properties to use 'sec' instead of 's' to adhere to typical conventions.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-21 16:45:36 -05:00
exceptionfactory a43135ce0c
NIFI-13783 Removed commons-codec from Kafka Processors
This closes #9295

- Replaced Commons Codec Hex with Java HexFormat

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-21 10:06:33 -07:00
Joe Witt 29307dbf71
NIFI-13775 Fixed NoClassDefFoundError with ArrayUtils in ConsumeKafka (#9287)
- Upgraded Kafka Clients from 3.7.1 to 3.8.0
- Inheriting from the correct base services-api instead of shared-bundle then identifying missing explicit dependencies of Kafka processors commons-lang3 and commons-codec

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-20 13:39:26 -05:00
Joseph Witt e155e6bb26
NIFI-13769 bump various deps for logback, amazon, spring, and more
ch.qos.logback 1.5.7 1.5.8
com.amazonaws 1.12.770 1.12.772
com.github.luben 1.5.6-4 1.5.6-5
commons-io 2.16.1 2.17.0
io.netty 4.1.112.Final 4.1.113.Final
org.apache.ant 1.10.14 1.10.15
org.apache.logging.log4j 2.23.1 2.24.0  (why is this here!?)
org.eclipse.jetty 12.0.12 12.0.13
org.springframework 6.1.12 6.1.13
org.xerial.snappy 1.1.10.6 1.1.10.7
software.amazon.awssdk 2.27.14 2.28.4
com.google.apis v3-rev20240730-2.0.0	 v3-rev20240903-2.0.0
com.slack.api bolt-socket-mode 1.42.0 1.42.1
com.squareup.wire wire-schema-jvm 5.0.0 5.1.0
io.projectreactor (core/test) 3.6.9 3.6.10
net.java.dev.jna (jna/jna-platform) 5.14.0 5.15.0
org.apache.groovy 4.0.22 4.0.23
org.apache.maven maven-artifact 3.9.8 3.9.9
org.eclipse.jgit 6.10.0.202406032230-r	 7.0.0.202409031743-r
org.flywaydb 10.17.2 10.18.0
org.kosuke 1.324 1.326
org.mongodb 4.11.3 4.11.4
org.neo4j.driver 5.23.0 5.24.0
org.postgresql 42.7.3 42.7.4
org.springframework.boot 3.3.3 3.3.4
org.springframework.integration 6.3.3 6.3.4
org.springframework.retry 2.0.8 2.0.9

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9280.
2024-09-20 13:46:02 +01:00
Lucas c71c13ce31
NIFI-13750 Abort SFTP listing once maxResults is reached (#9267)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 16:16:10 -05:00
timeabarna e125d8cdbb
NIFI-13763 Fixed HashSet Filtering for DeduplicateRecord (#9277)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:57:44 -05:00
Peter Turcsanyi 58184683df
NIFI-13758 Upgraded Google Cloud Libraries to 26.46.0 (#9275)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:54:03 -05:00
dependabot[bot] d455c00387
NIFI-13768 Upgraded protobuf from 3.25.3 to 3.25.5
This closes #9278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-19 15:06:28 -05:00
Lucas 00c7a78119
NIFI-13751 Upgraded SSHJ from 0.38.0 to 0.39.0 (#9266)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 14:59:29 -05:00
Peter Turcsanyi 6355812a77
NIFI-13733 Migrated FTP and SFTP processors' Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9252.
2024-09-12 11:54:04 +02:00
David Handermann 1101d4d995
NIFI-13734 Removed getTook assertions from Elasticsearch Test (#9254) 2024-09-10 17:21:25 -04:00
Lucas c4d11feda5
NIFI-13730 Refactor TestUpdateAttribute using current API methods (#9249)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-10 13:58:23 -05:00
EndzeitBegins 821e5d23c9
NIFI-13372 Add processor DeleteSFTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9012.
2024-09-09 16:03:24 +02:00
EndzeitBegins bb7cce50d2
NIFI-13703 Remove deprecated property DISTRIBUTED_CACHE_SERVICE in AbstractListProcessor
This closes #9246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 14:09:25 +02:00
Chris Sampson 2ead001d14
NIFI-13719 allow Elasticsearch response to contain Long values for the took field
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9244.
2024-09-09 14:00:23 +02:00
EndzeitBegins 657e75c667
NIFI-13729 Remove deprecated property MAX_RECV_THREAD_POOL_SIZE from ListenTCP
This closes #9248.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 10:17:07 +02:00
EndzeitBegins 61aeb7af39
NIFI-13728 Remove deprecated property KERBEROS_RELOGIN_PERIOD in AbstractHadoopProcessor
This closes #9247.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-09 09:42:09 +02:00
David Handermann fafdb96a50
NIFI-13725 Disabled Spring Logging System in Content Viewer (#9240)
This closes #9240
2024-09-06 18:34:49 -04:00
Peter Turcsanyi a7112a60ec
NIFI-13583 Overrode google-auth-library-oauth2-http version to 1.25.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9235.
2024-09-06 17:42:33 +02:00
Matt Gilman 39ab3129f0
NIFI-13632: Updating content access. (#9221)
* NIFI-13632: Updating content access.
- Removing existing content viewer application.
- Introduced new front end based content viewer applicaiton.
- Introduced new bundled content viewers for hex and images.
- Deleted previous image content viewer.
- Migrated existing standard content viewer (which handles json, xml, yaml, csv, and text) to utilize new content access interface.
- Moved standard content viewer into its own NAR.
- Moved and renamed custom ui utils and content viewer utils into nifi-common.
- Added mime type to FlowFileSummary response payload to help drive the initially opened content viewer.

* NIFI-13632: Fixing rat issue.

* NIFI-13632: Fixing CI issue.

* NIFI-13632: Removing standard content viewer war from code coverage.

* NIFI-13632: Addressing review feedback.

* NIFI-13632: Fixing import.

* NIFI-13632: Further simplification of content viewer state.

* NIFI-13632: Removing unneeded code.

* NIFI-13632: Adding a min height around codemirror.

* NIFI-13632: Addressing review feedback.
- Rendering mime type in the content viewer.
- Preventing additions to the browser history as the user changes how the content is viewed.
- Appending forward slash to content viewer UIs to prevent unnecessary redirect.
- Removing Standard Content Viewer title based on review feedback.
- Fixing double scroll bar in the Standard Content Viewer on small browser heights.
- Removed unnecessary application.yml.
- Bumping spring boot version.

This closes #9221
2024-09-06 09:12:38 -04:00
dan-s1 727b0ba106
NIFI-13709 Added more meaningful message when validation fails with non-compliant XML is validated and no schema is provided.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9229.
2024-09-05 12:06:23 +02:00
EndzeitBegins d1432d6be9
NIFI-13702 Remove deprecated property STATE_UPDATE_INTERVAL from CaptureChangeMySQL
This closes #9225

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:30 -05:00
EndzeitBegins 1ad9d86a26
NIFI-13701 Remove deprecated property CACHE_SCHEMA from QueryRecord
This closes #9224

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:02:07 -05:00
Juldrixx f92f6f1def
NIFI-13578 Add Schema Branch Name and Schema Version in ValidateRecord (#9108)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 10:54:26 -05:00
Pierre Villard f828907df5
NIFI-12080 Added support for KV_2 in HashiCorp Parameter Provider
This closes #9209

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 09:12:12 -05:00
Mike 2fc0ca1b7b
NIFI-13692 Catch All Exceptions in ResizeImage (#9213)
Widening the scope of caught Exceptions for routing to failure ensures that the Processor can catch pretty much everything a user could throw at this processor.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-29 09:29:15 -05:00
Joseph Witt a8e204aceb
NIFI-13690 Upgraded AWS SDK to 2.27.14 and other dependencies
- Upgraded Logback from 1.5.6 to 1.5.7
- Upgraded brotli4j from 1.16.0 to 1.17.0
- Upgraded AWS SDK from 1.12.767 to 1.12.770
- Upgraded AWS SDK from 2.27.1 to 2.27.14
- Upgraded H2 from 2.3.230 to 2.3.232
- Upgraded Commons CLI from 1.8.0 to 1.9.0
- Upgraded Dropwizard Metrics from 4.2.26 to 4.2.27
- Upgraded Kubernetes Client from 6.13.2 to 6.13.3
- Upgraded Reactor Netty from 1.1.21 to 1.1.22
- Upgraded Commons Compress from 1.27.0 to 1.27.1
- Upgraded Mockito from 5.12.0 to 5.13.0
- Upgraded Slack API from 1.40.3 to 1.42.0
- Upgraded Project Reactor Core from 3.6.8 to 3.6.9
- Upgraded Iceberg from 1.6.0 to 1.6.1
- Upgraded FlywayDB from 10.17.0 to 10.17.2
- Upgraded GitHub API 1.323 to 1.324
- Upgraded PostgreSQL from 42.7.3 to 42.7.4
- Upgraded Spring Integration from 6.3.2 to 6.3.3
- Upgraded Spring Retry 2.0.7 to 2.0.8
- Upgraded Spring Vault from 3.1.1 to 3.1.2

This closes #9206

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-28 14:17:37 -05:00
Jim Steinebrey 1d1cf92b16
NIFI-13686 Make TestListFile.testFilterAge more resilient to work with time delays during execution
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #9204.
2024-08-28 09:38:31 -04:00
Jim Steinebrey cbdc53a565 NIFI-13543 Add HttpRecordSink
NIFI-13543 Changed default batch size to 0 and changed to throw IOException from sendHttpRequest()

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9185
2024-08-23 15:53:38 -04:00
Mark Bathori f31f803282 NIFI-12078: Add JDBC Catalog Controller Service for Iceberg processors
Disable jdbc catalog tests on Windows OS

Fix review comments

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9145
2024-08-23 15:05:25 -04:00
lehelb 81bb78cef7
NIFI-13671 - QuerySalesforceObject fails to parse DateTime fields
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9193.
2024-08-23 11:42:05 +02:00
Mike Thomsen 31e5afc9b8 NIFI-13666 Added a catch for IllegalArgumentException in FetchS3Object
NIFI-13666 Added the same try/catch to a few other processors

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9188
2024-08-20 18:45:05 -04:00
Scott Aslan 8919955bfc
[NIFI-13656] allow enter button to submit create PG and create Port form (#9181)
* [NIFI-13656] allow enter button to submit create PG and create Port form

* restore scrolling for hints in codemirrors in update attribute

* fix unit tests

* update unit test

* remove duplicate imports

This closes #9181
2024-08-20 12:50:03 -04:00
sullis c2dd939e3c NIFI-13576: Upgrade Iceberg from 1.5.2 to 1.6.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9105
2024-08-19 16:23:54 -04:00
Juldrixx 9fbe6aab74
NIFI-13630 Handle Map Avro Type in PutBigQuery
This closes #9151

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 21:12:46 -05:00
Rajmund Takacs d4344a3140
NIFI-13642 Added Delete Keys Property to PutDatabaseRecord
- Delete Keys property enables targeted deletes for databases that do not support primary keys

This closes #9162

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 20:58:14 -05:00
Umar Hussain abe41ff649
NIFI-12411 Update PublishAMQP with configurable Header Source Property
This closes #8105

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 17:16:24 -05:00
dan-s1 9d51c675cb
NIFI-12709 Added New FlowFlow Attributes for Zip and Tar in UnpackContent
This closes #9122

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 15:57:16 -05:00
Matt Gilman 38f4110521
NIFI-13650: Fixing condition when including References Parameter... o… (#9174)
* NIFI-13650: Fixing condition when including References Parameter option.
- Updating property editors to better convey different parameter states.
- Updating hint tooltip to indicate that parameters are supported but no parameter context is bound.
- Fixing minor layout issue in Processor schedule tab.
- Fix combo editor unit tests.

* NIFI-13650: Fixing track warning errors when editing Parameter Contexts.

* NIFI-13650: Fixing z-index autocomplete issue.

This closes #9174
2024-08-16 16:20:01 -04:00
Joseph Witt e4ec0cb20d
NIFI-13651 Moved framework-related modules under framework-bundle
- Removed references to nifi-property-utils under nifi-extension-bundles

This closes #9169

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-16 13:44:13 -05:00
Mike Thomsen 99f3717f13
NIFI-13430 Added CopyS3Object and GetS3ObjectMetadata
This closes #8992

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-14 20:23:20 -05:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
Michael Akinyemi 39a1ccc191
NIFI-11977 Set UTF-8 Character Set in Subject for PutEmail (#9170)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:03:41 -05:00
Joseph Witt 3096c983f5
NIFI-13648 Upgraded Jetty to 12.0.12 along with other common dependencies
- Upgraded AWS SDK from 1.12.762 to 1.12.767
- Upgraded AWSK SDK from 2.26.21 to 2.27.1
- Upgraded zstd-jni from 1.5.6-3 to 1.5.6-4
- Upgraded excel-streaming-reader from 4.4.0 to 5.0.2
- Upgraded azure-sdk-bom from 1.2.25 to 1.2.26
- Upgraded json-schema-validator from 1.5.0 to 1.5.1
- Upgraded oauth2-oidc-sdk from 11.13 to 11.14
- Upgraded Fabric8 Kubernetes Client from 6.13.1 to 6.13.2
- Upgraded commons-compress from 1.26.2 to 1.27.0
- Upgraded commons-lang3 from 3.15.0 to 3.16.0
- Upgraded Apache SSHD from 2.13.1 to 2.13.2
- Upgraded Jetty from 12.0.11 to 12.0.12
- Upgraded Elasticsearch Client from 8.14.3 to 8.15.0
- Upgraded Jersey from 3.1.7 to 3.1.8
- Upgraded SLF4J from 2.0.13 to 2.0.15
- Upgraded Testcontainers from 1.20.0 to 1.20.1
- Upgraded org.tukaani xz from 1.9 to 1.10
- Upgraded snappy-java from 1.1.10.5 to 1.1.10.6
- Upgraded google-api-services-drive from v3-rev20240628-2.0.0 to v3-rev20240730-2.0.0
- Upgraded Hazelcast from 5.4.0 to 5.5.0
- Upgraded Azure Kusto from 5.1.0 to 5.1.1
- Upgraded ActiveMQ from 6.1.2 to 6.1.3
- Upgraded Clojure from 1.11.3 to 1.11.4
- Upgraded FlywayDB from 10.16.0 to 10.17.0
- Upgraded MongoDB from 4.11.2 to 4.11.3
- Upgraded Neo4j from 5.22.0 to 5.23.0

This closes #9167

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-12 13:03:46 -05:00
David Handermann 920edfc022
NIFI-13647 Removed Socket Close from ListenOTLP Error Responses (#9166) 2024-08-09 10:00:34 -04:00
Peter Gyori 4f262dc7ea
NIFI-13604 Python Source processors can be triggered without creating new FlowFiles
Closes #9159

Signed-off-by: Marton Szasz <szaszm@apache.org>
2024-08-08 22:49:05 +02:00
Matt Gilman 38292762bd
NIFI-13638: Limiting the maximum number of provenance events to return when fetching the latest events. (#9156) 2024-08-06 17:26:34 -04:00
David Handermann 8ba7d7805a
NIFI-13619 Switch web-client from OkHttp to Java HttpClient (#9140)
* NIFI-13619 Switched web-client from OkHttp to Java HttpClient
* NIFI-13619 Corrected comments to removed OkHttp references.
* NIFI-13619 Added writeTimeout handling and close method
* NIFI-13619 Added onDisabled to Service Provider
2024-08-06 15:46:54 -04:00
Matt Burgess fd8acd57b8
NIFI-13555 Added Verification to HikariDBCPConnectionPool (#9085)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-06 13:26:19 -05:00
Matt Gilman da6c9c4791
NIFI-13017: Replace JoltTransformJSON custom UI (#9117)
* NIFI-13017:
- Remove old JoltTransformJSON custom UI.
- Update build to use new JoltTransformJSON custom UI.
- Fix revision query parameter.

* NIFI-13017:
- Excluding jolt transform json ui in workflow ci.

* NIFI-13017:
- Excluding jolt nar in workflow ci.

* NIFI-13017:
- Excluding jolt ui war from code coverage.

* NIFI-13017:
- Incorporating nifi-web-servlet-shared.
- Moving QueryStringToFragmentFilter to nifi-web-servlet-shared.

This closes #9117
2024-08-06 13:51:41 -04:00