Commit Graph

264 Commits

Author SHA1 Message Date
exceptionfactory 7de2e68ce9
NIFI-13938 Removed Iceberg Processors and Services
This closes #9460

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-28 08:34:33 -07:00
Pierre Villard 0cad418874
NIFI-13544 Align number of Executors with Concurrent Tasks in PublishGCPubSub (#9454)
Co-authored-by: Paul-Adrien Cordonnier <pauladrien@adaltas.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-28 09:43:42 -05:00
Pierre Villard 8b6bf16929
NIFI-13936 Removed GCP PubSub Lite Processors (#9455)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-28 09:36:40 -05:00
exceptionfactory 63b0456bad
NIFI-13935 Removed HBase 2 Processors and Services
This closes #9453

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-28 07:20:47 -07:00
Peter Turcsanyi eb8d4ee06f
NIFI-13930 PutAzureDataLakeStorage sets close flag on file write so that Azure can emit FlushWithClose event
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9451.
2024-10-27 08:48:45 +01:00
exceptionfactory b6952f1246
NIFI-13933 Upgraded Spring Security to 6.3.4 and other dependencies
This closes #9450

- Upgraded Spring Security from 6.3.3 to 6.3.4
- Upgraded Hadoop from 3.4.0 to 3.4.1
- Upgraded Velocity Engine Core from 2.3.0 to 2.4.1
- Upgraded Parquet Avro from 1.13.1 to 1.14.3
- Upgraded Google Libraries from 26.47.0 to 26.49.0
- Set protobuf-java to 3.25.5 for calcite-core and amazon-kinesis-client libraries
- Updated Dependency Check suppressions

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-26 14:14:14 -07:00
Pierre Villard 31d92b5115
NIFI-13927 Use synchronized lists in PublishGCPubSub (#9449)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-26 11:44:29 -05:00
Bence Simon 5be2cd73e6
NIFI-13932 Calling super #migrateProperty in JsonRecordSetWriter
This closes #9448.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-10-25 17:08:15 +02:00
Nicolae Puica 35219052e1
NIFI-13869: Enhance QuerySalesforceObject Processor to Support Querying Deleted Records
- Added a new boolean property `Include Deleted Records` to allow users to include deleted (soft-deleted) records in Salesforce queries.
- Modified the query construction to include the `IsDeleted` field and use the `queryAll` API endpoint when `Include Deleted Records` is enabled.
- Updated `SalesforceRestClient` to support the `queryAll` API by adding a new `queryAll` method.
- Ensured backward compatibility by defaulting `Include Deleted Records` to `false`, maintaining existing behavior unless explicitly enabled.
- Updated processor documentation and annotations to reflect the new functionality.
- Adjusted state management to reset state when `Include Deleted Records` property is modified.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9434.
2024-10-22 18:37:45 +02:00
Lehel Boér a44fb528f6
NIFI-13896 Removed legacy state migration from TailFile (#9425)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-21 15:51:09 -05:00
Hunter Goller d693293c43
NIFI-13853: Added the ability to filter by all to the Advanced Rules page (#9371)
* NIFI-13853: Added the ability to filter by all to the Advanced Rules pag

* NIFI-13853: Fixed formatting

* NIFI-13853: Removed labels in filter by everything

Removed 'Name, Comments, Condition, Action' labels

Co-authored-by: Rob Fellows <rob.fellows@gmail.com>

* NIFI-13853: Fixed indentation

* NIFI-13853:Fixed the indentation

For some reason my last commit didn't fix the indentation

---------

Co-authored-by: Rob Fellows <rob.fellows@gmail.com>

This closes #9371
2024-10-21 16:46:56 -04:00
exceptionfactory cc2cdddd49
NIFI-13910 Upgraded Apache Tika from 2.9.2 to 3.0.0
This closes #9427

- Removed unused dependency from nifi-framework-bundle
- Aligned custom-mimetypes.xml location with Tika 3 default location

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-21 07:38:13 -07:00
Mike e37cd2b5e6
NIFI-13776 Updated CopyS3Object to Handle Files over 5 GB
This closes #9418

- Added multipart copying for files over 5 GB

Co-authored-by: Mike Thomsen <mthomsen@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 16:24:38 -07:00
Mike Moser 80e889305f
NIFI-7085 add flowFile batching to ConsumeJMS and PublishJMS
This closes #8584

load some configuration in onScheduled instead of a loop, reinstated and fixed a failing integration test
2024-10-18 16:23:22 -07:00
Joe Witt 811af23343
NIFI-13895 Upgraded AWS SDK to 1.12.775 and 2.28.25 along with others (#9416)
- Upgraded AWS SDK from 1.12.774 to 1.12.775
- Upgraded AWS SDK from 2.28.24 to 2.28.25
- Upgraded Box API from 4.11.1 to 4.12.0
- Upgraded nimbus-jose-jwt from 9.40 to 9.41.2
- Upgraded oauth2-oidc-sdk from 11.14 to 11.20.1
- Upgraded reactor-netty-heep from 1.1.22 to 1.1.23
- Upgraded Elasticsearch Client from 8.15.1 to 8.15.3
- Upgraded Google API from v3-rev20240903-2.0.0 to v3-rev20240914-2.0.0
- Upgraded MySQL Driver from 9.0.0 to 9.1.0
- Upgraded Slack bolt-socket-mode from 1.42.1 to 1.44.0
- Upgraded Project Reactor from 3.6.10 to 3.6.11
- Upgraded Flyway DB from 10.18.2 to 10.20.0
- Upgraded gitlab4j-api from 6.0.0-rc.5 to 6.0.0-rc.6
- Upgraded JLine from 3.27.0 to 3.27.1
- Upgraded Neo4j Driver from 5.25.0 to 5.26.0

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-18 00:11:52 -05:00
exceptionfactory d42b110474
NIFI-13886 Upgraded Spring from 6.1.13 to 6.1.14 and others
- Upgraded Apache MINA SSHD from 2.13.2 to 2.14.0
- Upgraded Dropwizard Metrics from 4.2.27 to 4.2.28
- Upgraded Guava from 33.2.1 to 33.3.1
- Upgraded ASM from 9.7 to 9.7.1
- Upgraded Apache JSP from 10.1.16 to 10.1.31
- Upgraded Apache EL from 10.1.16 to 10.1.31
- Upgraded Data Faker from 2.3.1 to 2.4.0
- Upgraded JSON Flattener from 0.16.6 to 0.17.0
- Upgraded Check Qual from 3.47.0 to 3.48.1
- Upgraded error-prone-annotations from 2.28.0 to 2.33.0
- Upgraded frontend-maven-plugin from 1.15.0 to 1.15.1
- Upgraded AWS SDK from 1.12.772 to 1.2.774
- Upgraded AWS SDK from 2.28.13 to 2.28.24
- Upgraded JSON Smart from 2.5.0 to 2.5.1
- Upgraded Jersey from 3.1.8 to 3.1.9
- Upgraded Logback from 1.5.8 to 1.5.11
- Upgraded Servlet API from 6.0.0 to 6.1.0
- Upgraded Swagger Annotations from 2.2.24 to 2.2.25

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9407.
2024-10-17 18:04:51 +02:00
Mark Bathori 7e1789d6f0
NIFI-13877 Closed Catalog after processing in PutIceberg (#9395)
- Resolved JdbcCatalog being created but not closed

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:36:32 -05:00
Mark Bathori 1823a52e36
NIFI-13884 Removed File IO Implementation Property from PutIceberg (#9403)
- Removed pending further testing and evaluation of runtime behavior

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-17 09:00:36 -05:00
exceptionfactory babfd5a559
NIFI-13881 Upgraded JUnit from 5.10.4 to 5.11.2 along with Plugins
- Upgraded Apache Parent from 32 to 33
- Upgraded Surefire Plugin from 3.2.5 to 3.5.1
- Upgraded Mockito from 5.14.1 to 5.14.2
- Upgraded JUnit Platform from 1.10.4 to 1.11.2
- Upgraded Exec Maven Plugin from 3.2.0 o 3.4.1
- Upgraded Buildnumber Maven Plugin from 3.2.0
- Upgraded Maven Checkstyle Plugin from 3.3.1 to 3.5.0
- Upgraded Checkstyle from 10.16.0 to 10.18.2
- Upgraded Versions Maven Plugin from 2.16.2 to 2.17.1
- Upgraded Nexus Staging Plugin from 1.6.13 to 1.7.00
- Upgraded JAXB Maven Plugin from 2.2.0 to 2.2.1
- Upgraded Swagger Maven Plugin from 2.2.23 to 2.2.25
- Upgraded Swagger Codegen Plugin from 3.0.55 to 3.0.63
- Upgraded Maven JAR Plugin from 3.4.1 to 3.4.2
- Upgraded Dependency Check Plugin from 10.0.3 to 10.0.4
- Upgraded Jagged BOM from 0.4.0 to 1.0.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9400.
2024-10-17 12:12:43 +02:00
exceptionfactory d23bf2ce4f
NIFI-13596 Renamed Distributed Cache Server and Client Services
- Renamed DistributedMapCacheServer to MapCacheServer
- Renamed DistributedSetCacheServer to SetCacheServer
- Renamed DistributedMapCacheClientService to MapCacheClientService
- Renamed DistributedSetCacheClientService to SetCacheClientService

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9398.
2024-10-17 12:09:00 +02:00
Bryan Bende 1fe54f060b
NIFI-13644 Added GitLab Flow Registry Client (#9264)
- Refactoring to create base class for other git-based flow registry clients
- Implement GitLabRepositoryClient
- Implement GitLabFlowRegistryClient

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 15:03:21 -05:00
exceptionfactory cb2117f8e6 NIFI-13579 Improved Timestamp Zone Offset Formatting and Parsing
- Improved Timestamp to String formatting to support patterns with zone offsets
- Improved String to Timestamp parsing to support adjusted hours and minutes when zone offset is included
2024-10-16 18:37:30 +00:00
exceptionfactory 1b37d78403
NIFI-13874 Refactored KeyStore and SSLContext Creation for Tests
This closes #9392

- Added EphemeralKeyStoreBuilder to nifi-security-ssl
- Removed nifi-security-utils
- Moved StandardTlsConfiguration to nifi-ssl-context-service
- Refactored tests to use EphemeralKeyStoreBuilder and nifi-security-cert-builder for TLS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-16 09:18:59 -07:00
exceptionfactory ea2cfb102f NIFI-13744 Corrected Excel Reader Cell Type Inferencing
- Added Cell Field Type Reader with Timestamp detection

Signed-off-by: dan-s1 <dstieg1@gmail.com>

This closes #9379.
2024-10-16 15:52:19 +00:00
tpalfy 6fb229b23c
NIFI-13860 Avoid Throwing Exceptions for Failures in IPLookupService (#9372)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 09:03:42 -05:00
exceptionfactory 988b4a1a7e
NIFI-13875 Upgraded Calcite from 1.37.0 to 1.38.0
- Upgraded Curator from 5.7.0 to 5.7.1
- Updated TestQueryRecord expected value to align with Calcite 1.38.0 decimal handling

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9394.
2024-10-16 15:29:41 +02:00
exceptionfactory 6a53010390
NIFI-10002 Validated Directory Path in ListFile
- Throw IOException for null or blank directories to avoid invalid directory expressions

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9393.
2024-10-16 12:27:06 +02:00
Peter Turcsanyi c3122b281b
NIFI-13867 Removed legacy code component Proxy Properties (#9381)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-12 11:34:03 -05:00
Mark Payne 0f8b570718
NIFI-13811 Fixed CalculateRecordStats Nested Record Array Handling
This closes #9321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 17:14:35 -05:00
dan-s1 f7d5bd7774
NIFI-13674 Added merge.competion.reason Attribute for MergeRecord (#9363)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 17:00:34 -05:00
Michael Moser 1bfdf3c107
NIFI-12304 Added FlowFileV3 Unpacking to ListenHTTP as a documented UseCase (#9369)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 16:12:15 -05:00
Peter Turcsanyi 4c243bd877
NIFI-13851 Migrated SiteToSiteReportingTask Proxy properties to ProxyConfigurationService (#9359)
- Fixed Reporting Task property migration: in case of sensitive properties the encrypted form was migrated to the new property value

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 16:09:39 -05:00
dan-s1 44ae874032 NIFI-13726 Set cell style copy policy to false in order to avoid exceeding the maximum number of cell styles (64000) in a .xlsx Workbook
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9326
2024-10-11 16:54:39 -04:00
dan-s1 f41f6fea4f
NIFI-13850 Simplified TextXMLReader using Current Language and Library Practices (#9361)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-09 13:06:05 -05:00
Mike Moser 4ecd743693
NIFI-12762 Added Request Header Size to ListenHTTP and HandleHttpRequest
This closes #9304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 14:28:55 -05:00
Vincenzo Abate 0719a8113f
NIFI-13827 Added Reply-To Property to PutEmail (#9332)
Co-authored-by: Vincenzo Abate <vincenzo.abate@teratecnologies.es>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 10:56:51 -05:00
Pierre Villard 7188155d50
NIFI-13847 - Typos in ReplaceText properties descriptions
This closes #9354.

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-10-08 14:33:21 +02:00
Peter Turcsanyi 2cb8411d4f
NIFI-13848 Migrated AWSCredentialsProviderControllerService's Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9357.
2024-10-08 10:54:49 +02:00
dan-s1 92c6ddd98e
NIFI-13335 Added ability for the XMLRecordReader to handle where an array of data has different types.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9356.
2024-10-08 10:47:34 +02:00
Peter Turcsanyi 5f6bdc6243
NIFI-13841 Restored proxy support in AWS PutSNS processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9351.
2024-10-08 10:35:53 +02:00
Peter Turcsanyi 17c8a6bed8
NIFI-13840 Fixed proxy setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9345.
2024-10-07 16:22:28 +02:00
Rajmund Takacs 7da06aab62 NIFI-13829: Mitigate false positive reports of MonitorActivity, in case of infrequent Flow Files
This closes #9333.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-10-07 11:37:46 +02:00
Peter Turcsanyi ae2277478a
NIFI-13842 Fixed truststore/keystore setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9346.
2024-10-07 11:30:21 +02:00
Matt Burgess e6e7e22465 NIFI-13790: Report SEND provenance event in PublishKafka
This closes #9349

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-06 12:42:24 -04:00
lehelb 8424e3428a
NIFI-13798: Renamed Airtable's API Key property to Personal Access Token and updated docs due to API Keys deprecation
This closes #9308.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-10-03 08:53:15 +02:00
Pierre Villard 3af800a017
NIFI-13826 Upgraded Jetty to 12.0.14 and Jackson to 2.18.0 along with others (#9331)
- Jackson from 2.17.2 to 2.18.0
- zstd-jni from 1.5.6-5 to 1.5.6-6
- gson from 2.10.1 to 2.11.0
- okio from 3.9.0 to 3.9.1
- Fabric8 Kubernetes from 6.13.1 to 6.13.4
- Netty from 4.1.113.Final to 4.1.114.Final
- swagger-annotations from 2.2.23 to 2.2.24
- avro from 1.11.3 to 1.11.4
- commons-lang3 from 3.16.0 to 3.17.0
- log4j from 2.24.0 to 2.24.1
- Jetty from 12.0.13 to 12.0.14
- junit-bom from 5.10.3 to 5.10.4
- junit-platform-commons from 1.10.3 to 1.10.4
- mockito from 5.13.0 to 5.14.1
- testcontainers from 1.20.1 to 1.20.2
- snakeyaml from 2.2 to 2.3
- AWS SDK v2 from 2.28.4 to 2.28.13
- flyway from 10.18.0 to 10.18.2
- jline from 3.26.3 to 3.27.0
- neo4j driver from 5.24.0 to 5.25.0
- maxmind from 3.1.0 to 3.1.1
- geoip2 from 4.2.0 to 4.2.1
- amqp-client from 5.21.0 to 5.22.0
- commons-csv from 1.11.0 to 1.12.0
- splunk from 1.9.4 to 1.9.5
- lucene from 9.11.1 to 9.12.0
- Google BOM from 26.46.0 to 26.47.0
- Azure BOM from 1.2.26 to 1.2.28
- msal4j from 1.16.1 to 1.17.1
- json-schema-validator from 1.5.1 to 1.5.2
- checker-qual from 3.45.0 to 3.47.0
- checkstyle from 10.16.0 to 10.18.2

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-02 18:13:08 -05:00
dan-s1 dd8681e3a2 NIFI-13819 Provided a row number and sheet name if ExcelReader throws exception when it fails to convert a value.
This closes #9327

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-10-01 09:17:14 -04:00
Matt Gilman fb2a82c035
NIFI-13721: Migrating documentation into the NiFi UI (#9288)
* NIFI-13721: Migrating additional details to markdown.

* NIFI-13721: Rebuilding documentation to generate mark up on the client.

* NIFI-13721: Removing old documentation approach.

* NIFI-13721: Rebase main and final fixing button colors.

* NIFI-13721: Fixing rat issues.

* NIFI-13721: Removing generated comonent documentation.
- Removing links and images from additional details markdown.

* NIFI-13721: Recreating package lock following rebase.

* NIFI-13721: Updating documentation for M3.

* NIFI-13721: Fixing broken test.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Ensuring the selected item is visible after routing.

* NIFI-13721: Fixing reportingTaskTypes in finding extensions for a given type.

* NIFI-13721: Updating the see also component to handle when the referenced extension is not installed.

* NIFI-13721: Fixing expansion panel header styles.
2024-09-27 11:11:55 -04:00
Bob Paulin 34aa764132
NIFI-13779 Improved Provenance Lineage for Python FlowFileTransform (#9292)
- Transform input FlowFile instead of cloned FlowFile

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-26 12:39:19 -05:00
Mark Payne 6b4daa2ec2
NIFI-13801: Fixed counter for ConsumeKafka to correctly indicate number of messages received using using a demarcator
This closes #9311.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-24 21:31:14 -04:00