Commit Graph

5923 Commits

Author SHA1 Message Date
Michael Moser eca4f5d68f
NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232)
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:06 -04:00
Peter Turcsanyi 3bd4b49abe NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 16:25:28 +02:00
mr1716 bfa4b178ee NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10
This closes #7307

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 14:07:44 -04:00
Mark Bathori cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
Peter Turcsanyi de62c6261f Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
This reverts commit 4e304ac586.
2023-05-26 11:07:45 +02:00
Mark Bathori 4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
dan-s1 d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
Mike Moser a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
mr1716 4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
mr1716 8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
Peter Turcsanyi e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
mr1716 40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
This closes #7290

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
NissimShiman a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273)
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
Mark Payne ca2a829d47
NIFI-11584 Improved MergeContent stream handling
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
Matthew Burgess adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:40:48 +02:00
Matthew Burgess df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
2023-05-24 10:43:30 +02:00
exceptionfactory 3833b51764
NIFI-11583 Removed GetIgniteCache and PutIgniteCache Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7285.
2023-05-24 09:49:34 +02:00
Mark Payne a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7265
2023-05-23 14:29:29 -04:00
Bence Simon ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:14:39 -05:00
exceptionfactory c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7264.
2023-05-21 07:17:52 -04:00
Pierre Villard a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4
This closes #7277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:58 -05:00
Pierre Villard 0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
mr1716 141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
Mike Thomsen c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor.
NIFI-11221 Style check fixes

NIFI-11221 Removed dead code.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7213
2023-05-19 10:53:28 -04:00
Joe Gresock 28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:24:13 -04:00
Lehel Boér 6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7263
2023-05-18 15:54:08 -04:00
Lehel 1a38bf003e
NIFI-11547 Fixed DBCPConnectionPool verification
- Added unit test for AbstractDBCPConnectionPool

This closes #7249

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 10:51:29 -05:00
siddr 607b53504b
NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3
This closes #7252

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-16 15:48:57 -05:00
exceptionfactory bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations (#7222)
* NIFI-11513 Removed deprecated NarProvider and implementations

- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
Lehel 335365874a
NIFI-11535: Transfer ConnectWebsocket connection configuration FlowFile to relationships
Also moved dto and util packages under org.apache.nifi.websocket.jetty

This closes #7246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 15:26:35 +02:00
Matthew Burgess 78fd7fadcd
NIFI-11380: Refactor CaptureChangeMySQL with improvements
This closes #7116

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-16 12:12:18 +02:00
exceptionfactory 8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7251.
2023-05-16 10:34:23 +02:00
krisztina-zsihovszki 3051b69a6c
NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
This closes #7241.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:43:47 +02:00
exceptionfactory bec6ceda1f
NIFI-11548 Upgraded Apache Tika from 2.7.0 to 2.8.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7247.
2023-05-15 20:41:22 +02:00
Ryan Van Den Bos 658f2547d8
NIFI-11430 - PaginatedJsonQueryElasticsearch processors should not output empty FlowFile if hits have been found; PaginatedJsonQueryElasticsearch processors should be able to use _source and _meta only result formats when grouping by query
This closes #7163

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-05-13 19:35:20 +01:00
exceptionfactory f7e36a07ac
NIFI-11228 Removed deprecated Azure Blob Storage Processors
This closes #7234

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-12 17:33:28 +02:00
Nissim Shiman fd2138b8cf NIFI-10756 Generate error message when processor and/or controller
service is unable to transition to start and/or enabled state

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-05-12 14:40:47 +00:00
M Tien 09cef4ff99
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) (#7117)
* NIFI-11287: detect dependent properties when the property it depends on references a parameter

* address review feedback

* address more review comments

* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class

* add type parameter to all places calling loadProperties

* get reference parameters by invoking provided callbacks from the client

* check for user permissions before requesting for referenced parameters

* address review feedback

This closes #7117
2023-05-11 17:00:57 -04:00
Nandor Soma Abonyi 2049d5068b
NIFI-11524 Improved ExecuteStreamCommand documentation and configuration
This closes #7228

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-11 14:52:21 -05:00
exceptionfactory e302f2aff7
NIFI-10976 Added Previous Cluster State Provider configuration (#7235)
- Added methods to enumerate Stored Component Identifiers on State Provider interface and implementations
- Added nifi.state.management.provider.cluster.previous to nifi.properties
- Updated State Manager Provider to restore Cluster State from Previous Cluster Provider
- Updated Configuring State Providers documentation for new property
2023-05-10 16:22:05 -04:00
Timea Barna 5811a9c579
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics
This closes #7124

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-08 08:11:20 -05:00
Emilio Setiadarma 340b5fcb00
NIFI-11526 Refactored DatabaseRecordSinkTest to Java from Groovy
This closes #7229

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-05 08:53:00 -05:00
Lehel Boér 265b132e73
NIFI-11493: Defaulted dynamically modified classpath fix
This closes #7201.

Co-authored-by: Peter Turcsanyi <turcsanyi@apache.org>
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-04 15:20:56 +02:00
Bence Simon 4e9675475c NIFI-11523 Refining schema handling for ScriptedTransfromRecord
This closes #7226

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:34:28 -04:00
mr1716 d754d952c2 NIFI-11522 Upgrade cassandra.sdk.version to 3.11.3
This closes #7225

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:29:35 -04:00
mkalavala aad7b40bd9
NIFI-11360 Added Client-Side Encryption for Azure Blob v12 Processors
This closes #7182

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-02 20:37:33 -05:00
dan-s1 e4cdb90a75 [NIFI-11509] Added configuration to allow for parsing comments in JSON.
This closes #7220

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:18:47 -04:00
dan-s1 71c7d38c75 [NIFI-11511] Added Provenance route events for all the relationships.
This closes #7221

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:03:49 -04:00
Pierre Villard 9f3284393a NIFI-11510 - Upgrade Box SDK to 4.1.0
This closes #7219

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 07:50:40 -04:00
Chris Sampson 3a3b9edc71
NIFI-10067: enable use of script when updating documents in Elasticsearch via PutElasticsearchJson or PutElasticsearchRecord
NIFI-3262: enable use of dynamic_templates in Elasticsearch _bulk operations

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6628.
2023-05-02 07:17:17 -04:00