Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-07 18:48:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
8,462 Commits 147 Branches 203 Tags
Commit Graph

5906 Commits

Author SHA1 Message Date
Mark Payne
a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed. 
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7265
 2023-05-23 14:29:29 -04:00
Bence Simon
ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest 
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-23 10:14:39 -05:00
exceptionfactory
c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency 
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7264.
 2023-05-21 07:17:52 -04:00
Pierre Villard
a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4 
This closes #7277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-19 16:26:58 -05:00
Pierre Villard
0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0 
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-19 16:25:58 -05:00
mr1716
141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8 
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-19 10:24:23 -05:00
Mike Thomsen
c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor. 
NIFI-11221 Style check fixes

NIFI-11221 Removed dead code.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7213
 2023-05-19 10:53:28 -04:00
Joe Gresock
28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:24:13 -04:00
Lehel Boér
6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7263
 2023-05-18 15:54:08 -04:00
Lehel
1a38bf003e
NIFI-11547 Fixed DBCPConnectionPool verification 
- Added unit test for AbstractDBCPConnectionPool

This closes #7249

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-17 10:51:29 -05:00
siddr
607b53504b
NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3 
This closes #7252

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-16 15:48:57 -05:00
exceptionfactory
bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations (#7222) 
* NIFI-11513 Removed deprecated NarProvider and implementations

- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
 2023-05-16 16:10:25 -04:00
Lehel
335365874a
NIFI-11535: Transfer ConnectWebsocket connection configuration FlowFile to relationships 
Also moved dto and util packages under org.apache.nifi.websocket.jetty

This closes #7246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2023-05-16 15:26:35 +02:00
Matthew Burgess
78fd7fadcd
NIFI-11380: Refactor CaptureChangeMySQL with improvements 
This closes #7116

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
 2023-05-16 12:12:18 +02:00
exceptionfactory
8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0 
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7251.
 2023-05-16 10:34:23 +02:00
krisztina-zsihovszki
3051b69a6c
NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor 
This closes #7241.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2023-05-16 09:43:47 +02:00
exceptionfactory
bec6ceda1f
NIFI-11548 Upgraded Apache Tika from 2.7.0 to 2.8.0 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7247.
 2023-05-15 20:41:22 +02:00
Ryan Van Den Bos
658f2547d8
NIFI-11430 - PaginatedJsonQueryElasticsearch processors should not output empty FlowFile if hits have been found; PaginatedJsonQueryElasticsearch processors should be able to use _source and _meta only result formats when grouping by query 
This closes #7163

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-05-13 19:35:20 +01:00
exceptionfactory
f7e36a07ac
NIFI-11228 Removed deprecated Azure Blob Storage Processors 
This closes #7234

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
 2023-05-12 17:33:28 +02:00
Nissim Shiman
fd2138b8cf NIFI-10756 Generate error message when processor and/or controller 
service is unable to transition to start and/or enabled state

Signed-off-by: Mike Moser <mosermw@apache.org>
 2023-05-12 14:40:47 +00:00
M Tien
09cef4ff99
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) (#7117) 
* NIFI-11287: detect dependent properties when the property it depends on references a parameter

* address review feedback

* address more review comments

* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class

* add type parameter to all places calling loadProperties

* get reference parameters by invoking provided callbacks from the client

* check for user permissions before requesting for referenced parameters

* address review feedback

This closes #7117
 2023-05-11 17:00:57 -04:00
Nandor Soma Abonyi
2049d5068b
NIFI-11524 Improved ExecuteStreamCommand documentation and configuration 
This closes #7228

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-11 14:52:21 -05:00
exceptionfactory
e302f2aff7
NIFI-10976 Added Previous Cluster State Provider configuration (#7235) 
- Added methods to enumerate Stored Component Identifiers on State Provider interface and implementations
- Added nifi.state.management.provider.cluster.previous to nifi.properties
- Updated State Manager Provider to restore Cluster State from Previous Cluster Provider
- Updated Configuring State Providers documentation for new property
 2023-05-10 16:22:05 -04:00
Timea Barna
5811a9c579
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics 
This closes #7124

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-08 08:11:20 -05:00
Emilio Setiadarma
340b5fcb00
NIFI-11526 Refactored DatabaseRecordSinkTest to Java from Groovy 
This closes #7229

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-05 08:53:00 -05:00
Lehel Boér
265b132e73
NIFI-11493: Defaulted dynamically modified classpath fix 
This closes #7201.

Co-authored-by: Peter Turcsanyi <turcsanyi@apache.org>
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2023-05-04 15:20:56 +02:00
Bence Simon
4e9675475c NIFI-11523 Refining schema handling for ScriptedTransfromRecord 
This closes #7226

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-03 19:34:28 -04:00
mr1716
d754d952c2 NIFI-11522 Upgrade cassandra.sdk.version to 3.11.3 
This closes #7225

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-03 19:29:35 -04:00
mkalavala
aad7b40bd9
NIFI-11360 Added Client-Side Encryption for Azure Blob v12 Processors 
This closes #7182

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-02 20:37:33 -05:00
dan-s1
e4cdb90a75 [NIFI-11509] Added configuration to allow for parsing comments in JSON. 
This closes #7220

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-02 08:18:47 -04:00
dan-s1
71c7d38c75 [NIFI-11511] Added Provenance route events for all the relationships. 
This closes #7221

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-02 08:03:49 -04:00
Pierre Villard
9f3284393a NIFI-11510 - Upgrade Box SDK to 4.1.0 
This closes #7219

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-02 07:50:40 -04:00
Chris Sampson
3a3b9edc71
NIFI-10067: enable use of script when updating documents in Elasticsearch via PutElasticsearchJson or PutElasticsearchRecord 
NIFI-3262: enable use of dynamic_templates in Elasticsearch _bulk operations

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6628.
 2023-05-02 07:17:17 -04:00
Pierre Villard
01d1be3215
NIFI-11507 Upgraded Calcite from 1.32 to 1.34 
This closes #7216

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-01 14:11:38 -05:00
Pierre Villard
65daa33dfa
NIFI-11506 Upgraded Curator from 5.4.0 to 5.5.0 
This closes #7215

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-01 14:09:42 -05:00
Pierre Villard
fb4eb38688
NIFI-11505 Upgraded gRPC from 1.54.0 to 1.54.1 
This closes #7214

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-05-01 14:08:53 -05:00
Matthew Burgess
0e93dfae83
NIFI-11466 Added ModifyCompression Processor 
- Added nifi-compress-bundle with nifi-compress-nar

This closes #7180

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-29 21:06:29 -05:00
Matthew Burgess
3d60e4a4f6 NIFI-11034: Restore image viewer to nifi-assembly 
This closes #7209

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-04-29 18:20:53 -04:00
Pierre Villard
7fb2468f4b NIFI-11502 - Upgrade json-path to 2.8.0 
NIFI-11502 fixing unit tests
NIFI-11502 review

This closes #7208

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-04-29 16:03:16 -04:00
Chris Sampson
9274d0c9b0 NIFI-10865 allow RecordPath's unescapeJson to convert de-serialised JSON Objects into Records 
NIFI-10865 allow UpdateRecord to replace the Record root for relative paths, e.g. when a RecordPath function is used to modify selected field(s)

This closes #6708

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-04-29 12:26:07 -04:00
Pierre Villard
3de6f960fb
NIFI-11501 Upgraded Hive MQTT client from 1.3.0 to 1.3.1 
This closes #7207

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-28 15:14:19 -05:00
Pierre Villard
abdef65096
NIFI-11497 Upgraded snowflake-ingest-sdk from 1.1.1 to 1.1.3 
This closes #7204

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-28 15:10:25 -05:00
Pierre Villard
67a4d10b3e
NIFI-11495 Upgraded Iceberg from 1.2.0 to 1.2.1 
This closes #7203

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-28 15:09:36 -05:00
exceptionfactory
d9f49bca14
NIFI-11491 Removed deprecated PersistentProvenanceRepository 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7200.
 2023-04-28 13:42:36 +03:00
exceptionfactory
7906e3424c
NIFI-11489 Removed Deprecated Record Writer and Schema Registry methods 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7199.
 2023-04-27 20:18:15 +03:00
exceptionfactory
ee03db0e8f
NIFI-11488 Removed Deprecated Sensitive Properties Algorithms 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7198.
 2023-04-27 20:16:26 +03:00
Timea Barna
d54940c397
NIFI-11473 Flow version change in NiFi should not stop a component when only position is changed 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7185
 2023-04-27 12:59:24 -04:00
Aakash Chauhan
afdbed5749
NIFI-8971 Removed legacy FlowFile name and path attributes 
This closes #6003

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-26 16:37:48 -05:00
Chris Sampson
99b2412ad4
NIFI-11483 Correctly use DescribedValue for JsonQueryElasticsearch 
This closes #7195

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-26 11:57:14 -05:00
Lehel Boér
ffaf81ec46
NIFI-11067 Delete Property History when changing Sensitive status 
This closes #7082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-04-26 09:55:21 -05:00