Commit Graph

8742 Commits

Author SHA1 Message Date
Mark Payne 702c635034
NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile
Rather than creating many FlowFiles with the same Content Claim, refactored content repos' OutputStreams and ClaimWriteCache so that a new ContentClaim is created for each FlowFile. This ensures that we have a content claim offset of 0. The poor performance was due to having to use StreamUtils.skip() in conjunction with the CipherInputStream, which would only skip a max of 511 bytes at a time. By using a separate Content Claim per FlowFile, we no longer need to seek after creating the CipherInputStream

This closes #7363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 09:47:44 -05:00
exceptionfactory 7485687d4b
NIFI-11657 Removed Deprecated PutBigQueryBatch and PutBigQueryStreaming
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7351.
2023-06-11 15:49:42 +02:00
exceptionfactory 1f1b2f1f28
NIFI-11675 Upgraded Apache Commons IO from 2.12.0 to 2.13.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7366.
2023-06-11 15:46:11 +02:00
exceptionfactory 9374039312
NIFI-11674 Upgraded Apache Iceberg from 1.2.1 to 1.3.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7364.
2023-06-11 15:43:58 +02:00
mr1716 02a34034fa
NIFI-11664 Upgraded WebDriverManager from 3.3.0 to 3.8.1
This closes #7359

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:45 -05:00
mr1716 054df20aed
NIFI-11665 Upgraded oauth2-oidc-sdk from 9.43.1 to 9.43.3
This closes #7358

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
Matt Burgess 5e6f3abdd2
NIFI-11655 Fixed float and double handling in GenerateRecord
This closes #7356

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
Mathew Kiprop 36da257e56
NIFI-11667 Provide default NiFi version when building dockerhub image
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #7361
2023-06-08 20:41:10 +01:00
exceptionfactory 4509f5de80 NIFI-11666 Added Exception to Error Log for ModifyCompression
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7360
2023-06-08 11:19:05 -04:00
Matt Burgess f3e8651522 NIFI-11647: Support UUID type in DataTypeUtils.getSQLTypeValue
This closes #7355

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-08 11:13:07 -04:00
siddr 119e6702a4
NIFI-11648 Upgraded archetype-packaging from 2.2 to 3.2.1
This closes #7345

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-07 15:17:43 -05:00
Nandor Soma Abonyi 10a2815527
NIFI-11659 Removed unnecessary Jackson 1 dependencies
This closes #7354

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-07 15:04:43 -05:00
exceptionfactory 9195b586e5
NIFI-11656 Removed deprecated Azure Queue Storage Processors
- Removed AzureStorageCredentialsControllerService and related implementations
- Removed com.micrsoft.azure:azure-storage dependencies

This closes #7350

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-07 16:19:38 +02:00
siddr dd2486d3e0 NIFI-11587: Update questdb to 6.7
This closes #7319
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-06-07 09:39:44 +02:00
siddr e72ca689c2
NIFI-11643 Upgraded geoip2 from 2.16.1 to 4.0.1
This closes #7341

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 15:31:39 -05:00
exceptionfactory 4faf3ea598
NIFI-11653 This closes #7349. Added Connection URL Validation for Database Services
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-06 09:29:48 -07:00
mr1716 d956ede743
NIFI-11649 Upgraded icu4j from 72.1 to 73.1
This closes #7346

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:42:17 -05:00
mr1716 6c2983daf3
NIFI-11651 Upgraded OkHttp from 4.10.0 to 4.11.0
This closes #7347

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:32:06 -05:00
mr1716 e6c2c7c7ee
NIFI-11652 Upgraded Jolt from 0.1.7 to 0.1.8
This closes #7348

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:30:36 -05:00
exceptionfactory c5c711c91d
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
- Added selective overrides to upgrade transitive dependencies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
exceptionfactory 2a9f87a1e5
NIFI-11641 This closes #7340. Upgraded Netty from 4.1.92 to 4.1.93
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:32:44 -07:00
Emilio Setiadarma b11373af7b
NIFI-11549 Added AzureQueueStorage_v12 Processors
- Deprecated GetAzureQueueStorage and PutAzureQueueStorage

This closes #7269

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 16:26:02 -05:00
Shane Ardell 7a7f6f6229
NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:36:49 -07:00
dependabot[bot] 88d7b3905b
NIFI-11644 Upgraded Hazelcast from 4.2.7 to 5.3.0
This closes #7282

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 14:49:22 -05:00
Matt Burgess d200186096
NIFI-11567: Auto-reload database file in GeoEnrichIP processors (#7266)
NIFI-11567: Auto-reload database file in GeoEnrichIP processors
2023-06-05 13:54:17 -04:00
siddr 0cd511f1aa
NIFI-11640 Upgraded download-maven-plugin from 1.2.1 to 1.6.8
This closes #7337

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 11:33:34 -05:00
Bryan Bende ce50ffbe0e
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:11:33 -04:00
Peter Turcsanyi 963518d943
NIFI-11586 Added AzureStorageCredentialsControllerServiceLookup_v12
Also added client caching in blob v_12 processors which was needed to support multiple credentials provided by the new lookup service

This closes #7300

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-05 13:07:02 +02:00
siddr 51a941ae0a NIFI-11639: Update maven-checkstyle-plugin to 3.3.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7336
2023-06-03 16:15:46 -04:00
siddr 258db04f68
NIFI-11626 Upgraded maven-source-plugin from 3.2.1 to 3.3.0
This closes #7335

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 16:30:59 -05:00
dan-s1 27b5a2f931
NIFI-11613 Refactored SanitizeContextPathFilterTest from Groovy to Java
- Moved Java tests from groovy directory to java directory and removed groovy directory from nifi-web-utils

This closes #7333

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 16:28:53 -05:00
mr1716 852ec9eefc
NIFI-11633 Upgraded MariaDB client from 3.1.3 to 3.1.4
This closes #7330

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 15:10:51 -05:00
Peter Turcsanyi 803868935a
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 14:59:07 -05:00
Mark Payne df9f8ddcfb NIFI-11636: Do not buffer Parquet content into memory unnecessarily
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7334
2023-06-02 15:35:10 -04:00
mr1716 8dfda776f7
NIFI-11634 Update testcontainers.version to 1.18.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7331.
2023-06-02 18:10:00 +02:00
exceptionfactory ec525b0437
NIFI-11629 This closes #7327. Added Socket Write Timeout to InvokeHTTP
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-02 08:04:25 -07:00
Joe Gresock 3ef4439879
NIFI-8287 Upgraded SQS Processors to use AWS SDK 2
This closes #7211

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 21:53:33 -05:00
Scott Aslan 7a10ba6165
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:13:08 -04:00
Matthew Burgess 3ebe8f2983
NIFI-11538: This closes #7239. Fix primitive type conversion for PutIceberg 2023-06-01 12:29:38 -07:00
mr1716 8b795a72f1
NIFI-11623 Upgraded snappy-java from 1.1.9.1 to 1.1.10.0
This closes #7325

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:48:03 -05:00
Mark Payne 50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
exceptionfactory b042eb01e8
NIFI-11614 Improved Validation for JndiJmsConnectionFactoryProvider
This closes #7313.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-01 19:53:18 +02:00
mr1716 db3e92f8af
NIFI-11617 Upgraded Jackson from 2.15.1 to 2.15.2
This closes #7317

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:33:32 -05:00
Pierre Villard d4f301f473
NIFI-11620 Upgraded Google libraries-bom from 26.12.0 to 26.15.0
This closes #7321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:44 -05:00
Pierre Villard 06b49cbc32
NIFI-11619 Upgraded Azure BOM from 1.2.11 to 1.2.13
This closes #7320

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:04 -05:00
Pierre Villard 6649fdcd1f
NIFI-11618 Upgraded AWS SDK from 2.20.41 to 2.20.75
- Upgraded AWS SDK 1.12.444 to 1.12.478

This closes #7318

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:30:20 -05:00
Mark Payne 4b7e20740e
NIFI-11591: Added additional logging for DynamicallyModifyClasspath system test
This closes #7312

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:23:07 -05:00
Mark Payne ac810671c5 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7322
2023-05-31 17:07:39 -04:00
Steven Matison 645618a609
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery
This closes #7316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 14:32:01 -05:00
Bence Simon 007bf3bcec
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 11:02:48 -05:00