Commit Graph

8514 Commits

Author SHA1 Message Date
siddr 51a941ae0a NIFI-11639: Update maven-checkstyle-plugin to 3.3.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7336
2023-06-03 16:15:46 -04:00
siddr 258db04f68
NIFI-11626 Upgraded maven-source-plugin from 3.2.1 to 3.3.0
This closes #7335

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 16:30:59 -05:00
dan-s1 27b5a2f931
NIFI-11613 Refactored SanitizeContextPathFilterTest from Groovy to Java
- Moved Java tests from groovy directory to java directory and removed groovy directory from nifi-web-utils

This closes #7333

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 16:28:53 -05:00
mr1716 852ec9eefc
NIFI-11633 Upgraded MariaDB client from 3.1.3 to 3.1.4
This closes #7330

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 15:10:51 -05:00
Peter Turcsanyi 803868935a
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 14:59:07 -05:00
Mark Payne df9f8ddcfb NIFI-11636: Do not buffer Parquet content into memory unnecessarily
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7334
2023-06-02 15:35:10 -04:00
mr1716 8dfda776f7
NIFI-11634 Update testcontainers.version to 1.18.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7331.
2023-06-02 18:10:00 +02:00
exceptionfactory ec525b0437
NIFI-11629 This closes #7327. Added Socket Write Timeout to InvokeHTTP
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-02 08:04:25 -07:00
Joe Gresock 3ef4439879
NIFI-8287 Upgraded SQS Processors to use AWS SDK 2
This closes #7211

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 21:53:33 -05:00
Scott Aslan 7a10ba6165
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:13:08 -04:00
Matthew Burgess 3ebe8f2983
NIFI-11538: This closes #7239. Fix primitive type conversion for PutIceberg 2023-06-01 12:29:38 -07:00
mr1716 8b795a72f1
NIFI-11623 Upgraded snappy-java from 1.1.9.1 to 1.1.10.0
This closes #7325

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:48:03 -05:00
Mark Payne 50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
exceptionfactory b042eb01e8
NIFI-11614 Improved Validation for JndiJmsConnectionFactoryProvider
This closes #7313.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-01 19:53:18 +02:00
mr1716 db3e92f8af
NIFI-11617 Upgraded Jackson from 2.15.1 to 2.15.2
This closes #7317

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:33:32 -05:00
Pierre Villard d4f301f473
NIFI-11620 Upgraded Google libraries-bom from 26.12.0 to 26.15.0
This closes #7321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:44 -05:00
Pierre Villard 06b49cbc32
NIFI-11619 Upgraded Azure BOM from 1.2.11 to 1.2.13
This closes #7320

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:04 -05:00
Pierre Villard 6649fdcd1f
NIFI-11618 Upgraded AWS SDK from 2.20.41 to 2.20.75
- Upgraded AWS SDK 1.12.444 to 1.12.478

This closes #7318

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:30:20 -05:00
Mark Payne 4b7e20740e
NIFI-11591: Added additional logging for DynamicallyModifyClasspath system test
This closes #7312

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:23:07 -05:00
Mark Payne ac810671c5 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7322
2023-05-31 17:07:39 -04:00
Steven Matison 645618a609
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery
This closes #7316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 14:32:01 -05:00
Bence Simon 007bf3bcec
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 11:02:48 -05:00
Bryan Bende 921e3d0f2a
NIFI-11604 Improve handling of non-renewable tickets in AbstractKerberosUser
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7301.
2023-05-31 15:13:41 +02:00
siddr b6802ffed8
NIFI-11598 Upgrade gremlin.version from 3.6.2 to 3.6.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7311.
2023-05-31 15:06:39 +02:00
Peter Turcsanyi 02374798d2
NIFI-11615: Logging fixes in AMQP bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7314.
2023-05-31 13:03:41 +02:00
dan-s1 818747d84b
NIFI-11612 Refactored SocketUtilsTest from Groovy to Java
This closes #7310

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-30 14:39:17 -05:00
dan-s1 2f8e5b27b0
NIFI-11611 Refactored TlsConfigurationTest from Groovy to Java
This closes #7309

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-30 14:32:29 -05:00
Michael Moser eca4f5d68f
NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232)
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:06 -04:00
Peter Turcsanyi 3bd4b49abe NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 16:25:28 +02:00
mr1716 f6b0bd30df NIFI-11605 Update spark-streaming_2.13 to to 3.3.2
This closes #7306

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 16:35:33 -04:00
mr1716 bfa4b178ee NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10
This closes #7307

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 14:07:44 -04:00
mr1716 6cd75aa7c4 NIFI-11607 Update spring.boot.version to 2.7.12
This closes #7308

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 08:02:36 -04:00
mr1716 d96f28b17a NIFI-11601 Update mysql-connector-java to 8.0.33
This closes #7303

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 08:01:42 -04:00
Mark Bathori cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
Peter Turcsanyi de62c6261f Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
This reverts commit 4e304ac586.
2023-05-26 11:07:45 +02:00
Mark Bathori 4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
Mark Payne 9f61b5f957
NIFI-11591 Improved stability of DynamicallyClassPath and AsyncCommitCallback tests
After terminating Processor in DynamicallyModifiedClasspathIT system test, keep trying to empty queue until successful instead of assuming success after the first iteration.

When writing to a replacement file in AsyncCommitCallbackIT, write to a temp file and then rename. This prevents the processor from picking up the file while it's still being written.

This closes #7302

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 19:14:01 -05:00
dan-s1 1dfd85b40b
NIFI-11600 Combined the two TestFormatUtils into one class
This closes #7298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 16:15:31 -05:00
dan-s1 d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
Mike Moser a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
mr1716 4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
mr1716 8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
Peter Turcsanyi e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
Mark Payne 108f841525
NIFI-11591 Corrected intermittent system test failures
When waiting for a Processor to stop completely in system tests, also consider any terminated threads. Consider the processor stopped only when all active threads and all terminated threads have gone to 0. Additionally, when stopping all components in a Process Group, wait for the PG to reflect that there are no running components.  Previously, we checked for processor active thread counts. However, this was problematic because the flow that was fetched was not fetched recursively and as a result, processors running in embedded groups were not always stopped when the waitForProcessorsStopped(String groupId) method returned. Finally, removed the step for gathering surefire-reports in failed system tests because it was not working as expected and was unneeded because the tests' logs were already gathered into the diagnostic dump that is uploaded.

Added fix for BatchFlowBetweenGroupsIT. The test would intermittently fail, based on timing. The test assumed that when Input Port in Group B was scheduled to run, it would trigger before FlowFiles in Group A finished processing. The Sleep processor caused a 10 ms delay for each of 5 FlowFiles which gives the Input Port about 50 ms to trigger. If it took longer to trigger the first time, the test failed. Adjusted the Sleep processor to use 2 seconds. So now instead of 50 milliseconds to start, it has 10 seconds. Overall this adds about 30-45 seconds to the run time of the test but ensures more-than-adequate time for the test to run, even on extremely slow hardware

This closes #7289

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 14:03:07 -05:00
mr1716 40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
This closes #7290

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
NissimShiman a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273)
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
Mark Payne ca2a829d47
NIFI-11584 Improved MergeContent stream handling
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
dependabot[bot] 1642315c0f
NIFI-11589 Upgraded socket.io-parser from 4.2.2 to 4.2.3
This closes #7288

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 09:07:19 -05:00
Matthew Burgess adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:40:48 +02:00
Matthew Burgess df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
2023-05-24 10:43:30 +02:00