Commit Graph

8793 Commits

Author SHA1 Message Date
Bence Simon 007bf3bcec
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 11:02:48 -05:00
Bryan Bende 921e3d0f2a
NIFI-11604 Improve handling of non-renewable tickets in AbstractKerberosUser
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7301.
2023-05-31 15:13:41 +02:00
siddr b6802ffed8
NIFI-11598 Upgrade gremlin.version from 3.6.2 to 3.6.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7311.
2023-05-31 15:06:39 +02:00
Peter Turcsanyi 02374798d2
NIFI-11615: Logging fixes in AMQP bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7314.
2023-05-31 13:03:41 +02:00
dan-s1 818747d84b
NIFI-11612 Refactored SocketUtilsTest from Groovy to Java
This closes #7310

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-30 14:39:17 -05:00
dan-s1 2f8e5b27b0
NIFI-11611 Refactored TlsConfigurationTest from Groovy to Java
This closes #7309

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-30 14:32:29 -05:00
Michael Moser eca4f5d68f
NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232)
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:06 -04:00
Peter Turcsanyi 3bd4b49abe NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 16:25:28 +02:00
mr1716 f6b0bd30df NIFI-11605 Update spark-streaming_2.13 to to 3.3.2
This closes #7306

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 16:35:33 -04:00
mr1716 bfa4b178ee NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10
This closes #7307

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 14:07:44 -04:00
mr1716 6cd75aa7c4 NIFI-11607 Update spring.boot.version to 2.7.12
This closes #7308

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 08:02:36 -04:00
mr1716 d96f28b17a NIFI-11601 Update mysql-connector-java to 8.0.33
This closes #7303

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 08:01:42 -04:00
Mark Bathori cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
Peter Turcsanyi de62c6261f Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
This reverts commit 4e304ac586.
2023-05-26 11:07:45 +02:00
Mark Bathori 4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
Mark Payne 9f61b5f957
NIFI-11591 Improved stability of DynamicallyClassPath and AsyncCommitCallback tests
After terminating Processor in DynamicallyModifiedClasspathIT system test, keep trying to empty queue until successful instead of assuming success after the first iteration.

When writing to a replacement file in AsyncCommitCallbackIT, write to a temp file and then rename. This prevents the processor from picking up the file while it's still being written.

This closes #7302

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 19:14:01 -05:00
dan-s1 1dfd85b40b
NIFI-11600 Combined the two TestFormatUtils into one class
This closes #7298

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 16:15:31 -05:00
dan-s1 d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
Mike Moser a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
mr1716 4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
mr1716 8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
Peter Turcsanyi e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
Mark Payne 108f841525
NIFI-11591 Corrected intermittent system test failures
When waiting for a Processor to stop completely in system tests, also consider any terminated threads. Consider the processor stopped only when all active threads and all terminated threads have gone to 0. Additionally, when stopping all components in a Process Group, wait for the PG to reflect that there are no running components.  Previously, we checked for processor active thread counts. However, this was problematic because the flow that was fetched was not fetched recursively and as a result, processors running in embedded groups were not always stopped when the waitForProcessorsStopped(String groupId) method returned. Finally, removed the step for gathering surefire-reports in failed system tests because it was not working as expected and was unneeded because the tests' logs were already gathered into the diagnostic dump that is uploaded.

Added fix for BatchFlowBetweenGroupsIT. The test would intermittently fail, based on timing. The test assumed that when Input Port in Group B was scheduled to run, it would trigger before FlowFiles in Group A finished processing. The Sleep processor caused a 10 ms delay for each of 5 FlowFiles which gives the Input Port about 50 ms to trigger. If it took longer to trigger the first time, the test failed. Adjusted the Sleep processor to use 2 seconds. So now instead of 50 milliseconds to start, it has 10 seconds. Overall this adds about 30-45 seconds to the run time of the test but ensures more-than-adequate time for the test to run, even on extremely slow hardware

This closes #7289

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 14:03:07 -05:00
mr1716 40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
This closes #7290

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
NissimShiman a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273)
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
Mark Payne ca2a829d47
NIFI-11584 Improved MergeContent stream handling
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
dependabot[bot] 1642315c0f
NIFI-11589 Upgraded socket.io-parser from 4.2.2 to 4.2.3
This closes #7288

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 09:07:19 -05:00
Matthew Burgess adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:40:48 +02:00
Matthew Burgess df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
2023-05-24 10:43:30 +02:00
exceptionfactory 3833b51764
NIFI-11583 Removed GetIgniteCache and PutIgniteCache Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7285.
2023-05-24 09:49:34 +02:00
Daniel Urban c8d3a69d64
NIFI-10867 Refactored common configuration for Stateless Connectors
This closes #6744

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 18:56:50 -05:00
Mark Payne a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7265
2023-05-23 14:29:29 -04:00
Bence Simon ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:14:39 -05:00
dan-s1 e77835758c
NIFI-11581 Refactored JSON Validator Test from Groovy to Java
This closes #7283

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:02:44 -05:00
dan-s1 57f5b518f8
NIFI-11528 Refactored TestFormatUtilsGroovy to Java Parameterized Test
This closes #7248

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 09:23:18 -05:00
exceptionfactory 5bbde66f14
NIFI-11558 Applied Security Headers to All Registry Responses
- Refactored Registry Filters to shared HeaderWriterHandler
- Refactored Registry Jetty Server with delegated HandlerProvider

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7258.
2023-05-23 06:43:16 -04:00
exceptionfactory c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7264.
2023-05-21 07:17:52 -04:00
mr1716 642b1748a6
NIFI-11573 Upgraded Swagger Annotations from 1.6.10 to 1.6.11
This closes #7278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:28:29 -05:00
Pierre Villard a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4
This closes #7277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:58 -05:00
Pierre Villard d030428dc3
NIFI-11572 Upgraded json-smart from 2.4.10 to 2.4.11
This closes #7276

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:25 -05:00
Pierre Villard 0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
Arek Burdach 8a4c3cab84
NIFI-8161 Migrated EL from SimpleDateFormat to DateTimeFormatter
This closes #7169

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:10:12 -05:00
mr1716 284c11fc87
NIFI-11569: Update Testcontainers to 1.18.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7272.
2023-05-19 20:54:40 +02:00
mr1716 0dba207a41
NIFI-11565: Upgrade jackson.bom to 2.15.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7271.
2023-05-19 20:48:46 +02:00
mr1716 141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
Mike Thomsen c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor.
NIFI-11221 Style check fixes

NIFI-11221 Removed dead code.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7213
2023-05-19 10:53:28 -04:00
Joe Gresock 28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:24:13 -04:00
Joe Gresock 6ee4632267
NIFI-11566: Adding updateTimeout argument to parameter commands in CLI
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7267.
2023-05-19 12:05:44 +02:00
Lehel Boér 6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7263
2023-05-18 15:54:08 -04:00
exceptionfactory e2134e2733
NIFI-11561 Upgraded Apache Commons IO from 2.11.0 to 2.12.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7259.
2023-05-17 21:23:49 +02:00