cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
...
This closes #7294 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
de62c6261f
Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
...
This reverts commit 4e304ac586
2023-05-26 11:07:45 +02:00
4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
...
This closes #7294 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
9f61b5f957
NIFI-11591 Improved stability of DynamicallyClassPath and AsyncCommitCallback tests
...
After terminating Processor in DynamicallyModifiedClasspathIT system test, keep trying to empty queue until successful instead of assuming success after the first iteration.
When writing to a replacement file in AsyncCommitCallbackIT, write to a temp file and then rename. This prevents the processor from picking up the file while it's still being written.
This closes #7302
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 19:14:01 -05:00
1dfd85b40b
NIFI-11600 Combined the two TestFormatUtils into one class
...
This closes #7298
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 16:15:31 -05:00
d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
...
This closes #7231
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
...
- Added thread naming based on Component Type and Component Identifier
This closes #7281
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
...
This closes #7293
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
...
This closes #7292
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
...
This closes #7287
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
108f841525
NIFI-11591 Corrected intermittent system test failures
...
When waiting for a Processor to stop completely in system tests, also consider any terminated threads. Consider the processor stopped only when all active threads and all terminated threads have gone to 0. Additionally, when stopping all components in a Process Group, wait for the PG to reflect that there are no running components. Previously, we checked for processor active thread counts. However, this was problematic because the flow that was fetched was not fetched recursively and as a result, processors running in embedded groups were not always stopped when the waitForProcessorsStopped(String groupId) method returned. Finally, removed the step for gathering surefire-reports in failed system tests because it was not working as expected and was unneeded because the tests' logs were already gathered into the diagnostic dump that is uploaded.
Added fix for BatchFlowBetweenGroupsIT. The test would intermittently fail, based on timing. The test assumed that when Input Port in Group B was scheduled to run, it would trigger before FlowFiles in Group A finished processing. The Sleep processor caused a 10 ms delay for each of 5 FlowFiles which gives the Input Port about 50 ms to trigger. If it took longer to trigger the first time, the test failed. Adjusted the Sleep processor to use 2 seconds. So now instead of 50 milliseconds to start, it has 10 seconds. Overall this adds about 30-45 seconds to the run time of the test but ensures more-than-adequate time for the test to run, even on extremely slow hardware
This closes #7289
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 14:03:07 -05:00
40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
...
This closes #7290
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change ( #7273 )
...
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
ca2a829d47
NIFI-11584 Improved MergeContent stream handling
...
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it
This closes #7286
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
1642315c0f
NIFI-11589 Upgraded socket.io-parser from 4.2.2 to 4.2.3
...
This closes #7288
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 09:07:19 -05:00
adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7268 .
2023-05-24 11:40:48 +02:00
df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4901 .
2023-05-24 10:43:30 +02:00
3833b51764
NIFI-11583 Removed GetIgniteCache and PutIgniteCache Processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7285 .
2023-05-24 09:49:34 +02:00
c8d3a69d64
NIFI-10867 Refactored common configuration for Stateless Connectors
...
This closes #6744
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 18:56:50 -05:00
a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
...
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #7265
2023-05-23 14:29:29 -04:00
ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
...
- Incremental adjustment avoids breaking test on slower environments
This closes #7260
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:14:39 -05:00
e77835758c
NIFI-11581 Refactored JSON Validator Test from Groovy to Java
...
This closes #7283
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:02:44 -05:00
57f5b518f8
NIFI-11528 Refactored TestFormatUtilsGroovy to Java Parameterized Test
...
This closes #7248
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 09:23:18 -05:00
5bbde66f14
NIFI-11558 Applied Security Headers to All Registry Responses
...
- Refactored Registry Filters to shared HeaderWriterHandler
- Refactored Registry Jetty Server with delegated HandlerProvider
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7258 .
2023-05-23 06:43:16 -04:00
c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7264 .
2023-05-21 07:17:52 -04:00
642b1748a6
NIFI-11573 Upgraded Swagger Annotations from 1.6.10 to 1.6.11
...
This closes #7278
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:28:29 -05:00
a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4
...
This closes #7277
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:58 -05:00
d030428dc3
NIFI-11572 Upgraded json-smart from 2.4.10 to 2.4.11
...
This closes #7276
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:25 -05:00
0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
...
This closes #7275
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
8a4c3cab84
NIFI-8161 Migrated EL from SimpleDateFormat to DateTimeFormatter
...
This closes #7169
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:10:12 -05:00
284c11fc87
NIFI-11569: Update Testcontainers to 1.18.1
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7272 .
2023-05-19 20:54:40 +02:00
0dba207a41
NIFI-11565: Upgrade jackson.bom to 2.15.1
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7271 .
2023-05-19 20:48:46 +02:00
141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
...
- Upgrade applies to nifi-azure-graph-authorizer
This closes #7262
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor.
...
NIFI-11221 Style check fixes
NIFI-11221 Removed dead code.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #7213
2023-05-19 10:53:28 -04:00
28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer ( #7261 )
2023-05-19 08:24:13 -04:00
6ee4632267
NIFI-11566: Adding updateTimeout argument to parameter commands in CLI
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7267 .
2023-05-19 12:05:44 +02:00
6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #7263
2023-05-18 15:54:08 -04:00
e2134e2733
NIFI-11561 Upgraded Apache Commons IO from 2.11.0 to 2.12.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7259 .
2023-05-17 21:23:49 +02:00
c4f7251b23
NIFI-11531 Migrated tests in nifi-security-utils from Groovy to Java
...
This closes #7238
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 13:39:15 -05:00
1a38bf003e
NIFI-11547 Fixed DBCPConnectionPool verification
...
- Added unit test for AbstractDBCPConnectionPool
This closes #7249
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 10:51:29 -05:00
764cc9e9b0
NIFI-11467 Upgraded jjwt from 0.7.0 to 0.9.1
...
This closes #7256
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 09:39:11 -05:00
c382ab6f06
NIFI-11150 Refactored QueryGroovyTest to TestQuery
...
This closes #7250
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 09:08:01 -05:00
607b53504b
NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3
...
This closes #7252
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-16 15:48:57 -05:00
bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations ( #7222 )
...
* NIFI-11513 Removed deprecated NarProvider and implementations
- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
335365874a
NIFI-11535: Transfer ConnectWebsocket connection configuration FlowFile to relationships
...
Also moved dto and util packages under org.apache.nifi.websocket.jetty
This closes #7246 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 15:26:35 +02:00
fcf2446bb5
NIFI-11485 Added Toolkit to Registry Docker Image
...
This closes #7197
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-16 08:21:15 -05:00
78fd7fadcd
NIFI-11380: Refactor CaptureChangeMySQL with improvements
...
This closes #7116
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-16 12:12:18 +02:00
8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0
...
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7251 .
2023-05-16 10:34:23 +02:00
3051b69a6c
NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
...
This closes #7241 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:43:47 +02:00
b9f4d02094
NIFI-11539 Removed ZooKeeper Migrator Toolkit ( #7237 )
2023-05-15 14:44:23 -04:00
Mark Bathori
Peter Turcsanyi
Mark Payne
dan-s1
Mike Moser
mr1716
NissimShiman
dependabot[bot]
Matthew Burgess
exceptionfactory
Daniel Urban
Bence Simon
Pierre Villard
Arek Burdach
Mike Thomsen
Joe Gresock
Lehel Boér
Emilio Setiadarma
Jeyassri Balchandran
siddr
Tan Luu
krisztina-zsihovszki