Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-07 18:48:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
8,498 Commits 147 Branches 203 Tags
Commit Graph

8498 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mark Payne
649494f7c1 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>> 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2023-05-31 16:58:01 -04:00
Steven Matison
0344bd3e25
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery 
This closes #7316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 645618a6095a94488f845cb427a4d4768161953d)
 2023-05-31 14:34:00 -05:00
Bence Simon
c8fbad875d
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services 
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 007bf3bcec8c1dcc898abe0673d55465df37ee29)
 2023-05-31 11:04:12 -05:00
Bryan Bende
5f5bf48d74
NIFI-11604 Improve handling of non-renewable tickets in AbstractKerberosUser 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7301.
 2023-05-31 15:14:15 +02:00
siddr
ddc1330a1a
NIFI-11598 Upgrade gremlin.version from 3.6.2 to 3.6.4 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7311.
 2023-05-31 15:07:00 +02:00
Peter Turcsanyi
7276e10a04
NIFI-11615: Logging fixes in AMQP bundle 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7314.
 2023-05-31 13:04:06 +02:00
dan-s1
a75ec445f2
NIFI-11612 Refactored SocketUtilsTest from Groovy to Java 
This closes #7310

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 818747d84b8bfca39211a277dbccf10bbbc30c7e)
 2023-05-30 14:42:13 -05:00
dan-s1
26235ad537
NIFI-11611 Refactored TlsConfigurationTest from Groovy to Java 
This closes #7309

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 2f8e5b27b074919837514ae22ce2d57fe3e76212)
 2023-05-30 14:42:11 -05:00
Peter Turcsanyi
1bad2f56ac NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 18:47:57 +02:00
Michael Moser
8143a12715 NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232) 
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
 2023-05-30 11:09:52 -04:00
mr1716
27a2b421f2 NIFI-11605 Update spark-streaming_2.13 to to 3.3.2 
This closes #7306

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-29 19:24:21 -04:00
mr1716
6a74c161ef NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10 
This closes #7307

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-29 19:24:10 -04:00
mr1716
0dcdf139b5 NIFI-11607 Update spring.boot.version to 2.7.12 
This closes #7308

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-29 19:24:00 -04:00
mr1716
0d774874d9 NIFI-11601 Update mysql-connector-java to 8.0.33 
This closes #7303

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-05-29 19:23:55 -04:00
Mark Bathori
7e705b6372
NIFI-11590: Missing Enum data type handling in FlowFileTable 
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2023-05-26 11:16:43 +02:00
Mark Payne
8208aa9536
NIFI-11591 Improved stability of DynamicallyClassPath and AsyncCommitCallback tests 
After terminating Processor in DynamicallyModifiedClasspathIT system test, keep trying to empty queue until successful instead of assuming success after the first iteration.

When writing to a replacement file in AsyncCommitCallbackIT, write to a temp file and then rename. This prevents the processor from picking up the file while it's still being written.

This closes #7302

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 9f61b5f957e0389d4929fd7f4e9fd83521bcd4c5)
 2023-05-25 19:14:58 -05:00
dan-s1
c2cafae6c3
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON 
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit d6600e67cb2eb6d18588f921fb51210464e42b84)
 2023-05-25 16:04:21 -05:00
Mike Moser
f0b35dfa44
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown 
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit a446af8aaaa7b65dd216043c847cfcb599bc83e8)
 2023-05-25 15:03:10 -05:00
mr1716
22a6127f49
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82 
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 4695925dd576a1291611282620e593e2d67911df)
 2023-05-25 13:21:48 -05:00
mr1716
75ccf1a761
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3 
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 8a0007a6b8c8988f7c356c397e5de0575bdfc350)
 2023-05-25 13:21:48 -05:00
Chris Sampson
dc17b3b4cd
NIFI-10797 add customisable Elasticsearch REST Client config and Elasticsearch Cluster Sniffer 
Signed-off-by: Joe Gresock <jgresock@gmail.com>
 2023-05-25 11:53:26 -04:00
Peter Turcsanyi
5fba0410d8
NIFI-11585: Added ADLSCredentialsControllerServiceLookup 
Backported
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
(cherry picked from commit e2dd9359e4004c2a45d1a9740295ddc8bab102ce)
 2023-05-25 16:11:53 +02:00
Mark Payne
336003725a
NIFI-11591 Corrected intermittent system test failures 
When waiting for a Processor to stop completely in system tests, also consider any terminated threads. Consider the processor stopped only when all active threads and all terminated threads have gone to 0. Additionally, when stopping all components in a Process Group, wait for the PG to reflect that there are no running components.  Previously, we checked for processor active thread counts. However, this was problematic because the flow that was fetched was not fetched recursively and as a result, processors running in embedded groups were not always stopped when the waitForProcessorsStopped(String groupId) method returned. Finally, removed the step for gathering surefire-reports in failed system tests because it was not working as expected and was unneeded because the tests' logs were already gathered into the diagnostic dump that is uploaded.

Added fix for BatchFlowBetweenGroupsIT. The test would intermittently fail, based on timing. The test assumed that when Input Port in Group B was scheduled to run, it would trigger before FlowFiles in Group A finished processing. The Sleep processor caused a 10 ms delay for each of 5 FlowFiles which gives the Input Port about 50 ms to trigger. If it took longer to trigger the first time, the test failed. Adjusted the Sleep processor to use 2 seconds. So now instead of 50 milliseconds to start, it has 10 seconds. Overall this adds about 30-45 seconds to the run time of the test but ensures more-than-adequate time for the test to run, even on extremely slow hardware

This closes #7289

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 108f841525f98aab8144c0421a1ea5e5cb2a3b3b)
 2023-05-24 14:03:57 -05:00
mr1716
22d76ab49c
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1 
This closes #7290

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 40157ae5a220660937dd27854cca81c509e34a63)
 2023-05-24 13:28:19 -05:00
NissimShiman
e18886fcb3 NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273) 
when underlying nar for nifi-flow-registry-client-nar is missing
 2023-05-24 13:33:18 -04:00
Mark Payne
9007e6b2fc
NIFI-11584 Improved MergeContent stream handling 
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit ca2a829d47a252544a764998d11318d2a2cd6e1c)
 2023-05-24 11:49:09 -05:00
dependabot[bot]
7ec61c22f1
NIFI-11589 Upgraded socket.io-parser from 4.2.2 to 4.2.3 
This closes #7288

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 1642315c0f0aa48b92128a0f329c86485857eabd)
 2023-05-24 09:08:22 -05:00
Matthew Burgess
dc9fbc1026
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
 2023-05-24 11:46:22 +02:00
Matthew Burgess
276cc5765b
NIFI-8326: Send records as individual messages in Kafka RecordSinks 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
 2023-05-24 10:43:57 +02:00
exceptionfactory
1e5c7073b9
NIFI-11582 Deprecated GetIgniteCache and PutIgniteCache Processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7284.
 2023-05-24 09:47:05 +02:00
Daniel Urban
ef97f7e214
NIFI-10867 Refactored common configuration for Stateless Connectors 
This closes #6744

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit c8d3a69d64b0699602750829421d08cd03b74622)
 2023-05-23 19:00:27 -05:00
Matthew Burgess
a84a7cb60a
NIFI-11557: Fixed error with Java 11 code 2023-05-23 16:05:26 -04:00
Mark Payne
82a55ebdd4
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed. 
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
 2023-05-23 14:30:59 -04:00
Bence Simon
9cebdc2824
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest 
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit ec01bce20786dfef0bd457fa7de8e04edbef9589)
 2023-05-23 10:15:19 -05:00
dan-s1
e78cf08fd5
NIFI-11581 Refactored JSON Validator Test from Groovy to Java 
This closes #7283

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit e77835758cd653e9a0d18d4e0c2be8661c99745c)
 2023-05-23 10:03:41 -05:00
dan-s1
e33b40e08e
NIFI-11528 Refactored TestFormatUtilsGroovy to Java Parameterized Test 
This closes #7248

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 57f5b518f8f6667d627c13be3e2265eefcbe9e75)
 2023-05-23 09:26:20 -05:00
exceptionfactory
4c2056d390
NIFI-11558 Applied Security Headers to All Registry Responses 
- Refactored Registry Filters to shared HeaderWriterHandler
- Refactored Registry Jetty Server with delegated HandlerProvider

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7258.
 2023-05-23 07:16:22 -04:00
exceptionfactory
3fde51320e
NIFI-11568 Removed Apache DS Test Dependency 
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7264.

(cherry picked from commit c32bfd055740c63f839c1dddeb5fbac991245776)
 2023-05-22 08:47:10 -05:00
mkalavala
935dc8c3e7
NIFI-9131 Refactor nifi-ldap-iaa-providers-bundle to use JUnit 5 
This closes #6946

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 0d0ba1ca41dd1ffb633ed2fc1f74b17e460de0f9)
 2023-05-22 08:42:19 -05:00
mr1716
f801510714
NIFI-11573 Upgraded Swagger Annotations from 1.6.10 to 1.6.11 
This closes #7278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 642b1748a6e103a218da44283e3d73b12db50404)
 2023-05-19 16:31:44 -05:00
Pierre Villard
dedbd617b1
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4 
This closes #7277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit a54c9915c360ca5023a7ba832825a6c6e7f98259)
 2023-05-19 16:31:43 -05:00
Pierre Villard
8c389bebb0
NIFI-11572 Upgraded json-smart from 2.4.10 to 2.4.11 
This closes #7276

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit d030428dc36e6509ae6cf130f42e640609d123ae)
 2023-05-19 16:31:42 -05:00
Pierre Villard
ce38aafa06
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0 
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 0e8aa5b744d756c8edc17c724f0c9f98dbcc0b8a)
 2023-05-19 16:31:42 -05:00
mr1716
2bfbe35c56
NIFI-11569: Update Testcontainers to 1.18.1 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7272.
 2023-05-19 20:55:02 +02:00
mr1716
ac308ceddb
NIFI-11565: Upgrade jackson.bom to 2.15.1 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7271.
 2023-05-19 20:49:35 +02:00
mr1716
f4e88d673c
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8 
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 141ea044bb15a1848a176625293ea80fe38ed809)
 2023-05-19 10:26:07 -05:00
Joe Gresock
0e6a099eb6
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:25:17 -04:00
Joe Gresock
e8ceed52ac
NIFI-11566: Adding updateTimeout argument to parameter commands in CLI 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7267.
 2023-05-19 12:06:08 +02:00
Lehel Boér
4fa47ecc2a
NIFI-5151: Add UPSERT support for Apache Phoenix 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
 2023-05-18 16:00:24 -04:00
exceptionfactory
35b3570158
NIFI-11561 Upgraded Apache Commons IO from 2.11.0 to 2.12.0 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7259.
 2023-05-17 21:25:23 +02:00