Commit Graph

6142 Commits

Author SHA1 Message Date
mr1716 05322fa8ce
NIFI-11730 Upgraded UnboundID LDAP SDK from 6.0.8 to 6.0.9
This closes #7412

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-20 17:12:05 -05:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
exceptionfactory 7b6a51aa9f NIFI-11728 Removed RethinkDB Processors
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7410
2023-06-20 16:15:13 -04:00
mr1716 3ac1876ecb NIFI-11731 Update json-schema-validator to 1.0.84
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7413
2023-06-20 12:52:50 -04:00
Peter Turcsanyi 4082951506
NIFI-11708: Upgraded snowflake-ingest-sdk to 2.0.1 and snowflake-jdbc to 3.13.33
This closes #7393

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-20 18:12:34 +02:00
mr1716 a5ae155839
NIFI-11725 Upgraded Woodstox from 6.5.0 to 6.5.1
This closes #7407

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:05:01 -05:00
mr1716 b8c5bb661e
NIFI-11724 Upgraded parquet-avro from 1.13.0 to 1.13.1
This closes #7406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:04:15 -05:00
mr1716 69ef6c6971
NIFI-11723 Upgraded Jedis from 3.9.0 to 3.10.0
This closes #7405

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:03:32 -05:00
mr1716 d252ed5e1b
NIFI-11722 Upgraded Spring Data Redis from 2.7.10 to 2.7.13
This closes #7404

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:02:07 -05:00
mr1716 8be9b01677
NIFI-11720 Upgraded HBase from 2.5.3 to 2.5.5
This closes #7402

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:01:15 -05:00
exceptionfactory 0ed1efc50a
NIFI-11712 Removed java.net.preferIPv4Stack from bootstrap.conf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7392.
2023-06-19 10:22:31 +02:00
exceptionfactory b6b621bf9e
NIFI-11717 Updated Required Java Version to 17.0.6
- Added Groovy Plugin Repository for groovy-eclipse-compiler

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7397.
2023-06-19 10:19:55 +02:00
Matt Burgess 8a696c1dfa
NIFI-11715 Removed unused user-defined property support from PutDatabaseRecord and DistributedMapCacheLookupService
This closes #7395

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 16:23:43 -05:00
dan-s1 e4d1dab8f7
NIFI-11167 Added ExcelReader to nifi-poi-nar
- Moved shared schema inference components to nifi-record-serialization-services-shared

This closes #7194

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:50:08 -05:00
Matt Burgess bc6ac4b700
NIFI-11682 Correct Quoting for UPSERT and INSERT_IGNORE keys in PutDatabaseRecord
This closes #7385

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:05:03 -05:00
exceptionfactory ce019071a4 NIFI-11713 Removed Deprecated ECMAScript Support
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7394
2023-06-16 14:23:51 -04:00
Peter Turcsanyi b36570f2cd
NIFI-11699 Fixed dynamic properties in SnowflakeComputingConnectionPool
Also fixed driver class name handling (caused IT test failure).
Other test fixes to make IT tests work.

This closes #7387

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:40:57 -05:00
mr1716 7c7b7c026b
NIFI-11710 Corrected nifi-kafka-2-6-nar Description
This closes #7390

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:39:46 -05:00
exceptionfactory 6b19ab8eaa NIFI-11696 Upgraded Bouncy Castle from 1.71 to 1.74
- Adjusted nifi-repository-encryption to remove dependency on Bouncy Castle Provider
- Updated Google Cloud Provider dependencies to remove exclusions and dependencies on Bouncy Castle that no longer apply to current versions

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7384
2023-06-15 16:33:20 -04:00
exceptionfactory 4638d2e251
NIFI-11635 Upgraded IoTDB from 1.0.1 to 1.1.1
- Excluded transitive test dependencies to avoid SNAPSHOT versions

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7382.
2023-06-15 13:39:11 +02:00
Matt Burgess 760949922c
NIFI-11691 Support VARBINARY and LONGVARBINARY in PutDatabaseRecord
This closes #7380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 21:01:02 -05:00
Matthew Burgess 991e5e24de
NIFI-4957 Add Resource File Support for Jolt Specifications
This closes #4044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 16:01:02 -05:00
mr1716 17efd87bae
NIFI-11687 Upgraded Hazelcast from 5.3.0 to 5.3.1
This closes #7375

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:45 -05:00
mr1716 8cd1b4b76c
NIFI-11685 Upgraded zstd-jni from 1.5.5-3 to 1.5.5-4
This closes #7376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:07 -05:00
mr1716 4b6209ed20
NIFI-11684 Upgraded Brotli4j from 1.11.0 to 1.12.0
This closes #7377

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:27:26 -05:00
Jeyassri Balchandran 8382b0a7a3
NIFI-11540 Removed legacy segment attributes from MergeContent
This closes #7305

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 18:37:48 -05:00
exceptionfactory ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
2023-06-13 15:36:23 -04:00
Emilio Setiadarma 31e1c17d44
NIFI-11642 Updated PutSNS using AWS SDK 2
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 13:50:22 -05:00
Paul Grey 336b857442
NIFI-11553 Add Record handling and more Properties for GCP PubSub
- Added Message Derivation Strategy to PublishGCPubSub with FlowFile and Record options
- Added API Endpoint property to PublishGCPPubSub and ConsumeGCPubSub
- Added Batch configuration properties

This closes #7274

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 11:00:51 -05:00
exceptionfactory 9c2f15cc18
NIFI-11680 Corrected Buffer Size Calculation for Connection Balancing (#7370)
- Resolved BufferOverflowException in PeerChannel with Bouncy Castle Provider
- Changed prepareForWrite() to use Destination Buffer remaining instead of Application Buffer Size
- Changed encrypt() to Packet Buffer Size instead of Application Buffer Size
2023-06-13 11:01:27 -04:00
Mark Payne 787e0d8261
NIFI-11681: Terminate Process Sessions before interrupting processor threads
This closes #7371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 08:24:03 -05:00
Paul Grey 45e8226f89
NIFI-11672 Adjusted ListSFTP to handle incomplete File Types
- Modified file handling to include both REGULAR and UNKNOWN File Types returned from an SFTP server

This closes #7365

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 11:25:22 -05:00
Mark Payne 702c635034
NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile
Rather than creating many FlowFiles with the same Content Claim, refactored content repos' OutputStreams and ClaimWriteCache so that a new ContentClaim is created for each FlowFile. This ensures that we have a content claim offset of 0. The poor performance was due to having to use StreamUtils.skip() in conjunction with the CipherInputStream, which would only skip a max of 511 bytes at a time. By using a separate Content Claim per FlowFile, we no longer need to seek after creating the CipherInputStream

This closes #7363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 09:47:44 -05:00
exceptionfactory 7485687d4b
NIFI-11657 Removed Deprecated PutBigQueryBatch and PutBigQueryStreaming
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7351.
2023-06-11 15:49:42 +02:00
exceptionfactory 9374039312
NIFI-11674 Upgraded Apache Iceberg from 1.2.1 to 1.3.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7364.
2023-06-11 15:43:58 +02:00
mr1716 054df20aed
NIFI-11665 Upgraded oauth2-oidc-sdk from 9.43.1 to 9.43.3
This closes #7358

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
Matt Burgess 5e6f3abdd2
NIFI-11655 Fixed float and double handling in GenerateRecord
This closes #7356

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
exceptionfactory 4509f5de80 NIFI-11666 Added Exception to Error Log for ModifyCompression
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7360
2023-06-08 11:19:05 -04:00
Matt Burgess f3e8651522 NIFI-11647: Support UUID type in DataTypeUtils.getSQLTypeValue
This closes #7355

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-08 11:13:07 -04:00
Nandor Soma Abonyi 10a2815527
NIFI-11659 Removed unnecessary Jackson 1 dependencies
This closes #7354

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-07 15:04:43 -05:00
exceptionfactory 9195b586e5
NIFI-11656 Removed deprecated Azure Queue Storage Processors
- Removed AzureStorageCredentialsControllerService and related implementations
- Removed com.micrsoft.azure:azure-storage dependencies

This closes #7350

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-07 16:19:38 +02:00
siddr dd2486d3e0 NIFI-11587: Update questdb to 6.7
This closes #7319
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-06-07 09:39:44 +02:00
siddr e72ca689c2
NIFI-11643 Upgraded geoip2 from 2.16.1 to 4.0.1
This closes #7341

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 15:31:39 -05:00
exceptionfactory 4faf3ea598
NIFI-11653 This closes #7349. Added Connection URL Validation for Database Services
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-06 09:29:48 -07:00
mr1716 d956ede743
NIFI-11649 Upgraded icu4j from 72.1 to 73.1
This closes #7346

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:42:17 -05:00
mr1716 e6c2c7c7ee
NIFI-11652 Upgraded Jolt from 0.1.7 to 0.1.8
This closes #7348

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:30:36 -05:00
exceptionfactory c5c711c91d
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
- Added selective overrides to upgrade transitive dependencies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
Emilio Setiadarma b11373af7b
NIFI-11549 Added AzureQueueStorage_v12 Processors
- Deprecated GetAzureQueueStorage and PutAzureQueueStorage

This closes #7269

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 16:26:02 -05:00
Shane Ardell 7a7f6f6229
NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:36:49 -07:00
dependabot[bot] 88d7b3905b
NIFI-11644 Upgraded Hazelcast from 4.2.7 to 5.3.0
This closes #7282

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 14:49:22 -05:00
Matt Burgess d200186096
NIFI-11567: Auto-reload database file in GeoEnrichIP processors (#7266)
NIFI-11567: Auto-reload database file in GeoEnrichIP processors
2023-06-05 13:54:17 -04:00
Bryan Bende ce50ffbe0e
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:11:33 -04:00
Peter Turcsanyi 963518d943
NIFI-11586 Added AzureStorageCredentialsControllerServiceLookup_v12
Also added client caching in blob v_12 processors which was needed to support multiple credentials provided by the new lookup service

This closes #7300

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-05 13:07:02 +02:00
Peter Turcsanyi 803868935a
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 14:59:07 -05:00
Mark Payne df9f8ddcfb NIFI-11636: Do not buffer Parquet content into memory unnecessarily
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7334
2023-06-02 15:35:10 -04:00
exceptionfactory ec525b0437
NIFI-11629 This closes #7327. Added Socket Write Timeout to InvokeHTTP
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-02 08:04:25 -07:00
Joe Gresock 3ef4439879
NIFI-8287 Upgraded SQS Processors to use AWS SDK 2
This closes #7211

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 21:53:33 -05:00
Scott Aslan 7a10ba6165
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:13:08 -04:00
Matthew Burgess 3ebe8f2983
NIFI-11538: This closes #7239. Fix primitive type conversion for PutIceberg 2023-06-01 12:29:38 -07:00
Mark Payne 50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
exceptionfactory b042eb01e8
NIFI-11614 Improved Validation for JndiJmsConnectionFactoryProvider
This closes #7313.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-01 19:53:18 +02:00
Pierre Villard d4f301f473
NIFI-11620 Upgraded Google libraries-bom from 26.12.0 to 26.15.0
This closes #7321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:44 -05:00
Pierre Villard 06b49cbc32
NIFI-11619 Upgraded Azure BOM from 1.2.11 to 1.2.13
This closes #7320

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:04 -05:00
Mark Payne 4b7e20740e
NIFI-11591: Added additional logging for DynamicallyModifyClasspath system test
This closes #7312

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:23:07 -05:00
Mark Payne ac810671c5 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7322
2023-05-31 17:07:39 -04:00
Steven Matison 645618a609
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery
This closes #7316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 14:32:01 -05:00
Bence Simon 007bf3bcec
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 11:02:48 -05:00
siddr b6802ffed8
NIFI-11598 Upgrade gremlin.version from 3.6.2 to 3.6.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7311.
2023-05-31 15:06:39 +02:00
Peter Turcsanyi 02374798d2
NIFI-11615: Logging fixes in AMQP bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7314.
2023-05-31 13:03:41 +02:00
Michael Moser eca4f5d68f
NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232)
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:06 -04:00
Peter Turcsanyi 3bd4b49abe NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 16:25:28 +02:00
mr1716 bfa4b178ee NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10
This closes #7307

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 14:07:44 -04:00
Mark Bathori cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
Peter Turcsanyi de62c6261f Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
This reverts commit 4e304ac586.
2023-05-26 11:07:45 +02:00
Mark Bathori 4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
dan-s1 d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
Mike Moser a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
mr1716 4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
mr1716 8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
Peter Turcsanyi e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
mr1716 40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
This closes #7290

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
NissimShiman a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273)
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
Mark Payne ca2a829d47
NIFI-11584 Improved MergeContent stream handling
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
Matthew Burgess adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:40:48 +02:00
Matthew Burgess df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
2023-05-24 10:43:30 +02:00
exceptionfactory 3833b51764
NIFI-11583 Removed GetIgniteCache and PutIgniteCache Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7285.
2023-05-24 09:49:34 +02:00
Mark Payne a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7265
2023-05-23 14:29:29 -04:00
Bence Simon ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:14:39 -05:00
exceptionfactory c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7264.
2023-05-21 07:17:52 -04:00
Pierre Villard a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4
This closes #7277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:58 -05:00
Pierre Villard 0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
mr1716 141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
Mike Thomsen c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor.
NIFI-11221 Style check fixes

NIFI-11221 Removed dead code.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7213
2023-05-19 10:53:28 -04:00
Joe Gresock 28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:24:13 -04:00
Lehel Boér 6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7263
2023-05-18 15:54:08 -04:00
Lehel 1a38bf003e
NIFI-11547 Fixed DBCPConnectionPool verification
- Added unit test for AbstractDBCPConnectionPool

This closes #7249

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 10:51:29 -05:00
siddr 607b53504b
NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3
This closes #7252

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-16 15:48:57 -05:00
exceptionfactory bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations (#7222)
* NIFI-11513 Removed deprecated NarProvider and implementations

- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
Lehel 335365874a
NIFI-11535: Transfer ConnectWebsocket connection configuration FlowFile to relationships
Also moved dto and util packages under org.apache.nifi.websocket.jetty

This closes #7246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 15:26:35 +02:00
Matthew Burgess 78fd7fadcd
NIFI-11380: Refactor CaptureChangeMySQL with improvements
This closes #7116

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-16 12:12:18 +02:00
exceptionfactory 8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7251.
2023-05-16 10:34:23 +02:00
krisztina-zsihovszki 3051b69a6c
NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
This closes #7241.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:43:47 +02:00
exceptionfactory bec6ceda1f
NIFI-11548 Upgraded Apache Tika from 2.7.0 to 2.8.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7247.
2023-05-15 20:41:22 +02:00
Ryan Van Den Bos 658f2547d8
NIFI-11430 - PaginatedJsonQueryElasticsearch processors should not output empty FlowFile if hits have been found; PaginatedJsonQueryElasticsearch processors should be able to use _source and _meta only result formats when grouping by query
This closes #7163

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-05-13 19:35:20 +01:00
exceptionfactory f7e36a07ac
NIFI-11228 Removed deprecated Azure Blob Storage Processors
This closes #7234

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-12 17:33:28 +02:00
Nissim Shiman fd2138b8cf NIFI-10756 Generate error message when processor and/or controller
service is unable to transition to start and/or enabled state

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-05-12 14:40:47 +00:00
M Tien 09cef4ff99
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) (#7117)
* NIFI-11287: detect dependent properties when the property it depends on references a parameter

* address review feedback

* address more review comments

* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class

* add type parameter to all places calling loadProperties

* get reference parameters by invoking provided callbacks from the client

* check for user permissions before requesting for referenced parameters

* address review feedback

This closes #7117
2023-05-11 17:00:57 -04:00
Nandor Soma Abonyi 2049d5068b
NIFI-11524 Improved ExecuteStreamCommand documentation and configuration
This closes #7228

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-11 14:52:21 -05:00
exceptionfactory e302f2aff7
NIFI-10976 Added Previous Cluster State Provider configuration (#7235)
- Added methods to enumerate Stored Component Identifiers on State Provider interface and implementations
- Added nifi.state.management.provider.cluster.previous to nifi.properties
- Updated State Manager Provider to restore Cluster State from Previous Cluster Provider
- Updated Configuring State Providers documentation for new property
2023-05-10 16:22:05 -04:00
Timea Barna 5811a9c579
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics
This closes #7124

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-08 08:11:20 -05:00
Emilio Setiadarma 340b5fcb00
NIFI-11526 Refactored DatabaseRecordSinkTest to Java from Groovy
This closes #7229

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-05 08:53:00 -05:00
Lehel Boér 265b132e73
NIFI-11493: Defaulted dynamically modified classpath fix
This closes #7201.

Co-authored-by: Peter Turcsanyi <turcsanyi@apache.org>
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-04 15:20:56 +02:00
Bence Simon 4e9675475c NIFI-11523 Refining schema handling for ScriptedTransfromRecord
This closes #7226

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:34:28 -04:00
mr1716 d754d952c2 NIFI-11522 Upgrade cassandra.sdk.version to 3.11.3
This closes #7225

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:29:35 -04:00
mkalavala aad7b40bd9
NIFI-11360 Added Client-Side Encryption for Azure Blob v12 Processors
This closes #7182

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-02 20:37:33 -05:00
dan-s1 e4cdb90a75 [NIFI-11509] Added configuration to allow for parsing comments in JSON.
This closes #7220

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:18:47 -04:00
dan-s1 71c7d38c75 [NIFI-11511] Added Provenance route events for all the relationships.
This closes #7221

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:03:49 -04:00
Pierre Villard 9f3284393a NIFI-11510 - Upgrade Box SDK to 4.1.0
This closes #7219

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 07:50:40 -04:00
Chris Sampson 3a3b9edc71
NIFI-10067: enable use of script when updating documents in Elasticsearch via PutElasticsearchJson or PutElasticsearchRecord
NIFI-3262: enable use of dynamic_templates in Elasticsearch _bulk operations

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6628.
2023-05-02 07:17:17 -04:00
Pierre Villard 01d1be3215
NIFI-11507 Upgraded Calcite from 1.32 to 1.34
This closes #7216

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:11:38 -05:00
Pierre Villard 65daa33dfa
NIFI-11506 Upgraded Curator from 5.4.0 to 5.5.0
This closes #7215

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:09:42 -05:00
Pierre Villard fb4eb38688
NIFI-11505 Upgraded gRPC from 1.54.0 to 1.54.1
This closes #7214

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-01 14:08:53 -05:00
Matthew Burgess 0e93dfae83
NIFI-11466 Added ModifyCompression Processor
- Added nifi-compress-bundle with nifi-compress-nar

This closes #7180

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-29 21:06:29 -05:00
Matthew Burgess 3d60e4a4f6 NIFI-11034: Restore image viewer to nifi-assembly
This closes #7209

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 18:20:53 -04:00
Pierre Villard 7fb2468f4b NIFI-11502 - Upgrade json-path to 2.8.0
NIFI-11502 fixing unit tests
NIFI-11502 review

This closes #7208

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 16:03:16 -04:00
Chris Sampson 9274d0c9b0 NIFI-10865 allow RecordPath's unescapeJson to convert de-serialised JSON Objects into Records
NIFI-10865 allow UpdateRecord to replace the Record root for relative paths, e.g. when a RecordPath function is used to modify selected field(s)

This closes #6708

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 12:26:07 -04:00
Pierre Villard 3de6f960fb
NIFI-11501 Upgraded Hive MQTT client from 1.3.0 to 1.3.1
This closes #7207

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:14:19 -05:00
Pierre Villard abdef65096
NIFI-11497 Upgraded snowflake-ingest-sdk from 1.1.1 to 1.1.3
This closes #7204

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:10:25 -05:00
Pierre Villard 67a4d10b3e
NIFI-11495 Upgraded Iceberg from 1.2.0 to 1.2.1
This closes #7203

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:09:36 -05:00
exceptionfactory d9f49bca14
NIFI-11491 Removed deprecated PersistentProvenanceRepository
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7200.
2023-04-28 13:42:36 +03:00
exceptionfactory 7906e3424c
NIFI-11489 Removed Deprecated Record Writer and Schema Registry methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7199.
2023-04-27 20:18:15 +03:00
exceptionfactory ee03db0e8f
NIFI-11488 Removed Deprecated Sensitive Properties Algorithms
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7198.
2023-04-27 20:16:26 +03:00
Timea Barna d54940c397
NIFI-11473 Flow version change in NiFi should not stop a component when only position is changed
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7185
2023-04-27 12:59:24 -04:00
Aakash Chauhan afdbed5749
NIFI-8971 Removed legacy FlowFile name and path attributes
This closes #6003

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 16:37:48 -05:00
Chris Sampson 99b2412ad4
NIFI-11483 Correctly use DescribedValue for JsonQueryElasticsearch
This closes #7195

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 11:57:14 -05:00
Lehel Boér ffaf81ec46
NIFI-11067 Delete Property History when changing Sensitive status
This closes #7082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-26 09:55:21 -05:00
Pierre Villard c819c4de94 NIFI-11224: Refactor and FF attribute support in WHERE in QuerySalesforceObject.
This closes #7019.

Co-authored-by: Lehel Boér <lehel44@hotmail.com>
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-04-26 14:27:40 +02:00
Scott Aslan 387504b66f
NIFI-11433 - use .add() for set instead of .push() (#7193)
* replace d3.nest, use add instead of push for Set, use forEach to loop over Set

* es5 function syntax

Merged #7193 into main.
2023-04-25 10:43:45 -07:00
Chris Sampson 05418d94f0 NIFI-11111 add option to output Elasticsearch error responses as FlowFile to PutElasticsearchJson and PutElasticsearchRecord
NIFI-11111 clarify error_responses relationships in PutElasticsearchJson/Record processors
NIFI-11111 Refactor exception handling for error response flowfile transfer
NIFI-11111 Add elasticsearch.bulk.error attributes containing the Elasticsearch _bulk response for error documents in PutElasticsearchJson

This closes #6903

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-25 06:41:44 -04:00
Scott Aslan 38ece1d7d9
[NIFI-11433] update angular, d3, moment, slickgrid, and jquery depen… (#7174)
* [NIFIF-11433] update angular, d3, moment, slickgrid, and jquery dependencies

* address review feedback

* .entries instead of .keys

Merged #7174 into main.
2023-04-24 10:16:20 -07:00
Daniel Aaron Salwerowicz d3f2bf1c16
NIFI-11472 Check working directory after making directory in PutFTP
- Multiple threads can attempt to create a remote directory when PutFTP has multiple concurrent tasks.

This closes #7184

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-24 11:33:09 -05:00
exceptionfactory 51956a4426
NIFI-11479 Upgraded JanusGraph from 0.5.3 to 0.6.3
- Set Guava to 31.1 overriding 29.0 from JanusGraph 0.6.3

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7192.
2023-04-23 11:52:14 +03:00
exceptionfactory 1639ecee11
NIFI-11438 Set standard OpenID Connect Scopes
- Restored previous behavior of sending openid and email scopes for OpenID Connect token requests
- Added offline_access scope as the default value in nifi.properties to support Refresh Tokens

This closes #7168
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-21 11:29:16 -04:00
Peter Turcsanyi 8586ac594e
NIFI-11475 Fixed missing jackson-dataformat-xml in nifi-azure-services-api
This closes #7186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-21 08:55:26 -05:00
Mike Thomsen f3f966ca37
NIFI-11441 Removed OpenCypherClientService
- The cypher-gremlin-neo4j-driver library is no longer supported

This closes #7171

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-21 08:50:25 -05:00
Pierre Villard bdcd4fcfda
NIFI-11402 - PutBigQuery fix for case sensitivity and error handling
This closes #7140.

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2023-04-19 21:07:23 +02:00
exceptionfactory bdff3abcd6
NIFI-11461 Improve User and Group Tenants Search (#7181)
* NIFI-11461 Improved User and Group Tenants Search

- Added searchTenants method to NiFiServiceFacade and removed unnecessary object creation
- Updated TenantsResource to use delegated NiFiServiceFacade.searchTenants method
- Changed autocomplete delay from default 300 ms to 500 ms

* NIFI-11461 Adjusted implementation to use EntityFactory.createTenantEntity

This closes #7181
2023-04-19 09:58:25 -04:00
exceptionfactory 382058e154
NIFI-11425 Removed Compression from EncryptContentPGP and SignContentPGP
- Removed Compression Algorithm property from EncryptContentPGP and SignContentPGP
- Removed Camellia values from Symmetric Key Algorithm property in EncryptContentPGP

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7156.
2023-04-19 15:27:54 +03:00
exceptionfactory d382b378a8
NIFI-11387 Added Transport Type property to Azure Event Hub Components
- Transport Type defaults to AMQP and also supports AMQP with WebSockets

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7126.
2023-04-19 15:04:56 +03:00
krisztina-zsihovszki 9a002d9a43
NIFI-11255 Allowable value for 'Use s3.region Attribute'
This closes #7051.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-04-18 17:58:49 +02:00
Tamas Palfy 88587f5c02
NIFI-11386 Added Resource and Audience support to StandardOauth2AccessTokenProvider
- Also keeping previous Refresh Token if one is not provided during a refresh request

This closes #7164

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 22:05:49 -05:00
mr1716 1466b7d7d3
NIFI-11458 Upgraded JNA from 5.12.1 to 5.13.0
This closes #7179

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:09:35 -05:00
mr1716 29bb652623
NIFI-11456 Upgraded brotli4j from 1.8.0 to 1.11.0
This closes #7178

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:08:27 -05:00
mr1716 dbb973a666
NIFI-10333 Upgraded HikariCP from 4.0.3 to 5.0.1
This closes #7177

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:06:59 -05:00
mr1716 f77659913f
NIFI-11457 Upgraded commons-configuration2 from 2.8.0 to 2.9.0
This closes #7176

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:05:09 -05:00
Mark Payne 7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Mark Bathori 44a7f7f38b
NIFI-11440 Speed up Iceberg Hive Metastore Tests
This closes #7170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 12:52:22 -05:00
Paul Grey cff7808543
NIFI-11439 Corrected GCS Transit URI for custom Storage API URL
This closes #7173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 10:09:27 -05:00
Paul Grey cd685671c8
NIFI-11439 Corrected Checkstyle violation on GCS Property
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 14:25:54 -05:00
Paul Grey ee24df2830
NIFI-11439 Added Storage API URL property to GCS Processors
- Included Host Header override with Storage API URL based on Google Private Service Connect documentation

This closes #7172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-13 13:56:23 -05:00
exceptionfactory bc5f00a667
NIFI-11437 Switched to StreamUtils.fillBuffer() for buffer, Improved EncryptContentPGP Content Type Detection
This closes #7166
Signed-off-by: Paul Grey <greyp@apache.org>
2023-04-13 12:11:45 -04:00
Pierre Villard 061f3a1380 NIFI-11429 - Upgrade Gremlin to 3.6.2
This closes #7160

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-13 08:22:25 -04:00
Bryan Bende ba93f60731
NIFI-11436 Fix NPE during updateFlow when called from a replace request for a PG that is not under version control (#7167) 2023-04-12 19:24:22 -04:00
Tamas Palfy 3322ad7a20
NIFI-10955 Added optional preprocessing to JASN1Reader
This close #6769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 22:16:20 -05:00
Pierre Villard 594e45cf9a
NIFI-11428 Upgraded Groovy to 3.0.17 and spock-core to 2.3
This closes #7159

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 08:01:36 -05:00
Pierre Villard cbca499070
NIFI-11427 Upgraded Atlas from 2.2.0 to 2.3.0
This closes #7158

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-11 08:01:36 -05:00
Pierre Villard a148b6f348
NIFI-11407 Upgraded Azure BOM from 1.2.9 to 1.2.11
- Added Woodstox Core to nifi-toolkit-encrypt-config

This closes #7136

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 14:36:48 -05:00
Joe Witt 4414793f2a
NIFI-11408 enable user to disable gzip compression with PutGCSObject
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7139.
2023-04-10 19:57:16 +03:00
Pierre Villard 21e4c665dc
NIFI-11421 Upgraded Parquet from 1.12.3 to 1.13.0
- Upgraded MockFtpServer from 2.7.1 to 3.1.0

This closes #7152

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:50:13 -05:00
Pierre Villard 81fefbafc9
NIFI-11420 Upgraded ActiveMQ from 5.15.15 to 5.18.0
This closes #7151

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:48:54 -05:00
Pierre Villard 06145d2b30
NIFI-11419 Upgraded MongoDB driver from 4.8.2 to 4.9.1
This closes #7150

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:46:45 -05:00
Pierre Villard 2b06306b07
NIFI-11418 Upgraded bcrypt from 0.9.0 to 0.10.2
This closes #7149

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:55 -05:00
Pierre Villard b0997f843d
NIFI-11416 Upgraded Caffeine from 2.8.1 to 3.1.6
This closes #7147

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:12 -05:00
Pierre Villard 0b2deb94de
NIFI-11415 Upgraded Saxon-HE from 10.6 to 12.1
This closes #7146

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:44:12 -05:00
Pierre Villard 2515c5771d
NIFI-11414 Upgraded snowflake-ingest-sdk from 1.0.3 to 1.1.1
This closes #7145

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:43:14 -05:00
Pierre Villard 83d19a6e9d
NIFI-11413 Upgraded JUnit 5.9.1 to 5.9.2
- Upgraded JUnit 4.13.1 to 4.13.2

This closes #7144

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:42:24 -05:00
Pierre Villard 0160d6d6b9
NIFI-11410 Upgraded multiple integration dependencies
- Upgraded Spring Boot from 2.7.9 to 2.7.10

This closes #7141

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:40:09 -05:00
mr1716 8992256f78
NIFI-11404 Upgraded AMQP Client from 5.16.0 to 5.17.0
This closes #7138

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 16:43:50 -05:00
mr1716 58257c8a55
NIFI-11403 Upgraded Calcite Core from 1.32.0 to 1.34.0
This closes #7137

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 16:42:45 -05:00
Pierre Villard 4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
Pierre Villard 9149bd47c4
NIFI-11406 Upgraded Google GCP from 26.4.0 to 26.12.0
- Upgraded Google Drive from Revision 20221219 to 20230306

This closes #7135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:47:15 -05:00
aglotero d80a19e230 NIFI-5642: QueryCassandra processor : output FlowFiles as soon fetch_size is reached
NIFI-5642: QueryCassandra processor : output FlowFiles as soon fetch_size is reached
Fixed checkstyle error
Delete build.sh
Delete local build file
NIFI-5642 : letting fetch_size to control the Cassandra data flow creating a new MAX_ROWS_PER_FLOW_FILE parameter
Fixed checkstyle error: no more import java.util.*
Fixed missing imports
NIFI-5642: added REL_ORIGINAL relationship in order to allow incremental commit
Addressing comments from code review
Adjustments on timestamp datatype formatting
Created the OUTPUT_BATCH_SIZE property
Code review adjustments
NIFI-5642: update after rebase
NIFI-5642: addressing PR comments
NIFI-5642: adding in integration test, fixing race condition
NIFI-5642: remove log4j2

This closes #6848

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-05 16:01:54 -04:00
Mark Bathori d15eeb445b
NIFI-11342: HDFS processors fail to get ClassloaderIsolationKey at startup
This closes #7121.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-04-05 15:37:28 +02:00
exceptionfactory dffad44a03
NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:10:02 -07:00
Nandor Soma Abonyi 32df0fa484
NIFI-11137 Add record support to Consume/PublishJMS (#6987) 2023-04-03 21:42:27 +02:00
exceptionfactory e4f0508c90
NIFI-11370 Corrected JWK Set retrieval for NIFI Trust Strategy (#7108)
- Added StandardOidcIdTokenDecoderFactory based on Spring Security OidcIdTokenDecoderFactory with custom REST Operations

Merged #7108 into main.
2023-03-31 16:26:02 -07:00
Matthew Burgess 59eebb9906
NIFI-8710: Pass details instead of source ID for Provenance per the interface doc
This closes #5224

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-31 18:43:22 +02:00
exceptionfactory 75eb449a31
NIFI-11365 Corrected OIDC Redirect URI resolution for reverse proxies (#7104)
- Added Authorization Request Resolver with support for building the base redirect URI using allowed proxy headers

This closes #7104
2023-03-30 16:26:35 -04:00
Nandor Soma Abonyi 2b9f2071ed
NIFI-11270 Refactoring of the overly Paho-specific MQTT interface
This closes #7032.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-29 23:20:06 +02:00
exceptionfactory 8952f7c0cf NIFI-11354 Removed Neo4j 3 Service and modules
This closes #7093

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-03-29 15:41:24 -04:00
exceptionfactory d66b29853e
NIFI-11359 Upgraded woodstox-core to 6.5.0 for Solr 8.11.1
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-29 08:04:35 -07:00
Mark Payne 23d6d6ede4
NIFI-11251: Fixed case in which changing Flow Version was improperly attempting to use a Temporary Funnel destination for a connection due to differences in Group ID by instead checking if the destination is reachable; fixed issue in which processors in an inner versioned group were not stopped even though they changed, when a higher-level parent (that was itself under version control) had its version changed. Wrote system tests to verify
- Fixed system tests so that they work properly in Clustered version of RegistryClientIT
- Fixed system test - ensure that we wait for processors to become valid before attempting to start them; also added an additional system test around Controller Services in versioned flows

This closes #7095

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-29 08:30:18 -05:00
exceptionfactory dde89c0b15
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 13:12:57 +02:00
exceptionfactory 7cb20d6f7f
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:22:12 -07:00
exceptionfactory 5214097c59
NIFI-11355 Upgraded Couchbase Client from 2.5.8 to 2.7.23
- Suppressed vulnerability findings related to Couchbase Server

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7094.
2023-03-28 22:05:55 +02:00
exceptionfactory 2dbb8f25f3
NIFI-11349 Upgraded HBase from 2.2.2 to 2.5.3 with Hadoop 3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7091.
2023-03-28 22:04:00 +02:00
exceptionfactory 158b5ffbcc
NIFI-11346 This closes #7088. Upgraded Parquet from 1.12.0 to 1.12.3
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:41:45 -07:00
exceptionfactory 5bdee9a714
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:41:11 -07:00
exceptionfactory 04cacad52a
NIFI-11348 This closes #7090. Upgraded JRuby from 9.3.9.0 to 9.4.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:40:51 -07:00
exceptionfactory 26400fcbe9
NIFI-4890 Refactor OIDC with support for Refresh Tokens (#7013)
* NIFI-4890 Refactored OIDC with support for Refresh Tokens

- Implemented OIDC Authorization Code Grant Flow using Spring Security Filters
- Implemented OIDC RP-Initiated Logout 1.0
- Implemented OAuth2 Token Revocation RFC 7009 for Refresh Tokens
- Added OIDC Bearer Token Refresh Filter for updating application Bearer Tokens from Refresh Token exchanges
- Added configurable Token Refresh Window to application properties
- Removed original implementation and supporting classes

* NIFI-4890 Set Bearer Token expiration based on Access Token

* NIFI-4890 Corrected spelling and naming issues based on feedback

This closes #7013
2023-03-28 08:35:10 -04:00