Commit Graph

7908 Commits

Author SHA1 Message Date
Pierre Villard f717025380 NIFI-10807 - Update gson to 2.10
This closes #6680

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:34:17 -05:00
Pierre Villard 87f02d26d9 NIFI-10809 - Update greenmail to 1.6.11
This closes #6679

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:33:34 -05:00
Pierre Villard 7374f9d2b2 NIFI-10810 - Update HTTPAsyncClient to 4.1.5
This closes #6678

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:32:52 -05:00
Pierre Villard 85a95550bb NIFI-10806 - update snmp4j dependencies
This closes #6677

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:32:06 -05:00
Kevin Doran 78f206a811 NIFI-10820 Change Docker base image to eclipse-temurin
NIFI-9656 Change Docker images to use Java 11

This closes #6673

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:50:37 +00:00
Matthew Burgess 214bd2f00c
NIFI-7862: Add UpdateDatabaseTable processor for auto table structure updates
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5523.
2022-11-17 14:38:52 -05:00
krisztina-zsihovszki dfdd86cff7 NIFI-10793 Comment is not populated when process group is created via API
This closes #6653.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-17 16:04:46 +01:00
Arpad Boda 7a449dbcee NIFI-10833 - Fix grammar error in ListenHTTP log msg 2022-11-16 19:40:20 -05:00
sedadgn 009d641576 NIFI-10787 - Cannot commit flows to nifi registry after updating our nifi release to 1.18.0
NifiRegistryFlowRegistryClient defines the PropertyDescriptor PROPERTY_URL  name as small case "url". The map bases on the name property of the PropertyDescriptor object. Here searching with uppercase value of "URL" causes the map lookup to fail and cause a NPE later on. Therefore, it is changed as "url"

NIFI-10787 - Added constant for property descriptor "url" in NiFiRegistryFlowMapper to make it more clear.

NIFI-10787 - Added change to unit test.

NIFI-10787 - Updated unit test to validate that NiFi registry url is being set and retrieved.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6655.
2022-11-16 19:07:15 -05:00
Mark Payne d7f2eb7c26
NIFI-10818: Fixed bug in which oldest bin in MergeContent was not being evicted in order to make room for a new bin when using a correlation attribute. Added additional tests for JoinEnrichment to ensure that the changes had no adverse effects on that processor. Found a bug when running that test in MockProcessSession so also addressed the bug (ConcurrentModificationException).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6668
2022-11-16 16:49:29 -05:00
greyp9 30facedc43
NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key (#6131)
* NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key
* publisher wrapper record; property naming and display order; doc updates
2022-11-16 16:07:43 -05:00
exceptionfactory 9e3987d04e
NIFI-10826 Separated Maven Compile and Verify in ci-workflow
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6666
2022-11-16 12:56:33 -05:00
exceptionfactory bd89d66539
NIFI-7392 Corrected TestValidationJson for Windows build 2022-11-16 11:29:12 -06:00
mr1716 83ff168ac1
NIFI-10763 Upgraded mysql-binlog-connector-java from 0.26.1 to 0.27.5
This closes #6667

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:19:19 -06:00
r65535 a702a8c215
NIFI-7392 Added ValidateJson to Standard Processors
This closes #6337

Co-authored-by: dan-s1 <dsteig1@gmail.com>
Co-authored-by: r65535 <ryan77056@gchq.gov.uk>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:02:17 -06:00
exceptionfactory 0135191106
NIFI-10821 Upgraded Netty from 4.1.84 to 4.1.85
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6665.
2022-11-16 10:55:13 +01:00
Nathan Gough 1b8cd8349b
NIFI-10703 - Updated VersionedDataflow to support MaxEventDrivenThreadCount
NIFI-10703 - Also setting the maxEventDrivenThreadCount on the controller when using a versioned flow.
NIFI-10703 - Corrected to use getMaxEventDrivenThreadCount(), set a default value for event driven thread count in VersionedDataflow
NIFI-10703 - Updated log message for setMaxThreadCount in FlowController.java
NIFI-10703 - Updated default value for maxEventDrivenThreadCount
NIFI-10703 - Set private for DEFAULT_MAX_EVENT_DRIVEN_THREAD_COUNT

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6638
2022-11-15 21:08:48 -05:00
Ferenc Kis 709110da35
NIFI-10701 Update MiNiFi docker base images to eclipse-temurin
This closes 6587.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-11-15 20:08:41 -05:00
Matthew Burgess f2774c4924
NIFI-9814: Add range sampling to SampleRecord
- Incorporated review comments

This closes #5878
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-15 18:49:51 -05:00
Nandor Soma Abonyi 241d619138
NIFI-10775 Improve support for DescribedValue in PropertyDescriptor.Builder
This closes #6650.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 22:17:21 +01:00
Mark Payne bda624823b
NIFI-10817: Moved the calls in StandardProcessSession to 'resetState()' and 'acknowledgeRecords()' from the outer commit(boolean) to the inner commit(Checkpoint, boolean). By moving the call here, the logic of StandardProcessSession is unaffected. But the StatelessProcessSession that inherits from it now has the benefit of having the state cleaned up when calling super.commit(Checkpoint, boolean).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6663
2022-11-15 15:47:32 -05:00
Malthe Borch a71556f115
NIFI-10491 Added Conflict Resolution Strategy to PutAzureBlobStorage_v12
This closes #6443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:40:23 -06:00
mr1716 491f21bf90
NIFI-10727 Upgraded grpc libraries from 1.48.0 to 1.50.2
This closes #6660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:24:17 -06:00
Paul Grey 25b6e2c9cd
NIFI-10815 Fixed initial internal yield duration when processor created
This closes #6664

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:14:50 -06:00
Tamas Palfy 56af75f5bd
NIFI-10722 - Add handling of TBCD-STRING in nifi-asn1-services
This closes #6611

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:12:22 -06:00
Mark Bathori 4083e07447
NIFI-10801: Fix hive metastore based tests in Iceberg processors
This closes #6656.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 20:12:37 +01:00
Mark Bean 2bfefc3e5b NIFI-10243: allow ControlRate to throttle on combination of data rate or flowfile rate
NIFI-10243: fix typos

NIFI-10243: re-ordered property in ControlRate

NIFI-10243: minor updates to make code cleaner based on PR comments

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6506.
2022-11-14 23:04:55 -05:00
Shawn Weeks e8774979de
NIFI-10751 Add Username to User and Group CRUD (#6614) 2022-11-14 13:49:07 -05:00
Emilio Setiadarma d06c19180a
NIFI-9697: Implemented AzureKeyVaultSecretsParameterProvider and AzureKeyVaultCredentialsService; Implemented unit tests as well as the documentation for the Parameter Provider
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6545.
2022-11-14 13:25:47 -05:00
Nathan Gough 23e8a19417
NIFI-10705 - Primary keys were not being included in ConvertJSONToSQL UPDATE queries when 'User statement.type Attribute' was used.
This closes #6652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 09:23:10 -06:00
Bryan Bende 7de74ad3f0
NIFI-10802 Apply bundle updates before properties in component synchronizer (#6654)
This closes #6654
2022-11-14 09:09:44 -05:00
mr1716 5fb8cf89f0
NIFI-10730 Upgraded Splunk from 1.6.5.0 to 1.9.1
This closes #6617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:58:27 -06:00
Mike Thomsen 78dbee8b7a
NIFI-10805 Upgraded script bundle Clojure, Groovy and JRuby
- Upgraded Clojure from 1.10.1 to 1.11.1
- Upgraded Groovy from 3.0.8 to 3.0.13
- Upgraded JRuby from 9.3.8.0 to 9.3.9.0

This closes #6657

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:54:52 -06:00
Mike Thomsen 00da6d5ead
NIFI-10562 Moved MongoDB to testcontainers for integration-tests
This closes #6642

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:35:06 -06:00
Peter Gyori 412c1f2e43
NIFI-10762: Ranger Authorizer accepts multiple Ranger Admin Identity property values (#6625) 2022-11-14 08:28:24 -05:00
Emilio Setiadarma 08bc44715e
NIFI-10789 Set FlowFile attributes for errors fetching from Azure Data Lake Storage
This closes #6644

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:27:59 -06:00
Mike Thomsen ea10b62615 NIFI-10794 Made StandardOauth2AccessTokenProvider a verifiable controller service.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6645.
2022-11-13 17:04:50 +00:00
exceptionfactory 3a536e261f NIFI-10798 Added Deprecation Logging for Java 8 on Startup
- Added deprecation warnings for NiFi, Registry, and MiNiFi
- Added RuntimeVersionProvider for shared reference to deprecated and minimum versions

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6648.
2022-11-10 21:48:50 -05:00
exceptionfactory b14eedfa7f
NIFI-10796 This closes #6647. Upgraded Apache Iceberg from 0.14.0 to 1.0.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-10 15:39:23 -07:00
exceptionfactory efa4f6e7de
NIFI-10795 This closes #6646. Upgraded Jackson from 2.13.4 to 2.14.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-10 15:30:08 -07:00
exceptionfactory 588e04cd07 NIFI-10780 Improved Event Server to avoid dropping messages
- Improved ByteArrayMessageChannelHandler to call BlockingQueue.offer() while the server is not shutting down
- Improved NettyEventServer to use ChannelFuture.await() for closing the channel to allow shutdown to proceed
- Added test method for EventDroppedException handling

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6634.
2022-11-10 15:38:43 -05:00
Tamas Palfy 56d0061da4
NIFI-10764 Fixed handling BIT STRING in nifi-asn1-services
Representing as a string of 1s and 0s (e.g. "010011000")

This closes #6622

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-10 10:33:17 -06:00
Seokwon Yang 0643f336e8
NIFI-10130 AzureGraphUserGroupProvider handles group with transitive members
This closes #6135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 15:47:03 -06:00
Pierre Villard 425dd6a848
NIFI-10790 Updated Snowflake JDBC driver from 3.13.21 to 3.13.24
This closes #6641

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 15:32:30 -06:00
sopan98 ad4e0b0585
NIFI-10783 Switched to LinkedHashMap for CompareFuzzyHash
This closes #6639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 14:27:39 -06:00
Gabor Kulik 1bd4169558 NIFI-10702 Clear server list on connection error in SMB processors
This closes #6620.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-09 21:07:24 +01:00
Bryan Bende 9c21e26e63
NIFI-10788 Ensure proposed service config is applied when component synchronizer adds a new service (#6640)
This closes #6640
2022-11-09 15:04:19 -05:00
Mike Thomsen ddfaf16f68
NIFI-10781 Made the MongoDB controller service implement VerifiableControllerService.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6635
2022-11-08 17:40:41 -05:00
exceptionfactory 01816da56f
NIFI-10645 Corrected Bouncy Castle dependencies for Iceberg
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6636
2022-11-08 17:36:57 -05:00
Nandor Soma Abonyi d374c1f399
NIFI-10760 Add API Key authentication to ElasticSearchClientServiceImpl
This closes #6619

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 16:02:49 -06:00