5762 Commits

Author SHA1 Message Date
exceptionfactory
588e0d74ab
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:50:14 +02:00
Mark Payne
d2fdff7b93
NIFI-11333: Do not allow components to be removed while a node is disconnected
This closes #7085

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 17:44:31 -05:00
Mark Payne
474e124667
NIFI-11341 Fixed OutputStream.close() handling for Content Claims
Fixed issue in StandardContentClaimWriteCache in which inner OutputStream class did not have an idempotent close() method; as a result, the stream could be written to while already in use for another active FlowFile; fixed bug in ContentClaimInputStream in which skip() method ignored its own BufferedInputStream - this was discovered because it was causing failures in StandardProcessSessionIT; fixed bug in StandardProcessSessionIT in which the length of StandardContentClaim was being doubled because the OutputStream was setting the claim length but that is already handled at a lower level.

This closes #7087

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:13:11 -05:00
Christian Wahl
06b0093130
NIFI-11232 Fixed buffer handling in ContentClaimInputStream
This closes #6996

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-27 16:13:10 -05:00
krisztina-zsihovszki
0b33ad8053
NIFI-11266 PutGoogleDrive, ListGoogleDrive, FetchGoogleDrive can't access a SharedDrive
This closes #7058

Reviewed-by: Mark Bathori <bathori.mark@gmail.com>

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-27 19:46:42 +02:00
Matt Burgess
e7be544989 NIFI-11337: Update PutDatabaseRecord's Max Batch Size property documentation to reflect actual behavior (#7081) 2023-03-24 10:24:42 -04:00
exceptionfactory
7ee16dda49
NIFI-11254 Upgraded SnakeYAML from 1.33 to 2.0
- Updated MiNiFi and EasyRules references to use required arguments

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7084.
2023-03-24 11:11:58 +01:00
Mark Bathori
986a1f0891 NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:44:51 +01:00
Bryan Bende
093935e1cd
NIFI-11332 Close Stream from Files.lines in StandardRuntimeManifestService
This closes #7079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 14:30:26 -05:00
Joe Gresock
c6aa166e32
NIFI-11336 Added CapabilityDescription to PutAccumuloRecord
This closes #7080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:57 -05:00
Emilio Setiadarma
82886d6514
NIFI-9196 Corrected FetchSFTP Move File destination formatting
- Changed FetchSFTP to use String.format() instead of  File.getAbsolutePath() for defining the destination path as part of the Move File completion strategy

This closes #7072

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 13:57:56 -05:00
Joe Witt
fb31fcca54
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:32:43 -05:00
Mark Payne
8eeebdb614
NIFI-11290 Run Component Primary Node State changes in background thread
- Ensure that components are notified that primary node has changed in a background thread instead of the Leader Election thread and activate/deactivate the thread in the case of Processors so that they can be viewed in the UI and terminated

- Fixed system tests that would fail intermittently because they did not wait for node disconnection to complete and did not properly switch the client to look at the connected node before checking cluster status

This closes #7052

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:21:45 -05:00
Joe Gresock
9208d056ef
NIFI-11330: Restarting service referenced by parameter only when service is active (#7078) 2023-03-23 13:14:48 -04:00
dependabot[bot]
573187eaf1
NIFI-11328 Upgraded Jettison from 1.5.2 to 1.5.4
- Upgraded direct dependencies in Framework and Registry modules as well as Spark bundle

This closes #7073
This closes #7074
This closes #7075

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 10:49:58 -05:00
exceptionfactory
a7daebc1af
NIFI-11325 Upgraded Mockito from 3.12.4 to 4.11.0
- Replaced deprecated Matchers references with ArgumentMatchers
- Removed unnecessary Mockito versions for Registry
- Refactored test configuration to Java for mocking

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7071.
2023-03-23 09:56:43 +01:00
Matt Burgess
3321de01f2 NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL (#7068)
NIFI-11305: Fixed out-of-order handling of binlog client shutdown in CaptureChangeMySQL
- Changed to allow 'unexpected' events to still be processed
2023-03-22 09:48:12 -04:00
exceptionfactory
6634125476
NIFI-4651 Corrected anonymous HashMap usage failing on Java 8 2023-03-21 18:55:32 -05:00
Mark Payne
cece57268e
NIFI-11310: Provide appropriate classpath resources to the ReloadComponent when a processor is terminated
NIFI-11310: Fixed META-INF/services file that was mistakenly listing an extra extension point, due to rebase
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2023-03-21 14:17:17 -04:00
krisztina-zsihovszki
5267a533bb
NIFI-4651 Add error message and code to PutSQL FlowFile attributes
NIFI-4651 Review comments

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7007
2023-03-21 11:22:06 -04:00
Nandor Soma Abonyi
69afe7fd8d
NIFI-11264 Added debug logs for List Processor yielding
- Corrected ListFile Processor description

This closes #7027

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-21 08:07:16 -05:00
Matt Burgess
b554102f4a NIFI-11305: Fix logic to correctly stop CaptureChangeMySQL (#7059) 2023-03-20 16:05:02 -04:00
Mark Bathori
835c95fca0 NIFI-11204: Add configurable retry logic for table commits in PutIceberg processor
This closes #6976.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-20 19:24:21 +01:00
simonbence
4a6e6751d5 NIFI-11213 Showing version change in older (pre 1.18.0) contained version flows properly (#7017) 2023-03-20 16:59:05 +01:00
Dustin Rodrigues
c15f47da92
NIFI-11301 Fixed typos in ISPEnrichIP and DistributeLoad
This closes #7056

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-20 08:56:11 -05:00
Mark Bathori
171c2ae670
NIFI-11263: Backported. Add case-insensitive and order independent field mapping to PutIceberg record converter
This closes #7026.

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-17 23:17:38 +01:00
Peter Turcsanyi
916e58a0a9
NIFI-11296 Backported improved code reusability of GRPC modules
This closes #7053

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-17 15:39:52 -05:00
johnAlJunior
f87e7f5478
NIFI-11269 Added snappy-java to nifi-avro-processors
This closes #7035

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 08:54:10 -05:00
Joe Gresock
957c9e2931
NIFI-11291: Ensuring exceptional EventIterators are closed in PartitionedEventStore
This closes #7047

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-16 08:27:38 -05:00
exceptionfactory
12774b97fb
NIFI-10792 Replaced PrintStream with OutputStream for Java 8 2023-03-15 17:18:56 -05:00
dan-s1
f7f8c22239
NIFI-10792 Updated ConvertExcelToCSV to handle files over 10 MB
- Refactored to reduce the cognitive complexity in the onTrigger method
- Added log4j-to-slf4j library and adjusted formatting
- Removed unnecessary graphics2d dependency

This closes #7016

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 15:26:46 -05:00
Mark Payne
f571d5704e
NIFI-11289: Avoid obtaining read locks on queues when fetching Group Status, except in those few specific situations where it's needed.
This closes #7046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-15 15:26:44 -05:00
Matt Burgess
9e804fec4e NIFI-11279: Allow event stream processing to continue in CaptureChangeMySQL after sync issue (#7039) 2023-03-14 16:30:41 -04:00
exceptionfactory
7b40dfe440
NIFI-11281 Corrected Accumulo NAR dependencies
- Set accumulo-core to provided in NAR and Services NAR modules
- Removed unused dependencies

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7042.
2023-03-14 15:15:55 -05:00
Chris Sampson
63bb245a2a
NIFI-11274 only add @timestamp to PutElasticsearchRecord document if not null
This closes #7036.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-03-13 14:12:50 -04:00
Peter Turcsanyi
ae24bccfd9
NIFI-11260 Added STS SSL Context Service for AWS Credentials Provider
This closes #7021

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-13 09:42:11 -05:00
Matt Burgess
7843a4a30a
NIFI-5501: Fixed classloader issue leading to multiple abandoned threads (#7031) 2023-03-10 15:43:12 -05:00
exceptionfactory
8511191ad1 NIFI-11261 Added Primary Node State handling to GetAzureEventHub
- Updated Qpid Proton J from 0.34.0 to 0.34.1

This closes #7023.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-09 22:33:57 +01:00
Nandor Soma Abonyi
dab3d6bfee
NIFI-11205 Added logging for deprecated Kafka 2_6 Kerberos properties
- Added Kerberos User Service property to KafkaRecordSink_2_6

This closes #6990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-09 15:25:26 -06:00
exceptionfactory
cc1e5b314b
NIFI-11194 Remove gzip CSS and JS from nifi-web-ui (#6968)
* NIFI-11194 Removed gzip CSS and JS from nifi-web-ui

* NIFI-11194 Updated comment for static content aggregation

This closes #6968
2023-03-08 11:10:03 -06:00
Nandor Soma Abonyi
9ee34eeb01 NIFI-11144 Fix failing tests for ConsumeJMS/PublishJMS
This closes #6930.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-03-08 14:43:49 +01:00
Lehel Boér
03625bb679 NIFI-11147 Backport - Fix Java8 compatibility issues. 2023-03-08 14:38:30 +01:00
Lehel Boér
203de77bb9 NIFI-11234: Fix RecordWriter NPE in QuerySalesforceObject
This closes #6997.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-03-08 14:38:30 +01:00
Lehel Boér
61a3ced5cc NIFI-10966: Add option to QuerySalesforceObject to run custom query
This closes #6794.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-03-08 14:38:30 +01:00
Lehel Boér
e0c1f0a89b NIFI-11147: Query all fields in QuerySalesforceObject
Fix review comments
2023-03-08 14:38:30 +01:00
Peter Turcsanyi
cdd94eaf72
NIFI-11256 Improved documentation for Azure Event Hubs Processors
- used the same ordering of 'Event Hub Namespace', 'Event Hub Name' and 'Service Bus Endpoint' properties
- removed "Primary" tag from 'Shared Access Policy Key' property name
- added some notes on clustering and consumer group in the documentation

This closes #7018

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-07 15:34:10 -06:00
Joe Gresock
a6687ae71a
NIFI-11247: Using parameterContextName instead of group name when fetching parameters (#7011)
Merged #7011.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2023-03-07 19:07:13 +01:00
Nissim Shiman
81aa752265
NIFI-4718 Improved detection of FlowFile V3 in IdentityMimeType
This closes #7009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-07 09:24:47 -06:00
Lehel Boér
b3242304f8 NIFI-11151: Improving code reusability of DBCP services
This closes #6935.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-07 14:48:44 +01:00
Nandor Soma Abonyi
609e25b3aa
NIFI-11249 Deprecated Kafka 2_0 Components
This closes #7012

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-06 08:56:28 -06:00