Commit Graph

577 Commits

Author SHA1 Message Date
Mark Payne 50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
Mark Payne ac810671c5 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7322
2023-05-31 17:07:39 -04:00
Mike Moser a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
Emilio Setiadarma 340b5fcb00
NIFI-11526 Refactored DatabaseRecordSinkTest to Java from Groovy
This closes #7229

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-05 08:53:00 -05:00
exceptionfactory 7906e3424c
NIFI-11489 Removed Deprecated Record Writer and Schema Registry methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7199.
2023-04-27 20:18:15 +03:00
Tamas Palfy 88587f5c02
NIFI-11386 Added Resource and Audience support to StandardOauth2AccessTokenProvider
- Also keeping previous Refresh Token if one is not provided during a refresh request

This closes #7164

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 22:05:49 -05:00
mr1716 dbb973a666
NIFI-10333 Upgraded HikariCP from 4.0.3 to 5.0.1
This closes #7177

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:06:59 -05:00
mr1716 f77659913f
NIFI-11457 Upgraded commons-configuration2 from 2.8.0 to 2.9.0
This closes #7176

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-17 18:05:09 -05:00
Mark Payne 7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Pierre Villard b0997f843d
NIFI-11416 Upgraded Caffeine from 2.8.1 to 3.1.6
This closes #7147

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:12 -05:00
Pierre Villard 4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
exceptionfactory dde89c0b15
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 13:12:57 +02:00
exceptionfactory 2dbb8f25f3
NIFI-11349 Upgraded HBase from 2.2.2 to 2.5.3 with Hadoop 3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7091.
2023-03-28 22:04:00 +02:00
Joe Witt 58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
exceptionfactory b23b2621ac
NIFI-11267 Removed deprecated OAuth2TokenProviderImpl
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7029.
2023-03-13 09:22:20 +01:00
Lehel Boér 13d343d5ee
NIFI-11151: Improving code reusability of DBCP services
This closes #6935.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-07 14:41:34 +01:00
exceptionfactory f76259a6cf
NIFI-11210 Removed unused import from TestDistributedMapCacheClientService
- Missed commit from #6994

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:31:27 -06:00
Paul Grey 288031f5f6
NIFI-11210 Added read timeout to DistributedMapCacheClientService
This closes #6994

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:00:28 -06:00
exceptionfactory 48689a2567
NIFI-11195 Refactored Identity Mapping to nifi-security-identity
- Moved StringUtils from nifi-properties to nifi-property-utils
- Moved Peer Identity methods from CertificateUtils to specific Site-to-Site classes

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6977.
2023-02-23 10:33:45 -05:00
exceptionfactory 7b12545e5a
NIFI-11211 Removed deprecated SSLContextService methods
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6983.
2023-02-22 14:54:03 -05:00
exceptionfactory a0ef378a42 NIFI-11207 Removed HBase 1.1.2 Services
This closes #6979

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:51:02 -05:00
exceptionfactory 0fa1060297
NIFI-11208 Removed Hortonworks Schema Registry
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6980
2023-02-21 16:48:45 -05:00
exceptionfactory 5507bfa4b2
NIFI-11191 Refactored HikariCPConnectionPoolTest with Mock Driver (#6966)
- Removed Derby dependencies from HikariCP module no longer required for testing

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-02-16 17:34:57 -05:00
Nissim Shiman dbef536ebd
NIFI-10950 DistributeLoad processor - this closes #6924. removed Load Distribution
Service

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 19:18:57 -05:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
dan-s1 99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
exceptionfactory 6877e84931
NIFI-11135 Upgraded Commons CSV from 1.9.0 to 1.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6921.
2023-02-03 12:26:47 +01:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
Pierre Villard 1148738c19
NIFI-11095 This closes #6888. Deprecate Hortonworks Schema Registry
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:59:00 -07:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Tamas Palfy 464e0a96ee
NIFI-11050 In PutEmail added OAuth authorization option. StandardOauth2AccessTokenProvider can be used with refresh_token grant type.
This closes #6845.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 16:05:28 +01:00
Matthew Burgess a9baa21f87 NIFI-10996: Write out CSV header even if there are no records
This closes #6818

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-01-11 10:55:31 -05:00
Esa Lindqvist 4716c8d715
NIFI-10456 Added Client Authentication Strategy option to OAuth2 Provider
StandardOauth2AccessTokenProvider has been updated with new property `Client Authentication Strategy` supporting Basic Authentication as recommended in RFC 6749. The changes maintain the current default implementation using Request Body parameters

This closes #6782

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:07:33 -06:00
exceptionfactory b556322749
NIFI-11005 Added Illegal and Redundant Import Modules to Checkstyle
- Updated impacted classes to remove redundant import lines
- Removed WebUtilsGroovyTest.groovy class due to use of internal sun.security classes

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6804.
2022-12-23 18:34:38 +01:00
Mark Payne 78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6725
2022-12-14 12:09:32 -05:00
Lehel Boér ed6ba53724 NIFI-10832: Create PutSalesforceRecord processor
This closes #6670.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
exceptionfactory b0ab364f61
NIFI-10967 Corrected TestWriteJsonResult mixed arrays
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6773
2022-12-09 01:01:58 -05:00
Matt Burgess b744fac479
NIFI-10956: Fix inference issues with mixed arrays (#6763) 2022-12-08 09:28:19 -05:00
sopan98 ab8e9aa8df
NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader
- Updated unit test based on deterministic behavior of LinkedHashMap

This closes #6726

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:26:58 -06:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
sopan98 ff14ea2aab
NIFI-10862 This closes #6709. Fix Flaky tests in TestXMLReader
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:25:02 -07:00
Curtis Ruck 54108689b6
NIFI-10842 Added HTTP Protocols to StandardOauth2AccessTokenProvider
This closes #6686

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:26:32 -06:00
mr1716 c63a668ac5
NIFI-10808 Upgraded Guava from 31.0.1 to 31.1
This closes #6683

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:18:13 -06:00
Pierre Villard 2698282615 NIFI-10804 - Update okhttp-digest to 2.7
This closes #6681

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:35:12 -05:00
Mike Thomsen ea10b62615 NIFI-10794 Made StandardOauth2AccessTokenProvider a verifiable controller service.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6645.
2022-11-13 17:04:50 +00:00
sopan98 ce18b63db0
NIFI-10743 Used LinkedHashMap in TestHBase_1_1_2_ClientService.testScan
This closes #6632

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 14:49:22 -06:00
Mark Payne 381e0f84e1
NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception
This closes #6623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 16:20:22 -05:00