582 Commits

Author SHA1 Message Date
Chris Sampson
756f9d0fdb
NIFI-9206 Added RemoveRecordField Processor
This closes #6816

Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 3f5ed2350476ea258b0d96b00987e5deb626af53)
2023-06-26 11:09:54 -05:00
exceptionfactory
532578799c NIFI-11744 Added Required Permission to Reference Remote Resources
- Applied Required Permission to components supporting URL Resource References

Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-23 18:02:22 -04:00
exceptionfactory
4d55615c7a NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-20 16:20:54 -04:00
mr1716
00b868870a
NIFI-11720 Upgraded HBase from 2.5.3 to 2.5.5
This closes #7402

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 8be9b016771fbefaac60533f00dbe7dab63ca41e)
2023-06-19 16:12:10 -05:00
dan-s1
4d1c71476e
NIFI-11167 Added ExcelReader to nifi-poi-nar
- Moved shared schema inference components to nifi-record-serialization-services-shared

- Backported from main branch following the addition of nifi-schema-inference-utils from NIFI-11716

This closes #7194

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit e4d1dab8f7f901acb62a896acd3d6533caefb7cc)
2023-06-19 15:41:56 -05:00
exceptionfactory
b6bf9c5725
NIFI-11716 Backported nifi-schema-inference-utils from NIFI-11241
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #7396
2023-06-19 21:02:27 +01:00
Joe Witt
edc9e40582
Merge branch 'NIFI-11654-RC1' into support/nifi-1.x 2023-06-11 20:45:15 -04:00
Nandor Soma Abonyi
45c73e6b76
NIFI-11659 Removed unnecessary Jackson 1 dependencies
This closes #7354

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 10a2815527ea24d3b3160e114613534eba106598)
2023-06-07 15:05:43 -05:00
Joe Witt
f1d5a8c4de
NIFI-11654-RC1 prepare for next development iteration 2023-06-06 12:32:00 -07:00
Joe Witt
71e3ea9f2c
NIFI-11654-RC1 prepare release nifi-1.22.0-RC1 2023-06-06 12:31:58 -07:00
exceptionfactory
6a7a91f0fa
NIFI-11653 This closes #7349. Added Connection URL Validation for Database Services
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-06 09:39:58 -07:00
Mark Payne
e75d78b3c3
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 50811660d00b4bcfcb431f9897807352b947813a)
2023-06-01 13:34:27 -05:00
Mark Payne
649494f7c1 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-05-31 16:58:01 -04:00
Mike Moser
f0b35dfa44
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit a446af8aaaa7b65dd216043c847cfcb599bc83e8)
2023-05-25 15:03:10 -05:00
Emilio Setiadarma
205b4b7fd4
NIFI-11526 Refactored DatabaseRecordSinkTest to Java from Groovy
This closes #7229

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 340b5fcb00671e3a23834efc025220998f044764)
2023-05-05 08:54:05 -05:00
Tamas Palfy
39c7a356d2
NIFI-11386 Added Resource and Audience support to StandardOauth2AccessTokenProvider
- Also keeping previous Refresh Token if one is not provided during a refresh request

This closes #7164

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 88587f5c0208d72db95e61112126de64f12c1b87)
2023-04-17 22:07:01 -05:00
mr1716
f24a070e26
NIFI-11457 Upgraded commons-configuration2 from 2.8.0 to 2.9.0
This closes #7176

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit f77659913f3d6e6728e13d8d5ff29274980fe555)
2023-04-17 18:14:17 -05:00
Pierre Villard
5255d1bad3
NIFI-11417 Upgraded Caffeine from 2.8.1 to 2.9.3
This closes #7148

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:55:45 -05:00
Pierre Villard
2b2d571b82
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 4a0b38f4dd4b497fad3d071d99bfeae0fb15e3d8)
2023-04-07 16:49:44 -05:00
Joe Witt
9c27ddcb1c
NIFI-11357-RC2 prepare for next development iteration 2023-04-03 14:40:08 -07:00
Joe Witt
892f822107
NIFI-11357-RC2 prepare release nifi-1.21.0-RC2 2023-04-03 14:40:07 -07:00
exceptionfactory
6b6d779069
NIFI-11349 Excluded reload4j from HBase 2 jigsaw profile 2023-03-29 11:14:48 -05:00
exceptionfactory
3c2cb36c05
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 08:15:17 -05:00
exceptionfactory
c8c38bb8c6
NIFI-11349 Upgraded HBase from 2.2.2 to 2.5.3 with Hadoop 3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7091.
2023-03-28 22:04:21 +02:00
Joe Witt
fb31fcca54
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:32:43 -05:00
Lehel Boér
b3242304f8 NIFI-11151: Improving code reusability of DBCP services
This closes #6935.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-07 14:48:44 +01:00
exceptionfactory
b6c58ed4b2
NIFI-11210 Removed unused import from TestDistributedMapCacheClientService
- Missed commit from #6994

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:34:08 -06:00
Paul Grey
853586fedb
NIFI-11210 Added read timeout to DistributedMapCacheClientService
This closes #6994

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-03 15:22:18 -06:00
exceptionfactory
1380a3df77
NIFI-11191 Refactored HikariCPConnectionPoolTest with Mock Driver (#6966)
- Removed Derby dependencies from HikariCP module no longer required for testing

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-02-16 21:08:59 -06:00
Joe Witt
8300477ed1
NIFI-11103 preparing support/nifi-1.x line for any subsequent feature/maint releases starting with 1.21-snap 2023-02-09 15:40:01 -07:00
Joe Witt
896fdacbbd
NIFI-11103-RC1 prepare for next development iteration 2023-02-06 11:41:41 -07:00
Joe Witt
81296b5b69
NIFI-11103-RC1 prepare release nifi-1.20.0-RC1 2023-02-06 11:41:39 -07:00
exceptionfactory
6877e84931
NIFI-11135 Upgraded Commons CSV from 1.9.0 to 1.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6921.
2023-02-03 12:26:47 +01:00
dan-s1
e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
Pierre Villard
1148738c19
NIFI-11095 This closes #6888. Deprecate Hortonworks Schema Registry
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:59:00 -07:00
exceptionfactory
972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Peter Turcsanyi
cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Tamas Palfy
464e0a96ee
NIFI-11050 In PutEmail added OAuth authorization option. StandardOauth2AccessTokenProvider can be used with refresh_token grant type.
This closes #6845.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 16:05:28 +01:00
Matthew Burgess
a9baa21f87 NIFI-10996: Write out CSV header even if there are no records
This closes #6818

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-01-11 10:55:31 -05:00
Esa Lindqvist
4716c8d715
NIFI-10456 Added Client Authentication Strategy option to OAuth2 Provider
StandardOauth2AccessTokenProvider has been updated with new property `Client Authentication Strategy` supporting Basic Authentication as recommended in RFC 6749. The changes maintain the current default implementation using Request Body parameters

This closes #6782

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:07:33 -06:00
exceptionfactory
b556322749
NIFI-11005 Added Illegal and Redundant Import Modules to Checkstyle
- Updated impacted classes to remove redundant import lines
- Removed WebUtilsGroovyTest.groovy class due to use of internal sun.security classes

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6804.
2022-12-23 18:34:38 +01:00
Mark Payne
78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6725
2022-12-14 12:09:32 -05:00
Lehel Boér
ed6ba53724 NIFI-10832: Create PutSalesforceRecord processor
This closes #6670.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
exceptionfactory
b0ab364f61
NIFI-10967 Corrected TestWriteJsonResult mixed arrays
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6773
2022-12-09 01:01:58 -05:00
Matt Burgess
b744fac479
NIFI-10956: Fix inference issues with mixed arrays (#6763) 2022-12-08 09:28:19 -05:00
sopan98
ab8e9aa8df
NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader
- Updated unit test based on deterministic behavior of LinkedHashMap

This closes #6726

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:26:58 -06:00
Joe Witt
75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt
ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
sopan98
ff14ea2aab
NIFI-10862 This closes #6709. Fix Flaky tests in TestXMLReader
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:25:02 -07:00
Curtis Ruck
54108689b6
NIFI-10842 Added HTTP Protocols to StandardOauth2AccessTokenProvider
This closes #6686

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:26:32 -06:00