35 Commits

Author SHA1 Message Date
krisztina-zsihovszki
8aa0d5549e NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
This closes #7241.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:46:14 +02:00
Pierre Villard
a7423e180a
NIFI-11495 Upgraded Iceberg from 1.2.0 to 1.2.1
This closes #7203

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 67a4d10b3e5863c42c5f63a787813aec32fa84fe)
2023-04-28 15:17:34 -05:00
Mark Bathori
15a1134c85
NIFI-11440 Speed up Iceberg Hive Metastore Tests
This closes #7170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 44a7f7f38b3950a8a0135d1ce8602a4890c3d995)
2023-04-14 12:53:38 -05:00
Pierre Villard
e0c70ca45b
NIFI-11410 Upgraded multiple integration dependencies
- Upgraded Spring Boot from 2.7.9 to 2.7.10

This closes #7141

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 0160d6d6b90ef2d2862d01520161b37d489e2669)
2023-04-10 08:53:20 -05:00
Joe Witt
9c27ddcb1c
NIFI-11357-RC2 prepare for next development iteration 2023-04-03 14:40:08 -07:00
Joe Witt
892f822107
NIFI-11357-RC2 prepare release nifi-1.21.0-RC2 2023-04-03 14:40:07 -07:00
exceptionfactory
e3c550e73c
NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:11:41 -07:00
exceptionfactory
3c2cb36c05
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 08:15:17 -05:00
exceptionfactory
6a5b8c39ef
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:23:07 -07:00
exceptionfactory
87768708ab
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:21:51 -07:00
exceptionfactory
588e0d74ab
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:50:14 +02:00
Mark Bathori
986a1f0891 NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:44:51 +01:00
Joe Witt
fb31fcca54
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:32:43 -05:00
Mark Bathori
835c95fca0 NIFI-11204: Add configurable retry logic for table commits in PutIceberg processor
This closes #6976.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-20 19:24:21 +01:00
Mark Bathori
171c2ae670
NIFI-11263: Backported. Add case-insensitive and order independent field mapping to PutIceberg record converter
This closes #7026.

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-17 23:17:38 +01:00
Joe Witt
8300477ed1
NIFI-11103 preparing support/nifi-1.x line for any subsequent feature/maint releases starting with 1.21-snap 2023-02-09 15:40:01 -07:00
Joe Witt
896fdacbbd
NIFI-11103-RC1 prepare for next development iteration 2023-02-06 11:41:41 -07:00
Joe Witt
81296b5b69
NIFI-11103-RC1 prepare release nifi-1.20.0-RC1 2023-02-06 11:41:39 -07:00
Mark Bathori
869e2b3d66
NIFI-11110: Create processor for triggering HMS events
Review comment fixes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6902
2023-02-02 11:31:44 -05:00
dan-s1
e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
exceptionfactory
972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Peter Turcsanyi
cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
mr1716
4d78ebc487
NIFI-11024: Update iceberg.version to 1.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6851.
2023-01-18 14:22:15 +01:00
Mark Bathori
4b24bcd2f8
NIFI-10677: Add Choice data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6563.
2022-12-25 17:58:17 +01:00
Joe Witt
75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt
ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
Mark Bathori
594e93d97e
NIFI-10812: Remove duplicate record template creation from Iceberg record converter
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6659
2022-11-20 17:26:49 -05:00
Mark Bathori
4083e07447
NIFI-10801: Fix hive metastore based tests in Iceberg processors
This closes #6656.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 20:12:37 +01:00
exceptionfactory
b14eedfa7f
NIFI-10796 This closes #6647. Upgraded Apache Iceberg from 0.14.0 to 1.0.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-10 15:39:23 -07:00
exceptionfactory
01816da56f
NIFI-10645 Corrected Bouncy Castle dependencies for Iceberg
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6636
2022-11-08 17:36:57 -05:00
Mark Bathori
2a85264dd5
NIFI-10645: Add cloud profiles for Iceberg processors
This closes #6541.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-08 18:03:31 +01:00
Joe Witt
c155d29658
NIFI-10614 Upgraded Bouncy Castle from 1.70 to 1.71
- Blocked Bouncy Castle jdk15on dependencies
- Forced jdk18on dependencies and validated across entire build

This closes #6498

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 19:35:02 -05:00
exceptionfactory
fcefd051d2
NIFI-10652 Corrected dependency scopes for nifi-iceberg-processors
- Marked nifi-iceberg-services-api as provided
- Marked multiple Hadoop and Hive dependencies as provided to avoid duplicate inclusion in nifi-iceberg-processors-nar

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6535
2022-10-18 13:25:11 -04:00
exceptionfactory
523dd94045
NIFI-10651 Upgraded Iceberg transitive dependencies
- Followed dependency override approach from nifi-hive-bundle based on Hive dependencies

NIFI-10651 Removed unnecessary Calcite dependency references

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6533
2022-10-18 13:23:15 -04:00
Mark Bathori
e87bced147
NIFI-10442: Create PutIceberg processor
This closes #6368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-11 21:51:18 +02:00