Commit Graph

49 Commits

Author SHA1 Message Date
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852)
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
2023-10-10 13:55:22 -04:00
mr1716 1e5c491433
NIFI-12184 Upgraded Iceberg from 1.3.1 to 1.4.0
This closes #7848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
Matt Burgess 3f7b1de6b8
NIFI-11739 - Add ability to ignore missing fields in PutIceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7421.
2023-10-03 14:41:12 +03:00
Matt Burgess e7da2ab5b8
NIFI-11177: Add defensive code for null values for Iceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
2023-09-26 11:30:08 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Joseph Witt bd2276260e
NIFI-12051 Upgraded Groovy from 3.0.19 to 4.0.15
- Adjusted Groovy Maven coordinates to org.apache.groovy
- Adjusted build configuration and tests for Groovy 4

This closes #7692

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:38:24 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:21:17 -07:00
Mark Bathori ea4c2055d6
NIFI-12054: PutIceberg should produce a provenance send event
This closes #7690.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-14 16:53:32 +02:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
krisztina-zsihovszki 0446990d54
NIFI-11916 Iceberg processor extensibility improvement
This closes #7583.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-08 22:31:52 +02:00
mr1716 f081bcb311
NIFI-11887 Upgraded Iceberg from 1.3.0 to 1.3.1
This closes #7551

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:56:27 -05:00
exceptionfactory 16c4004d58 NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7497
2023-07-18 18:29:20 -04:00
Mark Bathori b1be71f918
NIFI-11334: Fixed PutIceberg processor instance interference due to same class loader usage
This closes #7449.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-30 20:36:33 +02:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
exceptionfactory 9374039312
NIFI-11674 Upgraded Apache Iceberg from 1.2.1 to 1.3.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7364.
2023-06-11 15:43:58 +02:00
Matthew Burgess 3ebe8f2983
NIFI-11538: This closes #7239. Fix primitive type conversion for PutIceberg 2023-06-01 12:29:38 -07:00
Matthew Burgess adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:40:48 +02:00
krisztina-zsihovszki 3051b69a6c
NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
This closes #7241.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:43:47 +02:00
Pierre Villard 67a4d10b3e
NIFI-11495 Upgraded Iceberg from 1.2.0 to 1.2.1
This closes #7203

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-28 15:09:36 -05:00
Mark Bathori 44a7f7f38b
NIFI-11440 Speed up Iceberg Hive Metastore Tests
This closes #7170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 12:52:22 -05:00
Pierre Villard 0160d6d6b9
NIFI-11410 Upgraded multiple integration dependencies
- Upgraded Spring Boot from 2.7.9 to 2.7.10

This closes #7141

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:40:09 -05:00
exceptionfactory dffad44a03
NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:10:02 -07:00
exceptionfactory dde89c0b15
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 13:12:57 +02:00
exceptionfactory 7cb20d6f7f
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:22:12 -07:00
exceptionfactory 5bdee9a714
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:41:11 -07:00
exceptionfactory 623bcfd500
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:35:48 +02:00
Mark Bathori b50c8101cf
NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:41:33 +01:00
Joe Witt 58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
Mark Bathori e370292d7f
NIFI-11204: Add configurable retry logic for table commits in PutIceberg processor
This closes #6976.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-20 19:20:43 +01:00
Mark Bathori 2873575fce
NIFI-11263: Add case-insensitive and order independent field mapping to PutIceberg record converter
This closes #7026.

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-17 20:03:21 +01:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
Mark Bathori 869e2b3d66
NIFI-11110: Create processor for triggering HMS events
Review comment fixes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6902
2023-02-02 11:31:44 -05:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
mr1716 4d78ebc487
NIFI-11024: Update iceberg.version to 1.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6851.
2023-01-18 14:22:15 +01:00
Mark Bathori 4b24bcd2f8
NIFI-10677: Add Choice data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6563.
2022-12-25 17:58:17 +01:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
Mark Bathori 594e93d97e
NIFI-10812: Remove duplicate record template creation from Iceberg record converter
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6659
2022-11-20 17:26:49 -05:00
Mark Bathori 4083e07447
NIFI-10801: Fix hive metastore based tests in Iceberg processors
This closes #6656.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 20:12:37 +01:00
exceptionfactory b14eedfa7f
NIFI-10796 This closes #6647. Upgraded Apache Iceberg from 0.14.0 to 1.0.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-10 15:39:23 -07:00
exceptionfactory 01816da56f
NIFI-10645 Corrected Bouncy Castle dependencies for Iceberg
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6636
2022-11-08 17:36:57 -05:00
Mark Bathori 2a85264dd5
NIFI-10645: Add cloud profiles for Iceberg processors
This closes #6541.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-08 18:03:31 +01:00
Joe Witt c155d29658
NIFI-10614 Upgraded Bouncy Castle from 1.70 to 1.71
- Blocked Bouncy Castle jdk15on dependencies
- Forced jdk18on dependencies and validated across entire build

This closes #6498

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 19:35:02 -05:00
exceptionfactory fcefd051d2
NIFI-10652 Corrected dependency scopes for nifi-iceberg-processors
- Marked nifi-iceberg-services-api as provided
- Marked multiple Hadoop and Hive dependencies as provided to avoid duplicate inclusion in nifi-iceberg-processors-nar

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6535
2022-10-18 13:25:11 -04:00
exceptionfactory 523dd94045
NIFI-10651 Upgraded Iceberg transitive dependencies
- Followed dependency override approach from nifi-hive-bundle based on Hive dependencies

NIFI-10651 Removed unnecessary Calcite dependency references

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6533
2022-10-18 13:23:15 -04:00
Mark Bathori e87bced147
NIFI-10442: Create PutIceberg processor
This closes #6368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-11 21:51:18 +02:00