73 Commits

Author SHA1 Message Date
Pierre Villard
a4d1123820
NIFI-13133-RC1 prepare for next development iteration 2024-05-06 21:03:21 +03:00
Pierre Villard
c94be900cf
NIFI-13133-RC1 prepare release nifi-1.26.0-RC1 2024-05-06 21:03:20 +03:00
Mark Bathori
04b8587dfd NIFI-12939: Retry Kerberos login on authentication failure in Iceberg processors
Update rollback and context yield calls

Signed-off-by: Matt Burgess <mattyb149@apache.org>
2024-03-26 14:56:52 -04:00
exceptionfactory
e269304e23
NIFI-12943 Upgraded Hadoop from 3.3.6 to 3.4.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-03-25 19:25:54 -05:00
Mark Bathori
c4a2738606
NIFI-12938: Upgrade Iceberg from 1.4.3 to 1.5.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8552.
2024-03-25 10:29:29 +01:00
Pierre Villard
e48a8b5d4e
NIFI-12909 Upgraded Nimbus JOSE+JWT from 9.33.0 to 9.37.3
This closes #8519

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-15 15:45:39 -05:00
Mark Bathori
dcc0e5edb7
NIFI-12847: Add Enum data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8453.
2024-02-28 14:34:03 +01:00
Peter Turcsanyi
3baf052aae
NIFI-12769 Updated copyright year to 2024 in NOTICE file headers
This closes #8385.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-09 14:24:40 -07:00
Pierre Villard
65c33d08aa
NIFI-12662-RC1 prepare for next development iteration 2024-01-25 16:18:10 +04:00
Pierre Villard
6ecc398d3f
NIFI-12662-RC1 prepare release nifi-1.25.0-RC1 2024-01-25 16:17:58 +04:00
Mark Bathori
99ffcdb3bb NIFI-12596: PutIceberg is missing case-insensitive Record type handling in List and Map types
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2024-01-16 17:28:30 -05:00
exceptionfactory
12c94f2505
NIFI-12569 Upgraded Iceberg from 1.4.2 to 1.4.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8206.
2024-01-05 20:36:49 +04:00
Pierre Villard
7fedb49a9a
NIFI-12362-RC5 prepare for next development iteration 2023-11-23 11:03:53 +01:00
Pierre Villard
5241f43482
NIFI-12362-RC5 prepare release nifi-1.24.0-RC5 2023-11-23 11:03:47 +01:00
mr1716
5f108361f4
NIFI-12380 Upgraded Iceberg from 1.4.0 to 1.4.2
This closes #8039

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit a3983ae248516dff5f6d2914cacbfa9d00281fdf)
2023-11-16 17:47:32 -06:00
exceptionfactory
57cf654a94
NIFI-12276 Addressed Dependency Check Findings
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.39.12 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7989.
2023-11-07 13:00:11 +01:00
exceptionfactory
f37b77f64c
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.

(cherry picked from commit 2366132e92951a8fc27097c777d3104a1c396f7b)
2023-10-31 14:35:54 -05:00
Mark Bathori
67767b6550 NIFI-12130: Ability to configure snapshot properties via dynamic attributes in PutIceberg
Fix dynamic field expression language handling

Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-10-26 19:23:55 -04:00
mr1716
0ebdcf9da8
NIFI-12184 Upgraded Iceberg from 1.3.1 to 1.4.0
This closes #7848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 1e5c491433c92895317de486f2236763d95e4810)
2023-10-06 15:33:20 -05:00
Eric Secules
4cb3f50329
NIFI-12164 Fixed compilation with Optional method under JDK 8
This closes #7834

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-03 17:18:46 -05:00
Matt Burgess
8f4d202271
NIFI-11739 - Add ability to ignore missing fields in PutIceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7421.
2023-10-03 14:41:35 +03:00
Matt Burgess
e98a2ef5fd
NIFI-11177: Add defensive code for null values for Iceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
2023-09-26 11:30:27 +02:00
Joseph Witt
5baaa2185f
NIFI-12066 a series of minor version bumps for key dependencies 2023-09-15 13:21:41 -05:00
exceptionfactory
ab67daf891
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:32:24 -07:00
Mark Bathori
9b15bbf6b9
NIFI-12054: PutIceberg should produce a provenance send event
This closes #7690.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-14 16:55:25 +02:00
krisztina-zsihovszki
c4b779605a
NIFI-11916 Iceberg processor extensibility improvement
This closes #7583.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-08 22:46:34 +02:00
mr1716
027cd7df76
NIFI-11887 Upgraded Iceberg from 1.3.0 to 1.3.1
This closes #7551

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit f081bcb3118b3c54f0d068c0397641122a4461be)
2023-07-31 20:34:10 -05:00
exceptionfactory
27a690a30a NIFI-11832-RC3 prepare for next development iteration 2023-07-25 14:03:12 -05:00
exceptionfactory
b7792f03b7 NIFI-11832-RC3 prepare release nifi-1.23.0-RC3 2023-07-25 14:03:11 -05:00
Zoltan Kornel Torok
53a0aef422
NIFI-11334: Fixed dependency version in nifi-iceberg-services
This closes #7459.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-07-05 12:54:52 +02:00
Mark Bathori
331e0aead0 NIFI-11334: Fixed PutIceberg processor instance interference due to same class loader usage
This closes #7449.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-30 20:38:35 +02:00
exceptionfactory
4d55615c7a NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>
2023-06-20 16:20:54 -04:00
Joe Witt
edc9e40582
Merge branch 'NIFI-11654-RC1' into support/nifi-1.x 2023-06-11 20:45:15 -04:00
exceptionfactory
3f9c2bd97c
NIFI-11674 Upgraded Apache Iceberg from 1.2.1 to 1.3.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7364.
2023-06-11 15:44:19 +02:00
Joe Witt
f1d5a8c4de
NIFI-11654-RC1 prepare for next development iteration 2023-06-06 12:32:00 -07:00
Joe Witt
71e3ea9f2c
NIFI-11654-RC1 prepare release nifi-1.22.0-RC1 2023-06-06 12:31:58 -07:00
Matthew Burgess
674d125576
NIFI-11538: This closes #7239. Fix primitive type conversion for PutIceberg 2023-06-01 12:31:51 -07:00
Matthew Burgess
dc9fbc1026
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:46:22 +02:00
krisztina-zsihovszki
8aa0d5549e NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
This closes #7241.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:46:14 +02:00
Pierre Villard
a7423e180a
NIFI-11495 Upgraded Iceberg from 1.2.0 to 1.2.1
This closes #7203

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 67a4d10b3e5863c42c5f63a787813aec32fa84fe)
2023-04-28 15:17:34 -05:00
Mark Bathori
15a1134c85
NIFI-11440 Speed up Iceberg Hive Metastore Tests
This closes #7170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
(cherry picked from commit 44a7f7f38b3950a8a0135d1ce8602a4890c3d995)
2023-04-14 12:53:38 -05:00
Pierre Villard
e0c70ca45b
NIFI-11410 Upgraded multiple integration dependencies
- Upgraded Spring Boot from 2.7.9 to 2.7.10

This closes #7141

Signed-off-by: David Handermann <exceptionfactory@apache.org>

(cherry picked from commit 0160d6d6b90ef2d2862d01520161b37d489e2669)
2023-04-10 08:53:20 -05:00
Joe Witt
9c27ddcb1c
NIFI-11357-RC2 prepare for next development iteration 2023-04-03 14:40:08 -07:00
Joe Witt
892f822107
NIFI-11357-RC2 prepare release nifi-1.21.0-RC2 2023-04-03 14:40:07 -07:00
exceptionfactory
e3c550e73c
NIFI-11377 This closes #7113. Upgraded Apache Iceberg from 1.1.0 to 1.2.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-04-03 14:11:41 -07:00
exceptionfactory
3c2cb36c05
NIFI-11358 Upgraded Hadoop from 3.3.4 to 3.3.5
- Upgraded Ranger Hadoop dependencies from 3.3.3 to 3.3.5
- Aligned Iceberg Hadoop version with project Hadoop version
- Updated Atlas dependencies to align hadoop-hdfs-client version with hadoop-common
- Updated Ranger hadoop-auth version to align with other Hadoop dependencies
- Updated Spark Livy bundle to align with project Hadoop version
- Removed unnecessary dependencies from Hive Test Utilities
- Updated HBase 2 Woodstox Core from 5.3.0 to 5.4.0
- Suppressed false positive vulnerabilities for HBase client libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7097.
2023-03-29 08:15:17 -05:00
exceptionfactory
6a5b8c39ef
NIFI-11356 This closes #7096. Upgraded Nimbus JOSE JWT to 9.31
- Upgraded NiFi Framework from 9.24.3
- Upgraded NiFi Registry from 8.20
- Upgraded transitive msal4j dependency from 9.22
- Upgraded transitive hadoop-auth dependency from 9.8.1

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 14:23:07 -07:00
exceptionfactory
87768708ab
NIFI-11347 This closes #7089. Upgraded OWASP Dependency Check from 8.0.2 to 8.2.1
- Updated suppression configuration
- Upgraded Solr from 8.6.3 to 8.11.1 for Ranger
- Excluded Apache Ivy from Hive and Janus Graph dependencies
- Excluded Groovy from Hive tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-03-28 08:21:51 -07:00
exceptionfactory
588e0d74ab
NIFI-11345 Adjusted Iceberg test to avoid expensive duplicative runs
This closes #7086

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-03-28 01:50:14 +02:00
Mark Bathori
986a1f0891 NIFI-11215: Add custom validation for KerberosUserService in PutIceberg
This closes #6985.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-03-24 08:44:51 +01:00