Commit Graph

34 Commits

Author SHA1 Message Date
exceptionfactory b6952f1246
NIFI-13933 Upgraded Spring Security to 6.3.4 and other dependencies
This closes #9450

- Upgraded Spring Security from 6.3.3 to 6.3.4
- Upgraded Hadoop from 3.4.0 to 3.4.1
- Upgraded Velocity Engine Core from 2.3.0 to 2.4.1
- Upgraded Parquet Avro from 1.13.1 to 1.14.3
- Upgraded Google Libraries from 26.47.0 to 26.49.0
- Set protobuf-java to 3.25.5 for calcite-core and amazon-kinesis-client libraries
- Updated Dependency Check suppressions

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-26 14:14:14 -07:00
Mike e37cd2b5e6
NIFI-13776 Updated CopyS3Object to Handle Files over 5 GB
This closes #9418

- Added multipart copying for files over 5 GB

Co-authored-by: Mike Thomsen <mthomsen@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-18 16:24:38 -07:00
exceptionfactory d42b110474
NIFI-13886 Upgraded Spring from 6.1.13 to 6.1.14 and others
- Upgraded Apache MINA SSHD from 2.13.2 to 2.14.0
- Upgraded Dropwizard Metrics from 4.2.27 to 4.2.28
- Upgraded Guava from 33.2.1 to 33.3.1
- Upgraded ASM from 9.7 to 9.7.1
- Upgraded Apache JSP from 10.1.16 to 10.1.31
- Upgraded Apache EL from 10.1.16 to 10.1.31
- Upgraded Data Faker from 2.3.1 to 2.4.0
- Upgraded JSON Flattener from 0.16.6 to 0.17.0
- Upgraded Check Qual from 3.47.0 to 3.48.1
- Upgraded error-prone-annotations from 2.28.0 to 2.33.0
- Upgraded frontend-maven-plugin from 1.15.0 to 1.15.1
- Upgraded AWS SDK from 1.12.772 to 1.2.774
- Upgraded AWS SDK from 2.28.13 to 2.28.24
- Upgraded JSON Smart from 2.5.0 to 2.5.1
- Upgraded Jersey from 3.1.8 to 3.1.9
- Upgraded Logback from 1.5.8 to 1.5.11
- Upgraded Servlet API from 6.0.0 to 6.1.0
- Upgraded Swagger Annotations from 2.2.24 to 2.2.25

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9407.
2024-10-17 18:04:51 +02:00
Peter Turcsanyi c3122b281b
NIFI-13867 Removed legacy code component Proxy Properties (#9381)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-12 11:34:03 -05:00
Peter Turcsanyi 2cb8411d4f
NIFI-13848 Migrated AWSCredentialsProviderControllerService's Proxy properties to ProxyConfigurationService
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9357.
2024-10-08 10:54:49 +02:00
Peter Turcsanyi 5f6bdc6243
NIFI-13841 Restored proxy support in AWS PutSNS processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9351.
2024-10-08 10:35:53 +02:00
Peter Turcsanyi 17c8a6bed8
NIFI-13840 Fixed proxy setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9345.
2024-10-07 16:22:28 +02:00
Peter Turcsanyi ae2277478a
NIFI-13842 Fixed truststore/keystore setup in AWS v2 components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9346.
2024-10-07 11:30:21 +02:00
Matt Gilman fb2a82c035
NIFI-13721: Migrating documentation into the NiFi UI (#9288)
* NIFI-13721: Migrating additional details to markdown.

* NIFI-13721: Rebuilding documentation to generate mark up on the client.

* NIFI-13721: Removing old documentation approach.

* NIFI-13721: Rebase main and final fixing button colors.

* NIFI-13721: Fixing rat issues.

* NIFI-13721: Removing generated comonent documentation.
- Removing links and images from additional details markdown.

* NIFI-13721: Recreating package lock following rebase.

* NIFI-13721: Updating documentation for M3.

* NIFI-13721: Fixing broken test.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Ensuring the selected item is visible after routing.

* NIFI-13721: Fixing reportingTaskTypes in finding extensions for a given type.

* NIFI-13721: Updating the see also component to handle when the referenced extension is not installed.

* NIFI-13721: Fixing expansion panel header styles.
2024-09-27 11:11:55 -04:00
Mike Thomsen 31e5afc9b8 NIFI-13666 Added a catch for IllegalArgumentException in FetchS3Object
NIFI-13666 Added the same try/catch to a few other processors

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9188
2024-08-20 18:45:05 -04:00
Mike Thomsen 99f3717f13
NIFI-13430 Added CopyS3Object and GetS3ObjectMetadata
This closes #8992

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-14 20:23:20 -05:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
dan-s1 f64e68b23c
NIFI-13625 Removed or Replaced System.out.println in Tests (#9150)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 20:35:40 -05:00
Joseph Witt 3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Krisztina Zsihovszki c73d1cf634
NIFI-13487 ConsumeKinesisStream initial stream position handling error after AWS SDK 2.x migration
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #9035.
2024-07-04 06:03:06 -04:00
Joseph Witt 87107b311a
NIFI-13438 Upgraded Spring to 6.1.10 along with other dependencies
- Upgraded sshd from 2.12.1 to 2.13.1
- Upgraded reactor-netty-http from 1.1.19 to 1.1.20
- Upgraded guava from 33.2.0-jre to 33.2.1-jre
- Upgraded maven-artifact from 3.9.7 to 3.9.8
- Upgraded spring-integrations from 6.3.0 to 6.3.1
- Upgraded jjwt from 0.12.5 to 0.12.6
- Upgraded unboundid from 7.0.0 to 7.0.1
- Upgraded json-schema-validator from 1.4.0 to 1.4.2
- Upgraded Spring Boot from 3.3.0 to 3.3.1
- Upgraded jline from 3.26.1 to 3.26.2
- Upgraded com.amazonaws from 1.12.742 to 1.12.748
- Upgraded AWS SDK from 2.26.1 from 2.26.8
- Upgraded Spring from 6.1.9 to 6.1.10
- Upgraded Spring Security from 6.3.0 to 6.3.1

This closes #9001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 21:59:55 -05:00
dan-s1 957510e65a NIFI-13421 Replaced String.format in logging statements where only formatting strings (%s) with the use of logging parameters ({})
This closes #8994

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-06-23 18:13:39 -04:00
dan-s1 7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Joseph Witt 34c24f759a NIFI-13342 restored sts dependency in aws service api
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8910
2024-06-03 15:26:45 -04:00
dan-s1 86d36d2327
NIFI-13265 Removed instantiation of Object arrays for log arguments
This closes #8896

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-30 17:17:33 -05:00
Evan Shelton 99253b9673
NIFI-13283 - Fix exception thrown in PutKinesisFirehose processor by ensuring value exists before referencing
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8867.
2024-05-23 20:05:27 +02:00
dan-s1 a91dee65fb
NIFI-13252 Replaced deprecated AWS SQS method attributeNames()
This closes #8850

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-20 15:28:19 -05:00
dan-s1 2e7e3733f3
NIFI-13251 Replaced deprecated AWS method Region.fromName()
This closes #8848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-20 15:28:18 -05:00
sujkim ea48d22fba
NIFI-12896 Add Endpoint Override URL property for PutSNS Processor
This closes #8529

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 07:13:02 -05:00
Pierre Villard ee179f4acf
NIFI-13238 Added Checkstyle rules for whitespace
This closes #8832

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 06:41:19 -05:00
Joseph Witt 03005aa132
NIFI-13185 Removed manual and non-working Integration Tests
Removed the entire integration-tests-ci profile and reference in GitHub workflow.

Removed all tests which require specific local env configs/cloud credentials/ or simply do not work and thus have been blocked from the build for a long time.

Set Disabled annotation on a couple key tests which are by design manual and must be retained.

The move to testcontainers has been a dramatic improvement in test reliability/behaviors and should be a model for all such tests going forward.

This closes #8818

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-11 20:51:41 -05:00
Joseph Witt 6fc374b268
NIFI-13215 AWS SDK and Elasticsearch Dependencies Upgraded
- Upgraded AWS SDK 1 from 1.12.718 to 1.12.719
- Upgraded AWS SDK 2 from 2.25.48 to 2.25.49
- Upgraded snowflake-ingest-sdk from 2.1.0 to 2.1.1
- Upgraded org.elasticsearch.client from 8.13.3 to 8.13.4
- Upgraded software.amazon.kinesis from 2.5.8 to 2.6.0

This closes #8814

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-11 20:41:59 -05:00
Mark Payne c09144051f
NIFI-13206 Updated S3 Integration Tests to delete bucket encryption
- Enabled S3 and SQS Integration Tests

This closes #8801

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 09:22:50 -05:00
Mark Payne db7e073368
NIFI-13203: Include s3.url attribute in FetchS3Object, PutS3Object
This closes #8795

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-09 15:56:48 -07:00
Joe Gresock 1592b98298
NIFI-13194 Removed InvokeAWSGatewayApi Processor
This closes #8787

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-09 15:21:47 -05:00
exceptionfactory 09cf383f9b
NIFI-13167 Replaced Hamcrest Matchers with JUnit Matchers
This closes #8764

- Removed Hamcrest from set of default dependencies

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 10:21:57 -07:00
Joseph Witt 7a6c26fd96
NIFI-13144 improved depependency update config and various dependencies
com.puppycrawl.tools:checkstyle 10.15.0 -> 10.16.0
software.amazon.awssdk:xray  2.25.40 -> 2.25.45
com.amazonaws:aws-java-sdk-keyspaces  1.12.710 -> 1.12.715
com.azure:azure-sdk-bom  1.2.21 -> 1.2.23
com.google.cloud:libraries-bom  26.37.0 -> 26.38.0
net.bytebuddy:byte-buddy  1.14.12 -> 1.14.14
org.checkerframework:checker-qual  3.37.0 -> 3.43.0
org.eclipse.jdt:ecj  3.33.0 -> 3.37.0
com.microsoft.azure:msal4j  1.14.3 -> 1.15.0
com.google.guava:guava  33.1.0-jre -> 33.2.0-jre
com.ibm.icu:icu4j  74.2 -> 75.1
org.opensaml:opensaml-* 4.3.1 -> 4.3.2
org.apache.sshd:sshd-*  2.12.0 -> 2.12.1
com.nimbusds:oauth2-oidc-sdk  9.43.3 -> 9.43.4
excel-streaming-reader  4.2.1 -> 4.3.1
amqp-client 5.20.0 5.21.0
json-schema-validator 1.3.2 1.4.0
Saxon-HE 12.3 12.4
lucene 8.11.2 8.11.3
commons-compiler 3.1.10 3.1.12
dropbox.client.version 5.4.4 5.4.6
subethasmtp 7.0.1 7.0.2
docker-java-api 3.3.4 3.3.6
google-api-services-drive v3-rev20230520-2.0.0	v3-rev20240327-2.0.0
protobuf-java 3.25.1 3.25.3
hazelcast 5.3.5 5.3.7
jackson-datatype-protobuf 0.9.14 0.9.15
kusto-* 5.0.3 5.0.5
mysql-connector-j 8.3.0 8.4.0
docker-compose-junit-jupiter 2.0.0 2.3.0
bolt-socket-mode 1.37.0 1.39.0
wire-schema-jvm 4.9.3 4.9.9
mysql-binlog-connector-java 0.29.0 0.29.2
jjwt 0.12.3 0.12.5
reactor-core 3.4.34 3.4.37
reactor-test 3.5.14 3.5.16
jakarta.activation-api 2.0.1 (and 2.1.2) to 2.1.3
jakarta.mail-api 2.0.1 (and 2.1.2) to 2.1.3
datafaker 2.0.2 to 2.2.2
jna and jna-platform 5.13.0 5.14.0
activemq-* 6.1.1 6.1.2
camel-salesforce 3.14.9 3.14.10
commons-csv 1.10.0 1.11.0
hbase.version 2.5.5-hadoop3 2.5.8-hadoop3
httpasyncclient 4.1.4 4.1.5
httpcore-nio 4.4.12 4.4.16
iotdb 1.3.0 1.3.1
mina-core 2.1.6 2.1.8
gremlin-* 3.7.1 3.7.2
clojure 1.11.2 1.11.3
angus-mail 2.0.2 2.0.3
jgit* 6.8.0.202311291450-r 6.9.0.202403050737-r
javaassist 3.29.2-GA 3.30.2-GA
jline 3.25.1 3.26.1
mariadb-java-client	3.3.0 3.3.3
mongodb-driver-sync 4.11.1 4.11.2
neo4j-java-driver 4.4.12 4.4.16
postgresql 4.7.2 4.7.3
spring-data-redis 2.7.15 2.7.18
spring-integration-mail 6.2.1 6.2.4
spring-vault-core 3.1.0 3.1.1
xmlunit-core 2.9.1 2.10.0
xmlunit-matchers 2.9.1 2.10.0
amazon-kinesis-client 2.5.7 2.5.8
reactor-netty-http 1.0.39 1.0.44
ant 1.10.13 1.10.14
hamcrest-core and hamcrest-all 1.3 moved to just hamcrest 2.2

This closes #8746

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-05-06 15:13:18 +01:00
Joseph Witt 52255ee813
NIFI-13108 Updated common and framework dependencies
- Fixed logging logic for tests vs runtime scope
- Restoring behavior to testProcessUnparsableRecordWithRawOutputWithCheckpoint that changed in NIFI-12998 presumably because of log dependency changes. Now that we have a single provider the test behavior appears to be back to normal.

- Upgraded AWS SDK 1 from 1.12.686 to 1.12.710
- Upgraded AWS SDK 2 from 2.25.16 to 2.25.40
- Upgraded Azure SDK BOM from 1.2.21 to 1.2.23
- Upgraded GCP Libraries from 26.34.0 to 26.37.0
- Upgraded Fabric8 Kubernetes Client from 6.10.0 to 6.12.1
- Upgraded Commons CLI from 1.6.0 to 1.7.0
- Upgraded Commons Codec from 1.16.1 to 1.17.0
- Upgraded zstd-jni from 1.5.6-1 to 1.5.6-3
- Upgraded Commons Text from 1.11.0 to 1.12.0
- Upgraded Test Containers from 1.19.4 to 1.19.7
- Upgraded JAXB Runtime from 4.0.4 to 4.0.5
- Upgraded JAXB API from 4.0.1 to 4.0.2
- Upgraded Jersey from 3.1.4 to 3.1.6
- Upgraded Log4j 2 from 2.23.0 to 2.23.1
- Upgraded Logback from 1.5.5 to 1.5.6
- Upgraded Mockito from 5.8.0 to 5.11.0
- Upgraded Swagger Annotations from 2.2.20 to 2.2.21
- Upgraded jsoup from 1.17.1 to 1.17.2
- Upgraded JUnit Platform Commons from 1.10.0 to 1.10.2
- Upgraded Checkstyle from 9.3 to 10.15.0
- Upgraded ASM from 9.6 to 9.7

This closes #8708

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-03 09:35:23 -05:00
Joseph Witt 42a4385c82
NIFI-12998 Restructured framework and extension modules
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.

- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar

This closes #8677

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-26 12:12:48 -05:00