Commit Graph

97 Commits

Author SHA1 Message Date
EndzeitBegins 458844909b
NIFI-13590 Refactored Standard Processors using current API methods
This closes #9119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-02 09:37:37 -05:00
Joseph Witt bacc30b05b NIFI-13567 bump various deps
google libraries-bom 26.42.0 26.43.0
com.amazonaws 1.12.756 1.12.762
com.box 4.10.0 4.11.1
com.exceptionfactory.jagged 0.3.2 0.4.0
com.fasterxml.jackson.core 2.17.1 2.17.2
com.fasterxml.jackson.dataformat 2.17.1 2.17.2
com.fasterxml.jackson.datatype 2.17.1 2.17.2
com.fasterxml.jackson.jakarta.rs 2.17.1 2.17.2
com.fasterxml.jackson.jaxrs 2.17.1 2.17.2
com.fasterxml.jackson.jr 2.17.1 2.17.2
com.fasterxml.jackson.module 2.17.1 2.17.2
com.github.pjfanning 4.3.1 4.4.0
com.h2database 2.2.224 2.3.230
com.networknt 1.4.2 1.5.0
commons-codec 1.17.0 1.17.1
io.netty 4.1.111.Final 4.1.112.Final
io.projectreactor.netty 1.1.20 1.1.21
net.sf.saxon Saxon-HE 12.4 12.5
org.apache.commons commons-lang3 3.14.0 3.15.0
org.elasticsearch.client 8.14.2 8.14.3
org.jetbrains.kotlin 1.9.24 1.9.25
org.jsoup 1.17.2 1.18.1
org.springframework 6.1.10 6.1.11
org.testcontainers 1.19.8 1.20.0
software.amazon.awssdk 2.26.15 2.26.21
com.github.docker-java 3.3.6 3.4.0
google-api-services-drive v3-rev20240521-2.0.0	 v3-rev20240628-2.0.0
com.slack.api bolt-socket-mode 1.40.2 1.40.3
wire-schema-jvm 4.9.9 5.0.0
io.projectreactor reactor-core/test 3.6.7 3.6.8
net.datafaker 2.3.0 2.3.1
org.flywaydb 10.15.2 10.16.0
org.jline 3.26.2 3.26.3
org.mariadb.jdbc 3.4.0 3.4.1
org.springframework.boot 3.3.1 3.3.2
org.springframework.integration 6.3.1 6.3.2
org.springframework.retry 2.0.6 2.0.7

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9097
2024-07-22 13:39:17 -04:00
Mike Moser 3c7b262619
NIFI-13159 Moved Remote Delete after Put for PutFTP/PutSFTP REPLACE Strategy
This closes #8914

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 15:14:31 -05:00
EndzeitBegins 3b2120e6c6 NIFI-13537 Do not include exception details in FlowFile attributes in DeleteFile
This closes #9069

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-07-10 21:48:11 -04:00
Joseph Witt 3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
exceptionfactory 4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
Joseph Witt 15e5193099
NIFI-13517 Upgraded Jetty from 12.0.10 to 12.0.11 and others
- Upgraded AWS SDK 1 from 1.12.755 to 1.12.756
- Upgraded AWS SDK 2 from 2.26.14 to 2.26.15
- Upgraded Azure SDK BOM from 1.2.24 to 1.2.25
- Upgraded Elasticsearch Client from 8.14.1 to 8.14.2
- Upgraded GitHub Client from 1.322 to 1.323
- Upgraded mysql-connector-j from 8.4.0 to 9.0.0
- Upgraded Azure Kusto from 5.0.5 to 5.1.0
- Upgraded Datafaker from 2.2.2 to 2.3.0
- Upgraded nimbus-jose-jwt from 9.37.3 to 9.40
- Upgraded oauth2-oidc-sdk from 11.10.1 to 11.13

This closes #9051

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:00:13 -05:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00
Joseph Witt 4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
Joe Gresock b105b5bbef
NIFI-13454 Renamed FileParameterProvider to KubernetesSecretParameterProvider
This closes #9008

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-27 08:36:44 -05:00
exceptionfactory 275890a226
NIFI-13444 Removed unused test logging configuration
This closes #9004

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-25 20:03:15 -07:00
dan-s1 b3fac8c80b
NIFI-13403 Removed unnecessary toString in logging statements
This closes #8984

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 20:13:08 -05:00
Joseph Witt 87107b311a
NIFI-13438 Upgraded Spring to 6.1.10 along with other dependencies
- Upgraded sshd from 2.12.1 to 2.13.1
- Upgraded reactor-netty-http from 1.1.19 to 1.1.20
- Upgraded guava from 33.2.0-jre to 33.2.1-jre
- Upgraded maven-artifact from 3.9.7 to 3.9.8
- Upgraded spring-integrations from 6.3.0 to 6.3.1
- Upgraded jjwt from 0.12.5 to 0.12.6
- Upgraded unboundid from 7.0.0 to 7.0.1
- Upgraded json-schema-validator from 1.4.0 to 1.4.2
- Upgraded Spring Boot from 3.3.0 to 3.3.1
- Upgraded jline from 3.26.1 to 3.26.2
- Upgraded com.amazonaws from 1.12.742 to 1.12.748
- Upgraded AWS SDK from 2.26.1 from 2.26.8
- Upgraded Spring from 6.1.9 to 6.1.10
- Upgraded Spring Security from 6.3.0 to 6.3.1

This closes #9001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 21:59:55 -05:00
EndzeitBegins 57e07c080f
NIFI-12880 Added DeleteFile Processor
This closes #8489

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 14:03:23 -05:00
dan-s1 957510e65a NIFI-13421 Replaced String.format in logging statements where only formatting strings (%s) with the use of logging parameters ({})
This closes #8994

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-06-23 18:13:39 -04:00
Jim Steinebrey 01d1aa91c1 NIFI-12750 ExecuteStreamCommand incorrectly decodes std error stream
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8993
2024-06-21 18:52:12 -04:00
Jim Steinebrey 0c06340c5a NIFI-13103 Enhance AutoCommit property in PutDatabaseRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8937
2024-06-18 12:58:18 -04:00
Jim Steinebrey dda42824b6 NIFI-13199 Update ValidateRecord to avoid writing to FlowFiles that will be auto-terminated
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8942
2024-06-17 15:15:32 -04:00
Jim Steinebrey bc95799a39
NIFI-13397 Updated PutDatabaseRecord to retry transient ProcessException causes
This closes #8964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 13:29:53 -05:00
Jim Steinebrey fc01e0ccf4
NIFI-13198 Updated RouteText to skip writing to auto-terminated relationships
This closes #8939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 12:43:59 -05:00
dan-s1 7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Jim Steinebrey 2363e63c86 NIFI-13359 Tune ExecuteSQL/Record to create fewer transient flow files
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8928
2024-06-11 13:05:33 -04:00
dan-s1 27866c8ae6 NIFI-13375 Added missing logging parameter in SplitRecord
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8941
2024-06-10 15:16:11 +00:00
Matt Gilman 5727116aa0
NIFI-13313: Remove old UI (#8906)
* NIFI-13313:
- Use nifi-web-frontend as the default UI hosted at /nifi no longer deploying nifi-web-ui.

* NIFI-13313:
- Adding logout complete page.
- Updating backend to redirect to new logout complete page.

* NIFI-13313:
- Remove nifi-web-ui module.

* NIFI-13313:
- Updating LICENSE and NOTICE files for dependencies that are no longer included.

* NIFI-13313:
- Updating README.
- Updating proxy config to mirror actual context path.

* NIFI-13313:
- Establishing rewrite rules for redirecting logout complete.
- Setting the default handler for when a request isn't handled to redirect the user to /nifi.

* NIFI-13313:
- Removing nifi-web-error module.

* NIFI-13313:
- Restoring /nifi/logout-complete path.

* NIFI-13313:
- Adding an error handler for the ui which handles redirects to a 404 page.

This closes #8906
2024-06-05 09:09:01 -04:00
Jim Steinebrey 85cf0e995e
NIFI-13351 Improved QueryDatabaseTable Processors to call session.putAttributes()
This closes #8919

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-04 08:22:02 -05:00
dan-s1 6ca03eae55
NIFI-13288 Improved SplitXml and SplitAvro to call session.putAttributes()
This closes #8917

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-04 08:20:33 -05:00
Jim Steinebrey 5e3f1dbaf6 Update BinFiles not to write attributes to FlowFiles for auto-terminated ORIGINAL relationship
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8911
2024-06-03 16:34:32 -04:00
Matt Gilman 48edbeed90
NIFI-13329 - Updating the standard content viewer to render an error message when there is an error formatting.
Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8905.
2024-06-03 19:35:43 +02:00
David Handermann 5cf43f4a3c
NIFI-13307 Replaced KeyStoreUtils with nifi-security-ssl Builders (#8895)
- Removed unused test classes from nifi-web-api
2024-05-31 15:51:17 -04:00
dan-s1 86d36d2327
NIFI-13265 Removed instantiation of Object arrays for log arguments
This closes #8896

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-30 17:17:33 -05:00
dan-s1 a1a7c3c5a5
NIFI-13298 Removed unused instantiated java.util.HashSet from RouteAttribute
This closes #8883

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-28 09:37:01 -05:00
Joseph Witt 3f9ef07e3c
NIFI-13227 Upgraded Spring and various dependencies
- Upgraded aspectj from 1.9.22 to 1.9.22.1
- Upgraded mockito from 5.11.0 to 5.12.0
- Upgraded software.amazon.awssdk from 2.25.49 to 2.25.55
- Upgraded com.amazonaws from 1.12.719 to 1.12.725
- Upgraded com.slack.api from 1.39.0 to 1.39.2
- Upgraded swagger-annotations from 2.2.21 to 2.2.22
- Upgraded mockftpserver from 3.1.0 to 3.2.0
- Upgraded Spring Framework from 6.1.6 to 6.1.7
- Upgraded subethasmtp from 7.0.2 to 7.1.1
- Upgraded reactor-core and test from 3.6.5 to 3.6.6
- Upgraded spring-retry from 2.0.5 to 2.0.6
- Upgraded com.google.cloud libraries-bom from 26.38.0 to 26.39.0
- Upgraded flyway from 10.12.0 to 10.13.0

This closes #8849

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-20 15:36:05 -05:00
Andre F de Miranda c1063600af
NIFI-13263 - Bump ParCEFone version (#8851)
This closes #8851
2024-05-19 08:34:22 -04:00
Pierre Villard ee179f4acf
NIFI-13238 Added Checkstyle rules for whitespace
This closes #8832

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 06:41:19 -05:00
Chris Sampson 2d112871db
NIFI-8134 allow unescapeJson Record Path function to recursively convert Maps to Records (#7745)
* NIFI-8134 recursively convert Java Objects to NiFi Records
2024-05-14 17:11:28 -04:00
Matt Gilman 3a786cee23
NIFI-13211: Decoupling other UIs from exiting NiFi UI (#8828)
* NIFI-13211:
- Decoupling the content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi documentation from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi image viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi standard content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi jolt transform json from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi update attribute from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Updating rat config.

* NIFI-13211:
- Bumping dependency check timeout.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

This closes #8828
2024-05-14 15:54:23 -04:00
Jim Steinebrey e6a90eb1e8 NIFI-12669 Fix EvaluateXQuery processor which incorrectly encodes result attributes in certain case
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8826
2024-05-14 11:08:06 -04:00
Rajmund Takacs bffacdec98
NIFI-13072: Fix MonitorActivity problems with cluster scope flow monitoring
This closes #8669.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-05-12 23:19:40 +02:00
Joseph Witt 03005aa132
NIFI-13185 Removed manual and non-working Integration Tests
Removed the entire integration-tests-ci profile and reference in GitHub workflow.

Removed all tests which require specific local env configs/cloud credentials/ or simply do not work and thus have been blocked from the build for a long time.

Set Disabled annotation on a couple key tests which are by design manual and must be retained.

The move to testcontainers has been a dramatic improvement in test reliability/behaviors and should be a model for all such tests going forward.

This closes #8818

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-11 20:51:41 -05:00
dan-s1 7dfb4936a9
NIFI-13157 Replaced deprecated getNextTarEntry() and getNextZipEntry() with getNextEntry().
This closes #8813

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-10 12:57:31 -07:00
Joseph Witt f0d0676518
NIFI-13178 Upgraded extension and framework dependencies
- Upgraded Apache Mina 2.1.8 to 2.2.3
- Upgraded unboundid-ldapsdk from 6.0.11 to 7.0.0
- Upgraded okhttp-digest from 2.7 to 3.1.0
- Upgraded reactor-netty-http from 1.0.44 to 1.1.18
- Upgraded jetbrains-annotations 13.0 to 24.1.0
- Upgraded reactor-core from 3.4.37 to 3.6.5
- Upgraded reactor-test from 3.5.16 to 3.6.5

This closes #8775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 21:49:27 -05:00
exceptionfactory 09cf383f9b
NIFI-13167 Replaced Hamcrest Matchers with JUnit Matchers
This closes #8764

- Removed Hamcrest from set of default dependencies

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 10:21:57 -07:00
Joseph Witt ff34c41261
NIFI-13161 Upgraded Jackson and AWS dependencies
- Removed bytebuddy as was only there due to Jackson 2.17.0 mistake
- io.grpc context 1.59.0 to 1.59.1
- com.amazonaws 1.12.715 to 1.12.716
- software.amazon.awssdk 2.25.45 to 2.25.46
- jackson 2.17.0 to 2.17.1
- calcite 1.36.0 to 1.37.0

This closes #8758

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 22:54:32 -05:00
Joseph Witt 7a6c26fd96
NIFI-13144 improved depependency update config and various dependencies
com.puppycrawl.tools:checkstyle 10.15.0 -> 10.16.0
software.amazon.awssdk:xray  2.25.40 -> 2.25.45
com.amazonaws:aws-java-sdk-keyspaces  1.12.710 -> 1.12.715
com.azure:azure-sdk-bom  1.2.21 -> 1.2.23
com.google.cloud:libraries-bom  26.37.0 -> 26.38.0
net.bytebuddy:byte-buddy  1.14.12 -> 1.14.14
org.checkerframework:checker-qual  3.37.0 -> 3.43.0
org.eclipse.jdt:ecj  3.33.0 -> 3.37.0
com.microsoft.azure:msal4j  1.14.3 -> 1.15.0
com.google.guava:guava  33.1.0-jre -> 33.2.0-jre
com.ibm.icu:icu4j  74.2 -> 75.1
org.opensaml:opensaml-* 4.3.1 -> 4.3.2
org.apache.sshd:sshd-*  2.12.0 -> 2.12.1
com.nimbusds:oauth2-oidc-sdk  9.43.3 -> 9.43.4
excel-streaming-reader  4.2.1 -> 4.3.1
amqp-client 5.20.0 5.21.0
json-schema-validator 1.3.2 1.4.0
Saxon-HE 12.3 12.4
lucene 8.11.2 8.11.3
commons-compiler 3.1.10 3.1.12
dropbox.client.version 5.4.4 5.4.6
subethasmtp 7.0.1 7.0.2
docker-java-api 3.3.4 3.3.6
google-api-services-drive v3-rev20230520-2.0.0	v3-rev20240327-2.0.0
protobuf-java 3.25.1 3.25.3
hazelcast 5.3.5 5.3.7
jackson-datatype-protobuf 0.9.14 0.9.15
kusto-* 5.0.3 5.0.5
mysql-connector-j 8.3.0 8.4.0
docker-compose-junit-jupiter 2.0.0 2.3.0
bolt-socket-mode 1.37.0 1.39.0
wire-schema-jvm 4.9.3 4.9.9
mysql-binlog-connector-java 0.29.0 0.29.2
jjwt 0.12.3 0.12.5
reactor-core 3.4.34 3.4.37
reactor-test 3.5.14 3.5.16
jakarta.activation-api 2.0.1 (and 2.1.2) to 2.1.3
jakarta.mail-api 2.0.1 (and 2.1.2) to 2.1.3
datafaker 2.0.2 to 2.2.2
jna and jna-platform 5.13.0 5.14.0
activemq-* 6.1.1 6.1.2
camel-salesforce 3.14.9 3.14.10
commons-csv 1.10.0 1.11.0
hbase.version 2.5.5-hadoop3 2.5.8-hadoop3
httpasyncclient 4.1.4 4.1.5
httpcore-nio 4.4.12 4.4.16
iotdb 1.3.0 1.3.1
mina-core 2.1.6 2.1.8
gremlin-* 3.7.1 3.7.2
clojure 1.11.2 1.11.3
angus-mail 2.0.2 2.0.3
jgit* 6.8.0.202311291450-r 6.9.0.202403050737-r
javaassist 3.29.2-GA 3.30.2-GA
jline 3.25.1 3.26.1
mariadb-java-client	3.3.0 3.3.3
mongodb-driver-sync 4.11.1 4.11.2
neo4j-java-driver 4.4.12 4.4.16
postgresql 4.7.2 4.7.3
spring-data-redis 2.7.15 2.7.18
spring-integration-mail 6.2.1 6.2.4
spring-vault-core 3.1.0 3.1.1
xmlunit-core 2.9.1 2.10.0
xmlunit-matchers 2.9.1 2.10.0
amazon-kinesis-client 2.5.7 2.5.8
reactor-netty-http 1.0.39 1.0.44
ant 1.10.13 1.10.14
hamcrest-core and hamcrest-all 1.3 moved to just hamcrest 2.2

This closes #8746

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-05-06 15:13:18 +01:00
Jim Steinebrey 1d24c080ab
NiFiNIFI-13103 Make AutoCommit default to no value set in PutDatabaseRecord. Remove unneeded carriage return.
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8723.
2024-05-01 17:12:44 -04:00
Joseph Witt 42a4385c82
NIFI-12998 Restructured framework and extension modules
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.

- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar

This closes #8677

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-26 12:12:48 -05:00