Commit Graph

314 Commits

Author SHA1 Message Date
Peter Gyori 3efb0763da
NIFI-13427 Added FlowFileSource interface for Python Processors
This closes #9000

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-27 12:35:31 -05:00
Joe Gresock b105b5bbef
NIFI-13454 Renamed FileParameterProvider to KubernetesSecretParameterProvider
This closes #9008

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-27 08:36:44 -05:00
dan-s1 5c9fb448a4
NIFI-13456 Removed unused code from TestSplitExcel
This closes #9009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-26 17:46:08 -05:00
mr1716 2066d6ebc5
NIFI-13451 Upgraded error_prone_annotations from 2.21.1 to 2.28.0
This closes #9006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-26 17:45:01 -05:00
exceptionfactory 275890a226
NIFI-13444 Removed unused test logging configuration
This closes #9004

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-25 20:03:15 -07:00
dan-s1 b3fac8c80b
NIFI-13403 Removed unnecessary toString in logging statements
This closes #8984

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 20:13:08 -05:00
Ferenc Kis a5501baa7f
NIFI-13396 Added Python constant Allowable Values to Manifests
This closes #8963

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 16:49:05 -05:00
dan-s1 48e8457a8a
NIFI-13442 Removed nifi-poi-utils and consolidated nifi-poi-services
This closes #9002

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 13:23:24 -05:00
HunterG6700 02ec9b73eb
NIFI-13428 Added filter by comments to UpdateAttribute Advanced Rules
This closes #8999

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 09:12:55 -05:00
dan-s1 20c815dc12
NIFI-13304 Added SplitExcel Processor
This closes #8981

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 07:51:27 -05:00
Joseph Witt 87107b311a
NIFI-13438 Upgraded Spring to 6.1.10 along with other dependencies
- Upgraded sshd from 2.12.1 to 2.13.1
- Upgraded reactor-netty-http from 1.1.19 to 1.1.20
- Upgraded guava from 33.2.0-jre to 33.2.1-jre
- Upgraded maven-artifact from 3.9.7 to 3.9.8
- Upgraded spring-integrations from 6.3.0 to 6.3.1
- Upgraded jjwt from 0.12.5 to 0.12.6
- Upgraded unboundid from 7.0.0 to 7.0.1
- Upgraded json-schema-validator from 1.4.0 to 1.4.2
- Upgraded Spring Boot from 3.3.0 to 3.3.1
- Upgraded jline from 3.26.1 to 3.26.2
- Upgraded com.amazonaws from 1.12.742 to 1.12.748
- Upgraded AWS SDK from 2.26.1 from 2.26.8
- Upgraded Spring from 6.1.9 to 6.1.10
- Upgraded Spring Security from 6.3.0 to 6.3.1

This closes #9001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 21:59:55 -05:00
exceptionfactory 238b5249c4
NIFI-11259 Removed inconsistent PublishKafkaRecordPartialHandlingIT 2024-06-24 17:55:06 -05:00
exceptionfactory b24973960f
NIFI-11259 Used asAllowableValue() from Failure Strategy 2024-06-24 17:55:06 -05:00
Paul Grey 24925ed9b5
NIFI-11259 Added Redesigned Kafka Processors and Services
- Added ConsumeKafka and PublishKafka Processors with Kafka3ConnectionService
- Added Kafka 3 integration tests

This closes #8463

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 17:55:06 -05:00
EndzeitBegins 57e07c080f
NIFI-12880 Added DeleteFile Processor
This closes #8489

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 14:03:23 -05:00
mr1716 722374298c
NIFI-13434 Upgraded github-api from 1.321 to 1.322
This closes #8996

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 13:26:07 -05:00
dan-s1 957510e65a NIFI-13421 Replaced String.format in logging statements where only formatting strings (%s) with the use of logging parameters ({})
This closes #8994

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-06-23 18:13:39 -04:00
Jim Steinebrey 01d1aa91c1 NIFI-12750 ExecuteStreamCommand incorrectly decodes std error stream
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8993
2024-06-21 18:52:12 -04:00
exceptionfactory 65739826c4 NIFI-13429 Corrected EncryptContentPGP Packet Detection
- Added set of expected OpenPGP Packet Tags to avoid misidentification

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8990
2024-06-21 13:03:54 -04:00
Jim Steinebrey b7a48f766a NIFI-10666 PrometheusReportingTask needs to use UTF-8 (not jvm default charset) for /metrics endpoint
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8988
2024-06-20 14:23:53 -04:00
Mark Payne 4636d9c79d
NIFI-13423 Corrected Starting Field handling in JsonTreeReader
Ensure that when using a Starting Field Name, JsonTreeReader is still able to process all records

This closes #8989

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-20 12:50:39 -05:00
JackHintonSmartDCSIT 4b63d69063
NIFI-13082 Added SplitPCAP Processor
This closes #8691

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-20 12:47:47 -05:00
Joseph Witt a774ff8120
NIFI-13400 ensure container has time to startup before interacting with smb
This closes #8982.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-06-19 19:49:28 +02:00
Mark Bathori 9141f64ef5
NIFI-13356 Fixed ProtobufReader handling of repeated fields
This closes #8922

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-18 16:43:22 -05:00
Jim Steinebrey 0c06340c5a NIFI-13103 Enhance AutoCommit property in PutDatabaseRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8937
2024-06-18 12:58:18 -04:00
Jim Steinebrey dda42824b6 NIFI-13199 Update ValidateRecord to avoid writing to FlowFiles that will be auto-terminated
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8942
2024-06-17 15:15:32 -04:00
Jim Steinebrey bc95799a39
NIFI-13397 Updated PutDatabaseRecord to retry transient ProcessException causes
This closes #8964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 13:29:53 -05:00
Jim Steinebrey bd1ad8f9f4
NIFI-13389 Streamlined use of putAllAttributes() in ConsumeJMS
This closes #8955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 13:04:01 -05:00
Jim Steinebrey fc01e0ccf4
NIFI-13198 Updated RouteText to skip writing to auto-terminated relationships
This closes #8939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 12:43:59 -05:00
Bob Paulin d25efb385c
NIFI-13394 Check candidate directory for python command
This closes #8961

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 11:46:04 -05:00
Mike Moser c60b0cf4a3
NIFI-13381 Use AllowableValue for PutSFTP/PutFTP Conflict Resolution
This closes #8950

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-14 17:16:19 -05:00
Mark Payne cb72cfde8a
NIFI-13324 Set FlowFile attributes for Python Processors on failure
In case a Python Processor routes a FlowFile to failure and returns attributes, add those attributes to the 'original' FlowFile before routing to 'failure'

This closes #8943

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-14 17:04:09 -05:00
dependabot[bot] c64605f9b7
NIFI-13405 Upgraded MSAL4J from 1.15.0 to 1.15.1
This closes #8956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-14 16:42:24 -05:00
Joseph Witt bf637e0bfe
NIFI-13401 Upgraded Spring to 6.1.9 and Jetty to 12.0.10 and others
- Upgraded com.amazonaws from 1.12.733 to 1.12.742
- Upgraded software.amazon.awssdk from 2.25.63 to 2.26.1
- Upgraded com.box SDK from 4.9.1 to 4.10.0
- Upgraded commons-net from 3.11.0 to 3.11.1
- Upgraded io.dropwizard.metrics from 4.2.25 to 4.2.26
- Upgraded Netty from 4.1.110.Final to 4.1.111.Final
- Upgraded Commons Configuration2 from 2.10.1 to 2.11.0
- Upgraded Lucene from 9.10.0 to 9.11.0
- Upgraded org.checkerframework from 3.43.0 to 3.44.0
- Upgraded org.eclipse.jdt ecj from 3.37.0 to 3.38.0
- Upgraded Jetty from 12.0.9 to 12.0.10
- Upgraded Elasticsearch Client from 8.13.4 to 8.14.1
- Upgraded Spring Framework from 6.1.8 to 6.1.9
- Upgraded com.slack.api from 1.39.3 to 1.40.0
- Upgraded io.projectreactor from 3.6.6 to 3.6.7
- Upgraded JGit from 6.9.0.202403050737-r to 6.10.0.202406032230-r
- Upgraded Flyway from 10.13.0 to 10.15.0
- Upgraded Spring Integration from 6.2.5 to 6.3.0

This closes #8966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-14 16:36:19 -05:00
dan-s1 7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Michael Moser aac90fb375
NIFI-13383 Changed info log level to debug in XXEValidator (#8952)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:21:30 -04:00
Jim Steinebrey 2363e63c86 NIFI-13359 Tune ExecuteSQL/Record to create fewer transient flow files
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8928
2024-06-11 13:05:33 -04:00
dan-s1 27866c8ae6 NIFI-13375 Added missing logging parameter in SplitRecord
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8941
2024-06-10 15:16:11 +00:00
simonbence 8d85aeb34e
Merge pull request #8930 from terjekid/main
NIFI-13365 - Fix unit tests running in kubernetes pod
2024-06-06 10:39:13 +02:00
Laszlo Denes Terjeki 61ce13c4f3 NIFI-13365 - Fix unit tests running in kubernetes pod 2024-06-05 16:41:30 +00:00
Matt Gilman 5727116aa0
NIFI-13313: Remove old UI (#8906)
* NIFI-13313:
- Use nifi-web-frontend as the default UI hosted at /nifi no longer deploying nifi-web-ui.

* NIFI-13313:
- Adding logout complete page.
- Updating backend to redirect to new logout complete page.

* NIFI-13313:
- Remove nifi-web-ui module.

* NIFI-13313:
- Updating LICENSE and NOTICE files for dependencies that are no longer included.

* NIFI-13313:
- Updating README.
- Updating proxy config to mirror actual context path.

* NIFI-13313:
- Establishing rewrite rules for redirecting logout complete.
- Setting the default handler for when a request isn't handled to redirect the user to /nifi.

* NIFI-13313:
- Removing nifi-web-error module.

* NIFI-13313:
- Restoring /nifi/logout-complete path.

* NIFI-13313:
- Adding an error handler for the ui which handles redirects to a 404 page.

This closes #8906
2024-06-05 09:09:01 -04:00
David Handermann f5ecb18fef
NIFI-13357 Removed APP_INSTALLATION_TOKEN from GitHubFlowRegistryClient (#8923)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-04 10:51:37 -05:00
andrealves23 7a85da9fee
NIFI-13339 Set sensitive as true in USM Users JSON content on ListenTrapSNMP
This closes #8908

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-04 09:08:06 -05:00
Jim Steinebrey 85cf0e995e
NIFI-13351 Improved QueryDatabaseTable Processors to call session.putAttributes()
This closes #8919

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-04 08:22:02 -05:00
dan-s1 6ca03eae55
NIFI-13288 Improved SplitXml and SplitAvro to call session.putAttributes()
This closes #8917

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-04 08:20:33 -05:00
maybevanshh cfcae70d37
NIFI-13231 Added App Private Key Auth to GitHub FlowRegistryClient
This closes #8890

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
2024-06-04 07:55:59 -05:00
Joseph Witt 1c0297bba2
NIFI-13310 merged RAT declarations
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8916.
2024-06-04 11:22:43 +02:00
exceptionfactory ab2cea4c22
NIFI-13352 Adjusted Shutdown handling in ListenOTLP and Test Class
This closes #8913

- Added quick duration for shutdown quiet period in ListenOTLP HttpServerFactory
- Added TestRunner.stop() to ListenOTLPTest to close listening sockets
- Increased Connect Timeout from 5 to 10 seconds in ListenOTLPTest

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-03 15:40:01 -07:00
Jim Steinebrey 5e3f1dbaf6 Update BinFiles not to write attributes to FlowFiles for auto-terminated ORIGINAL relationship
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8911
2024-06-03 16:34:32 -04:00
Joseph Witt 34c24f759a NIFI-13342 restored sts dependency in aws service api
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8910
2024-06-03 15:26:45 -04:00
Matt Gilman 48edbeed90
NIFI-13329 - Updating the standard content viewer to render an error message when there is an error formatting.
Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8905.
2024-06-03 19:35:43 +02:00
shubhamsharma a21c2544ad
NIFI-12801 Add local file upload option in PutHDFS processor
This closes #8415.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-06-03 15:00:47 +02:00
Joseph Witt 477aa8fe35
NIFI-13336 updating various deps for aws google azure and more
- com.amazonaws	* 1.12.730 1.12.733
- com.azure azure-sdk-bom 1.2.23 1.2.24
- com.google.cloud libraries-bom 26.39.0 26.40.0
- commons-cli 1.7.0 1.8.0
- commons-net 3.10.0 3.11.0
- io.fabric8 * 6.12.1 6.13.0
- org.apache.commons commons-compress 1.26.1 1.26.2
- software.amazon.awssdk 2.25.60 2.25.63
- com.google.apis	google-api-services-drive v3-rev20240327-2.0.0	 v3-rev20240521-2.0.0
- org.neo4j.driver	neo4j-java-driver 5.20.0 5.21.0
- org.springframework.integration	spring-integration-mail 6.2.4 6.2.5

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8907.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2024-06-02 13:29:49 +02:00
David Handermann 5cf43f4a3c
NIFI-13307 Replaced KeyStoreUtils with nifi-security-ssl Builders (#8895)
- Removed unused test classes from nifi-web-api
2024-05-31 15:51:17 -04:00
dan-s1 86d36d2327
NIFI-13265 Removed instantiation of Object arrays for log arguments
This closes #8896

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-30 17:17:33 -05:00
Peter Turcsanyi 7ea4c067fc
NIFI-13315 Fixed ListAzureBlobStorage_v12 fails when Record Writer is used
This closes #8897

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-05-30 13:32:42 +02:00
Joseph Witt 89e8434bf0
NIFI-13308 Upgraded Spring Framework from 6.1.7 to 6.1.8
- Upgraded Spring Boot from 3.2.5 to 3.2.6
- Upgraded Slack bolt-socket-mode from 1.39.2 to 1.39.3
- Upgraded maven-artifact from 3.9.6 to 3.9.7
- Upgraded mariadb-java-client from 3.3.3 to 3.4.0
- Upgraded software.amazon.awssdk from 2.25.55 to 2.25.60
- Upgraded com.amazonaws from 1.12.725 to 1.12.730
- Upgraded Jersey from 3.1.6 to 3.1.7
- Upgraded Netty from 4.1.109.Final to 4.1.110.Final
- Upgraded box-java-sdk from 4.9.0 to 4.9.1

This closes #8887

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-29 14:21:27 -05:00
Chris Sampson cbe5f7db9d
NIFI-12343 Added Max JSON Field String Length for Elasticsearch
This closes #8881

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-29 14:16:17 -05:00
exceptionfactory 68630b64c1
NIFI-13305 Upgraded HBase from 2.5.8 to 2.6.0
This closes 8886

- Removed unnecessary transitive dependency overrides

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-28 11:42:17 -07:00
dan-s1 a1a7c3c5a5
NIFI-13298 Removed unused instantiated java.util.HashSet from RouteAttribute
This closes #8883

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-28 09:37:01 -05:00
Peter Turcsanyi de11b6c43e
NIFI-13287: Added note to msal4j dependency in Azure bundle's pom
This closes #8869.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-25 12:20:28 -07:00
Evan Shelton 99253b9673
NIFI-13283 - Fix exception thrown in PutKinesisFirehose processor by ensuring value exists before referencing
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8867.
2024-05-23 20:05:27 +02:00
Peter Turcsanyi 05d0d36e70
NIFI-13268 Fixed missing grpc dependencies in GCP module
This closes #8863

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-22 10:07:26 -07:00
dan-s1 e12a2dd39e
NIFI-13255 Replaced deprecated Netty JdkSslContext constructor
This closes #8856

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-21 10:17:30 -05:00
Joseph Witt 3f9ef07e3c
NIFI-13227 Upgraded Spring and various dependencies
- Upgraded aspectj from 1.9.22 to 1.9.22.1
- Upgraded mockito from 5.11.0 to 5.12.0
- Upgraded software.amazon.awssdk from 2.25.49 to 2.25.55
- Upgraded com.amazonaws from 1.12.719 to 1.12.725
- Upgraded com.slack.api from 1.39.0 to 1.39.2
- Upgraded swagger-annotations from 2.2.21 to 2.2.22
- Upgraded mockftpserver from 3.1.0 to 3.2.0
- Upgraded Spring Framework from 6.1.6 to 6.1.7
- Upgraded subethasmtp from 7.0.2 to 7.1.1
- Upgraded reactor-core and test from 3.6.5 to 3.6.6
- Upgraded spring-retry from 2.0.5 to 2.0.6
- Upgraded com.google.cloud libraries-bom from 26.38.0 to 26.39.0
- Upgraded flyway from 10.12.0 to 10.13.0

This closes #8849

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-20 15:36:05 -05:00
dan-s1 45a66745b0
NIFI-13254 Replaced deprecated BoundedInputStream constructor with builder
This closes #8854

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-20 15:29:35 -05:00
dan-s1 a91dee65fb
NIFI-13252 Replaced deprecated AWS SQS method attributeNames()
This closes #8850

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-20 15:28:19 -05:00
dan-s1 2e7e3733f3
NIFI-13251 Replaced deprecated AWS method Region.fromName()
This closes #8848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-20 15:28:18 -05:00
Andre F de Miranda c1063600af
NIFI-13263 - Bump ParCEFone version (#8851)
This closes #8851
2024-05-19 08:34:22 -04:00
Jim Steinebrey b27fc46b60
NIFI-12670 Read Jolt Transform with UTF-8 Encoding
- Specified UTF-8 encoding for reading Jolt Transform to avoid decoding issues on Windows or platforms with different default character sets

This closes #8842

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-17 08:56:14 -05:00
Matt Gilman eaf3f23100
NIFI-13228 Fixed Jolt Transform Custom UI with updated property names
This closes #8829

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 10:50:43 -05:00
sujkim ea48d22fba
NIFI-12896 Add Endpoint Override URL property for PutSNS Processor
This closes #8529

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 07:13:02 -05:00
Pierre Villard ee179f4acf
NIFI-13238 Added Checkstyle rules for whitespace
This closes #8832

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 06:41:19 -05:00
Chris Sampson 2d112871db
NIFI-8134 allow unescapeJson Record Path function to recursively convert Maps to Records (#7745)
* NIFI-8134 recursively convert Java Objects to NiFi Records
2024-05-14 17:11:28 -04:00
Matt Gilman 3a786cee23
NIFI-13211: Decoupling other UIs from exiting NiFi UI (#8828)
* NIFI-13211:
- Decoupling the content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi documentation from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi image viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi standard content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi jolt transform json from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi update attribute from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Updating rat config.

* NIFI-13211:
- Bumping dependency check timeout.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

This closes #8828
2024-05-14 15:54:23 -04:00
Jim Steinebrey e6a90eb1e8 NIFI-12669 Fix EvaluateXQuery processor which incorrectly encodes result attributes in certain case
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8826
2024-05-14 11:08:06 -04:00
dan-s1 2a45cae588
NIFI-13224 Replaced deprecated commons-compress IOUtils.toByteArray
Replaced deprecated commons-compress IOUtils.toByteArray with commons-io IOUtils.toByteArray

This closes #8825

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-13 17:02:38 -05:00
Rajmund Takacs bffacdec98
NIFI-13072: Fix MonitorActivity problems with cluster scope flow monitoring
This closes #8669.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-05-12 23:19:40 +02:00
Joseph Witt 03005aa132
NIFI-13185 Removed manual and non-working Integration Tests
Removed the entire integration-tests-ci profile and reference in GitHub workflow.

Removed all tests which require specific local env configs/cloud credentials/ or simply do not work and thus have been blocked from the build for a long time.

Set Disabled annotation on a couple key tests which are by design manual and must be retained.

The move to testcontainers has been a dramatic improvement in test reliability/behaviors and should be a model for all such tests going forward.

This closes #8818

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-11 20:51:41 -05:00
dan-s1 c66a3cf4ff
NIFI-13214 Replaced deprecated Lucene IndexReader methods with StoredFields
This closes #8815

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-11 20:44:00 -05:00
Joseph Witt 6fc374b268
NIFI-13215 AWS SDK and Elasticsearch Dependencies Upgraded
- Upgraded AWS SDK 1 from 1.12.718 to 1.12.719
- Upgraded AWS SDK 2 from 2.25.48 to 2.25.49
- Upgraded snowflake-ingest-sdk from 2.1.0 to 2.1.1
- Upgraded org.elasticsearch.client from 8.13.3 to 8.13.4
- Upgraded software.amazon.kinesis from 2.5.8 to 2.6.0

This closes #8814

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-11 20:41:59 -05:00
dan-s1 7dfb4936a9
NIFI-13157 Replaced deprecated getNextTarEntry() and getNextZipEntry() with getNextEntry().
This closes #8813

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-10 12:57:31 -07:00
lehelb 49a9f4f544
NIFI-13208 Increased PropertyDescriptor visibility in HadoopDBCPConnectionPool
This closes #8805

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 11:12:52 -05:00
dan-s1 811a491ba5
NIFI-13156 Replaced JsonParser deprecated getCurrentName() with currentName()
This closes #8807

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 11:10:45 -05:00
Mark Payne c09144051f
NIFI-13206 Updated S3 Integration Tests to delete bucket encryption
- Enabled S3 and SQS Integration Tests

This closes #8801

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 09:22:50 -05:00
Joseph Witt 44f6e2b833
NIFI-13205 Removed legacy Provenance Lucene integration test
This closes #8799

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 08:05:53 -05:00
Joseph Witt d1a9043167
NIFI-13193 Set Minimum Maven Version to 3.9.6
- Upgraded Maven plugins
- Upgraded SpotBugs from 4.7.3.5 to 4.8.5.0
- Upgraded asciidoctor-maven-plugin from 2.2.4 to 3.0.0
- Upgraded license-maven-plugin from 2.2.0 to 2.4.0
- Upgraded download-maven-plugin from 1.7.1 to 1.9.0
- Upgraded maven-clean-plugin from 3.3.1 to 3.3.2
- Upgraded frontend-maven-plugin from 1.14.2 to 1.15.0
- Upgraded hisrc-higherjaxb40-maven-plugin from 2.1.1 to 2.2.0
- Upgraded jacoco-maven-plugin from 0.8.11 to 0.8.12
- Upgraded swagger-maven-plugin-jakarta from 2.2.20 to 2.2.21
- Upgraded swagger-codegen-maven-plugin from 3.0.52 to 3.0.55

This closes #8797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 08:05:14 -05:00
exceptionfactory 72b45f3114
NIFI-13202 Removed Accumulo Processors and Services
This closes #8794.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-09 16:14:20 -07:00
Mark Payne db7e073368
NIFI-13203: Include s3.url attribute in FetchS3Object, PutS3Object
This closes #8795

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-09 15:56:48 -07:00
sullis 7584a5c6f5
NIFI-13113: upgrade Iceberg from 1.5.0 to 1.5.2
This closes #8796

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-09 15:40:50 -07:00
Joe Gresock 1592b98298
NIFI-13194 Removed InvokeAWSGatewayApi Processor
This closes #8787

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-09 15:21:47 -05:00
krisztina-zsihovszki 5a3b47353e
NIFI-13146 ConsumeSlack rate limit error mitigation (#8748)
Co-authored-by: Krisztina Zsihovszki <kzsihovszki@cloudera.com>
2024-05-09 15:36:41 -04:00
Bryan Bende 7cd1a30948
NIFI-13105 Implemented FlowRegistryClient using GitHub for versioning
This closes #8765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-09 13:38:05 -05:00
Joseph Witt d305a169b3
NIFI-13186 Corrected Provenance dependency for lucene-backward-codecs
- Updated references to lucene-9 indexes and removed legacy old style indexes

This closes #8782

Signed-off-by: David Handermann <exceptionfactory@apache.org>i
2024-05-09 11:55:57 -05:00
Joseph Witt f0d0676518
NIFI-13178 Upgraded extension and framework dependencies
- Upgraded Apache Mina 2.1.8 to 2.2.3
- Upgraded unboundid-ldapsdk from 6.0.11 to 7.0.0
- Upgraded okhttp-digest from 2.7 to 3.1.0
- Upgraded reactor-netty-http from 1.0.44 to 1.1.18
- Upgraded jetbrains-annotations 13.0 to 24.1.0
- Upgraded reactor-core from 3.4.37 to 3.6.5
- Upgraded reactor-test from 3.5.16 to 3.6.5

This closes #8775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 21:49:27 -05:00
exceptionfactory f4d40722fe
NIFI-13168 Upgraded QuestDB from 7.3.7 to 7.4.2
This closes #8773

- Changed getSym() to getSymA() following QuestDB changes
- Added WAL Table status check for Table Metadata lookup

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 15:01:15 -07:00
Chris Sampson 1f5868b999
NIFI-11686 upgrade Elasticsearch low-level REST client to 8.13.3
This closes #8772

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 14:40:05 -07:00
Joseph Witt 096ce97530
NIFI-13170 Upgraded Neo4j Driver to 5.20.0
- Upgraded Neo4j Docker to 5.19

This closes #8767

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 14:34:39 -05:00
Joseph Witt 89ab35c955
NIFI-13166 Upgraded Jetty from 12.0.8 to 12.0.9
- Upgraded Kotlin from 1.9.23 to 1.9.24
- Upgraded Box from 4.8.0 to 4.9.0
- Upgraded Hazelcast from 5.3.7 to 5.4.0
- Upgraded Guava references from 32.1.2 to 33.2.0

This closes #8763

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 14:32:58 -05:00
exceptionfactory 09cf383f9b
NIFI-13167 Replaced Hamcrest Matchers with JUnit Matchers
This closes #8764

- Removed Hamcrest from set of default dependencies

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 10:21:57 -07:00
Chris Sampson 9edea70713
NIFI-12255 Refactored PutElasticsearchRecord and PutElasticsearchJson Relationships
- Migrated previous relationship names to be more consistent with other Processors
- Added nifi-mock objects for Relationship Migration

This closes #7940

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 09:06:56 -05:00
Bryan Bende e7567b04e2
NIFI-13120 Introduce branch as a concept in Registry Client and VCI
- Methods for getBranches, getDefaultBranch, and createBranch in flow registry client
- Add branch as a field to all relevant objects
- Add optional branch argument to REST API for retrieving buckets
- Add new REST API for retrieving branches for a given registry client
- Enforce NiFi Registry can only receive default branch

This closes #8726

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 08:44:33 -05:00
Joseph Witt 6922abde5a
NIFI-13163 Upgraded Lucene from 8.11.3 to 9.10.0
This closes #8759

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 22:58:06 -05:00
Joseph Witt ff34c41261
NIFI-13161 Upgraded Jackson and AWS dependencies
- Removed bytebuddy as was only there due to Jackson 2.17.0 mistake
- io.grpc context 1.59.0 to 1.59.1
- com.amazonaws 1.12.715 to 1.12.716
- software.amazon.awssdk 2.25.45 to 2.25.46
- jackson 2.17.0 to 2.17.1
- calcite 1.36.0 to 1.37.0

This closes #8758

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 22:54:32 -05:00
Joseph Witt 2711f9d8cf
NIFI-13150 Removed Couchbase Components
This closes #8753

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 15:28:25 -05:00
Joseph Witt 030435d996
NIFI-13149 Removed nifi-datadog-bundle
This closes #8751

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 14:57:44 -05:00
Peter Turcsanyi 9f69ff233c
NIFI-12231 FetchSmb supports Move and Delete Completion Strategies
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8617.
2024-05-06 20:30:21 +03:00
Joseph Witt 7a6c26fd96
NIFI-13144 improved depependency update config and various dependencies
com.puppycrawl.tools:checkstyle 10.15.0 -> 10.16.0
software.amazon.awssdk:xray  2.25.40 -> 2.25.45
com.amazonaws:aws-java-sdk-keyspaces  1.12.710 -> 1.12.715
com.azure:azure-sdk-bom  1.2.21 -> 1.2.23
com.google.cloud:libraries-bom  26.37.0 -> 26.38.0
net.bytebuddy:byte-buddy  1.14.12 -> 1.14.14
org.checkerframework:checker-qual  3.37.0 -> 3.43.0
org.eclipse.jdt:ecj  3.33.0 -> 3.37.0
com.microsoft.azure:msal4j  1.14.3 -> 1.15.0
com.google.guava:guava  33.1.0-jre -> 33.2.0-jre
com.ibm.icu:icu4j  74.2 -> 75.1
org.opensaml:opensaml-* 4.3.1 -> 4.3.2
org.apache.sshd:sshd-*  2.12.0 -> 2.12.1
com.nimbusds:oauth2-oidc-sdk  9.43.3 -> 9.43.4
excel-streaming-reader  4.2.1 -> 4.3.1
amqp-client 5.20.0 5.21.0
json-schema-validator 1.3.2 1.4.0
Saxon-HE 12.3 12.4
lucene 8.11.2 8.11.3
commons-compiler 3.1.10 3.1.12
dropbox.client.version 5.4.4 5.4.6
subethasmtp 7.0.1 7.0.2
docker-java-api 3.3.4 3.3.6
google-api-services-drive v3-rev20230520-2.0.0	v3-rev20240327-2.0.0
protobuf-java 3.25.1 3.25.3
hazelcast 5.3.5 5.3.7
jackson-datatype-protobuf 0.9.14 0.9.15
kusto-* 5.0.3 5.0.5
mysql-connector-j 8.3.0 8.4.0
docker-compose-junit-jupiter 2.0.0 2.3.0
bolt-socket-mode 1.37.0 1.39.0
wire-schema-jvm 4.9.3 4.9.9
mysql-binlog-connector-java 0.29.0 0.29.2
jjwt 0.12.3 0.12.5
reactor-core 3.4.34 3.4.37
reactor-test 3.5.14 3.5.16
jakarta.activation-api 2.0.1 (and 2.1.2) to 2.1.3
jakarta.mail-api 2.0.1 (and 2.1.2) to 2.1.3
datafaker 2.0.2 to 2.2.2
jna and jna-platform 5.13.0 5.14.0
activemq-* 6.1.1 6.1.2
camel-salesforce 3.14.9 3.14.10
commons-csv 1.10.0 1.11.0
hbase.version 2.5.5-hadoop3 2.5.8-hadoop3
httpasyncclient 4.1.4 4.1.5
httpcore-nio 4.4.12 4.4.16
iotdb 1.3.0 1.3.1
mina-core 2.1.6 2.1.8
gremlin-* 3.7.1 3.7.2
clojure 1.11.2 1.11.3
angus-mail 2.0.2 2.0.3
jgit* 6.8.0.202311291450-r 6.9.0.202403050737-r
javaassist 3.29.2-GA 3.30.2-GA
jline 3.25.1 3.26.1
mariadb-java-client	3.3.0 3.3.3
mongodb-driver-sync 4.11.1 4.11.2
neo4j-java-driver 4.4.12 4.4.16
postgresql 4.7.2 4.7.3
spring-data-redis 2.7.15 2.7.18
spring-integration-mail 6.2.1 6.2.4
spring-vault-core 3.1.0 3.1.1
xmlunit-core 2.9.1 2.10.0
xmlunit-matchers 2.9.1 2.10.0
amazon-kinesis-client 2.5.7 2.5.8
reactor-netty-http 1.0.39 1.0.44
ant 1.10.13 1.10.14
hamcrest-core and hamcrest-all 1.3 moved to just hamcrest 2.2

This closes #8746

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-05-06 15:13:18 +01:00
Joseph Witt 81d387cad5
NIFI-13139 ensure nifi-py4j-nar is included in test assembly
Ensure nifi-py4j integration tests have proper logback libs

This closes #8747

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-05-06 14:50:21 +01:00
Joseph Witt 52255ee813
NIFI-13108 Updated common and framework dependencies
- Fixed logging logic for tests vs runtime scope
- Restoring behavior to testProcessUnparsableRecordWithRawOutputWithCheckpoint that changed in NIFI-12998 presumably because of log dependency changes. Now that we have a single provider the test behavior appears to be back to normal.

- Upgraded AWS SDK 1 from 1.12.686 to 1.12.710
- Upgraded AWS SDK 2 from 2.25.16 to 2.25.40
- Upgraded Azure SDK BOM from 1.2.21 to 1.2.23
- Upgraded GCP Libraries from 26.34.0 to 26.37.0
- Upgraded Fabric8 Kubernetes Client from 6.10.0 to 6.12.1
- Upgraded Commons CLI from 1.6.0 to 1.7.0
- Upgraded Commons Codec from 1.16.1 to 1.17.0
- Upgraded zstd-jni from 1.5.6-1 to 1.5.6-3
- Upgraded Commons Text from 1.11.0 to 1.12.0
- Upgraded Test Containers from 1.19.4 to 1.19.7
- Upgraded JAXB Runtime from 4.0.4 to 4.0.5
- Upgraded JAXB API from 4.0.1 to 4.0.2
- Upgraded Jersey from 3.1.4 to 3.1.6
- Upgraded Log4j 2 from 2.23.0 to 2.23.1
- Upgraded Logback from 1.5.5 to 1.5.6
- Upgraded Mockito from 5.8.0 to 5.11.0
- Upgraded Swagger Annotations from 2.2.20 to 2.2.21
- Upgraded jsoup from 1.17.1 to 1.17.2
- Upgraded JUnit Platform Commons from 1.10.0 to 1.10.2
- Upgraded Checkstyle from 9.3 to 10.15.0
- Upgraded ASM from 9.6 to 9.7

This closes #8708

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-03 09:35:23 -05:00
Matt Burgess b6a8699b57
NIFI-13121: Handle runtime exceptions in FetchHDFS
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8727.
2024-05-02 06:49:42 -04:00
Jim Steinebrey 1d24c080ab
NiFiNIFI-13103 Make AutoCommit default to no value set in PutDatabaseRecord. Remove unneeded carriage return.
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8723.
2024-05-01 17:12:44 -04:00
Joseph Witt 19aab9bbba
NIFI-13007 Removed nifi-solr-bundle
This closes #8705

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-27 22:42:49 -05:00
Joseph Witt 42a4385c82
NIFI-12998 Restructured framework and extension modules
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.

- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar

This closes #8677

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-26 12:12:48 -05:00