- Moved RequestUriBuilder from web-utils to web-servlet-shared
- Refactored proxy header parsing from WebUtils to StandardRequestUriProvider
- Renamed WebUtils to WebClientUtils
This closes#9123
- Added ProcessingPerformanceStatus to nifi-api
- Added Performance Status to Process Group and Processor Sources for Query NiFi Reporting Task
This closes#9014
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster
This closes#9017
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- The readBlob method avoids issues with 1 MB limits on alternative getContent requests
This closes#9067
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Remove nifi-socket-utils and moved remaining classes to referencing framework components
This closes#9059
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Upgraded AWS SDK 1 from 1.12.755 to 1.12.756
- Upgraded AWS SDK 2 from 2.26.14 to 2.26.15
- Upgraded Azure SDK BOM from 1.2.24 to 1.2.25
- Upgraded Elasticsearch Client from 8.14.1 to 8.14.2
- Upgraded GitHub Client from 1.322 to 1.323
- Upgraded mysql-connector-j from 8.4.0 to 9.0.0
- Upgraded Azure Kusto from 5.0.5 to 5.1.0
- Upgraded Datafaker from 2.2.2 to 2.3.0
- Upgraded nimbus-jose-jwt from 9.37.3 to 9.40
- Upgraded oauth2-oidc-sdk from 11.10.1 to 11.13
This closes#9051
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Upgraded AWS SDK 1 from 1.12.748 to 1.12.755
- Upgraded AWS SDK 2 from 2.26.8 to 2.26.14
- Upgraded Google Libraries BOM from 26.40.0 to 26.42.0
- Upgraded Fabric8 Kubernetes Client from 6.13.0 to 6.13.1
- Upgraded Groovy from 4.0.21 to 4.0.22
- Upgraded Lucene from 9.11.0 to 9.11.1
- Upgraded org.checkerframework from 3.44.0 to 3.45.0
- Upgraded org.junit.jupiter from 5.10.2 to 5.10.3
- Upgraded org.junit.platform from 1.10.2 to 1.10.3
- Upgraded org.junit.vintage from 5.10.2 to 5.10.3
- Upgraded Mockito from 5.11.0 to 5.12.0
- Upgraded com.slack.api from 1.40.0 to 1.40.2
- Upgraded org.apache.iotdb from 1.3.1 to 1.3.2
- Upgraded org.apache.kafka from 3.7.0 to 3.7.1
- Upgraded org.flywaydb from 10.15.0 to 1.15.2
- Upgraded org.neo4j.driver from 5.21.0 to 5.22.0
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Upgraded sshd from 2.12.1 to 2.13.1
- Upgraded reactor-netty-http from 1.1.19 to 1.1.20
- Upgraded guava from 33.2.0-jre to 33.2.1-jre
- Upgraded maven-artifact from 3.9.7 to 3.9.8
- Upgraded spring-integrations from 6.3.0 to 6.3.1
- Upgraded jjwt from 0.12.5 to 0.12.6
- Upgraded unboundid from 7.0.0 to 7.0.1
- Upgraded json-schema-validator from 1.4.0 to 1.4.2
- Upgraded Spring Boot from 3.3.0 to 3.3.1
- Upgraded jline from 3.26.1 to 3.26.2
- Upgraded com.amazonaws from 1.12.742 to 1.12.748
- Upgraded AWS SDK from 2.26.1 from 2.26.8
- Upgraded Spring from 6.1.9 to 6.1.10
- Upgraded Spring Security from 6.3.0 to 6.3.1
This closes#9001
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Added ConsumeKafka and PublishKafka Processors with Kafka3ConnectionService
- Added Kafka 3 integration tests
This closes#8463
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
Ensure that when using a Starting Field Name, JsonTreeReader is still able to process all records
This closes#8989
Signed-off-by: David Handermann <exceptionfactory@apache.org>
In case a Python Processor routes a FlowFile to failure and returns attributes, add those attributes to the 'original' FlowFile before routing to 'failure'
This closes#8943
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Upgraded com.amazonaws from 1.12.733 to 1.12.742
- Upgraded software.amazon.awssdk from 2.25.63 to 2.26.1
- Upgraded com.box SDK from 4.9.1 to 4.10.0
- Upgraded commons-net from 3.11.0 to 3.11.1
- Upgraded io.dropwizard.metrics from 4.2.25 to 4.2.26
- Upgraded Netty from 4.1.110.Final to 4.1.111.Final
- Upgraded Commons Configuration2 from 2.10.1 to 2.11.0
- Upgraded Lucene from 9.10.0 to 9.11.0
- Upgraded org.checkerframework from 3.43.0 to 3.44.0
- Upgraded org.eclipse.jdt ecj from 3.37.0 to 3.38.0
- Upgraded Jetty from 12.0.9 to 12.0.10
- Upgraded Elasticsearch Client from 8.13.4 to 8.14.1
- Upgraded Spring Framework from 6.1.8 to 6.1.9
- Upgraded com.slack.api from 1.39.3 to 1.40.0
- Upgraded io.projectreactor from 3.6.6 to 3.6.7
- Upgraded JGit from 6.9.0.202403050737-r to 6.10.0.202406032230-r
- Upgraded Flyway from 10.13.0 to 10.15.0
- Upgraded Spring Integration from 6.2.5 to 6.3.0
This closes#8966
Signed-off-by: David Handermann <exceptionfactory@apache.org>
* NIFI-13313:
- Use nifi-web-frontend as the default UI hosted at /nifi no longer deploying nifi-web-ui.
* NIFI-13313:
- Adding logout complete page.
- Updating backend to redirect to new logout complete page.
* NIFI-13313:
- Remove nifi-web-ui module.
* NIFI-13313:
- Updating LICENSE and NOTICE files for dependencies that are no longer included.
* NIFI-13313:
- Updating README.
- Updating proxy config to mirror actual context path.
* NIFI-13313:
- Establishing rewrite rules for redirecting logout complete.
- Setting the default handler for when a request isn't handled to redirect the user to /nifi.
* NIFI-13313:
- Removing nifi-web-error module.
* NIFI-13313:
- Restoring /nifi/logout-complete path.
* NIFI-13313:
- Adding an error handler for the ui which handles redirects to a 404 page.
This closes#8906
This closes#8913
- Added quick duration for shutdown quiet period in ListenOTLP HttpServerFactory
- Added TestRunner.stop() to ListenOTLPTest to close listening sockets
- Increased Connect Timeout from 5 to 10 seconds in ListenOTLPTest
Signed-off-by: Joseph Witt <joewitt@apache.org>
- Upgraded Spring Boot from 3.2.5 to 3.2.6
- Upgraded Slack bolt-socket-mode from 1.39.2 to 1.39.3
- Upgraded maven-artifact from 3.9.6 to 3.9.7
- Upgraded mariadb-java-client from 3.3.3 to 3.4.0
- Upgraded software.amazon.awssdk from 2.25.55 to 2.25.60
- Upgraded com.amazonaws from 1.12.725 to 1.12.730
- Upgraded Jersey from 3.1.6 to 3.1.7
- Upgraded Netty from 4.1.109.Final to 4.1.110.Final
- Upgraded box-java-sdk from 4.9.0 to 4.9.1
This closes#8887
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Upgraded aspectj from 1.9.22 to 1.9.22.1
- Upgraded mockito from 5.11.0 to 5.12.0
- Upgraded software.amazon.awssdk from 2.25.49 to 2.25.55
- Upgraded com.amazonaws from 1.12.719 to 1.12.725
- Upgraded com.slack.api from 1.39.0 to 1.39.2
- Upgraded swagger-annotations from 2.2.21 to 2.2.22
- Upgraded mockftpserver from 3.1.0 to 3.2.0
- Upgraded Spring Framework from 6.1.6 to 6.1.7
- Upgraded subethasmtp from 7.0.2 to 7.1.1
- Upgraded reactor-core and test from 3.6.5 to 3.6.6
- Upgraded spring-retry from 2.0.5 to 2.0.6
- Upgraded com.google.cloud libraries-bom from 26.38.0 to 26.39.0
- Upgraded flyway from 10.12.0 to 10.13.0
This closes#8849
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Specified UTF-8 encoding for reading Jolt Transform to avoid decoding issues on Windows or platforms with different default character sets
This closes#8842
Signed-off-by: David Handermann <exceptionfactory@apache.org>
* NIFI-13211:
- Decoupling the content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.
* NIFI-13211:
- Decoupling nifi documentation from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.
* NIFI-13211:
- Decoupling nifi image viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.
* NIFI-13211:
- Decoupling nifi standard content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.
* NIFI-13211:
- Decoupling nifi jolt transform json from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.
* NIFI-13211:
- Decoupling nifi update attribute from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.
* NIFI-13211:
- Updating rat config.
* NIFI-13211:
- Bumping dependency check timeout.
* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.
* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.
This closes#8828
Replaced deprecated commons-compress IOUtils.toByteArray with commons-io IOUtils.toByteArray
This closes#8825
Signed-off-by: David Handermann <exceptionfactory@apache.org>
Removed the entire integration-tests-ci profile and reference in GitHub workflow.
Removed all tests which require specific local env configs/cloud credentials/ or simply do not work and thus have been blocked from the build for a long time.
Set Disabled annotation on a couple key tests which are by design manual and must be retained.
The move to testcontainers has been a dramatic improvement in test reliability/behaviors and should be a model for all such tests going forward.
This closes#8818
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Upgraded AWS SDK 1 from 1.12.718 to 1.12.719
- Upgraded AWS SDK 2 from 2.25.48 to 2.25.49
- Upgraded snowflake-ingest-sdk from 2.1.0 to 2.1.1
- Upgraded org.elasticsearch.client from 8.13.3 to 8.13.4
- Upgraded software.amazon.kinesis from 2.5.8 to 2.6.0
This closes#8814
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Upgraded Maven plugins
- Upgraded SpotBugs from 4.7.3.5 to 4.8.5.0
- Upgraded asciidoctor-maven-plugin from 2.2.4 to 3.0.0
- Upgraded license-maven-plugin from 2.2.0 to 2.4.0
- Upgraded download-maven-plugin from 1.7.1 to 1.9.0
- Upgraded maven-clean-plugin from 3.3.1 to 3.3.2
- Upgraded frontend-maven-plugin from 1.14.2 to 1.15.0
- Upgraded hisrc-higherjaxb40-maven-plugin from 2.1.1 to 2.2.0
- Upgraded jacoco-maven-plugin from 0.8.11 to 0.8.12
- Upgraded swagger-maven-plugin-jakarta from 2.2.20 to 2.2.21
- Upgraded swagger-codegen-maven-plugin from 3.0.52 to 3.0.55
This closes#8797
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Updated references to lucene-9 indexes and removed legacy old style indexes
This closes#8782
Signed-off-by: David Handermann <exceptionfactory@apache.org>i
- Upgraded Apache Mina 2.1.8 to 2.2.3
- Upgraded unboundid-ldapsdk from 6.0.11 to 7.0.0
- Upgraded okhttp-digest from 2.7 to 3.1.0
- Upgraded reactor-netty-http from 1.0.44 to 1.1.18
- Upgraded jetbrains-annotations 13.0 to 24.1.0
- Upgraded reactor-core from 3.4.37 to 3.6.5
- Upgraded reactor-test from 3.5.16 to 3.6.5
This closes#8775
Signed-off-by: David Handermann <exceptionfactory@apache.org>
This closes#8773
- Changed getSym() to getSymA() following QuestDB changes
- Added WAL Table status check for Table Metadata lookup
Signed-off-by: Joseph Witt <joewitt@apache.org>
- Upgraded Kotlin from 1.9.23 to 1.9.24
- Upgraded Box from 4.8.0 to 4.9.0
- Upgraded Hazelcast from 5.3.7 to 5.4.0
- Upgraded Guava references from 32.1.2 to 33.2.0
This closes#8763
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Migrated previous relationship names to be more consistent with other Processors
- Added nifi-mock objects for Relationship Migration
This closes#7940
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Methods for getBranches, getDefaultBranch, and createBranch in flow registry client
- Add branch as a field to all relevant objects
- Add optional branch argument to REST API for retrieving buckets
- Add new REST API for retrieving branches for a given registry client
- Enforce NiFi Registry can only receive default branch
This closes#8726
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Removed bytebuddy as was only there due to Jackson 2.17.0 mistake
- io.grpc context 1.59.0 to 1.59.1
- com.amazonaws 1.12.715 to 1.12.716
- software.amazon.awssdk 2.25.45 to 2.25.46
- jackson 2.17.0 to 2.17.1
- calcite 1.36.0 to 1.37.0
This closes#8758
Signed-off-by: David Handermann <exceptionfactory@apache.org>
Ensure nifi-py4j integration tests have proper logback libs
This closes#8747
Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
- Fixed logging logic for tests vs runtime scope
- Restoring behavior to testProcessUnparsableRecordWithRawOutputWithCheckpoint that changed in NIFI-12998 presumably because of log dependency changes. Now that we have a single provider the test behavior appears to be back to normal.
- Upgraded AWS SDK 1 from 1.12.686 to 1.12.710
- Upgraded AWS SDK 2 from 2.25.16 to 2.25.40
- Upgraded Azure SDK BOM from 1.2.21 to 1.2.23
- Upgraded GCP Libraries from 26.34.0 to 26.37.0
- Upgraded Fabric8 Kubernetes Client from 6.10.0 to 6.12.1
- Upgraded Commons CLI from 1.6.0 to 1.7.0
- Upgraded Commons Codec from 1.16.1 to 1.17.0
- Upgraded zstd-jni from 1.5.6-1 to 1.5.6-3
- Upgraded Commons Text from 1.11.0 to 1.12.0
- Upgraded Test Containers from 1.19.4 to 1.19.7
- Upgraded JAXB Runtime from 4.0.4 to 4.0.5
- Upgraded JAXB API from 4.0.1 to 4.0.2
- Upgraded Jersey from 3.1.4 to 3.1.6
- Upgraded Log4j 2 from 2.23.0 to 2.23.1
- Upgraded Logback from 1.5.5 to 1.5.6
- Upgraded Mockito from 5.8.0 to 5.11.0
- Upgraded Swagger Annotations from 2.2.20 to 2.2.21
- Upgraded jsoup from 1.17.1 to 1.17.2
- Upgraded JUnit Platform Commons from 1.10.0 to 1.10.2
- Upgraded Checkstyle from 9.3 to 10.15.0
- Upgraded ASM from 9.6 to 9.7
This closes#8708
Signed-off-by: David Handermann <exceptionfactory@apache.org>
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.
- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar
This closes#8677
Signed-off-by: David Handermann <exceptionfactory@apache.org>