Commit Graph

236 Commits

Author SHA1 Message Date
Ferenc Kis dca7aac9b3
NIFI-13541 [MiNiFi] Validate flow during startup
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #9073.
2024-07-25 07:57:54 -04:00
Ferenc Kis c31fb9d373
NIFI-13568 MiNiFi Fix concurrent SAXParser issue in manifest parsing
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #9098.
2024-07-24 11:45:31 +02:00
Mark Payne 6dd83b7034 NIFI-13563: Updated Provenance Repository so that instead of returning the single latest event for a component, we return the events from the latest invocation / session. Added system tests to verify the behavior. Also, when replaying latest event, attempt all of those events until one succeeds or all fail
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9095
2024-07-22 12:44:35 -04:00
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
exceptionfactory 4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00
Joseph Witt 4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
Ferenc Erdei 903090b649
NIFI-13436 Retain queue for non-modified connections during MiNiFi flow update
This closes #8998.

Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>
2024-06-28 08:40:23 +02:00
Ferenc Erdei 212dd94f90
NIFI-13450 Regenerate MiNiFi Agent Manifest between Heartbeats
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #9005
2024-06-26 17:18:35 -04:00
exceptionfactory af6964642a
NIFI-13457 Removed nifi-python-extensions
This closes #9013

- Python Processors migrated to new nifi-python-extensions repository

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-26 13:33:49 -07:00
dan-s1 b3fac8c80b
NIFI-13403 Removed unnecessary toString in logging statements
This closes #8984

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 20:13:08 -05:00
Ferenc Kis 55d2f39d55
NIFI-13395 Added Python Processors to MiNiFi
This closes #8962

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 14:09:57 -05:00
Ferenc Kis 2a5fe2e809
NIFI-13412 [MiNiFi] Handle absolute paths in Sync/Resource C2 command
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8975.
2024-06-21 10:36:37 +02:00
exceptionfactory 49a0401058
NIFI-13414 Removed Property Protection Modules and Encrypt Config
This closes #8978

- Removed nifi-property-protection-api and implementation modules
- Removed nifi-toolkit-encrypt-config and minifi-toolkit-encrypt-config modules
- Removed extra bootstrap.conf configuration files for property protection implementations

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-20 13:04:00 -07:00
Ferenc Kis cbe52a3763
NIFI-13407 Set Defaults for MiNiFi Runtime Type and Manifest ID
This closes #8970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 08:13:36 -05:00
Ferenc Kis 3aa4ff9d56
NIFI-13242 MiNiFi Sync Resource C2 command
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8898.
2024-06-12 09:31:41 +02:00
dan-s1 7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Matt Gilman b3c7952ef3
NIFI-13373: Adding support for banner text (#8947)
* NIFI-13373:
- Adding support for banner text.

* NIFI-13373:
- Prettier.

* NIFI-13373:
- Removing unused property.

* NIFI-13373:
- Defining reponse payload when loading banner text.
- Removing banner text from login, logout, and error pages.

* NIFI-13373:
- Only loading the banner text when necessary.

This closes #8947
2024-06-11 11:47:56 -04:00
Matt Gilman 5c335cbbec
NIFI-13364 Removed autorefresh and banner UI properties
This closes #8932

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-06 08:34:17 -05:00
Matt Gilman 5727116aa0
NIFI-13313: Remove old UI (#8906)
* NIFI-13313:
- Use nifi-web-frontend as the default UI hosted at /nifi no longer deploying nifi-web-ui.

* NIFI-13313:
- Adding logout complete page.
- Updating backend to redirect to new logout complete page.

* NIFI-13313:
- Remove nifi-web-ui module.

* NIFI-13313:
- Updating LICENSE and NOTICE files for dependencies that are no longer included.

* NIFI-13313:
- Updating README.
- Updating proxy config to mirror actual context path.

* NIFI-13313:
- Establishing rewrite rules for redirecting logout complete.
- Setting the default handler for when a request isn't handled to redirect the user to /nifi.

* NIFI-13313:
- Removing nifi-web-error module.

* NIFI-13313:
- Restoring /nifi/logout-complete path.

* NIFI-13313:
- Adding an error handler for the ui which handles redirects to a 404 page.

This closes #8906
2024-06-05 09:09:01 -04:00
dan-s1 86d36d2327
NIFI-13265 Removed instantiation of Object arrays for log arguments
This closes #8896

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-30 17:17:33 -05:00
Andre F de Miranda c1063600af
NIFI-13263 - Bump ParCEFone version (#8851)
This closes #8851
2024-05-19 08:34:22 -04:00
Pierre Villard ee179f4acf
NIFI-13238 Added Checkstyle rules for whitespace
This closes #8832

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 06:41:19 -05:00
Matt Gilman 3a786cee23
NIFI-13211: Decoupling other UIs from exiting NiFi UI (#8828)
* NIFI-13211:
- Decoupling the content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi documentation from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi image viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi standard content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi jolt transform json from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi update attribute from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Updating rat config.

* NIFI-13211:
- Bumping dependency check timeout.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

This closes #8828
2024-05-14 15:54:23 -04:00
Joseph Witt 44dddbd739
NIFI-13189 Upgraded AWS SDK with Testcontainers and picocli
- Upgraded picocli from 4.7.5 to 4.7.6
- Upgraded Testcontainers from 1.19.7 to 1.19.8
- Upgraded AWS SDK 1 from 1.12.716 to 1.12.718
- Upgraded AWS SDK 2 from 2.25.46 to 2.25.48

This closes #8785

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-09 11:58:15 -05:00
Joseph Witt f0d0676518
NIFI-13178 Upgraded extension and framework dependencies
- Upgraded Apache Mina 2.1.8 to 2.2.3
- Upgraded unboundid-ldapsdk from 6.0.11 to 7.0.0
- Upgraded okhttp-digest from 2.7 to 3.1.0
- Upgraded reactor-netty-http from 1.0.44 to 1.1.18
- Upgraded jetbrains-annotations 13.0 to 24.1.0
- Upgraded reactor-core from 3.4.37 to 3.6.5
- Upgraded reactor-test from 3.5.16 to 3.6.5

This closes #8775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 21:49:27 -05:00
exceptionfactory 09cf383f9b
NIFI-13167 Replaced Hamcrest Matchers with JUnit Matchers
This closes #8764

- Removed Hamcrest from set of default dependencies

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 10:21:57 -07:00
Joseph Witt ff34c41261
NIFI-13161 Upgraded Jackson and AWS dependencies
- Removed bytebuddy as was only there due to Jackson 2.17.0 mistake
- io.grpc context 1.59.0 to 1.59.1
- com.amazonaws 1.12.715 to 1.12.716
- software.amazon.awssdk 2.25.45 to 2.25.46
- jackson 2.17.0 to 2.17.1
- calcite 1.36.0 to 1.37.0

This closes #8758

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 22:54:32 -05:00
Ferenc Kis 52e257e16c
NIFI-13123 MiNiFi async C2 operation processing
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8738.
2024-05-06 18:14:59 -04:00
Joseph Witt 7a6c26fd96
NIFI-13144 improved depependency update config and various dependencies
com.puppycrawl.tools:checkstyle 10.15.0 -> 10.16.0
software.amazon.awssdk:xray  2.25.40 -> 2.25.45
com.amazonaws:aws-java-sdk-keyspaces  1.12.710 -> 1.12.715
com.azure:azure-sdk-bom  1.2.21 -> 1.2.23
com.google.cloud:libraries-bom  26.37.0 -> 26.38.0
net.bytebuddy:byte-buddy  1.14.12 -> 1.14.14
org.checkerframework:checker-qual  3.37.0 -> 3.43.0
org.eclipse.jdt:ecj  3.33.0 -> 3.37.0
com.microsoft.azure:msal4j  1.14.3 -> 1.15.0
com.google.guava:guava  33.1.0-jre -> 33.2.0-jre
com.ibm.icu:icu4j  74.2 -> 75.1
org.opensaml:opensaml-* 4.3.1 -> 4.3.2
org.apache.sshd:sshd-*  2.12.0 -> 2.12.1
com.nimbusds:oauth2-oidc-sdk  9.43.3 -> 9.43.4
excel-streaming-reader  4.2.1 -> 4.3.1
amqp-client 5.20.0 5.21.0
json-schema-validator 1.3.2 1.4.0
Saxon-HE 12.3 12.4
lucene 8.11.2 8.11.3
commons-compiler 3.1.10 3.1.12
dropbox.client.version 5.4.4 5.4.6
subethasmtp 7.0.1 7.0.2
docker-java-api 3.3.4 3.3.6
google-api-services-drive v3-rev20230520-2.0.0	v3-rev20240327-2.0.0
protobuf-java 3.25.1 3.25.3
hazelcast 5.3.5 5.3.7
jackson-datatype-protobuf 0.9.14 0.9.15
kusto-* 5.0.3 5.0.5
mysql-connector-j 8.3.0 8.4.0
docker-compose-junit-jupiter 2.0.0 2.3.0
bolt-socket-mode 1.37.0 1.39.0
wire-schema-jvm 4.9.3 4.9.9
mysql-binlog-connector-java 0.29.0 0.29.2
jjwt 0.12.3 0.12.5
reactor-core 3.4.34 3.4.37
reactor-test 3.5.14 3.5.16
jakarta.activation-api 2.0.1 (and 2.1.2) to 2.1.3
jakarta.mail-api 2.0.1 (and 2.1.2) to 2.1.3
datafaker 2.0.2 to 2.2.2
jna and jna-platform 5.13.0 5.14.0
activemq-* 6.1.1 6.1.2
camel-salesforce 3.14.9 3.14.10
commons-csv 1.10.0 1.11.0
hbase.version 2.5.5-hadoop3 2.5.8-hadoop3
httpasyncclient 4.1.4 4.1.5
httpcore-nio 4.4.12 4.4.16
iotdb 1.3.0 1.3.1
mina-core 2.1.6 2.1.8
gremlin-* 3.7.1 3.7.2
clojure 1.11.2 1.11.3
angus-mail 2.0.2 2.0.3
jgit* 6.8.0.202311291450-r 6.9.0.202403050737-r
javaassist 3.29.2-GA 3.30.2-GA
jline 3.25.1 3.26.1
mariadb-java-client	3.3.0 3.3.3
mongodb-driver-sync 4.11.1 4.11.2
neo4j-java-driver 4.4.12 4.4.16
postgresql 4.7.2 4.7.3
spring-data-redis 2.7.15 2.7.18
spring-integration-mail 6.2.1 6.2.4
spring-vault-core 3.1.0 3.1.1
xmlunit-core 2.9.1 2.10.0
xmlunit-matchers 2.9.1 2.10.0
amazon-kinesis-client 2.5.7 2.5.8
reactor-netty-http 1.0.39 1.0.44
ant 1.10.13 1.10.14
hamcrest-core and hamcrest-all 1.3 moved to just hamcrest 2.2

This closes #8746

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-05-06 15:13:18 +01:00
Joseph Witt 42a4385c82
NIFI-12998 Restructured framework and extension modules
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.

- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar

This closes #8677

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-26 12:12:48 -05:00
Ferenc Kis 4b5b7ac2bb
NIFI-13088 Populate missing parameter context ids in MiNiFi flows.json.raw
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8692.
2024-04-23 15:07:37 +02:00
Ferenc Kis 6eff8a9262
NIFI-13045 Support Bootstrap Listen Port property in MiNiFi
This closes #8648

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-17 10:27:20 -05:00
Ferenc Kis bc589e273d
NIFI-13020 Fix legacy flow C2 update issue
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8624
2024-04-10 14:26:01 -04:00
Ferenc Kis 4e8528d028
NIFI-13019 Exclude Jetty EE10 jars from MiNiFi lib directory
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8625.
2024-04-10 15:52:06 +02:00
exceptionfactory 64db927ca1
NIFI-12965 Upgraded Guava from 32.1.2 to 33.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8577.
2024-03-28 10:32:31 +01:00
Ferenc Kis d1b6aab9d3
NIFI-12760 Flow sensitive properties encryption support in toolkit
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8430.
2024-03-05 14:35:15 +01:00
AjayPremarajan fcbd7c690b
NIFI-12644 Exported json flows does not match minifi json schema resolved by adding new method transform-nifi to convert Nifi Flow json to MiNifi flow json #8393
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #8393.
2024-02-20 12:47:51 +01:00
Ferenc Kis 4f030fefca
NIFI-12787 [MiNiFi] Update list of out-of-the-box supported processors in quickstart guide
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8402.
2024-02-14 13:44:31 +01:00
Peter Turcsanyi b6b0b241c3
NIFI-12769 Updated copyright year to 2024 in NOTICE file headers
This closes #8384.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-09 14:23:39 -07:00
exceptionfactory 5ca7b0df81 NIFI-12646-RC4 prepare for next development iteration 2024-01-25 18:11:30 -06:00
exceptionfactory 640b7bdfbb NIFI-12646-RC4 prepare release nifi-2.0.0-M2-RC4 2024-01-25 18:11:28 -06:00
exceptionfactory 3fcf5f25b4
NIFI-12657 Removed MiNiFi C2 Server modules
This closes #8291.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-01-22 17:51:29 -07:00
Ferenc Erdei 5b9897cd4b
NIFI-12501 Encrypt MiNiFi bootstrap properties
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #8151.
2024-01-22 09:25:57 +01:00
exceptionfactory dc87cfa9ab
NIFI-12591 Upgraded from Swagger Annotations 1.6.12 to 2.2.20
- Added nifi-swagger-integration with ObjectMapperProcessor for enum customization
- Changed nifi-web-api REST API documentation to use HTML template from swagger-codegen-maven-plugin

Upgraded references in multiple modules:

- c2-protocol-api
- c2-protocol-component-api
- minifi-c2-service
- nifi-api
- nifi-client-dto
- nifi-extension-manifest-model
- nifi-registry-revision-entity-model
- nifi-registry-data-model
- nifi-registry-web-api
- nifi-web-api

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8232.
2024-01-11 15:11:28 +01:00
exceptionfactory 42547eb60c
NIFI-11703 Upgraded to Spring Framework 6 and Jetty 12
- Upgraded Spring Framework from 5.3.31 to 6.0.15
- Upgraded Spring Security from 5.8.7 to 6.2.0
- Upgraded Spring Vault from 2.3.4 to 3.1.0
- Upgraded Jetty from 10.0.18 to 12.0.5 with EE 10
- Upgraded Jersey from 2.41 to 3.1.4
- Upgraded JAXB from 2.3.9 to 4.0.4
- Upgraded AspectJ from 1.9.20.1 to 1.9.21
- Upgraded JMS API from 2.0.1 to 3.1.0
- Upgraded ActiveMQ Broker from 5.18.2 to 6.0.1 for JMS 3
- Upgraded JJWT from 0.9.1 to 0.12.3
- Replaced jackson-module-jaxb-annotations with jackson-module-jakarta-xmlbind-annotations
- Replaced maven-jaxb2-plugin with hisrc-higherjaxb40-maven-plugin 2.1.1
- Replaced kongchen swagger-maven-plugin with swagger-codegen-maven-plugin from Swagger 3
- Replaced com.nickwongdev AspectJ Plugin with Codehaus 1.14.0 for newer Java versions
- Removed unused cglib-nodep
- Removed references to javax.validation
- Removed custom Jetty ALPN Processor not required for Java 21
- Removed several tests depending on older Jetty and Jakarta libraries
- Removed unnecessary webdefault.xml configurations
- Replaced unsupported cross-context servlet forwarding with HTTP forwarding
- Replaced javax.servlet references with jakarta.servlet
- Replaced javax.xml.bind references with jakarta.xml.bind
- Replaced javax.ws references with jakarata.ws
- Updated Spring Security CSRF implementation for Spring Security 6
- Updated web.xml versions to 6.0
- Updated REST API templates using new swagger-codegen variables
- Removed VALIDATE_DATA property from ParseCEF based on library compatibility issue with javax.validation
- Added application URL logging to NiFi JettyServer

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8197.
2024-01-04 14:01:32 +04:00
David Handermann 6b7b7cccf8
NIFI-12493 Update Documentation References to Java 21 (#8144)
* NIFI-12493 Updated Documentation References to Java 21

- Removed Apache Maven download step from Custom Distribution instructions and referenced Apache Maven Wrapper in command
- Updated Java Documentation links to Java 21

* NIFI-12493 Updated additional Java version references
2023-12-19 09:49:00 -05:00
Bence Simon 5b664147ee
NIFI-12508 Cleaning up remainders of the Event Driven Strategy
This closes #8153

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:15:29 -06:00
Ferenc Kis c55d600d0a
NIFI-12490 MiNiFi docker graceful shutdown
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8145.
2023-12-09 14:52:38 +01:00