Commit Graph

224 Commits

Author SHA1 Message Date
Ferenc Kis 55d2f39d55
NIFI-13395 Added Python Processors to MiNiFi
This closes #8962

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 14:09:57 -05:00
Ferenc Kis 2a5fe2e809
NIFI-13412 [MiNiFi] Handle absolute paths in Sync/Resource C2 command
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8975.
2024-06-21 10:36:37 +02:00
exceptionfactory 49a0401058
NIFI-13414 Removed Property Protection Modules and Encrypt Config
This closes #8978

- Removed nifi-property-protection-api and implementation modules
- Removed nifi-toolkit-encrypt-config and minifi-toolkit-encrypt-config modules
- Removed extra bootstrap.conf configuration files for property protection implementations

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-20 13:04:00 -07:00
Ferenc Kis cbe52a3763
NIFI-13407 Set Defaults for MiNiFi Runtime Type and Manifest ID
This closes #8970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 08:13:36 -05:00
Ferenc Kis 3aa4ff9d56
NIFI-13242 MiNiFi Sync Resource C2 command
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8898.
2024-06-12 09:31:41 +02:00
dan-s1 7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Matt Gilman b3c7952ef3
NIFI-13373: Adding support for banner text (#8947)
* NIFI-13373:
- Adding support for banner text.

* NIFI-13373:
- Prettier.

* NIFI-13373:
- Removing unused property.

* NIFI-13373:
- Defining reponse payload when loading banner text.
- Removing banner text from login, logout, and error pages.

* NIFI-13373:
- Only loading the banner text when necessary.

This closes #8947
2024-06-11 11:47:56 -04:00
Matt Gilman 5c335cbbec
NIFI-13364 Removed autorefresh and banner UI properties
This closes #8932

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-06 08:34:17 -05:00
Matt Gilman 5727116aa0
NIFI-13313: Remove old UI (#8906)
* NIFI-13313:
- Use nifi-web-frontend as the default UI hosted at /nifi no longer deploying nifi-web-ui.

* NIFI-13313:
- Adding logout complete page.
- Updating backend to redirect to new logout complete page.

* NIFI-13313:
- Remove nifi-web-ui module.

* NIFI-13313:
- Updating LICENSE and NOTICE files for dependencies that are no longer included.

* NIFI-13313:
- Updating README.
- Updating proxy config to mirror actual context path.

* NIFI-13313:
- Establishing rewrite rules for redirecting logout complete.
- Setting the default handler for when a request isn't handled to redirect the user to /nifi.

* NIFI-13313:
- Removing nifi-web-error module.

* NIFI-13313:
- Restoring /nifi/logout-complete path.

* NIFI-13313:
- Adding an error handler for the ui which handles redirects to a 404 page.

This closes #8906
2024-06-05 09:09:01 -04:00
dan-s1 86d36d2327
NIFI-13265 Removed instantiation of Object arrays for log arguments
This closes #8896

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-30 17:17:33 -05:00
Andre F de Miranda c1063600af
NIFI-13263 - Bump ParCEFone version (#8851)
This closes #8851
2024-05-19 08:34:22 -04:00
Pierre Villard ee179f4acf
NIFI-13238 Added Checkstyle rules for whitespace
This closes #8832

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 06:41:19 -05:00
Matt Gilman 3a786cee23
NIFI-13211: Decoupling other UIs from exiting NiFi UI (#8828)
* NIFI-13211:
- Decoupling the content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi documentation from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi image viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi standard content viewer from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi jolt transform json from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Decoupling nifi update attribute from the NiFi UI which is currently pulling in shared dependencies, scripts, styles, and images.

* NIFI-13211:
- Updating rat config.

* NIFI-13211:
- Bumping dependency check timeout.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

* NIFI-13211:
- Since this page is included through the context viewer, the dependency imports must directly reference through its context path.

This closes #8828
2024-05-14 15:54:23 -04:00
Joseph Witt 44dddbd739
NIFI-13189 Upgraded AWS SDK with Testcontainers and picocli
- Upgraded picocli from 4.7.5 to 4.7.6
- Upgraded Testcontainers from 1.19.7 to 1.19.8
- Upgraded AWS SDK 1 from 1.12.716 to 1.12.718
- Upgraded AWS SDK 2 from 2.25.46 to 2.25.48

This closes #8785

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-09 11:58:15 -05:00
Joseph Witt f0d0676518
NIFI-13178 Upgraded extension and framework dependencies
- Upgraded Apache Mina 2.1.8 to 2.2.3
- Upgraded unboundid-ldapsdk from 6.0.11 to 7.0.0
- Upgraded okhttp-digest from 2.7 to 3.1.0
- Upgraded reactor-netty-http from 1.0.44 to 1.1.18
- Upgraded jetbrains-annotations 13.0 to 24.1.0
- Upgraded reactor-core from 3.4.37 to 3.6.5
- Upgraded reactor-test from 3.5.16 to 3.6.5

This closes #8775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-07 21:49:27 -05:00
exceptionfactory 09cf383f9b
NIFI-13167 Replaced Hamcrest Matchers with JUnit Matchers
This closes #8764

- Removed Hamcrest from set of default dependencies

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 10:21:57 -07:00
Joseph Witt ff34c41261
NIFI-13161 Upgraded Jackson and AWS dependencies
- Removed bytebuddy as was only there due to Jackson 2.17.0 mistake
- io.grpc context 1.59.0 to 1.59.1
- com.amazonaws 1.12.715 to 1.12.716
- software.amazon.awssdk 2.25.45 to 2.25.46
- jackson 2.17.0 to 2.17.1
- calcite 1.36.0 to 1.37.0

This closes #8758

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 22:54:32 -05:00
Ferenc Kis 52e257e16c
NIFI-13123 MiNiFi async C2 operation processing
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8738.
2024-05-06 18:14:59 -04:00
Joseph Witt 7a6c26fd96
NIFI-13144 improved depependency update config and various dependencies
com.puppycrawl.tools:checkstyle 10.15.0 -> 10.16.0
software.amazon.awssdk:xray  2.25.40 -> 2.25.45
com.amazonaws:aws-java-sdk-keyspaces  1.12.710 -> 1.12.715
com.azure:azure-sdk-bom  1.2.21 -> 1.2.23
com.google.cloud:libraries-bom  26.37.0 -> 26.38.0
net.bytebuddy:byte-buddy  1.14.12 -> 1.14.14
org.checkerframework:checker-qual  3.37.0 -> 3.43.0
org.eclipse.jdt:ecj  3.33.0 -> 3.37.0
com.microsoft.azure:msal4j  1.14.3 -> 1.15.0
com.google.guava:guava  33.1.0-jre -> 33.2.0-jre
com.ibm.icu:icu4j  74.2 -> 75.1
org.opensaml:opensaml-* 4.3.1 -> 4.3.2
org.apache.sshd:sshd-*  2.12.0 -> 2.12.1
com.nimbusds:oauth2-oidc-sdk  9.43.3 -> 9.43.4
excel-streaming-reader  4.2.1 -> 4.3.1
amqp-client 5.20.0 5.21.0
json-schema-validator 1.3.2 1.4.0
Saxon-HE 12.3 12.4
lucene 8.11.2 8.11.3
commons-compiler 3.1.10 3.1.12
dropbox.client.version 5.4.4 5.4.6
subethasmtp 7.0.1 7.0.2
docker-java-api 3.3.4 3.3.6
google-api-services-drive v3-rev20230520-2.0.0	v3-rev20240327-2.0.0
protobuf-java 3.25.1 3.25.3
hazelcast 5.3.5 5.3.7
jackson-datatype-protobuf 0.9.14 0.9.15
kusto-* 5.0.3 5.0.5
mysql-connector-j 8.3.0 8.4.0
docker-compose-junit-jupiter 2.0.0 2.3.0
bolt-socket-mode 1.37.0 1.39.0
wire-schema-jvm 4.9.3 4.9.9
mysql-binlog-connector-java 0.29.0 0.29.2
jjwt 0.12.3 0.12.5
reactor-core 3.4.34 3.4.37
reactor-test 3.5.14 3.5.16
jakarta.activation-api 2.0.1 (and 2.1.2) to 2.1.3
jakarta.mail-api 2.0.1 (and 2.1.2) to 2.1.3
datafaker 2.0.2 to 2.2.2
jna and jna-platform 5.13.0 5.14.0
activemq-* 6.1.1 6.1.2
camel-salesforce 3.14.9 3.14.10
commons-csv 1.10.0 1.11.0
hbase.version 2.5.5-hadoop3 2.5.8-hadoop3
httpasyncclient 4.1.4 4.1.5
httpcore-nio 4.4.12 4.4.16
iotdb 1.3.0 1.3.1
mina-core 2.1.6 2.1.8
gremlin-* 3.7.1 3.7.2
clojure 1.11.2 1.11.3
angus-mail 2.0.2 2.0.3
jgit* 6.8.0.202311291450-r 6.9.0.202403050737-r
javaassist 3.29.2-GA 3.30.2-GA
jline 3.25.1 3.26.1
mariadb-java-client	3.3.0 3.3.3
mongodb-driver-sync 4.11.1 4.11.2
neo4j-java-driver 4.4.12 4.4.16
postgresql 4.7.2 4.7.3
spring-data-redis 2.7.15 2.7.18
spring-integration-mail 6.2.1 6.2.4
spring-vault-core 3.1.0 3.1.1
xmlunit-core 2.9.1 2.10.0
xmlunit-matchers 2.9.1 2.10.0
amazon-kinesis-client 2.5.7 2.5.8
reactor-netty-http 1.0.39 1.0.44
ant 1.10.13 1.10.14
hamcrest-core and hamcrest-all 1.3 moved to just hamcrest 2.2

This closes #8746

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-05-06 15:13:18 +01:00
Joseph Witt 42a4385c82
NIFI-12998 Restructured framework and extension modules
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.

- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar

This closes #8677

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-26 12:12:48 -05:00
Ferenc Kis 4b5b7ac2bb
NIFI-13088 Populate missing parameter context ids in MiNiFi flows.json.raw
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8692.
2024-04-23 15:07:37 +02:00
Ferenc Kis 6eff8a9262
NIFI-13045 Support Bootstrap Listen Port property in MiNiFi
This closes #8648

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-17 10:27:20 -05:00
Ferenc Kis bc589e273d
NIFI-13020 Fix legacy flow C2 update issue
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8624
2024-04-10 14:26:01 -04:00
Ferenc Kis 4e8528d028
NIFI-13019 Exclude Jetty EE10 jars from MiNiFi lib directory
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8625.
2024-04-10 15:52:06 +02:00
exceptionfactory 64db927ca1
NIFI-12965 Upgraded Guava from 32.1.2 to 33.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8577.
2024-03-28 10:32:31 +01:00
Ferenc Kis d1b6aab9d3
NIFI-12760 Flow sensitive properties encryption support in toolkit
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8430.
2024-03-05 14:35:15 +01:00
AjayPremarajan fcbd7c690b
NIFI-12644 Exported json flows does not match minifi json schema resolved by adding new method transform-nifi to convert Nifi Flow json to MiNifi flow json #8393
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #8393.
2024-02-20 12:47:51 +01:00
Ferenc Kis 4f030fefca
NIFI-12787 [MiNiFi] Update list of out-of-the-box supported processors in quickstart guide
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8402.
2024-02-14 13:44:31 +01:00
Peter Turcsanyi b6b0b241c3
NIFI-12769 Updated copyright year to 2024 in NOTICE file headers
This closes #8384.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-09 14:23:39 -07:00
exceptionfactory 5ca7b0df81 NIFI-12646-RC4 prepare for next development iteration 2024-01-25 18:11:30 -06:00
exceptionfactory 640b7bdfbb NIFI-12646-RC4 prepare release nifi-2.0.0-M2-RC4 2024-01-25 18:11:28 -06:00
exceptionfactory 3fcf5f25b4
NIFI-12657 Removed MiNiFi C2 Server modules
This closes #8291.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-01-22 17:51:29 -07:00
Ferenc Erdei 5b9897cd4b
NIFI-12501 Encrypt MiNiFi bootstrap properties
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #8151.
2024-01-22 09:25:57 +01:00
exceptionfactory dc87cfa9ab
NIFI-12591 Upgraded from Swagger Annotations 1.6.12 to 2.2.20
- Added nifi-swagger-integration with ObjectMapperProcessor for enum customization
- Changed nifi-web-api REST API documentation to use HTML template from swagger-codegen-maven-plugin

Upgraded references in multiple modules:

- c2-protocol-api
- c2-protocol-component-api
- minifi-c2-service
- nifi-api
- nifi-client-dto
- nifi-extension-manifest-model
- nifi-registry-revision-entity-model
- nifi-registry-data-model
- nifi-registry-web-api
- nifi-web-api

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8232.
2024-01-11 15:11:28 +01:00
exceptionfactory 42547eb60c
NIFI-11703 Upgraded to Spring Framework 6 and Jetty 12
- Upgraded Spring Framework from 5.3.31 to 6.0.15
- Upgraded Spring Security from 5.8.7 to 6.2.0
- Upgraded Spring Vault from 2.3.4 to 3.1.0
- Upgraded Jetty from 10.0.18 to 12.0.5 with EE 10
- Upgraded Jersey from 2.41 to 3.1.4
- Upgraded JAXB from 2.3.9 to 4.0.4
- Upgraded AspectJ from 1.9.20.1 to 1.9.21
- Upgraded JMS API from 2.0.1 to 3.1.0
- Upgraded ActiveMQ Broker from 5.18.2 to 6.0.1 for JMS 3
- Upgraded JJWT from 0.9.1 to 0.12.3
- Replaced jackson-module-jaxb-annotations with jackson-module-jakarta-xmlbind-annotations
- Replaced maven-jaxb2-plugin with hisrc-higherjaxb40-maven-plugin 2.1.1
- Replaced kongchen swagger-maven-plugin with swagger-codegen-maven-plugin from Swagger 3
- Replaced com.nickwongdev AspectJ Plugin with Codehaus 1.14.0 for newer Java versions
- Removed unused cglib-nodep
- Removed references to javax.validation
- Removed custom Jetty ALPN Processor not required for Java 21
- Removed several tests depending on older Jetty and Jakarta libraries
- Removed unnecessary webdefault.xml configurations
- Replaced unsupported cross-context servlet forwarding with HTTP forwarding
- Replaced javax.servlet references with jakarta.servlet
- Replaced javax.xml.bind references with jakarta.xml.bind
- Replaced javax.ws references with jakarata.ws
- Updated Spring Security CSRF implementation for Spring Security 6
- Updated web.xml versions to 6.0
- Updated REST API templates using new swagger-codegen variables
- Removed VALIDATE_DATA property from ParseCEF based on library compatibility issue with javax.validation
- Added application URL logging to NiFi JettyServer

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8197.
2024-01-04 14:01:32 +04:00
David Handermann 6b7b7cccf8
NIFI-12493 Update Documentation References to Java 21 (#8144)
* NIFI-12493 Updated Documentation References to Java 21

- Removed Apache Maven download step from Custom Distribution instructions and referenced Apache Maven Wrapper in command
- Updated Java Documentation links to Java 21

* NIFI-12493 Updated additional Java version references
2023-12-19 09:49:00 -05:00
Bence Simon 5b664147ee
NIFI-12508 Cleaning up remainders of the Event Driven Strategy
This closes #8153

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:15:29 -06:00
Ferenc Kis c55d600d0a
NIFI-12490 MiNiFi docker graceful shutdown
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #8145.
2023-12-09 14:52:38 +01:00
Ferenc Kis effbb76baa
NIFI-12476 Exclude nifi-framework-core from minifi-bootstrap
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8128.
2023-12-06 14:51:42 +01:00
Ferenc Kis 9d50c6dd53
NIFI-12372 [MiNiFi] Encrpyt raw flow sensitive properties
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8028.
2023-11-29 14:31:30 +01:00
exceptionfactory 00fd7d7cca NIFI-12361-RC6 prepare for next development iteration 2023-11-22 18:35:27 -06:00
exceptionfactory 49fa0d8674 NIFI-12361-RC6 prepare release nifi-2.0.0-M1-RC6 2023-11-22 18:35:26 -06:00
exceptionfactory 76a27b0ad8
NIFI-12375 Removed maxFileSize from non-applicable policies in Logback
- Removed the non-applicable maxFileSize from TimeBasedRollingPolicy configurations in default logback.xml files to avoid warnings on shutdown

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8033.
2023-11-15 22:36:34 +01:00
Mike Thomsen 6447aea258
NIFI-11788 Modified APP_FILE logback configuration to have better cleanup
NIFI-11788 Standardized Logback maximum settings
- Set MiNiFi maxHistory to 10 and totalSizeCap to 10MB
- Set NiFi maxHistory to 30 and totalSizeCap to 3GB except for deprecation log
- Set Stateless maxHistory to 30 and totalSizeCap to 3GB
- Set Registry maxHistory to 30 and totalSizeCap to 3GB
NIFI-11788 Increased MiNiFi maxFileSize to 10MB and cap to 100MB

This closes #7465. Coauthored by David Handermann and Mike Thomsen

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-11-13 09:48:40 -07:00
Ferenc Erdei 61bb01560d
NIFI-12333 MiNiFi property override through env and system variables
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #7997.
2023-11-10 16:20:41 +01:00
Ferenc Erdei 4430effe00 NIFI-12335 Fix MiNiFi startup issue
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #7998.
2023-11-08 17:17:10 +01:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00