Commit Graph

955 Commits

Author SHA1 Message Date
EndzeitBegins a52d6a8214
NIFI-12704 Avoid NPE in escapeJson() for Root Path
This closes #8450

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 13:20:13 -05:00
Mark Payne a039bc2b76 NIFI-13380: When determining if Record Type A is 'wider' than Record Type B, and both have a RECORD with the same name but different schemas, instead of determining that A is not wider than B, perform a recursive comparison to check if the RECORD within A's schema is wider than the RECORD within B's schema.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8948
2024-06-15 14:40:24 -04:00
dependabot[bot] c64605f9b7
NIFI-13405 Upgraded MSAL4J from 1.15.0 to 1.15.1
This closes #8956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-14 16:42:24 -05:00
Joseph Witt bf637e0bfe
NIFI-13401 Upgraded Spring to 6.1.9 and Jetty to 12.0.10 and others
- Upgraded com.amazonaws from 1.12.733 to 1.12.742
- Upgraded software.amazon.awssdk from 2.25.63 to 2.26.1
- Upgraded com.box SDK from 4.9.1 to 4.10.0
- Upgraded commons-net from 3.11.0 to 3.11.1
- Upgraded io.dropwizard.metrics from 4.2.25 to 4.2.26
- Upgraded Netty from 4.1.110.Final to 4.1.111.Final
- Upgraded Commons Configuration2 from 2.10.1 to 2.11.0
- Upgraded Lucene from 9.10.0 to 9.11.0
- Upgraded org.checkerframework from 3.43.0 to 3.44.0
- Upgraded org.eclipse.jdt ecj from 3.37.0 to 3.38.0
- Upgraded Jetty from 12.0.9 to 12.0.10
- Upgraded Elasticsearch Client from 8.13.4 to 8.14.1
- Upgraded Spring Framework from 6.1.8 to 6.1.9
- Upgraded com.slack.api from 1.39.3 to 1.40.0
- Upgraded io.projectreactor from 3.6.6 to 3.6.7
- Upgraded JGit from 6.9.0.202403050737-r to 6.10.0.202406032230-r
- Upgraded Flyway from 10.13.0 to 10.15.0
- Upgraded Spring Integration from 6.2.5 to 6.3.0

This closes #8966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-14 16:36:19 -05:00
dan-s1 7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Matt Gilman b3c7952ef3
NIFI-13373: Adding support for banner text (#8947)
* NIFI-13373:
- Adding support for banner text.

* NIFI-13373:
- Prettier.

* NIFI-13373:
- Removing unused property.

* NIFI-13373:
- Defining reponse payload when loading banner text.
- Removing banner text from login, logout, and error pages.

* NIFI-13373:
- Only loading the banner text when necessary.

This closes #8947
2024-06-11 11:47:56 -04:00
Matt Gilman 5c335cbbec
NIFI-13364 Removed autorefresh and banner UI properties
This closes #8932

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-06 08:34:17 -05:00
Matt Gilman 5727116aa0
NIFI-13313: Remove old UI (#8906)
* NIFI-13313:
- Use nifi-web-frontend as the default UI hosted at /nifi no longer deploying nifi-web-ui.

* NIFI-13313:
- Adding logout complete page.
- Updating backend to redirect to new logout complete page.

* NIFI-13313:
- Remove nifi-web-ui module.

* NIFI-13313:
- Updating LICENSE and NOTICE files for dependencies that are no longer included.

* NIFI-13313:
- Updating README.
- Updating proxy config to mirror actual context path.

* NIFI-13313:
- Establishing rewrite rules for redirecting logout complete.
- Setting the default handler for when a request isn't handled to redirect the user to /nifi.

* NIFI-13313:
- Removing nifi-web-error module.

* NIFI-13313:
- Restoring /nifi/logout-complete path.

* NIFI-13313:
- Adding an error handler for the ui which handles redirects to a 404 page.

This closes #8906
2024-06-05 09:09:01 -04:00
Joseph Witt 477aa8fe35
NIFI-13336 updating various deps for aws google azure and more
- com.amazonaws	* 1.12.730 1.12.733
- com.azure azure-sdk-bom 1.2.23 1.2.24
- com.google.cloud libraries-bom 26.39.0 26.40.0
- commons-cli 1.7.0 1.8.0
- commons-net 3.10.0 3.11.0
- io.fabric8 * 6.12.1 6.13.0
- org.apache.commons commons-compress 1.26.1 1.26.2
- software.amazon.awssdk 2.25.60 2.25.63
- com.google.apis	google-api-services-drive v3-rev20240327-2.0.0	 v3-rev20240521-2.0.0
- org.neo4j.driver	neo4j-java-driver 5.20.0 5.21.0
- org.springframework.integration	spring-integration-mail 6.2.4 6.2.5

Signed-off-by: Joseph Witt <joewitt@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8907.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2024-06-02 13:29:49 +02:00
David Handermann 5cf43f4a3c
NIFI-13307 Replaced KeyStoreUtils with nifi-security-ssl Builders (#8895)
- Removed unused test classes from nifi-web-api
2024-05-31 15:51:17 -04:00
dan-s1 86d36d2327
NIFI-13265 Removed instantiation of Object arrays for log arguments
This closes #8896

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-30 17:17:33 -05:00
exceptionfactory fa8dc4f1a0
NIFI-13295 Removed Apache Knox SSO Authentication
This closes #8876

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-25 13:10:36 -07:00
exceptionfactory 43cc2b4aaa
NIFI-13297 Removed Kerberos SPENGO Authentication
This closes #8879

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-25 12:47:38 -07:00
Pierre Villard ee179f4acf
NIFI-13238 Added Checkstyle rules for whitespace
This closes #8832

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 06:41:19 -05:00
Chris Sampson 2d112871db
NIFI-8134 allow unescapeJson Record Path function to recursively convert Maps to Records (#7745)
* NIFI-8134 recursively convert Java Objects to NiFi Records
2024-05-14 17:11:28 -04:00
Joseph Witt 03005aa132
NIFI-13185 Removed manual and non-working Integration Tests
Removed the entire integration-tests-ci profile and reference in GitHub workflow.

Removed all tests which require specific local env configs/cloud credentials/ or simply do not work and thus have been blocked from the build for a long time.

Set Disabled annotation on a couple key tests which are by design manual and must be retained.

The move to testcontainers has been a dramatic improvement in test reliability/behaviors and should be a model for all such tests going forward.

This closes #8818

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-11 20:51:41 -05:00
dan-s1 7dfb4936a9
NIFI-13157 Replaced deprecated getNextTarEntry() and getNextZipEntry() with getNextEntry().
This closes #8813

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-10 12:57:31 -07:00
Joseph Witt d1a9043167
NIFI-13193 Set Minimum Maven Version to 3.9.6
- Upgraded Maven plugins
- Upgraded SpotBugs from 4.7.3.5 to 4.8.5.0
- Upgraded asciidoctor-maven-plugin from 2.2.4 to 3.0.0
- Upgraded license-maven-plugin from 2.2.0 to 2.4.0
- Upgraded download-maven-plugin from 1.7.1 to 1.9.0
- Upgraded maven-clean-plugin from 3.3.1 to 3.3.2
- Upgraded frontend-maven-plugin from 1.14.2 to 1.15.0
- Upgraded hisrc-higherjaxb40-maven-plugin from 2.1.1 to 2.2.0
- Upgraded jacoco-maven-plugin from 0.8.11 to 0.8.12
- Upgraded swagger-maven-plugin-jakarta from 2.2.20 to 2.2.21
- Upgraded swagger-codegen-maven-plugin from 3.0.52 to 3.0.55

This closes #8797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 08:05:14 -05:00
exceptionfactory 09cf383f9b
NIFI-13167 Replaced Hamcrest Matchers with JUnit Matchers
This closes #8764

- Removed Hamcrest from set of default dependencies

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-07 10:21:57 -07:00
Joseph Witt ff34c41261
NIFI-13161 Upgraded Jackson and AWS dependencies
- Removed bytebuddy as was only there due to Jackson 2.17.0 mistake
- io.grpc context 1.59.0 to 1.59.1
- com.amazonaws 1.12.715 to 1.12.716
- software.amazon.awssdk 2.25.45 to 2.25.46
- jackson 2.17.0 to 2.17.1
- calcite 1.36.0 to 1.37.0

This closes #8758

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-06 22:54:32 -05:00
Joseph Witt 7a6c26fd96
NIFI-13144 improved depependency update config and various dependencies
com.puppycrawl.tools:checkstyle 10.15.0 -> 10.16.0
software.amazon.awssdk:xray  2.25.40 -> 2.25.45
com.amazonaws:aws-java-sdk-keyspaces  1.12.710 -> 1.12.715
com.azure:azure-sdk-bom  1.2.21 -> 1.2.23
com.google.cloud:libraries-bom  26.37.0 -> 26.38.0
net.bytebuddy:byte-buddy  1.14.12 -> 1.14.14
org.checkerframework:checker-qual  3.37.0 -> 3.43.0
org.eclipse.jdt:ecj  3.33.0 -> 3.37.0
com.microsoft.azure:msal4j  1.14.3 -> 1.15.0
com.google.guava:guava  33.1.0-jre -> 33.2.0-jre
com.ibm.icu:icu4j  74.2 -> 75.1
org.opensaml:opensaml-* 4.3.1 -> 4.3.2
org.apache.sshd:sshd-*  2.12.0 -> 2.12.1
com.nimbusds:oauth2-oidc-sdk  9.43.3 -> 9.43.4
excel-streaming-reader  4.2.1 -> 4.3.1
amqp-client 5.20.0 5.21.0
json-schema-validator 1.3.2 1.4.0
Saxon-HE 12.3 12.4
lucene 8.11.2 8.11.3
commons-compiler 3.1.10 3.1.12
dropbox.client.version 5.4.4 5.4.6
subethasmtp 7.0.1 7.0.2
docker-java-api 3.3.4 3.3.6
google-api-services-drive v3-rev20230520-2.0.0	v3-rev20240327-2.0.0
protobuf-java 3.25.1 3.25.3
hazelcast 5.3.5 5.3.7
jackson-datatype-protobuf 0.9.14 0.9.15
kusto-* 5.0.3 5.0.5
mysql-connector-j 8.3.0 8.4.0
docker-compose-junit-jupiter 2.0.0 2.3.0
bolt-socket-mode 1.37.0 1.39.0
wire-schema-jvm 4.9.3 4.9.9
mysql-binlog-connector-java 0.29.0 0.29.2
jjwt 0.12.3 0.12.5
reactor-core 3.4.34 3.4.37
reactor-test 3.5.14 3.5.16
jakarta.activation-api 2.0.1 (and 2.1.2) to 2.1.3
jakarta.mail-api 2.0.1 (and 2.1.2) to 2.1.3
datafaker 2.0.2 to 2.2.2
jna and jna-platform 5.13.0 5.14.0
activemq-* 6.1.1 6.1.2
camel-salesforce 3.14.9 3.14.10
commons-csv 1.10.0 1.11.0
hbase.version 2.5.5-hadoop3 2.5.8-hadoop3
httpasyncclient 4.1.4 4.1.5
httpcore-nio 4.4.12 4.4.16
iotdb 1.3.0 1.3.1
mina-core 2.1.6 2.1.8
gremlin-* 3.7.1 3.7.2
clojure 1.11.2 1.11.3
angus-mail 2.0.2 2.0.3
jgit* 6.8.0.202311291450-r 6.9.0.202403050737-r
javaassist 3.29.2-GA 3.30.2-GA
jline 3.25.1 3.26.1
mariadb-java-client	3.3.0 3.3.3
mongodb-driver-sync 4.11.1 4.11.2
neo4j-java-driver 4.4.12 4.4.16
postgresql 4.7.2 4.7.3
spring-data-redis 2.7.15 2.7.18
spring-integration-mail 6.2.1 6.2.4
spring-vault-core 3.1.0 3.1.1
xmlunit-core 2.9.1 2.10.0
xmlunit-matchers 2.9.1 2.10.0
amazon-kinesis-client 2.5.7 2.5.8
reactor-netty-http 1.0.39 1.0.44
ant 1.10.13 1.10.14
hamcrest-core and hamcrest-all 1.3 moved to just hamcrest 2.2

This closes #8746

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2024-05-06 15:13:18 +01:00
Joseph Witt 42a4385c82
NIFI-12998 Restructured framework and extension modules
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.

- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar

This closes #8677

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-26 12:12:48 -05:00
knguyen1 b6d044853c
NIFI-12885 Added Record Methods for Local and Offset Dates (#8502)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-24 23:23:54 -05:00
Mark Payne 2ad9db18db
NIFI-12959: Support loading Python processors from NARs
This closes #8573

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-05 15:55:03 -05:00
Bence Simon 88d434f9ec NIFI-12735 Adding the option to execute flow analysis before committing snapshot to registry
This closes #8377.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-04-03 17:24:21 +02:00
tpalfy c3eff68f92
NIFI-12924 Flow Analysis no longer done regularly or on-demand, but automatically when a change occurs that could result in the change of violations.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8537.
2024-03-29 13:34:03 +01:00
exceptionfactory 64db927ca1
NIFI-12965 Upgraded Guava from 32.1.2 to 33.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8577.
2024-03-28 10:32:31 +01:00
Mark Payne afed8c6f53
NIFI-12934 Clear Serialized Form of Records on Field Changes
Any time a Record's field is removed or renamed, ensure that we clear the Serialized Form so that a stale cached value cannot be written

This closes #8576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-27 17:13:56 -05:00
exceptionfactory daad0720b1
NIFI-12957 Upgraded Azure SDK BOM from 1.2.19 to 1.2.21
- Upgraded MSAL4J from 1.14.2 to 1.14.3

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8571.
2024-03-27 10:30:09 +01:00
Mark Payne 8ad3c731da
NIFI-12797 Refactored Record.incorporateInactiveFields
Refactored Record.incorporateInactiveFields to handle when an updated field and an inactive field have the same name (which can happen if incorporateInactiveFields is called multiple times). Also refactored the setValue(String, Object) method to call setValue(RecordField, Object) because the logic had diverged. Also exposed the text of Expression Language, which led to the discovery of this bug.

This closes #8413

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 15:25:49 -06:00
David Handermann 26f5fa2be0
NIFI-11443 Route Python Framework Logging to SLF4J (#8407)
* NIFI-11443 Routed Python Framework Logging to SLF4J

- Changed Python logging to use standard output stream
- Adjusted Python logging format for simplified processing
- Updated PythonProcess to pipe standard error and standard output streams to reader
- Added Log Reader command with Virtual Thread for each Python Process
- Removed Python log properties from NiFi Properties configuration
2024-03-05 16:55:04 -05:00
ravisingh 8346bd7d0f NIFI-12828: Added Mapping for BIT type to return INT and handled boolean case for postgres
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8445
2024-02-29 14:06:57 -05:00
Mark Payne 74bd798097
NIFI-12773: Added join and anchored RecordPath function
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #8391
2024-02-28 20:11:50 +00:00
Mark Bathori c29a744644
NIFI-12847: Add Enum data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8453.
2024-02-28 14:33:39 +01:00
Mark Payne ae423fc6ba
NIFI-12832 Removed unnecessary dependencies from nifi-mock
- Moved StandardValidators to nifi-api
- Moved URL creation method from UriUtils to URLValidator
- Separated FormatUtils into FormatUtils and DurationFormat classes
- Added DurationFormat to nifi-api

This closes #8442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-23 15:13:21 -06:00
dan-s1 fd4a74dbff
NIFI-12725 Upgraded json-schema-validator from 1.1.0 to 1.3.2
- Adjusted URIs for schemas Draft 4, Draft 6 and Draft 7 to match official values set on json-schema-validator 1.3.0

This closes #8405

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 15:11:01 -06:00
David Handermann 2ea4838157
NIFI-12764 Removed Commons Codec and Lang3 from security-utils (#8380) 2024-02-09 16:00:06 -05:00
Mark Payne 5f534dcc42
NIFI-12710 Support microsecond precision for Timestamp Record fields
- PutDatabaseRecordIT supports operating systems with either nanosecond or microsecond precision

This closes #8332

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-09 08:19:51 -06:00
Bence Simon a519585b02
NIFI-12236 Improved Fault Tolerance in QuestDB Status Repository
- Moved QuestDB components to nifi-questdb-bundle

This closes #8152

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 17:27:05 -06:00
lehelb 6a007f9159
NIFI-12270 Added UPLOAD Provenance Event Type to nifi-api
This closes #8094

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 08:16:46 -06:00
Mark Payne e16286ef40
NIFI-12707 Allow LookupRecord to operate on multiple child-records
- In order to accommodate this, also needed to improve DataTypeUtils so that it knows that Record A is wider than Record B if Record A contains all fields of Record B and more.

- Removed unit tests and resources that are overly complex and no longer applicable
- Fixed issue in unit test based on different line endings between operating systems

This closes #8331

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:24:43 -06:00
mr1716 001ada9536
NIFI-12705 Update metrics-jvm to 4.2.25
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8328.
2024-02-01 10:51:21 +04:00
exceptionfactory 5ca7b0df81 NIFI-12646-RC4 prepare for next development iteration 2024-01-25 18:11:30 -06:00
exceptionfactory 640b7bdfbb NIFI-12646-RC4 prepare release nifi-2.0.0-M2-RC4 2024-01-25 18:11:28 -06:00
David Handermann 93788f9281
NIFI-12650 Upgraded json-path from 2.8.0 to 2.9.0 (#8282)
- Upgraded json-smart from 2.4.11 to 2.5.0
- Added json-path to managed dependencies in root Maven configuration
- Suppressed OWASP Dependency Check finding resolved in json-path 2.9.0
2024-01-22 13:18:28 -05:00
Ferenc Erdei 5b9897cd4b
NIFI-12501 Encrypt MiNiFi bootstrap properties
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #8151.
2024-01-22 09:25:57 +01:00
EndzeitBegins 53bb995e4e
NIFI-12613 Renamed asDescribedValue() to asAllowableValue()
This closes #8260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-17 22:16:29 -06:00
Juldrixx 787c45dd61
NIFI-12590 Added Prefix Properties for Kubernetes Leases and ConfigMaps
This closes #8240

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-17 11:34:52 -06:00
David Handermann 250fe90b34
NIFI-9458 Replaced SimpleDateFormat with DateTimeFormatter (#8248)
- Added FieldConverterRegistry and Standard implementation
- Moved DateTypeUtils methods to FieldConverter implementations
2024-01-16 16:39:40 -05:00
exceptionfactory c6f5f534cb
NIFI-12618 Upgraded Azure SDK BOM from 1.2.18 to 1.2.19
- Suppressed CVE-2023-36052 not applicable to Java Azure libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8254.
2024-01-16 23:08:52 +04:00