Commit Graph

1003 Commits

Author SHA1 Message Date
exceptionfactory cf59c514ff
NIFI-13947 Removed unused nifi-security-utils Maven configuration
This closes #9470

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-29 14:10:15 -07:00
Pierre Villard c68f6910ba
NIFI-13843 Default to Drop Unknown Fields in Record Readers (#9347)
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-29 14:18:47 -05:00
exceptionfactory b6952f1246
NIFI-13933 Upgraded Spring Security to 6.3.4 and other dependencies
This closes #9450

- Upgraded Spring Security from 6.3.3 to 6.3.4
- Upgraded Hadoop from 3.4.0 to 3.4.1
- Upgraded Velocity Engine Core from 2.3.0 to 2.4.1
- Upgraded Parquet Avro from 1.13.1 to 1.14.3
- Upgraded Google Libraries from 26.47.0 to 26.49.0
- Set protobuf-java to 3.25.5 for calcite-core and amazon-kinesis-client libraries
- Updated Dependency Check suppressions

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-26 14:14:14 -07:00
Pierre Villard 56f859f37f
NIFI-13890 Fixed referencing components for quoted parameter names (#9411)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-18 07:56:51 -05:00
exceptionfactory 927baa858f
NIFI-13891 Updated Documentation for Bootstrap Network Address
- Removed unused nifi.listener.bootstrap.port property from nifi.properties
- Added documentation for management.server.address property in bootstrap.conf
- Corrected location of nifi.diagnostics.on.shutdown property documentation
- Added localized handling to bootstrap port property in StandardMiNiFiServer

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9413.
2024-10-17 21:32:00 +02:00
exceptionfactory 7aabef305c
NIFI-13889 Removed Unused Protected Properties abstraction
- Removed unused methods from nifi-property-utils components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9410.
2024-10-17 20:10:55 +02:00
exceptionfactory d42b110474
NIFI-13886 Upgraded Spring from 6.1.13 to 6.1.14 and others
- Upgraded Apache MINA SSHD from 2.13.2 to 2.14.0
- Upgraded Dropwizard Metrics from 4.2.27 to 4.2.28
- Upgraded Guava from 33.2.1 to 33.3.1
- Upgraded ASM from 9.7 to 9.7.1
- Upgraded Apache JSP from 10.1.16 to 10.1.31
- Upgraded Apache EL from 10.1.16 to 10.1.31
- Upgraded Data Faker from 2.3.1 to 2.4.0
- Upgraded JSON Flattener from 0.16.6 to 0.17.0
- Upgraded Check Qual from 3.47.0 to 3.48.1
- Upgraded error-prone-annotations from 2.28.0 to 2.33.0
- Upgraded frontend-maven-plugin from 1.15.0 to 1.15.1
- Upgraded AWS SDK from 1.12.772 to 1.2.774
- Upgraded AWS SDK from 2.28.13 to 2.28.24
- Upgraded JSON Smart from 2.5.0 to 2.5.1
- Upgraded Jersey from 3.1.8 to 3.1.9
- Upgraded Logback from 1.5.8 to 1.5.11
- Upgraded Servlet API from 6.0.0 to 6.1.0
- Upgraded Swagger Annotations from 2.2.24 to 2.2.25

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9407.
2024-10-17 18:04:51 +02:00
dan-s1 92f571940e
NIFI-13880 Replaced if statements with enhanched switch in Object FieldConverters (#9399)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 18:28:52 -05:00
exceptionfactory cb2117f8e6 NIFI-13579 Improved Timestamp Zone Offset Formatting and Parsing
- Improved Timestamp to String formatting to support patterns with zone offsets
- Improved String to Timestamp parsing to support adjusted hours and minutes when zone offset is included
2024-10-16 18:37:30 +00:00
exceptionfactory 1b37d78403
NIFI-13874 Refactored KeyStore and SSLContext Creation for Tests
This closes #9392

- Added EphemeralKeyStoreBuilder to nifi-security-ssl
- Removed nifi-security-utils
- Moved StandardTlsConfiguration to nifi-ssl-context-service
- Refactored tests to use EphemeralKeyStoreBuilder and nifi-security-cert-builder for TLS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-16 09:18:59 -07:00
exceptionfactory 988b4a1a7e
NIFI-13875 Upgraded Calcite from 1.37.0 to 1.38.0
- Upgraded Curator from 5.7.0 to 5.7.1
- Updated TestQueryRecord expected value to align with Calcite 1.38.0 decimal handling

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9394.
2024-10-16 15:29:41 +02:00
Mark Payne c97510aa66
NIFI-13862: Ensure that when FlowFile Repository is checkpointed, we always call the onGlobalSync() method to ensure that any transient claims that may have been provided (such as those from Stateless NiFi) get dealt with appropriately.
This closes #9375

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-10 13:41:53 -07:00
Mike Moser 4ecd743693
NIFI-12762 Added Request Header Size to ListenHTTP and HandleHttpRequest
This closes #9304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-08 14:28:55 -05:00
exceptionfactory 6761de3901
NIFI-13810 Handled Trailing Separator for Paths in URI Builder
This closes #9319.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-09-27 19:11:35 +02:00
Matt Gilman fb2a82c035
NIFI-13721: Migrating documentation into the NiFi UI (#9288)
* NIFI-13721: Migrating additional details to markdown.

* NIFI-13721: Rebuilding documentation to generate mark up on the client.

* NIFI-13721: Removing old documentation approach.

* NIFI-13721: Rebase main and final fixing button colors.

* NIFI-13721: Fixing rat issues.

* NIFI-13721: Removing generated comonent documentation.
- Removing links and images from additional details markdown.

* NIFI-13721: Recreating package lock following rebase.

* NIFI-13721: Updating documentation for M3.

* NIFI-13721: Fixing broken test.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Ensuring the selected item is visible after routing.

* NIFI-13721: Fixing reportingTaskTypes in finding extensions for a given type.

* NIFI-13721: Updating the see also component to handle when the referenced extension is not installed.

* NIFI-13721: Fixing expansion panel header styles.
2024-09-27 11:11:55 -04:00
exceptionfactory 1548a21219
NIFI-13804 Migrated to NiFi API 2.0.0
This closes #9314.

- Upgraded NAR Maven Plugin from 2.0.0 to 2.1.0
- Removed nifi-api module in favor of released version

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-26 04:54:24 -04:00
dan-s1 3b3b431732
NIFI-13781 Updated DataTypeUtils with syntax optimizations from recent Java versions (#9302)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-24 16:27:40 -05:00
Mark Payne 457d83ef84
NIFI-13796: When writing to a content claim and its size + offset exceeds the max appendable size, do not write to that content claim again
This closes #9306.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-09-23 21:06:08 -07:00
EndzeitBegins 6ac5a96dd0
NIFI-13468 Add standalone RecordPath function recordOf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9018.
2024-09-06 17:45:13 +02:00
Matt Gilman 39ab3129f0
NIFI-13632: Updating content access. (#9221)
* NIFI-13632: Updating content access.
- Removing existing content viewer application.
- Introduced new front end based content viewer applicaiton.
- Introduced new bundled content viewers for hex and images.
- Deleted previous image content viewer.
- Migrated existing standard content viewer (which handles json, xml, yaml, csv, and text) to utilize new content access interface.
- Moved standard content viewer into its own NAR.
- Moved and renamed custom ui utils and content viewer utils into nifi-common.
- Added mime type to FlowFileSummary response payload to help drive the initially opened content viewer.

* NIFI-13632: Fixing rat issue.

* NIFI-13632: Fixing CI issue.

* NIFI-13632: Removing standard content viewer war from code coverage.

* NIFI-13632: Addressing review feedback.

* NIFI-13632: Fixing import.

* NIFI-13632: Further simplification of content viewer state.

* NIFI-13632: Removing unneeded code.

* NIFI-13632: Adding a min height around codemirror.

* NIFI-13632: Addressing review feedback.
- Rendering mime type in the content viewer.
- Preventing additions to the browser history as the user changes how the content is viewed.
- Appending forward slash to content viewer UIs to prevent unnecessary redirect.
- Removing Standard Content Viewer title based on review feedback.
- Fixing double scroll bar in the Standard Content Viewer on small browser heights.
- Removed unnecessary application.yml.
- Bumping spring boot version.

This closes #9221
2024-09-06 09:12:38 -04:00
Peter Turcsanyi 85ca96cc90
NIFI-13715 Fixed StandardProvenanceEventRecord.hashCode() to sort Parent/Child FlowFiles as equals() does
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9233.
2024-09-06 14:27:20 +02:00
David Handermann d56f92d738
NIFI-13707 Switched Kubernetes HTTP Client from OkHttp to JDK (#9228) 2024-09-05 11:31:15 -04:00
EndzeitBegins b80ef7eed9
NIFI-12852 Refactor TestRecordPath to improve expressiveness and reduce duplication
This closes #9198

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-02 21:01:49 -05:00
Juldrixx f92f6f1def
NIFI-13578 Add Schema Branch Name and Schema Version in ValidateRecord (#9108)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 10:54:26 -05:00
Pierre Villard f828907df5
NIFI-12080 Added support for KV_2 in HashiCorp Parameter Provider
This closes #9209

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 09:12:12 -05:00
Matt Gilman 31a3014696
NIFI-13695 Fixed Redirect Handling for Custom UI Extensions
Appending a trailing slash when opening a custom UI and in the query string to fragment filter to avoid a Jetty-based redirect that could lead to losing the proxy path.

This closes #9222

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 08:59:27 -05:00
EndzeitBegins 5c8753fe15
NIFI-13643 mapOf returns a FieldValue with a Map instead of a Record
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9163.
2024-08-29 16:23:07 +02:00
Joseph Witt a8e204aceb
NIFI-13690 Upgraded AWS SDK to 2.27.14 and other dependencies
- Upgraded Logback from 1.5.6 to 1.5.7
- Upgraded brotli4j from 1.16.0 to 1.17.0
- Upgraded AWS SDK from 1.12.767 to 1.12.770
- Upgraded AWS SDK from 2.27.1 to 2.27.14
- Upgraded H2 from 2.3.230 to 2.3.232
- Upgraded Commons CLI from 1.8.0 to 1.9.0
- Upgraded Dropwizard Metrics from 4.2.26 to 4.2.27
- Upgraded Kubernetes Client from 6.13.2 to 6.13.3
- Upgraded Reactor Netty from 1.1.21 to 1.1.22
- Upgraded Commons Compress from 1.27.0 to 1.27.1
- Upgraded Mockito from 5.12.0 to 5.13.0
- Upgraded Slack API from 1.40.3 to 1.42.0
- Upgraded Project Reactor Core from 3.6.8 to 3.6.9
- Upgraded Iceberg from 1.6.0 to 1.6.1
- Upgraded FlywayDB from 10.17.0 to 10.17.2
- Upgraded GitHub API 1.323 to 1.324
- Upgraded PostgreSQL from 42.7.3 to 42.7.4
- Upgraded Spring Integration from 6.3.2 to 6.3.3
- Upgraded Spring Retry 2.0.7 to 2.0.8
- Upgraded Spring Vault from 3.1.1 to 3.1.2

This closes #9206

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-28 14:17:37 -05:00
exceptionfactory 6013b93cee NIFI-13661 Added Multipart Form Data Builder to web-client-api
This closes #9183

Signed-off-by: dan-s1 <dstieg1@gmail.com>
2024-08-23 16:49:12 +00:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
David Handermann 8ba7d7805a
NIFI-13619 Switch web-client from OkHttp to Java HttpClient (#9140)
* NIFI-13619 Switched web-client from OkHttp to Java HttpClient
* NIFI-13619 Corrected comments to removed OkHttp references.
* NIFI-13619 Added writeTimeout handling and close method
* NIFI-13619 Added onDisabled to Service Provider
2024-08-06 15:46:54 -04:00
Matt Gilman da6c9c4791
NIFI-13017: Replace JoltTransformJSON custom UI (#9117)
* NIFI-13017:
- Remove old JoltTransformJSON custom UI.
- Update build to use new JoltTransformJSON custom UI.
- Fix revision query parameter.

* NIFI-13017:
- Excluding jolt transform json ui in workflow ci.

* NIFI-13017:
- Excluding jolt nar in workflow ci.

* NIFI-13017:
- Excluding jolt ui war from code coverage.

* NIFI-13017:
- Incorporating nifi-web-servlet-shared.
- Moving QueryStringToFragmentFilter to nifi-web-servlet-shared.

This closes #9117
2024-08-06 13:51:41 -04:00
dan-s1 f64e68b23c
NIFI-13625 Removed or Replaced System.out.println in Tests (#9150)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-05 20:35:40 -05:00
David Handermann 33da3463b6
NIFI-13594 Added web-servlet-shared abstracted from web-utils (#9123)
- Moved RequestUriBuilder from web-utils to web-servlet-shared
- Refactored proxy header parsing from WebUtils to StandardRequestUriProvider
- Renamed WebUtils to WebClientUtils

This closes #9123
2024-07-30 15:41:49 -04:00
David Handermann dfa015ec33
NIFI-13599 Replaced Commons Codec Hex with HexFormat for Encryptor (#9125)
- Removed commons-codec dependency from nifi-property-encryptor
2024-07-30 13:23:56 -04:00
dan-s1 7c4c5ae693
NIFI-13569 Converted TestRegexDateTimeMatcher to Parameterized Test (#9099)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-23 08:10:42 -05:00
dan-s1 059a3b7745
NIFI-13557 Corrected Date Time Matcher to support single digit months
This closes #9094

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-19 16:59:14 -05:00
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Mark Payne f338215851
NIFI-13529 Set Calcite Connection timeZone to UTC for Records
Calcite adjusts Timestamp objects returned from a Result Set based on the configured Time Zone Offset in an attempt to localize the results. Framework use of Calcite for Record processing expects input Timestamp values to remain unchanged, so setting the timeZone property to UTC with an offset of 0 effectively avoids this Calcite localization.

This closes #9066

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-09 13:47:27 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
exceptionfactory 62c66a12d1
NIFI-13525 Removed unused classes from nifi-security-crypto-key
This closes #9057

- Removed Derived Key Parameter Reader and implementations
- Removed bcrypt and scrypt Derived Key Providers
- Removed unused dependency from nifi-cipher-processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-06 09:33:32 -07:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00
exceptionfactory 7cb6684801
NIFI-13494 Removed support for Repository Encryption
This closes #9039

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:48:40 -07:00
exceptionfactory 275890a226
NIFI-13444 Removed unused test logging configuration
This closes #9004

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-25 20:03:15 -07:00
dan-s1 b3fac8c80b
NIFI-13403 Removed unnecessary toString in logging statements
This closes #8984

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-25 20:13:08 -05:00
David Handermann 42c0aa6aa7
NIFI-12125 Refactored Framework SSLContext Loading (#8967)
- Added Framework SSLContext Provider for centralized loading
- Refactored Spring Framework XML to Java Configuration
- Removed Jetty StoreScanner
2024-06-25 16:08:04 -04:00
Joseph Witt 87107b311a
NIFI-13438 Upgraded Spring to 6.1.10 along with other dependencies
- Upgraded sshd from 2.12.1 to 2.13.1
- Upgraded reactor-netty-http from 1.1.19 to 1.1.20
- Upgraded guava from 33.2.0-jre to 33.2.1-jre
- Upgraded maven-artifact from 3.9.7 to 3.9.8
- Upgraded spring-integrations from 6.3.0 to 6.3.1
- Upgraded jjwt from 0.12.5 to 0.12.6
- Upgraded unboundid from 7.0.0 to 7.0.1
- Upgraded json-schema-validator from 1.4.0 to 1.4.2
- Upgraded Spring Boot from 3.3.0 to 3.3.1
- Upgraded jline from 3.26.1 to 3.26.2
- Upgraded com.amazonaws from 1.12.742 to 1.12.748
- Upgraded AWS SDK from 2.26.1 from 2.26.8
- Upgraded Spring from 6.1.9 to 6.1.10
- Upgraded Spring Security from 6.3.0 to 6.3.1

This closes #9001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-24 21:59:55 -05:00
exceptionfactory 49a0401058
NIFI-13414 Removed Property Protection Modules and Encrypt Config
This closes #8978

- Removed nifi-property-protection-api and implementation modules
- Removed nifi-toolkit-encrypt-config and minifi-toolkit-encrypt-config modules
- Removed extra bootstrap.conf configuration files for property protection implementations

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-20 13:04:00 -07:00
EndzeitBegins a52d6a8214
NIFI-12704 Avoid NPE in escapeJson() for Root Path
This closes #8450

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-17 13:20:13 -05:00
Mark Payne a039bc2b76 NIFI-13380: When determining if Record Type A is 'wider' than Record Type B, and both have a RECORD with the same name but different schemas, instead of determining that A is not wider than B, perform a recursive comparison to check if the RECORD within A's schema is wider than the RECORD within B's schema.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8948
2024-06-15 14:40:24 -04:00