Commit Graph

1580 Commits

Author SHA1 Message Date
Pierre Villard 415505ea5d NIFI-12587 - improve error message in ValidateCSV
review - removed row source from logging

Update nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ValidateCsv.java

Co-authored-by: dan-s1 <dstieg1@gmail.com>

Update nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/ValidateCsv.java

Co-authored-by: dan-s1 <dstieg1@gmail.com>

Update nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/java/org/apache/nifi/processors/standard/TestValidateCsv.java

Co-authored-by: dan-s1 <dstieg1@gmail.com>

Update nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/java/org/apache/nifi/processors/standard/TestValidateCsv.java

Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #8224

Co-authored-by: dan-s1 <dstieg1@gmail.com>
2024-01-09 17:56:50 -05:00
mr1716 56eb3a46c4
NIFI-12562 Upgraded json-schema-validator from 1.0.87 to 1.1.0
This closes #8202

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-04 08:38:40 -06:00
exceptionfactory 42547eb60c
NIFI-11703 Upgraded to Spring Framework 6 and Jetty 12
- Upgraded Spring Framework from 5.3.31 to 6.0.15
- Upgraded Spring Security from 5.8.7 to 6.2.0
- Upgraded Spring Vault from 2.3.4 to 3.1.0
- Upgraded Jetty from 10.0.18 to 12.0.5 with EE 10
- Upgraded Jersey from 2.41 to 3.1.4
- Upgraded JAXB from 2.3.9 to 4.0.4
- Upgraded AspectJ from 1.9.20.1 to 1.9.21
- Upgraded JMS API from 2.0.1 to 3.1.0
- Upgraded ActiveMQ Broker from 5.18.2 to 6.0.1 for JMS 3
- Upgraded JJWT from 0.9.1 to 0.12.3
- Replaced jackson-module-jaxb-annotations with jackson-module-jakarta-xmlbind-annotations
- Replaced maven-jaxb2-plugin with hisrc-higherjaxb40-maven-plugin 2.1.1
- Replaced kongchen swagger-maven-plugin with swagger-codegen-maven-plugin from Swagger 3
- Replaced com.nickwongdev AspectJ Plugin with Codehaus 1.14.0 for newer Java versions
- Removed unused cglib-nodep
- Removed references to javax.validation
- Removed custom Jetty ALPN Processor not required for Java 21
- Removed several tests depending on older Jetty and Jakarta libraries
- Removed unnecessary webdefault.xml configurations
- Replaced unsupported cross-context servlet forwarding with HTTP forwarding
- Replaced javax.servlet references with jakarta.servlet
- Replaced javax.xml.bind references with jakarta.xml.bind
- Replaced javax.ws references with jakarata.ws
- Updated Spring Security CSRF implementation for Spring Security 6
- Updated web.xml versions to 6.0
- Updated REST API templates using new swagger-codegen variables
- Removed VALIDATE_DATA property from ParseCEF based on library compatibility issue with javax.validation
- Added application URL logging to NiFi JettyServer

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8197.
2024-01-04 14:01:32 +04:00
exceptionfactory b8c8eafd03 NIFI-12559 Upgraded SSHJ from 0.37.0 to 0.38.0
- Removed Bouncy Castle JDK 1.5 version exclusions no longer required in SSHJ 0.38.0

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8200
2024-01-02 13:49:31 -05:00
krisztina-zsihovszki 1a34208f65
NIFI-12531 Parameter references are removed after property migration
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8176.
2024-01-02 21:42:56 +04:00
dan-s1 3e62e1e7f2
NIFI-12517 Updated isJson function to improve space handling
- The isJson Expression Language function returns true regardless of leading or trailing spaces

This closes #8165

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-29 21:58:09 -06:00
exceptionfactory a06fe5905c
NIFI-11627 Corrected TestValidateJson exception evaluation
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-26 18:57:34 -06:00
dan-s1 3b8ff2299f
NIFI-12513 Added UriUtils to nifi-utils and updated InvokeHTTP
The UriUtils class allows the construction of a valid java.net.URI with a single string even though there maybe illegal characters in the path, query and/or fragment sections(s) of the URI. The create method uses regular expressions from Spring Framework UriComponentsBuilder and provides capabilities closer to the deprecated constructor for java.net.URL.

This closes #8189

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-26 16:53:29 -06:00
dan-s1 6bca79cb37
NIFI-11627 Added JsonSchemaRegistry for ValidateJson
- Added nifi-json-schema-api to nifi-commons
- Added StandardJsonSchemaRegistry implementation of JsonSchemaRegistry
- Added strategy configuration properties to ValidateJson

This closes #8005

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-26 16:28:30 -06:00
dan-s1 1ddb5c185a
NIFI-12408 Added Pretty Print Property to AttributesToJSON
This closes #8156

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-16 14:45:30 -06:00
EndzeitBegins 4f399c9bb9
NIFI-12446 Refactor FilterAttribute to align with code conventions
This closes #8161

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-16 12:18:39 -06:00
EndzeitBegins c272574dcc
NIFI-12452 Improved support for DescribedValue in Descriptors
- Removed calls to Builder.defaultValue(null) in several Components

This closes #8102

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:45:45 -06:00
exceptionfactory 34aebc1f69
NIFI-12473 Deleted removeByPattern Methods from Cache Services
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8124.
2023-12-07 12:42:08 +01:00
Matt Burgess eeb2b1a644
NIFI-12318: Fixed byte array generation in GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8109.
2023-12-05 14:41:22 +01:00
Mark Payne 283abadf97
NIFI-12457: Added additional use case based documentation and fixed some typos/made some clarifications in related docs
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8108.
2023-12-04 14:59:53 +01:00
EndzeitBegins edca4cd347 NIFI-12386 Adds processor FilterAttribute
attribute uuid is not removed by removeAttribute(s) in MockProcessSession

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8049
2023-11-30 19:21:08 +00:00
mr1716 0430974783
NIFI-12436 Upgraded datafaker from 2.0.1 to 2.0.2
This closes #8084

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-29 22:45:26 -06:00
David Handermann 50efc55df6
NIFI-12403 Improve Jolt UI Parameter Processing (#8060)
* Improved Jolt UI Parameter Processing

* Changed double quotes to single quotes per review

This closes #8060
2023-11-22 14:37:02 -05:00
Mark Payne d0c7ebb196
NIFI-11671: Allow FlowFile attributes to be referenced in SQL for JoinEnrichment
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8059.
2023-11-22 14:37:18 +01:00
Ferenc Gerlits ceeb0deb3d
NIFI-12381 Fixed CR and LF documentation in SplitText
This closes #8041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-16 17:44:53 -06:00
Mark Payne e1942a8346
NIFI-12374: Added use case based documentation to explain how to perform incremental / full loads from databases
This closes #8030

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 19:28:10 -06:00
EndzeitBegins 6c333cdb7e
NIFI-1874 Added Character Set Detection to IdentifyMimeType
NIFI-4550 New Processor not required based on improvements to IdentifyMimeType

- Added mime.charset FlowFile attribute when not null for text MIME types

This closes #8011

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-15 09:11:30 -06:00
mr1716 db827b88b2
NIFI-12360 Upgraded brotli4j from 1.12.0 to 1.13.0
This closes #8020

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:58:08 -06:00
mr1716 2c00d73ce9
NIFI-12359 Upgraded json-schema-validator from 1.0.86 to 1.0.87
This closes #8019

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 13:56:46 -06:00
mr1716 0c4de923ba
NIFI-12353 Upgraded json-flattener from 0.16.4 to 0.16.6
This closes #8014

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-13 12:16:06 -06:00
mr1716 246ffe4ee9
NIFI-12346 Upgraded Apache Calcite from 1.35.0 to 1.36.0
This closes #8009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:27:07 -06:00
Pierre Villard 279084ddfe
NIFI-12233 Added Parameter Provider for 1Password
This closes #7884

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 11:57:16 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:07:59 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-31 14:20:50 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-28 09:23:23 -07:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Matt Burgess 880770f992
NIFI-12273 Fixed command.argument references in ExecuteStreamCommand docs
This closes #7941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:52:26 -05:00
exceptionfactory 2eb5b79353
NIFI-12275 Disabled Keepalive in SFTP Tests
This closes #7932

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:28:02 +01:00
Mike Moser 9eb2038585
NIFI-12038 add UseCase documentation to PackageFlowFile
This closes #7896

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:00:55 +01:00
exceptionfactory f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 19:54:27 +01:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925)
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
2023-10-25 13:22:26 -04:00
exceptionfactory dc5cd92aa8
NIFI-12264 Upgraded Apache Tika from 2.9.0 to 2.9.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7921.
2023-10-24 11:03:32 +02:00
dan-s1 7f7e3f0e7a
NIFI-12165 Changed the properties "Custom Transformation Class Name" and "Custom Module Directory" to depend on the "Jolt Transformation DSL" property when its value is "Custom"
This closes #7890

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-23 18:13:20 +01:00
exceptionfactory f9615414bd
NIFI-12258 Upgraded MINA SSHD from 2.10.0 to 2.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7915.
2023-10-20 18:22:07 +02:00
Mark Payne 40ac38dfe3 NIFI-12242: Added ability to route data that exceeds the configured threshold in ControlRate to be routed to 'rate exceeded' instead of just staying in the queue. Added Use Case documentation to ControlRate.
This closes #7895

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-20 15:19:04 +00:00
Mark Payne 015b721800
NIFI-7643 Removed absolute.path attribute from UnpackContent
- Do not include the absolute.path attribute from Zip/Tar files in UnpackContent; some code cleanup

This closes #7902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:51:27 -05:00
Pierre Villard 814e94b2ac
NIFI-12244 - UpdateRecord invalid because of migrateProperties (#7898) 2023-10-19 09:34:55 -04:00
Gabor Gyimesi 91e4b453b4
NIFI-12238 Fix SplitText endline trimming with max fragment size (#7892) 2023-10-18 12:40:52 -04:00
exceptionfactory 574c2b2168 NIFI-12234 Upgraded SSHJ from 0.35.0 to 0.37.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7886
2023-10-17 02:10:51 -04:00
Mark Payne 3ae0eedee6
NIFI-12124: This closes #7791. Added a new RenameRecordField processor. In testing, also noticed that the Descendant Wildcard operator (//*) and Descendant Field Path Operator (//name, for instance) did not properly account for array of records or map elements, so addressed those concerns.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 14:02:55 -07:00