Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,190 Commits 146 Branches 201 Tags 403 MiB
Commit Graph

1398 Commits

Author SHA1 Message Date
EndzeitBegins 4f399c9bb9
NIFI-12446 Refactor FilterAttribute to align with code conventions 
This closes #8161

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-12-16 12:18:39 -06:00
EndzeitBegins c272574dcc
NIFI-12452 Improved support for DescribedValue in Descriptors 
- Removed calls to Builder.defaultValue(null) in several Components

This closes #8102

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-12-13 13:45:45 -06:00
exceptionfactory 34aebc1f69
NIFI-12473 Deleted removeByPattern Methods from Cache Services 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8124.
 2023-12-07 12:42:08 +01:00
Matt Burgess eeb2b1a644
NIFI-12318: Fixed byte array generation in GenerateRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8109.
 2023-12-05 14:41:22 +01:00
Mark Payne 283abadf97
NIFI-12457: Added additional use case based documentation and fixed some typos/made some clarifications in related docs 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8108.
 2023-12-04 14:59:53 +01:00
EndzeitBegins edca4cd347 NIFI-12386 Adds processor FilterAttribute 
attribute uuid is not removed by removeAttribute(s) in MockProcessSession

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #8049
 2023-11-30 19:21:08 +00:00
mr1716 0430974783
NIFI-12436 Upgraded datafaker from 2.0.1 to 2.0.2 
This closes #8084

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-29 22:45:26 -06:00
Mark Payne d0c7ebb196
NIFI-11671: Allow FlowFile attributes to be referenced in SQL for JoinEnrichment 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8059.
 2023-11-22 14:37:18 +01:00
Ferenc Gerlits ceeb0deb3d
NIFI-12381 Fixed CR and LF documentation in SplitText 
This closes #8041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-16 17:44:53 -06:00
Mark Payne e1942a8346
NIFI-12374: Added use case based documentation to explain how to perform incremental / full loads from databases 
This closes #8030

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-15 19:28:10 -06:00
EndzeitBegins 6c333cdb7e
NIFI-1874 Added Character Set Detection to IdentifyMimeType 
NIFI-4550 New Processor not required based on improvements to IdentifyMimeType

- Added mime.charset FlowFile attribute when not null for text MIME types

This closes #8011

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-15 09:11:30 -06:00
mr1716 db827b88b2
NIFI-12360 Upgraded brotli4j from 1.12.0 to 1.13.0 
This closes #8020

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-13 13:58:08 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType 
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying 
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-11-07 09:07:59 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns 
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
 2023-11-05 19:26:04 -05:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs 
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-31 14:20:50 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures 
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities 
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-28 09:23:23 -07:00
Matt Burgess 880770f992
NIFI-12273 Fixed command.argument references in ExecuteStreamCommand docs 
This closes #7941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-27 08:52:26 -05:00
exceptionfactory 2eb5b79353
NIFI-12275 Disabled Keepalive in SFTP Tests 
This closes #7932

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-10-25 20:28:02 +01:00
Mike Moser 9eb2038585
NIFI-12038 add UseCase documentation to PackageFlowFile 
This closes #7896

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-10-25 20:00:55 +01:00
exceptionfactory f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names 
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-10-25 19:54:27 +01:00
dan-s1 7f7e3f0e7a
NIFI-12165 Changed the properties "Custom Transformation Class Name" and "Custom Module Directory" to depend on the "Jolt Transformation DSL" property when its value is "Custom" 
This closes #7890

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-10-23 18:13:20 +01:00
Mark Payne 40ac38dfe3 NIFI-12242: Added ability to route data that exceeds the configured threshold in ControlRate to be routed to 'rate exceeded' instead of just staying in the queue. Added Use Case documentation to ControlRate. 
This closes #7895

Signed-off-by: Mike Moser <mosermw@apache.org>
 2023-10-20 15:19:04 +00:00
Mark Payne 015b721800
NIFI-7643 Removed absolute.path attribute from UnpackContent 
- Do not include the absolute.path attribute from Zip/Tar files in UnpackContent; some code cleanup

This closes #7902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-19 13:51:27 -05:00
Pierre Villard 814e94b2ac
NIFI-12244 - UpdateRecord invalid because of migrateProperties (#7898) 2023-10-19 09:34:55 -04:00
Gabor Gyimesi 91e4b453b4
NIFI-12238 Fix SplitText endline trimming with max fragment size (#7892) 2023-10-18 12:40:52 -04:00
Mark Payne 3ae0eedee6
NIFI-12124: This closes #7791. Added a new RenameRecordField processor. In testing, also noticed that the Descendant Wildcard operator (//*) and Descendant Field Path Operator (//name, for instance) did not properly account for array of records or map elements, so addressed those concerns. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-13 14:02:55 -07:00
Mark Payne abfc49e212
NIFI-12139: Implemented migrateProperties, migrateRelationships for processors, as well as migrateProperties for ReportingTasks and Controller Services. Added system tests to verify behavior. 
- Ensure that after restoring nars in the lib/ directory we restart NiFi so that they take effect. This is important if this test is not the last one to run

This closes #7837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-12 11:40:18 -05:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852) 
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
 2023-10-10 13:55:22 -04:00
dan-s1 66b68140e2
NIFI-12116 Documented lack of NDJSON support in ValidateJson 
This closes #7782

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-09 11:12:02 -05:00
Chris Sampson 099ceec7ed
NIFI-12153 Added Allow Comments and Max String Length to JSON Readers 
This closes #7823

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-09 10:43:08 -05:00
exceptionfactory 457973d133
NIFI-12188 Upgraded Commons Net from 3.9.0 to 3.10.0 
- Removed ProxyFTPClient extension of standard FTPClient no longer required following changes implemented in NET-650

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7855.
 2023-10-09 12:21:23 +02:00
exceptionfactory da4c6f6e25
NIFI-12163 This closes #7835. Improved Syslog 5424 Line Handling 
- Eliminated unused parseEvent method signatures from StrictSyslog5424Parser in favor of a single String line method
- Eliminated intermediate conversion from String to byte array and back to String for Syslog Parser

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-03 19:26:06 -07:00
Mark Payne 342fb0d876
NIFI-12143: This closes #7820. Introduced a new nifi-calcite-utils module and refactored the nifi-sql-reporting-tasks to mamke use of it. This uses the newer calcite api instead of deprecated classes/methods 
- Refactored QueryRecord / JoinEnrichment to use new nifi-calcite-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-30 13:28:03 -07:00
Mike Moser e93586df11
NIFI-12038 This closes #7760. introduce PackageFlowFile processor 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-30 08:51:46 -07:00
exceptionfactory c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references 
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-30 07:56:53 -07:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-28 14:07:48 -07:00
Arpad Boda dbcc223b40 NIFI-12134 - Disable Directory Listing property is duplicated on PutSFTP processor 
Signed-off-by: Bejan Csaba <bejan.csaba@gmail.com>

This closes #7798.
 2023-09-27 17:44:24 +02:00
Bryan Bende 1ac833654b NIFI-12127 Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath 
This closes #7794

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-09-27 08:48:11 -04:00
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
 2023-09-26 13:01:13 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-25 07:54:21 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String) 
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match(). 
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-09-23 14:02:09 +01:00
Mark Payne 140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-22 10:47:47 -07:00
Joseph Witt 4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098 
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-20 16:38:22 -05:00
exceptionfactory 2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute 
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-20 13:54:44 -07:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable 
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-19 08:53:00 -05:00
Joe Witt 019e16c728
NIFI-12069 removed nifi grpc bundle and build related config. Cleaned up brittle test check for command line text which varies. (#7739) 2023-09-15 18:15:02 -04:00