Commit Graph

1387 Commits

Author SHA1 Message Date
Nathan Gough 9ff1dadcf6
NIFI-10604 Added Idle Connection Timeout property to ListenTCP
This closes #6492

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 14:30:37 -05:00
zhangcheng b5f4101fa0
NIFI-10352: remove the meaningless code of GenerateTableFetch.java, It is confusing for reading code.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6299
2022-10-07 14:50:26 -04:00
exceptionfactory 97dc4b67aa NIFI-10569 Added Maximum Thread property to HandleHttpRequest
- Added simple unit test for HandleHttpRequest to run without requests
- Removed cleanup integration test method for HandleHttpRequest

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6465.
2022-10-07 14:37:04 -04:00
Michael 81877 572799a201
NIFI-10273 Supported file entries larger than 8.5GB for TAR in MergeContent
This closes #6369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 10:36:10 -05:00
Joe Witt c6a9d70814
Merge branch 'NIFI-10521-RC4' 2022-10-06 14:13:30 -07:00
exceptionfactory d1145ee34e NIFI-10586 Prioritized ssh-rsa algorithm in SFTP Processors
- The default configuration prioritizes ssh-rsa when Key Algorithms Allowed is not specified

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6479.
2022-10-06 14:31:10 -04:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Emilio Setiadarma abf88c3aab
NIFI-10240 Removed custom validation for SSL Context Service in ListenSyslog
- Made sure to check TCP is protocol set before using SSL Context Service during runtime

This closes #6441

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-30 11:03:39 -05:00
Aerilym 4b691b133b
NIFI-10192 Caffeine cache schema request for reuse
This closes #6364

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 15:07:42 -04:00
Matthew Hawkins 3e60414d48
NIFI-10436 Initial basic brotli support
NIFI-10436 Add Brotli-compressed SampleFile.txt.br for unit testing
NIFI-10436 Fixup basic usage of Brotli4j API
NIFI-10436 NOTICE ok, LICENSE updated
NIFI-10436 style fixup CompressContent.java
NIFI-10436 Update CompressContent.java

This closes #6432

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 12:03:09 -04:00
Joe Gresock 094222260c
NIFI-9402: Adding DatabaseParameterProvider
Adding provided scope to api dependency in nifi-standard-parameter-providers module

Adding additional documentation, other minor code cleanup

Correcting error handling in StandardParameterProviderNode, updating additional details for DatabaseParameterProvider

Correcting null columm value handling

NIFI-9402: Fixed Checkstyle violation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6391
2022-09-28 17:41:57 -04:00
Joe Witt 1a99b9611c
NIFI-10559 Clarified remote path can come from flowfile attributes and made inherited prop descriptors more obvious
This closes #6457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-28 15:52:32 -05:00
Eduardo Fontes 9bc63920aa
NIFI-10289 This closes #6256. Change getConflictColumnsClause
NIFI-10289 Test upsert to catch this issue

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-26 15:38:42 -07:00
Joe Witt 9e6ee656b5
NIFI-10532 ensuring client gets reset if any of the key values host/port/user/pw change on a per ff basis (#6445) 2022-09-26 17:00:23 -04:00
Bryan Bende 27e3ee1915 NIFI-10528 Create nifi-json-record-utils and updated Salesforce NAR dependencies to use it
This closes #6435.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-23 17:11:13 +02:00
Emilio Setiadarma f586f8f4cf NIFI-9451 - Add 'Input Character Set' property for PutEmail and additional tests
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6313.
2022-09-23 00:20:23 -04:00
Mark Payne ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6421
2022-09-16 17:58:19 -04:00
exceptionfactory 04c0df1723
NIFI-10471 Documented and applied standard deprecation logging
- Updated Admin Guide with section on Logging Configuration and Deprecation Logging
- Updated Developer Guide with section on Deprecating Components and Features
- Added Deprecation Logging when adding components marked with DeprecationNotice to the Flow Configuration
- Added Deprecation Logging on deprecated methods in standard Controller Service implementations
- Removed integration tests for deprecated PersistentProvenanceRepository
- Updated logging and added documentation on minor upgrade steps
- Updated logging for HDFSNarProvider and RocksDB Repository

This closes #6390
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-13 19:40:03 -04:00
exceptionfactory a91928e0e3
NIFI-10489 Upgraded zip4j from 2.10.0 to 2.11.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6409.
2022-09-13 15:03:54 +02:00
exceptionfactory dfa18b848f
NIFI-10477 Upgraded Apache Calcite from 1.31 to 1.32
This closes #6396

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-11 07:55:07 -04:00
exceptionfactory 1370295bd3
NIFI-10470 Upgraded SSHJ from 0.33.0 to 0.34.0
This closes #6387

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:19:22 -04:00
exceptionfactory 5b3601f50f
NIFI-10472 Upgraded SnakeYAML from 1.29 to 1.31
- Replaced module overrides with root managed dependency version

This closes #6389

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-09 20:38:01 -04:00
Joe Gresock de7793e69b
NIFI-9003 Added framework support for Parameter Providers
- Added Environment Variable and File Parameter Provider implementations
- Added Parameter Provider commands to CLI
- Added component search handling for Parameter Providers
- Added documentation for integrating Parameter Providers

This closes #5369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 13:04:56 -05:00
UcanInfosec aca93ed3ce
NIFI-10464 Upgraded json-flattener from 0.13.0 to 0.14.0
This closes #6380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:03:31 -05:00
ravinarayansingh 97b8f0e205
NIFI-10435 Masked sensitive arguments in ExecuteStreamCommand
This closes #6367

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-07 21:33:57 -05:00
krisztina-zsihovszki 822c4d473a NIFI-10404 TailFile processor persistent state not cleaned up
This closes #6349.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-06 10:52:38 +02:00
Matthew Hawkins 64acd8b1c5
NIFI-2827 Adding zstd-jni to the necessary pom.xml. It's already in the LICENSE.
NIFI-2827 Update CompressContent.java to use zstd compression format
NIFI-2827 Update test cases for CompressContent.java to include zstd format
NIFI-2827 Update JsonRecordSetWriter.java to enable zstd compression format

This closes #6294

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-04 15:02:41 -04:00
UcanInfosec a22f0b6bb4
NIFI-10399 Upgraded Jolt from 0.1.1 to 0.1.7
This closes #6339

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-31 15:40:59 -05:00
exceptionfactory 4f87cd770b
NIFI-10410 Added InputRequirement annotation to ExtractGrok
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6345.
2022-08-30 15:46:14 +02:00
Emilio Setiadarma f5fee4dda3
NIFI-10344 Refactored Groovy tests in standard-processor to Java and JUnit 5
This closes #6321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 08:02:15 -05:00
exceptionfactory 8605d0a29f
NIFI-10336 Removed unnecessary lineage check from TestMonitorActivity
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6285.
2022-08-10 15:34:44 +02:00
Emilio Setiadarma 5b9f096143
NIFI-10307 Refactored nifi-standard-processors tests to use JUnit 5
This closes #6272

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:35:19 -05:00
exceptionfactory fdf3925f81
NIFI-3964 Updated Grok Patterns to support TEXT and URL Resources
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6260.
2022-08-08 14:48:21 +02:00
UcanInfosec 0fd262efca NIFI-10319 - Update pom.xml
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6270.
2022-08-05 16:42:06 -04:00
exceptionfactory 5cc2790891
NIFI-10302 Streamlined TestMonitorActivity to improve reliability
- Removed TestRunner.run() loops
- Reduced usage of Thread.sleep()
- Upgraded TestMonitorActivity to JUnit 5

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6261.
2022-08-05 10:44:26 -04:00
exceptionfactory 2d73fd5631
NIFI-10318 Corrected HandleHttpRequest TLS client authentication
- Corrected setting of wantClientAuth instead of needClientAuth based on Client Authentication configuration

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6271.
2022-08-04 14:18:10 -04:00
Emilio Setiadarma b260c10ad4
NIFI-10293 Refactored tests in nifi-jolt-transform-json-ui to use JUnit 5
This closes #6258

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-01 10:49:27 -05:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
exceptionfactory 7767a5b85d
NIFI-10265 Route to Failure on Connect Exceptions in PutDatabaseRecord
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6235
2022-07-25 09:36:54 -04:00
Eduardo Fontes c61efecbdc
NIFI-10252: Use correct field(s) for PutDatabaseRecord update keys
Not always UpdateKey comes in first position

Better readability

Include testUpdatePkNotFirst

Including usefull SQL log debug

Fix semicolon

NIFI-10252: Additional unit test for specified update keys
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6226
2022-07-25 08:48:06 -04:00
NissimShiman 74b25c7306
NIFI-10154 ReplaceText AdminYielding on long line (#6151)
* NIFI-10154 ReplaceText AdminYielding on long line

* NIFI-10154 code review changes

Signed-off-by: Otto Fowler <otto@apache.org>
2022-07-22 11:14:23 -04:00
Nandor Soma Abonyi 302bdbfb11
NIFI-10260 Changed display name and description of Validate DTD properties
- Set Allow DTD as display name in EvaluateXPath and EvaluateXQuery

This closes #6230

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-21 13:28:36 -05:00
Arpad Boda eab687ee50
NIFI-10255 Updated original relationship description on ExecuteStreamCommand
- Description of original relationship of ExecuteStreamCommand processor might be misleading

This closes #6229

Signed-off-by: David Handermann <exceptinofactory@apache.org>
2022-07-21 09:41:53 -05:00
Emilio Setiadarma cb0753b03c
NIFI-9758 Added Dynamic Properties to PutEmail
This closes #6204

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 10:58:31 -05:00
exceptionfactory 0dea0ae364
NIFI-10196 Corrected Jolt UI CSRF Header Handling
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6198
2022-07-13 15:25:16 -04:00
Paul Grey 274e4feeaa
NIFI-10143 Adjusted UTF-8 auto-detection in FTP Processors
This closes #6172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 20:00:40 -05:00
Peter Turcsanyi 1685204cc1
NIFI-10206: Restored flushBuffer() call in HandleHttpResponse to avoid HTTP 404
This closes #6186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-08 16:51:20 -05:00
exceptionfactory ea0e1b446e
NIFI-10187 Upgraded FtpServer from 1.1.1 to 1.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6171.
2022-07-01 14:24:21 +02:00
Paul Grey 26a10d772f
NIFI-10186 Corrected PutFTP Remote Path Property EL
This closes #6173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 19:12:28 -05:00
exceptionfactory 0458b6432d NIFI-10158 Corrected ListFTP expression support for Hostname and Port
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6162.
2022-06-29 22:11:11 -04:00
exceptionfactory 7a47c8cfbd
NIFI-10162 Reorganized InvokeHTTP Properties
- Corrected handling of documentation for allowable values

NIFI-10162 Updated Multipart Form-Data Name description

This closes #6163.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-29 16:52:19 -04:00
Mark Payne 39c366eeef
NIFI-10169: When using the Insert Record Fields join strategy of JoinEnrichment, ensure that in order to combine schemas from the original record and the enrichment record we use incorporateSchema() so that even when the first enrichment record is null, we get the schema correct
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6157.
2022-06-29 17:28:15 +02:00
Matthew Burgess 9d379121c4 NIFI-5005: Fix MergeRecord to honor writer's schema
This closes #6141.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-27 21:53:20 +02:00
exceptionfactory d8ebfb25d0
NIFI-10161 Added Gzip Content-Encoding to InvokeHTTP and ListenHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6150.
2022-06-26 22:23:32 +02:00
Juldrixx bc84532a8b
NIFI-9983 Add output relation name attribute in QueryRecord processor (#6011)
* NIFI-9983 Add output relation name attribute
2022-06-21 17:55:07 -04:00
greyp9 f9beb507fd
NIFI-9996 - ListFile does not list root directory when Recurse Subdirectories is active and Path Filter is specified (#6110) 2022-06-21 17:23:49 -04:00
tpalfy c08996515b
NIFI-10106 Avoid NPE in LookupRecord.createLookupCoordinates (#6111) 2022-06-21 17:03:44 -04:00
exceptionfactory 47121614a2
NIFI-10146 Upgraded Apache Tika from 2.4.0 to 2.4.1
- Removed direct dependency on metadata-extractor to inherit newer transitive version

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6140.
2022-06-21 22:58:40 +02:00
exceptionfactory bd45eb4995 NIFI-10100 Upgraded Jersey to 2.35
- Replaced individual version references with Jersey BOM dependency

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6106.
2022-06-16 23:09:22 -04:00
exceptionfactory 554f648f00
NIFI-9654 Added Queue Logging to ListenTCP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6116.
2022-06-14 15:47:38 +02:00
exceptionfactory a5bed1391e
NIFI-10098 Upgraded Apache Tika from 2.3.0 to 2.4.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6104.
2022-06-07 17:53:58 +01:00
Emilio Setiadarma 58f93d1f8b
NIFI-10085 Removed CryptoUtility.isUnlimitedStrengthCryptoSupported() and references
This closes #6098

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-06 08:49:39 -05:00
exceptionfactory 4aa0d31d9f NIFI-10088 Set SSH Transport Timeout using SFTP Data Timeout property
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6097.
2022-06-03 19:10:28 -04:00
exceptionfactory 1f9672c18b
NIFI-10075 Improved TestListSFTP configuration verification
- Changed assertVerificationSuccess() to separate testVerificationSuccessful() method
- Upgraded TestListSFTP to JUnit 5

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6092.
2022-06-02 11:36:25 +02:00
exceptionfactory 45cc3cefe5 NIFI-10069 Updated multiple components to support Sensitive Dynamic Properties
- ExecuteScript
- ExecuteStreamCommand
- InvokeScriptedProcessor
- HikariCPConnectionPool

This closes #6085.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-01 11:26:41 -04:00
exceptionfactory 99be62be67
NIFI-9958 Add Framework Support for Sensitive Dynamic Properties (#6057)
* NIFI-9958 Implemented Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties annotation for components
- Added optional sensitive query parameter to Property Descriptor REST Resource methods
- Added system tests for components supporting sensitive dynamic properties
- Updated REST Resources to support Sensitive Dynamic Property Names
- Updated Documentation Writer to indicate component support for Sensitive Dynamic Properties
- Updated InvokeHTTP to support Sensitive Dynamic Properties
- Updated Auditor components to handle masking Sensitive Dynamic Properties

* Refactored Property Descriptor REST method handling

- Corrected AbstractDocumentationWriter evaluation of support for sensitive dynamic properties
- Refactored Controller Service Dynamic Properties system tests to new class

* Updated AbstractComponentNode.getProperties() to get canonical descriptor
2022-05-23 17:20:54 -04:00
Matthew Burgess 41b3778d67
NIFI-10044: Add content viewer support for YAML
This closes #6063

Signed-off-by: David Handermann <exceptionfactory@apache.org?
2022-05-23 11:46:15 -05:00
exceptionfactory e0976f42d3 NIFI-3869 Added HTTP/2 support to ListenHTTP and HandleHttpRequest
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6048.
2022-05-19 16:21:53 -04:00
Peter Gyori 3f16a41ca1
NIFI-10010: ListenTCP adds Certificate Subject and Issuer FlowFile attributes
This closes #6032

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-13 15:48:12 -05:00
exceptionfactory 30f7c1ba1e
NIFI-9990 This closes #6030. Improved FTP 550 file unavailable handling
- Improved File Not Found reply detection
- Added Permission Denied reply handling

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-05-13 07:44:22 -07:00
exceptionfactory 0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
Mike Thomsen 7271e8cea7
NIFI-7234 Standardized on Avro 1.11.0
NIFI-7234 Replaced Jackson 1.X references with Jackson 2.X references in various classes.
NIFI-7234 Added jackson-annotations to nifi-hdfs-processors.
NIFI-7234 Various updates to bring our test cases into better alignment with the Avro specification as of 1.11.
Fixed a checkstyle issue.

NIFI-7234 Made changes requested in a review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5900
2022-04-29 17:48:59 -04:00
exceptionfactory ac2d7d1e54
NIFI-9968 Added null check before System.setProperty() in test methods
- Resolves build failures on Java 17 where the original user.timezone property returns null from System.getProperty()

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6000
2022-04-27 14:38:33 -04:00
exceptionfactory 4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries

This closes #5992

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
exceptionfactory 4b7f8cbe1f
NIFI-9949 This closes #5988. Corrected intermittent failures in TestPutSFTP
- Changed SSH server to start and stop after each method
- Replaced queued file with string FlowFile contents
- Refactored TestPutSFTP using JUnit 5

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-21 12:23:07 -07:00
exceptionfactory b288810316
NIFI-9943 Added Transform Provider to nifi-xml-processing
- Refactored TransformerFactory references using StandardTransformerProvider

This closes #5986
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 15:14:54 -04:00
exceptionfactory 1e345db649
NIFI-9942 Removed load test from TestPutUDP
- Refactored TestPutUDP using JUnit 5
- Standardized test method naming

This closes #5984
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 09:45:00 -04:00
exceptionfactory e98b68cc3a
NIFI-9939 Upgraded SSHJ from 0.32.0 to 0.33.0
- Removed PatchedSFTPEngine with resolution of SFTP renaming in SSHJ 0.33.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5982.
2022-04-20 15:21:22 +02:00
Paul Grey 0a94762119
NIFI-9925 Adjust PutUDP and SNMP tests to run without preferring IPv4
This closes #5976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-19 14:13:00 -05:00
exceptionfactory ecf0a93124
NIFI-9935 Upgraded Zip4j from 2.9.1 to 2.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5975.
2022-04-19 09:36:29 +02:00
Paul Grey 4310df0544
NIFI-9924 Corrected text encoding in PutEmail filenames and TestFTP
This closes #5967

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-14 14:58:22 -05:00
exceptionfactory 15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services

This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
Mark Payne 05f3d7510f
NIFI-9903: This closes #5955. When using the 'success' relationship only for LookupRecord, lookup all records until a match is found, in order to determine the resultant schema. Refactored code to eliminate AbstractRouteRecord, because LookupRecord is the last processor that extended from it. Refactored code to use an inner interface to clean up code.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-13 13:49:26 -07:00
Joe Witt 873d25585c
NIFI-9780 Merge branch 'NIFI-9780-RC3' 2022-04-04 08:35:23 -07:00
exceptionfactory cf21bc47cd NIFI-9844 Refactored Encryptor tests using JUnit 5
- Refactored Keyed and Password Based Encryptor tests from Groovy to Java

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5913.
2022-03-29 17:53:13 -04:00
Nathan Gough 2a6e521549
NIFI-9702 ListSFTP will set mime.type when Record Writer configured
This closes #5891

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 16:03:00 -05:00
Peter Gyori 6ade47ac4f
NIFI-9838: Added Client Certificate attributes to ListenTCPRecord FlowFiles
This closes #5908

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 13:36:16 -05:00
Emilio Setiadarma 9566d3fa78
NIFI-9841 Improved Encryptor test reliability
- Changed expected exception to ProcessException in KeyedEncryptorGroovyTest and PasswordBasedEncryptorGroovyTest to avoid intermittent failures

This closes #5911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 13:28:28 -05:00
Nathan Gough 2fbe10b4bc
NIFI-9701 - Corrected No Tracking strategy to create one flow file when using a Record Writer
- Corrected No Tracking strategy Record Writer handling for ListSFTP
- Updated temporary test files to have last modified time of epoch to avoid intermittent issue with Minimum Age filtering
- Refactored MockCacheService to separate reusable class

This closes #5885

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 12:47:30 -05:00
Mark Payne 63f02c99bf
NIFI-9835: Fixed threading bug in which NioAsyncLoadBalanceClient calls LoadBalanceSession.isComplete() followed by LoadBalanceSession.isCanceled() but it's possible for the complete flag to change before the canceled flag (they are not updated atomically). So changed to use a single LoadBalanceSessionState enum that represents the state. Also made the private StandardProcessSession.commit(boolean) method synchronized. When a processor is terminated (as is the case in Offload), we roll back sessions and both the commit() and rollback() need to be synchronized. Only the public commit() method was synchronized, and now with commitAsync() happening, we had the ability to commit without any synchronization. This addresses that concern. Also fixed a typo in docs for MergeRecord.
This closes #5902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-25 12:42:03 -05:00
Marcus Ely 72435c3c6d
NIFI-8124 Added Cookie Strategy property to InvokeHTTP
This closes #5887

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-23 15:55:40 -05:00
Emilio Setiadarma 772adbc709
NIFI-1468 Added tests to handle invalid cipher streams missing Salt/IV
- Updated PasswordBasedEncryptorGroovyTest and KeyedEncryptorGroovyTest

This closes #5877

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-23 13:30:15 -05:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Matthew Burgess c84f438782
NIFI-9800: Unwrap SQLException in PutDatabaseRecord when table does not exist
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5871
2022-03-21 14:00:13 -04:00
Mike Thomsen 2bb1a06a8c
NIFI-9788 Updated commons-codec to 1.15 across all modules.
This closes #5881

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-21 09:13:05 -05:00
exceptionfactory 412e21be97
NIFI-9281 Enabled building on Java 17
- Added Ubuntu Zulu JDK 17 GitHub build
- Adjusted MiNiFi C2 FileSystemConfigurationCache test to avoid using environment variables
- Adjusted MiNiFi StatusLogger and StatusLoggerTest to avoid overriding private logger
- Adjusted failure reason attribute check in TestGetIgniteCache
- Adjusted TestRangerAuthorizer and TestRangerNiFiAuthorizer to avoid checking nested exceptions
- Adjusted encrypt-config TestUtil to avoid unnecessary comparison of different types
- Disabled Javascript tests on Java 15 and higher
- Disabled several Hive 3 tests on Java 17 for StringInternUtils illegal access
- Refactored nifi-enrich-processors tests to use Mockito without Powermock
- Refactored nifi-toolkit-tls tests to avoid illegal reflective access
- Removed deprecated X509Certificate test in CertificateUtilsTest
- Removed kryo serialization from nifi-site-to-site-client test
- Updated TestHashContent to use SHA-1 instead of SHA for hash algorithm
- Upgraded maven-war-plugin from 2.5 to 3.3.2
- Upgraded nifi-graph-bundle dependencies from Groovy 2.5.14 to 3.0.8
- Upgraded QuestDB from 4.2.1 to 6.2.1 in nifi-framework-core

This closes #5870

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:08:38 -04:00
Mike Thomsen df00cc6cb5
NIFI-6047 Cleaned up code to allow tests to run against 1.13.0-snapshot
Removed DMC.
NIFI-6047 Started integrating changes from NIFI-6014.
NIFI-6047 Added DMC tests.
NIFI-6047 Added cache identifier recordpath test.
NIFI-6047 Added additional details.
NIFI-6047 Removed old additional details.
NIFI-6047 made some changes requested in a follow up review.
NIFI-6047 latest.
NIFI-6047 Finished updates
First round of code review cleanup
Latest
Removed EL from the dynamic properties.
Finished code review requested refactoring.
Checkstyle fix.
Removed a Java 11 API
NIFI-6047 Renamed processor to DeduplicateRecord

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4646
2022-03-09 19:06:44 -05:00