Commit Graph

1185 Commits

Author SHA1 Message Date
Nandor Soma Abonyi 302bdbfb11
NIFI-10260 Changed display name and description of Validate DTD properties
- Set Allow DTD as display name in EvaluateXPath and EvaluateXQuery

This closes #6230

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-21 13:28:36 -05:00
Arpad Boda eab687ee50
NIFI-10255 Updated original relationship description on ExecuteStreamCommand
- Description of original relationship of ExecuteStreamCommand processor might be misleading

This closes #6229

Signed-off-by: David Handermann <exceptinofactory@apache.org>
2022-07-21 09:41:53 -05:00
Emilio Setiadarma cb0753b03c
NIFI-9758 Added Dynamic Properties to PutEmail
This closes #6204

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 10:58:31 -05:00
Paul Grey 274e4feeaa
NIFI-10143 Adjusted UTF-8 auto-detection in FTP Processors
This closes #6172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 20:00:40 -05:00
Peter Turcsanyi 1685204cc1
NIFI-10206: Restored flushBuffer() call in HandleHttpResponse to avoid HTTP 404
This closes #6186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-08 16:51:20 -05:00
exceptionfactory ea0e1b446e
NIFI-10187 Upgraded FtpServer from 1.1.1 to 1.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6171.
2022-07-01 14:24:21 +02:00
Paul Grey 26a10d772f
NIFI-10186 Corrected PutFTP Remote Path Property EL
This closes #6173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 19:12:28 -05:00
exceptionfactory 0458b6432d NIFI-10158 Corrected ListFTP expression support for Hostname and Port
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6162.
2022-06-29 22:11:11 -04:00
exceptionfactory 7a47c8cfbd
NIFI-10162 Reorganized InvokeHTTP Properties
- Corrected handling of documentation for allowable values

NIFI-10162 Updated Multipart Form-Data Name description

This closes #6163.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-29 16:52:19 -04:00
Mark Payne 39c366eeef
NIFI-10169: When using the Insert Record Fields join strategy of JoinEnrichment, ensure that in order to combine schemas from the original record and the enrichment record we use incorporateSchema() so that even when the first enrichment record is null, we get the schema correct
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6157.
2022-06-29 17:28:15 +02:00
Matthew Burgess 9d379121c4 NIFI-5005: Fix MergeRecord to honor writer's schema
This closes #6141.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-27 21:53:20 +02:00
exceptionfactory d8ebfb25d0
NIFI-10161 Added Gzip Content-Encoding to InvokeHTTP and ListenHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6150.
2022-06-26 22:23:32 +02:00
Juldrixx bc84532a8b
NIFI-9983 Add output relation name attribute in QueryRecord processor (#6011)
* NIFI-9983 Add output relation name attribute
2022-06-21 17:55:07 -04:00
greyp9 f9beb507fd
NIFI-9996 - ListFile does not list root directory when Recurse Subdirectories is active and Path Filter is specified (#6110) 2022-06-21 17:23:49 -04:00
tpalfy c08996515b
NIFI-10106 Avoid NPE in LookupRecord.createLookupCoordinates (#6111) 2022-06-21 17:03:44 -04:00
exceptionfactory 554f648f00
NIFI-9654 Added Queue Logging to ListenTCP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6116.
2022-06-14 15:47:38 +02:00
Emilio Setiadarma 58f93d1f8b
NIFI-10085 Removed CryptoUtility.isUnlimitedStrengthCryptoSupported() and references
This closes #6098

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-06 08:49:39 -05:00
exceptionfactory 4aa0d31d9f NIFI-10088 Set SSH Transport Timeout using SFTP Data Timeout property
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6097.
2022-06-03 19:10:28 -04:00
exceptionfactory 1f9672c18b
NIFI-10075 Improved TestListSFTP configuration verification
- Changed assertVerificationSuccess() to separate testVerificationSuccessful() method
- Upgraded TestListSFTP to JUnit 5

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6092.
2022-06-02 11:36:25 +02:00
exceptionfactory 45cc3cefe5 NIFI-10069 Updated multiple components to support Sensitive Dynamic Properties
- ExecuteScript
- ExecuteStreamCommand
- InvokeScriptedProcessor
- HikariCPConnectionPool

This closes #6085.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-01 11:26:41 -04:00
exceptionfactory 99be62be67
NIFI-9958 Add Framework Support for Sensitive Dynamic Properties (#6057)
* NIFI-9958 Implemented Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties annotation for components
- Added optional sensitive query parameter to Property Descriptor REST Resource methods
- Added system tests for components supporting sensitive dynamic properties
- Updated REST Resources to support Sensitive Dynamic Property Names
- Updated Documentation Writer to indicate component support for Sensitive Dynamic Properties
- Updated InvokeHTTP to support Sensitive Dynamic Properties
- Updated Auditor components to handle masking Sensitive Dynamic Properties

* Refactored Property Descriptor REST method handling

- Corrected AbstractDocumentationWriter evaluation of support for sensitive dynamic properties
- Refactored Controller Service Dynamic Properties system tests to new class

* Updated AbstractComponentNode.getProperties() to get canonical descriptor
2022-05-23 17:20:54 -04:00
exceptionfactory e0976f42d3 NIFI-3869 Added HTTP/2 support to ListenHTTP and HandleHttpRequest
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6048.
2022-05-19 16:21:53 -04:00
Peter Gyori 3f16a41ca1
NIFI-10010: ListenTCP adds Certificate Subject and Issuer FlowFile attributes
This closes #6032

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-13 15:48:12 -05:00
exceptionfactory 30f7c1ba1e
NIFI-9990 This closes #6030. Improved FTP 550 file unavailable handling
- Improved File Not Found reply detection
- Added Permission Denied reply handling

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-05-13 07:44:22 -07:00
Mike Thomsen 7271e8cea7
NIFI-7234 Standardized on Avro 1.11.0
NIFI-7234 Replaced Jackson 1.X references with Jackson 2.X references in various classes.
NIFI-7234 Added jackson-annotations to nifi-hdfs-processors.
NIFI-7234 Various updates to bring our test cases into better alignment with the Avro specification as of 1.11.
Fixed a checkstyle issue.

NIFI-7234 Made changes requested in a review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5900
2022-04-29 17:48:59 -04:00
exceptionfactory ac2d7d1e54
NIFI-9968 Added null check before System.setProperty() in test methods
- Resolves build failures on Java 17 where the original user.timezone property returns null from System.getProperty()

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6000
2022-04-27 14:38:33 -04:00
exceptionfactory 4b7f8cbe1f
NIFI-9949 This closes #5988. Corrected intermittent failures in TestPutSFTP
- Changed SSH server to start and stop after each method
- Replaced queued file with string FlowFile contents
- Refactored TestPutSFTP using JUnit 5

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-21 12:23:07 -07:00
exceptionfactory b288810316
NIFI-9943 Added Transform Provider to nifi-xml-processing
- Refactored TransformerFactory references using StandardTransformerProvider

This closes #5986
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 15:14:54 -04:00
exceptionfactory 1e345db649
NIFI-9942 Removed load test from TestPutUDP
- Refactored TestPutUDP using JUnit 5
- Standardized test method naming

This closes #5984
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 09:45:00 -04:00
exceptionfactory e98b68cc3a
NIFI-9939 Upgraded SSHJ from 0.32.0 to 0.33.0
- Removed PatchedSFTPEngine with resolution of SFTP renaming in SSHJ 0.33.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5982.
2022-04-20 15:21:22 +02:00
Paul Grey 0a94762119
NIFI-9925 Adjust PutUDP and SNMP tests to run without preferring IPv4
This closes #5976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-19 14:13:00 -05:00
exceptionfactory ecf0a93124
NIFI-9935 Upgraded Zip4j from 2.9.1 to 2.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5975.
2022-04-19 09:36:29 +02:00
Paul Grey 4310df0544
NIFI-9924 Corrected text encoding in PutEmail filenames and TestFTP
This closes #5967

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-14 14:58:22 -05:00
exceptionfactory 15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services

This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
Mark Payne 05f3d7510f
NIFI-9903: This closes #5955. When using the 'success' relationship only for LookupRecord, lookup all records until a match is found, in order to determine the resultant schema. Refactored code to eliminate AbstractRouteRecord, because LookupRecord is the last processor that extended from it. Refactored code to use an inner interface to clean up code.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-13 13:49:26 -07:00
Joe Witt 873d25585c
NIFI-9780 Merge branch 'NIFI-9780-RC3' 2022-04-04 08:35:23 -07:00
exceptionfactory cf21bc47cd NIFI-9844 Refactored Encryptor tests using JUnit 5
- Refactored Keyed and Password Based Encryptor tests from Groovy to Java

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5913.
2022-03-29 17:53:13 -04:00
Nathan Gough 2a6e521549
NIFI-9702 ListSFTP will set mime.type when Record Writer configured
This closes #5891

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 16:03:00 -05:00
Peter Gyori 6ade47ac4f
NIFI-9838: Added Client Certificate attributes to ListenTCPRecord FlowFiles
This closes #5908

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 13:36:16 -05:00
Emilio Setiadarma 9566d3fa78
NIFI-9841 Improved Encryptor test reliability
- Changed expected exception to ProcessException in KeyedEncryptorGroovyTest and PasswordBasedEncryptorGroovyTest to avoid intermittent failures

This closes #5911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 13:28:28 -05:00
Nathan Gough 2fbe10b4bc
NIFI-9701 - Corrected No Tracking strategy to create one flow file when using a Record Writer
- Corrected No Tracking strategy Record Writer handling for ListSFTP
- Updated temporary test files to have last modified time of epoch to avoid intermittent issue with Minimum Age filtering
- Refactored MockCacheService to separate reusable class

This closes #5885

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 12:47:30 -05:00
Mark Payne 63f02c99bf
NIFI-9835: Fixed threading bug in which NioAsyncLoadBalanceClient calls LoadBalanceSession.isComplete() followed by LoadBalanceSession.isCanceled() but it's possible for the complete flag to change before the canceled flag (they are not updated atomically). So changed to use a single LoadBalanceSessionState enum that represents the state. Also made the private StandardProcessSession.commit(boolean) method synchronized. When a processor is terminated (as is the case in Offload), we roll back sessions and both the commit() and rollback() need to be synchronized. Only the public commit() method was synchronized, and now with commitAsync() happening, we had the ability to commit without any synchronization. This addresses that concern. Also fixed a typo in docs for MergeRecord.
This closes #5902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-25 12:42:03 -05:00
Marcus Ely 72435c3c6d
NIFI-8124 Added Cookie Strategy property to InvokeHTTP
This closes #5887

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-23 15:55:40 -05:00
Emilio Setiadarma 772adbc709
NIFI-1468 Added tests to handle invalid cipher streams missing Salt/IV
- Updated PasswordBasedEncryptorGroovyTest and KeyedEncryptorGroovyTest

This closes #5877

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-23 13:30:15 -05:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Matthew Burgess c84f438782
NIFI-9800: Unwrap SQLException in PutDatabaseRecord when table does not exist
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5871
2022-03-21 14:00:13 -04:00
Mike Thomsen 2bb1a06a8c
NIFI-9788 Updated commons-codec to 1.15 across all modules.
This closes #5881

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-21 09:13:05 -05:00
exceptionfactory 412e21be97
NIFI-9281 Enabled building on Java 17
- Added Ubuntu Zulu JDK 17 GitHub build
- Adjusted MiNiFi C2 FileSystemConfigurationCache test to avoid using environment variables
- Adjusted MiNiFi StatusLogger and StatusLoggerTest to avoid overriding private logger
- Adjusted failure reason attribute check in TestGetIgniteCache
- Adjusted TestRangerAuthorizer and TestRangerNiFiAuthorizer to avoid checking nested exceptions
- Adjusted encrypt-config TestUtil to avoid unnecessary comparison of different types
- Disabled Javascript tests on Java 15 and higher
- Disabled several Hive 3 tests on Java 17 for StringInternUtils illegal access
- Refactored nifi-enrich-processors tests to use Mockito without Powermock
- Refactored nifi-toolkit-tls tests to avoid illegal reflective access
- Removed deprecated X509Certificate test in CertificateUtilsTest
- Removed kryo serialization from nifi-site-to-site-client test
- Updated TestHashContent to use SHA-1 instead of SHA for hash algorithm
- Upgraded maven-war-plugin from 2.5 to 3.3.2
- Upgraded nifi-graph-bundle dependencies from Groovy 2.5.14 to 3.0.8
- Upgraded QuestDB from 4.2.1 to 6.2.1 in nifi-framework-core

This closes #5870

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:08:38 -04:00
Mike Thomsen df00cc6cb5
NIFI-6047 Cleaned up code to allow tests to run against 1.13.0-snapshot
Removed DMC.
NIFI-6047 Started integrating changes from NIFI-6014.
NIFI-6047 Added DMC tests.
NIFI-6047 Added cache identifier recordpath test.
NIFI-6047 Added additional details.
NIFI-6047 Removed old additional details.
NIFI-6047 made some changes requested in a follow up review.
NIFI-6047 latest.
NIFI-6047 Finished updates
First round of code review cleanup
Latest
Removed EL from the dynamic properties.
Finished code review requested refactoring.
Checkstyle fix.
Removed a Java 11 API
NIFI-6047 Renamed processor to DeduplicateRecord

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4646
2022-03-09 19:06:44 -05:00