Commit Graph

1052 Commits

Author SHA1 Message Date
exceptionfactory 2cdb0fb6a3 NIFI-8088 Removed deprecation warning log for PKCS12 trust stores
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4727.
2021-01-26 16:50:33 -05:00
Peter Turcsanyi 67d06003b7 NIFI-8023: Convert java.sql.Date between UTC/local time zone normalized forms before/after database operations
This closes #4781

Signed-off-by: David Handermann <exceptionfactory@gmail.com>
2021-01-26 14:39:02 -06:00
exceptionfactory 8c49f0688b
NIFI-7243 Upgraded com.hierynomus.sshj to 0.30.0 to resolve authentication race condition in version 0.27.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4774.
2021-01-21 21:21:47 +04:00
Matthew Burgess fb2a8b5820
NIFI-8043: Quote update key column names in PutDatabaseRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4772.
2021-01-21 11:17:13 +04:00
Mark Payne 803ba882aa
NIFI-8146: Ensure that we close the Connection/Statement/PreparedStatement objects in finally blocks or try-with-resources
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4770
2021-01-20 13:48:57 -05:00
Mark Payne 25ab050ed7
NIFI-8149: Updated Apache Calcite version from 1.21.0 to 1.26.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4765.
2021-01-20 13:04:08 +04:00
Mark Payne 930e8d9e0e
NIFI-7698: Added a merge.reason attribute for flowfiles indicating why they were merged by MergeContent. Also updated logs to indicate the reason and added additional documentation for processor
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4764
2021-01-19 17:20:06 -05:00
Mark Payne f02079c2fa
NIFI-8146: Added RecordPath for Statement Type and to specify where to find the data within the incoming Record. Also performed some minor code refactoring to avoid lots of large lambdas, as it results in code that is more readable and more maintainable. Updated some properties to use dependsOn() notation now that this is available.
NIFI-8146: Updated PutDatabaseRecord to avoid using the functional style framework that had previously been used. Doing so resulted in code that was difficult to understand and maintain. Added additional unit tests and improved MockRecordParser so that it could throw configurable types of exceptions

NIFI-8146: Fixed checkstyle issues

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4763
2021-01-19 13:23:54 -05:00
Mark Payne 097edf4f7c
NIFI-8136: Added getState/setState/replaceState/clearState methods to ProcessSession, updated processors to use these methods instead of StateManager version where appropriate
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4757
2021-01-15 10:02:09 -05:00
Matthew Burgess 382439c1d0 NIFI-7973: Add default precision and scale properties to remaining SQL-based components
This closes #4682.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-13 08:41:12 -05:00
exceptionfactory d41f2e1d0a NIFI-8121 Updated ListenHTTP with inferred Client Authentication Policy
- Added default property value for automatic determination of Client Authentication Policy based on SSLContextService Trust Store properties
- Added new ClientAuthentication enum with values specific to ListenHTTP

This closes #4749.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-11 18:02:09 +01:00
exceptionfactory a4027e8e77 NIFI-8120 Added RuntimeException handling on HttpContextMap.complete()
NIFI-8120 Renamed exception variable and reordered log statements

This closes #4747.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-08 17:13:10 +00:00
exceptionfactory 817f621d6f NIFI-8096 Deprecated ClientAuth references in SSLContextService
- Added SSLContextService.createContext() and refactored referencing components
- Removed references to ClientAuth from SslContextFactory methods

This closes #4737.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-06 16:24:26 -05:00
tlsmith 7214dc0f85 NIFI-6242 PutFileTransfer generating incorrect provenance event 2021-01-06 12:10:20 -05:00
Otto Fowler ceb9dff3b9
NIFI-7761 Allow HandleHttpRequest to add specified form data to FlowFile attributes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4513.
2021-01-05 09:42:41 +01:00
exceptionfactory e7c6bdad42 NIFI-7937 Added StandardFlowFileMediaType enum to replace string references to FlowFile Media Types 2021-01-04 14:20:05 -05:00
Kevin Barranco 0f667cb4f3 MonitorActivity THRESHOLD to use Variables
When using MonitorActivity, it would be interesting to use variables in "Threshold Duration", which will help maintain Version Control in ProcessGroups (Avoiding "breaking" versions when including the value manually). 

I've included the option expressionLanguageSupported(ExpressionLanguageScope.VARIABLE_REGISTRY), so we can use variables in "Threshold Duration".
2021-01-04 14:14:29 -05:00
tlsmith 112b893bf2 NIFI-7225 FetchSFTP processor routing to not.found error given when Private Key Path property is invalid 2021-01-04 13:41:03 -05:00
Denes Arvay 31c5dc5ab4 NIFI-8102 TailFile can skip characters if tailing a file on NFS mount
- Force the TailFile processor to recreate and reposition the reader
  by setting it to null in case of a NulCharacterEncounteredException
- Updated the TestTailFile.testNULContent() to not initialize the
  processor when calling the second run()

Update the reader's position instead of abandoning it.

This closes #4736.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2020-12-18 14:20:41 -05:00
Tamas Palfy 989287adaf
NIFI-8027 In AbstractExecuteSQL make 'SQL Pre-Query' and 'SQL Post-Query' properties support escaping semicolons to allow them be part of statements.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4732
2020-12-16 14:57:59 -05:00
exceptionfactory 28ca7478d6 NIFI-8019 Added TlsPlatform to provide runtime TLS protocol configuration
NIFI-8019 Renamed getDefaultProtocols() to getSupportedProtocols()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
2020-12-14 19:34:58 -05:00
exceptionfactory 5bcb5abc86 NIFI-1930 Updated ListenHTTP to set TLS included protocols based on SSLContextService
NIFI-1930 Removed unused import in SSLContextServiceTest

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
2020-12-14 14:31:08 -05:00
Mike Thomsen 8e4948322e
NIFI-8074 Switched ReplaceText to use line by line evaluation as its default evaluation mode.
This closes #4711

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-10 10:30:11 -05:00
Matthew Burgess 405c393cb5
NIFI-8031: Add UPSERT capability for MySQL in PutDatabaseRecord
This closes #4678

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-07 08:51:07 -05:00
Matthew Burgess 71d5162965
NIFI-6878: Added 'Use statement.type Attribute' to ConvertJSONToSQL
This closes #3893

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-04 07:39:08 -05:00
Mark Payne 29ea872f2c
NIFI-8042: Fixed bug that was escaping Expression Language references for use in a Regular Expression (i.e., Pattern.quote) even though it wasn't being used in a Regular Expression
This closes #4685

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-04 07:30:09 -05:00
Bence Simon 39f8a008d4 NIFI-8039 Adding properties to ListenTCP in order to allow refine behaviour under higher load; Refining thread pool for better scalability
NIFI-8039 Review findings; refining thread pool to be able to scale down properly when not under load
NIFI-8039 Answers to PR comments

This closes #4689.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-11-30 10:17:15 +01:00
Matthew Burgess fe950131c3 NIFI-8046: Fix issue with ResultSetRecordSet on DB2
This closes #8046.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-11-27 19:23:44 +01:00
Mark Payne 3c9d8a7007
NIFI-7897: Refactoring to create a new nifi-framework-components module.
- Refactored nifi-stateless to make use of nifi-framework-components
- Removed requirement for nifi-framework-nar to be provided.
- Refactored stateless nifi into api, engine, nar, and bootstrap modules, with a parent 'bundle' module
- Creation of nifi-stateless-system-tests
- Added unit tests and logging
- Changed flow configuration to use properties file instead of json
- Allow for -p parameter to specify parameters on command line
- Moved implementations of Authorizer, NiFiUser, and UserGroupProviders to new module named nifi-framework-authorization-providers so that those that depend on nifi-framework-authorization don't have to bring in the providers. This way, we can have stateless not bring in those providers, as we otherwise get warnings on startup about the provider already being registered. Additionally, it avoids needing dependencies on spring-security-core
- Updated bin/nifi.sh script to run new stateless bootstrap
- Added Reporting Tasks to stateless.
- Download bundles as necessary on stateless nifi startup

NIFI-7897: Addressing review feedback

NIFI-7897: Fixed typos in README and also addressed issue that caused parameters with spaces not to be parsed properly

This closes #4669.

Signed-off-by: Bryan Bende <bbende@apache.org>
2020-11-24 11:37:45 -05:00
Tamas Palfy 4aaec5aa38
NIFI-8020 Make sure TailFile doesn't leave FileChannel open when handling NUL characters
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4671.
2020-11-18 00:26:27 +01:00
r65535 d5dc63ded9
NIFI-7982 Added tags to FlattenJSON processor
Adding missing imports

This closes #4662

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-11-17 07:05:52 -05:00
Tamas Palfy 47cc2867ba NIFI-7972 Add a boolean property by which the user can tell the processor to yield (and try again later) whenever it encounters a NUL character. 2020-11-16 15:16:12 -05:00
Denes Arvay 83948db989
NIFI-7996 Conversion with ConvertRecord to avro results in invalid date
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4666.
2020-11-16 17:40:40 +01:00
Peter Gyori e66362194d NIFI-7922: Added support for GET in ListenHTTP for health check
NIFI-7922: Fixes based on review comments

ListenHTTP: changed if(!sslRequired) to if(sslRequired) so that the positive case comes first.
HealthCheckServlet: response body for GET contains "OK".
ContentAcknowledgmentServlet: super.doDelete() is called when a DELETE should be rejected because of port mismatch.

NIFI-7922: Refactored, based on review comments

NIFI-7922: Fixed a checkstyle violation (organized the imports)

This closes #4603.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-11-16 12:20:30 +01:00
Peter Turcsanyi 018778a25d NIFI-7994: Fixed ReplaceText concurrency issue
Moving RegexReplace.additionalAttrs field to local variable in replace() method.
Concurrent usage of the additionalAttrs map caused data corruption.
2020-11-12 10:45:10 -05:00
Pierre Villard 14ec02f21d
NIFI-7981 - add support for enum type in avro schema
This closes #4648

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-11-05 18:19:55 -05:00
Bence Simon 59e00c4b6f NIFI-7959 Handling node disconnection in MonitorActivity processor
- Make reporting in clustered scope to dependent of expected cluster state in order to prevent unexpected flow file emission

This closes #4642.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2020-11-04 10:09:46 -05:00
Mark Payne 4b9014b959
NIFI-1121: Updated backend to perform appropriate validation. Added tests. Updated documentation writer. Updated dev guide to explain how PropertyDescriptor.Builder#dependsOn affects validation. Updated JavaDocs for PropertyDescriptor.Builder#dependsOn
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-11-03 15:37:42 -05:00
mtien 535cab3167
NIFI-1121: Added an additional check for hidden properties to account for transitive dependent properties.
- Added a 'dependent' attribute to determine whether or not to save dependent property values

Co-authored-by: Scott Aslan <scottyaslan@gmail.com>
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-11-03 15:37:33 -05:00
Mark Payne e2e901b6b9
NIFI-1121: Added property dependencies to MergeContent
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-11-03 15:37:26 -05:00
Mark Payne f7f336a4b0
NIFI-1121: Added API changes for having one Property depend on another
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-11-03 15:37:08 -05:00
r65535 d8d9aa9cec Added regex support for attribute header selection on HandleHTTPResponse 2020-11-03 12:22:41 -05:00
Denes Arvay d05d0c6240 NIFI-7925: ValidateRecord reports false positive for avro arrays with null elements 2020-10-21 09:17:29 -04:00
Dan Kim 5b5b9a7800
NIFI-7916 refactor CountText to ignore whitespace words when counting
This closes #4595

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-14 09:09:42 -04:00
Matthew Burgess 4c235f0405
NIFI-7909: Change DataTypeUtils.toInteger() to use Math.toIntExact()
This closes #4596

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-12 17:53:27 -04:00
Peter Gyori 668c278e30
NIFI-7815: Enhance the logging in MergeContent processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4534.
2020-10-08 11:44:52 +02:00
exceptionfactory efb629e37d
NIFI-7777 Removed support for Expression Language from Password property
Added unit test for no password configured on Zip files

This closes #4572.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-10-07 10:59:50 -07:00
exceptionfactory ea6b01159d
NIFI-7777 Added optional Password property to UnpackContent for decrypting Zip archives
This closes #4572.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-10-07 10:56:23 -07:00
Denes Arvay 6990f0d3a9
NIFI-7685: Add UTF8 support for FetchFTP
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4446
2020-10-01 17:35:46 -04:00
Mike Thomsen a66c3d8168
NIFI-2580 Added a little explanation note about a common issue new users face with jsonpath.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4561.
2020-09-30 14:15:07 +02:00