Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-09 19:45:09 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,460 Commits 147 Branches 203 Tags
Commit Graph

1035 Commits

Author SHA1 Message Date
Peter Turcsanyi
67d06003b7 NIFI-8023: Convert java.sql.Date between UTC/local time zone normalized forms before/after database operations 
This closes #4781

Signed-off-by: David Handermann <exceptionfactory@gmail.com>
 2021-01-26 14:39:02 -06:00
Matthew Burgess
fb2a8b5820
NIFI-8043: Quote update key column names in PutDatabaseRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4772.
 2021-01-21 11:17:13 +04:00
Mark Payne
803ba882aa
NIFI-8146: Ensure that we close the Connection/Statement/PreparedStatement objects in finally blocks or try-with-resources 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4770
 2021-01-20 13:48:57 -05:00
Mark Payne
930e8d9e0e
NIFI-7698: Added a merge.reason attribute for flowfiles indicating why they were merged by MergeContent. Also updated logs to indicate the reason and added additional documentation for processor 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4764
 2021-01-19 17:20:06 -05:00
Mark Payne
f02079c2fa
NIFI-8146: Added RecordPath for Statement Type and to specify where to find the data within the incoming Record. Also performed some minor code refactoring to avoid lots of large lambdas, as it results in code that is more readable and more maintainable. Updated some properties to use dependsOn() notation now that this is available. 
NIFI-8146: Updated PutDatabaseRecord to avoid using the functional style framework that had previously been used. Doing so resulted in code that was difficult to understand and maintain. Added additional unit tests and improved MockRecordParser so that it could throw configurable types of exceptions

NIFI-8146: Fixed checkstyle issues

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4763
 2021-01-19 13:23:54 -05:00
Mark Payne
097edf4f7c
NIFI-8136: Added getState/setState/replaceState/clearState methods to ProcessSession, updated processors to use these methods instead of StateManager version where appropriate 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4757
 2021-01-15 10:02:09 -05:00
Matthew Burgess
382439c1d0 NIFI-7973: Add default precision and scale properties to remaining SQL-based components 
This closes #4682.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-13 08:41:12 -05:00
exceptionfactory
d41f2e1d0a NIFI-8121 Updated ListenHTTP with inferred Client Authentication Policy 
- Added default property value for automatic determination of Client Authentication Policy based on SSLContextService Trust Store properties
- Added new ClientAuthentication enum with values specific to ListenHTTP

This closes #4749.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-11 18:02:09 +01:00
exceptionfactory
a4027e8e77 NIFI-8120 Added RuntimeException handling on HttpContextMap.complete() 
NIFI-8120 Renamed exception variable and reordered log statements

This closes #4747.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-08 17:13:10 +00:00
exceptionfactory
817f621d6f NIFI-8096 Deprecated ClientAuth references in SSLContextService 
- Added SSLContextService.createContext() and refactored referencing components
- Removed references to ClientAuth from SslContextFactory methods

This closes #4737.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-06 16:24:26 -05:00
tlsmith
7214dc0f85 NIFI-6242 PutFileTransfer generating incorrect provenance event 2021-01-06 12:10:20 -05:00
Otto Fowler
ceb9dff3b9
NIFI-7761 Allow HandleHttpRequest to add specified form data to FlowFile attributes 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4513.
 2021-01-05 09:42:41 +01:00
exceptionfactory
e7c6bdad42 NIFI-7937 Added StandardFlowFileMediaType enum to replace string references to FlowFile Media Types 2021-01-04 14:20:05 -05:00
Kevin Barranco
0f667cb4f3 MonitorActivity THRESHOLD to use Variables 
When using MonitorActivity, it would be interesting to use variables in "Threshold Duration", which will help maintain Version Control in ProcessGroups (Avoiding "breaking" versions when including the value manually). 

I've included the option expressionLanguageSupported(ExpressionLanguageScope.VARIABLE_REGISTRY), so we can use variables in "Threshold Duration".
 2021-01-04 14:14:29 -05:00
tlsmith
112b893bf2 NIFI-7225 FetchSFTP processor routing to not.found error given when Private Key Path property is invalid 2021-01-04 13:41:03 -05:00
Denes Arvay
31c5dc5ab4 NIFI-8102 TailFile can skip characters if tailing a file on NFS mount 
- Force the TailFile processor to recreate and reposition the reader
  by setting it to null in case of a NulCharacterEncounteredException
- Updated the TestTailFile.testNULContent() to not initialize the
  processor when calling the second run()

Update the reader's position instead of abandoning it.

This closes #4736.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2020-12-18 14:20:41 -05:00
Tamas Palfy
989287adaf
NIFI-8027 In AbstractExecuteSQL make 'SQL Pre-Query' and 'SQL Post-Query' properties support escaping semicolons to allow them be part of statements. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4732
 2020-12-16 14:57:59 -05:00
exceptionfactory
28ca7478d6 NIFI-8019 Added TlsPlatform to provide runtime TLS protocol configuration 
NIFI-8019 Renamed getDefaultProtocols() to getSupportedProtocols()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
 2020-12-14 19:34:58 -05:00
exceptionfactory
5bcb5abc86 NIFI-1930 Updated ListenHTTP to set TLS included protocols based on SSLContextService 
NIFI-1930 Removed unused import in SSLContextServiceTest

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
 2020-12-14 14:31:08 -05:00
Mike Thomsen
8e4948322e
NIFI-8074 Switched ReplaceText to use line by line evaluation as its default evaluation mode. 
This closes #4711

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-12-10 10:30:11 -05:00
Matthew Burgess
405c393cb5
NIFI-8031: Add UPSERT capability for MySQL in PutDatabaseRecord 
This closes #4678

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-12-07 08:51:07 -05:00
Matthew Burgess
71d5162965
NIFI-6878: Added 'Use statement.type Attribute' to ConvertJSONToSQL 
This closes #3893

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-12-04 07:39:08 -05:00
Mark Payne
29ea872f2c
NIFI-8042: Fixed bug that was escaping Expression Language references for use in a Regular Expression (i.e., Pattern.quote) even though it wasn't being used in a Regular Expression 
This closes #4685

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-12-04 07:30:09 -05:00
Bence Simon
39f8a008d4 NIFI-8039 Adding properties to ListenTCP in order to allow refine behaviour under higher load; Refining thread pool for better scalability 
NIFI-8039 Review findings; refining thread pool to be able to scale down properly when not under load
NIFI-8039 Answers to PR comments

This closes #4689.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-11-30 10:17:15 +01:00
Matthew Burgess
fe950131c3 NIFI-8046: Fix issue with ResultSetRecordSet on DB2 
This closes #8046.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-11-27 19:23:44 +01:00
Tamas Palfy
4aaec5aa38
NIFI-8020 Make sure TailFile doesn't leave FileChannel open when handling NUL characters 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4671.
 2020-11-18 00:26:27 +01:00
r65535
d5dc63ded9
NIFI-7982 Added tags to FlattenJSON processor 
Adding missing imports

This closes #4662

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-11-17 07:05:52 -05:00
Tamas Palfy
47cc2867ba NIFI-7972 Add a boolean property by which the user can tell the processor to yield (and try again later) whenever it encounters a NUL character. 2020-11-16 15:16:12 -05:00
Denes Arvay
83948db989
NIFI-7996 Conversion with ConvertRecord to avro results in invalid date 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4666.
 2020-11-16 17:40:40 +01:00
Peter Gyori
e66362194d NIFI-7922: Added support for GET in ListenHTTP for health check 
NIFI-7922: Fixes based on review comments

ListenHTTP: changed if(!sslRequired) to if(sslRequired) so that the positive case comes first.
HealthCheckServlet: response body for GET contains "OK".
ContentAcknowledgmentServlet: super.doDelete() is called when a DELETE should be rejected because of port mismatch.

NIFI-7922: Refactored, based on review comments

NIFI-7922: Fixed a checkstyle violation (organized the imports)

This closes #4603.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-11-16 12:20:30 +01:00
Peter Turcsanyi
018778a25d NIFI-7994: Fixed ReplaceText concurrency issue 
Moving RegexReplace.additionalAttrs field to local variable in replace() method.
Concurrent usage of the additionalAttrs map caused data corruption.
 2020-11-12 10:45:10 -05:00
Pierre Villard
14ec02f21d
NIFI-7981 - add support for enum type in avro schema 
This closes #4648

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-11-05 18:19:55 -05:00
Bence Simon
59e00c4b6f NIFI-7959 Handling node disconnection in MonitorActivity processor 
- Make reporting in clustered scope to dependent of expected cluster state in order to prevent unexpected flow file emission

This closes #4642.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2020-11-04 10:09:46 -05:00
Mark Payne
4b9014b959
NIFI-1121: Updated backend to perform appropriate validation. Added tests. Updated documentation writer. Updated dev guide to explain how PropertyDescriptor.Builder#dependsOn affects validation. Updated JavaDocs for PropertyDescriptor.Builder#dependsOn 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-11-03 15:37:42 -05:00
mtien
535cab3167
NIFI-1121: Added an additional check for hidden properties to account for transitive dependent properties. 
- Added a 'dependent' attribute to determine whether or not to save dependent property values

Co-authored-by: Scott Aslan <scottyaslan@gmail.com>
Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-11-03 15:37:33 -05:00
Mark Payne
e2e901b6b9
NIFI-1121: Added property dependencies to MergeContent 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-11-03 15:37:26 -05:00
Mark Payne
f7f336a4b0
NIFI-1121: Added API changes for having one Property depend on another 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-11-03 15:37:08 -05:00
r65535
d8d9aa9cec Added regex support for attribute header selection on HandleHTTPResponse 2020-11-03 12:22:41 -05:00
Denes Arvay
d05d0c6240 NIFI-7925: ValidateRecord reports false positive for avro arrays with null elements 2020-10-21 09:17:29 -04:00
Dan Kim
5b5b9a7800
NIFI-7916 refactor CountText to ignore whitespace words when counting 
This closes #4595

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-10-14 09:09:42 -04:00
Matthew Burgess
4c235f0405
NIFI-7909: Change DataTypeUtils.toInteger() to use Math.toIntExact() 
This closes #4596

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-10-12 17:53:27 -04:00
Peter Gyori
668c278e30
NIFI-7815: Enhance the logging in MergeContent processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4534.
 2020-10-08 11:44:52 +02:00
exceptionfactory
efb629e37d
NIFI-7777 Removed support for Expression Language from Password property 
Added unit test for no password configured on Zip files

This closes #4572.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-10-07 10:59:50 -07:00
exceptionfactory
ea6b01159d
NIFI-7777 Added optional Password property to UnpackContent for decrypting Zip archives 
This closes #4572.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-10-07 10:56:23 -07:00
Denes Arvay
6990f0d3a9
NIFI-7685: Add UTF8 support for FetchFTP 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4446
 2020-10-01 17:35:46 -04:00
Mike Thomsen
a66c3d8168
NIFI-2580 Added a little explanation note about a common issue new users face with jsonpath. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4561.
 2020-09-30 14:15:07 +02:00
Matthew Burgess
95fb8e3144
NIFI-7503: PutSQL - only call commit() and rollback() if autocommit is disabled 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4558.
 2020-09-29 11:08:44 +02:00
Mohammed Nadeem
9c83908c9c
NIFI-7852: Small correction in additional details of LookupRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4555.
 2020-09-28 15:10:46 +02:00
Andy LoPresto
9370571131
NIFI-7804 Split nifi-security-utils into sub-module for nifi-security… (#4533) 
* NIFI-7804 Split nifi-security-utils into sub-module for nifi-security-utils-api (no external dependencies).
Separated interface and implementation of TlsConfiguration.
Reabsorbed nifi-security-xml-config into nifi-security-utils.

* NIFI-7804 Resolved failing unit test on Java 8.
Removed accidental module dependency.

* NIFI-7804 Resolved failing unit test.

* NIFI-7804 Removed legacy dependency.

* NIFI-7804 Marked nifi-security-utils-api as provided and overrode with compile scope in specific modules which are not children of nifi-standard-services-api-nar.
 2020-09-17 12:52:22 -04:00
Peter Gyori
266433e13d
NIFI-7624: ListenFTP processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4481.
 2020-09-17 12:37:58 +02:00