Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,415 Commits 146 Branches 201 Tags 409 MiB
Commit Graph

6415 Commits

Author SHA1 Message Date
Mike Thomsen 953327cdf5
NIFI-8156 Fixed byte handling bug in cassandra. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4771.
 2021-01-21 11:23:14 +04:00
Matthew Burgess fb2a8b5820
NIFI-8043: Quote update key column names in PutDatabaseRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4772.
 2021-01-21 11:17:13 +04:00
Andrew Lim 27f57e6463
NIFI-8150 Change Download flow to Download flow definition for process groups (#4766) 2021-01-20 16:00:41 -05:00
Mark Payne 803ba882aa
NIFI-8146: Ensure that we close the Connection/Statement/PreparedStatement objects in finally blocks or try-with-resources 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4770
 2021-01-20 13:48:57 -05:00
Mark Payne 25ab050ed7
NIFI-8149: Updated Apache Calcite version from 1.21.0 to 1.26.0 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4765.
 2021-01-20 13:04:08 +04:00
Pierre Villard 88de03aebb NIFI-7895 - Fix NPE in ConsumeMQTT with truststore only SSL CS 
This closes #4587.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-20 00:29:30 +01:00
Mark Payne 930e8d9e0e
NIFI-7698: Added a merge.reason attribute for flowfiles indicating why they were merged by MergeContent. Also updated logs to indicate the reason and added additional documentation for processor 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4764
 2021-01-19 17:20:06 -05:00
s9514171 b4ddeb8997 NIFI-8116 The old peers do not be deleted when the URIs of the remote process group are changed 
This closes #4745.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-19 16:25:09 -05:00
Mark Payne f02079c2fa
NIFI-8146: Added RecordPath for Statement Type and to specify where to find the data within the incoming Record. Also performed some minor code refactoring to avoid lots of large lambdas, as it results in code that is more readable and more maintainable. Updated some properties to use dependsOn() notation now that this is available. 
NIFI-8146: Updated PutDatabaseRecord to avoid using the functional style framework that had previously been used. Doing so resulted in code that was difficult to understand and maintain. Added additional unit tests and improved MockRecordParser so that it could throw configurable types of exceptions

NIFI-8146: Fixed checkstyle issues

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4763
 2021-01-19 13:23:54 -05:00
eduardofontes 3e72dfe421
NIFI-8109 - Update MongoDBControllerService to externalize username and password 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4759.
 2021-01-19 21:21:44 +04:00
Chris Sampson 40f193098b
NIFI-7726 correct versionedFlowState field name in SiteToSiteStatusReportingTask schema 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4762.
 2021-01-19 10:40:38 +04:00
Mark Payne 097edf4f7c
NIFI-8136: Added getState/setState/replaceState/clearState methods to ProcessSession, updated processors to use these methods instead of StateManager version where appropriate 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4757
 2021-01-15 10:02:09 -05:00
Matthew Burgess b9076ca26e NIFI-7989: Add Update Field Names and Record Writer to UpdateHiveTable processors 
NIFI-7989: Only rewrite records if a field name doesn't match a table column name exactly
NIFI-7989: Rewrite records for created tables if Update Field Names is set

This closes #4750.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-13 23:26:44 +01:00
Nissim Shiman 3cc8d767b3 NIFI-7738 Reverse Provenance Query 
This closes #4563.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-13 09:35:05 -05:00
Matthew Burgess 382439c1d0 NIFI-7973: Add default precision and scale properties to remaining SQL-based components 
This closes #4682.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-13 08:41:12 -05:00
tlsmith 0b966cdb14
NIFI-7991 Flow Configuration History displays "annotation data not found/available" from "Advanced" changes 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4668
 2021-01-12 16:09:38 -05:00
Matthew Burgess 2d69179184
NIFI-8138: Add Sensitive Property value to property tooltip 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4752.
 2021-01-13 00:44:03 +04:00
exceptionfactory 7d76bcd520 NIFI-8094 Added support for BCFKS Keystore Type 
NIFI-8094 Updated Administration Guide to include BCFKS

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4729.
 2021-01-12 10:52:49 -05:00
Mike Thomsen 82c84492ce
NIFI-7906 Fixed a bug in how record paths were handled. 
NIFI-7906 Fixed bugs in unit tests.

NIFI-7906 Updated a few things based on a code review.

NIFI-7906: Fixed typo in record.count attribute

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4739
 2021-01-12 10:32:08 -05:00
exceptionfactory 5f7558cecf NIFI-8069 Set invalid status when Controller Services are enabling 
This closes #4710.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-11 13:42:52 -05:00
Peter Turcsanyi 84b561ad33
NIFI-8131: Support aws_s3_v2_directory in Atlas reporting task 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4751.
 2021-01-11 21:53:12 +04:00
exceptionfactory d41f2e1d0a NIFI-8121 Updated ListenHTTP with inferred Client Authentication Policy 
- Added default property value for automatic determination of Client Authentication Policy based on SSLContextService Trust Store properties
- Added new ClientAuthentication enum with values specific to ListenHTTP

This closes #4749.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-11 18:02:09 +01:00
exceptionfactory a4027e8e77 NIFI-8120 Added RuntimeException handling on HttpContextMap.complete() 
NIFI-8120 Renamed exception variable and reordered log statements

This closes #4747.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-08 17:13:10 +00:00
sjyang18 f330078fff NIFI-7924 Add fallback claims for identifying user to OIDC provider 
This closes #4630

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-01-07 14:57:57 -06:00
exceptionfactory 817f621d6f NIFI-8096 Deprecated ClientAuth references in SSLContextService 
- Added SSLContextService.createContext() and refactored referencing components
- Removed references to ClientAuth from SslContextFactory methods

This closes #4737.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-06 16:24:26 -05:00
Mark Payne 783633cac5
NIFI-8021: Fixed bug in ConsumeKafka_2_6 and ConsumeKafkaRecord_2_6 where explicit partition assignment causes issues with more than 1 concurrent task. Also fixed bug that prevented more nifi nodes than partitions because it didn't properly handle empty string for the list of partitions 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4744.
 2021-01-06 19:28:09 +01:00
Mark Payne ea80dad16a
NIFI-8021: Fixed bug in ConsumeKafka_2_0 and ConsumeKafkaRecord_2_0 where explicit partition assignment causes issues with more than 1 concurrent task. Also fixed bug that prevented more nifi nodes than partitions because it didn't properly handle empty string for the list of partitions 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4744.
 2021-01-06 19:27:33 +01:00
tlsmith 7214dc0f85 NIFI-6242 PutFileTransfer generating incorrect provenance event 2021-01-06 12:10:20 -05:00
Mark Bean 954c09d0c3 NIFI-7387: update ComponentLog API to accept Object varargs instead of array 
This closes #4225.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-06 11:09:07 -05:00
Otto Fowler 8b2712e537 NIFI-7436 Ability to walk Record FieldValue to root 
This closes #4262.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-06 11:02:45 -05:00
Pierre Villard 80eb570ee1 NIFI-7894 - ConsumeMQTT - allow EL on Client ID property with shared subscription 
This closes #4586.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-06 16:46:17 +01:00
Pierre Villard c9d778a8ee NIFI-7889 - ConsumeMQTT - use offer instead of add 
This closes #4578.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-06 14:15:27 +01:00
Joey Frazee 1e227ca643 NIFI-7964 Force PutAzureBlobStorage to stream writes 
NIFI-7964 Remove unused import
NIFI-7964 Reverted to using BufferedInputStream along with unmarkable
NIFI-7964 Made UnmarkableInputStream static and added factory method
NIFI-7964 Remove unnecessary factory method from UnmarkableInputStream

This closes #4632.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-01-06 13:47:05 +01:00
exceptionfactory bb178f371b
NIFI-6576 Added Basic Authentication support to ConfluentSchemaRegistry 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4743.
This closes #4508.
This closes #4224.
 2021-01-06 09:34:43 +01:00
Peter Turcsanyi 584adc3b91
NIFI-8067 - Fix 1-way SSL in GRPC processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4733.
 2021-01-05 11:31:00 +01:00
Otto Fowler ceb9dff3b9
NIFI-7761 Allow HandleHttpRequest to add specified form data to FlowFile attributes 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4513.
 2021-01-05 09:42:41 +01:00
exceptionfactory e7c6bdad42 NIFI-7937 Added StandardFlowFileMediaType enum to replace string references to FlowFile Media Types 2021-01-04 14:20:05 -05:00
Kevin Barranco 0f667cb4f3 MonitorActivity THRESHOLD to use Variables 
When using MonitorActivity, it would be interesting to use variables in "Threshold Duration", which will help maintain Version Control in ProcessGroups (Avoiding "breaking" versions when including the value manually). 

I've included the option expressionLanguageSupported(ExpressionLanguageScope.VARIABLE_REGISTRY), so we can use variables in "Threshold Duration".
 2021-01-04 14:14:29 -05:00
tlsmith 112b893bf2 NIFI-7225 FetchSFTP processor routing to not.found error given when Private Key Path property is invalid 2021-01-04 13:41:03 -05:00
Shane Ardell 5c79553af6 NIFI-8062: make tabs functional with keyboard 2021-01-04 11:58:47 -05:00
Matthew Burgess de88ce7a61 NIFI-7906: Implemented RecordSetWriter support for ExecuteGraphQueryRecord 
This closes #4704

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2020-12-23 12:41:42 -05:00
dependabot[bot] 19bf89f7ed
NIFI-8098 - Bump jetty.version from 9.4.34.v20201102 to 9.4.35.v20201120 
dependabot[bot] <support@github.com> Updates `jetty-server` from 9.4.34.v20201102 to 9.4.35.v20201120
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.34.v20201102...jetty-9.4.35.v20201120)

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4731.
 2020-12-22 11:27:49 +01:00
Denes Arvay 31c5dc5ab4 NIFI-8102 TailFile can skip characters if tailing a file on NFS mount 
- Force the TailFile processor to recreate and reposition the reader
  by setting it to null in case of a NulCharacterEncounteredException
- Updated the TestTailFile.testNULContent() to not initialize the
  processor when calling the second run()

Update the reader's position instead of abandoning it.

This closes #4736.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2020-12-18 14:20:41 -05:00
sjyang18 942030579a NIFI-7386 Added Azure Azurite emulator credentials service 
This closes #4286

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2020-12-16 18:11:06 -06:00
Tamas Palfy 989287adaf
NIFI-8027 In AbstractExecuteSQL make 'SQL Pre-Query' and 'SQL Post-Query' properties support escaping semicolons to allow them be part of statements. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4732
 2020-12-16 14:57:59 -05:00
Peter Turcsanyi 02665d7561
NIFI-8092: Fix ITPutS3Object test failure due to Outposts storage class 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4728.
 2020-12-16 12:43:24 +01:00
Matthew Burgess f29d6a6046 NIFI-7989: Add support to UpdateHiveTable for creating external tables 
NIFI-7989: Add support for creating partitions, quote identifiers
NIFI-7989: Quote table name when getting description

This closes #4697.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-12-15 22:05:53 +01:00
exceptionfactory 28ca7478d6 NIFI-8019 Added TlsPlatform to provide runtime TLS protocol configuration 
NIFI-8019 Renamed getDefaultProtocols() to getSupportedProtocols()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
 2020-12-14 19:34:58 -05:00
exceptionfactory 5bcb5abc86 NIFI-1930 Updated ListenHTTP to set TLS included protocols based on SSLContextService 
NIFI-1930 Removed unused import in SSLContextServiceTest

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
 2020-12-14 14:31:08 -05:00
Mark Payne a73cd6a610
NIFI-7856: If a Provenance Event File is ready to be rolled over due to the maximum amount of time having elapsed, avoid rolling over unless there is at least one event written to the event file. Otherwise, we can have multiple RecordWriters / RecordWriterLeases pointing to the same file. This can result in data being overwritten, as well as failing to compress the event file upon rollover. Also added significant DEBUG/TRACE level logging. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4580
 2020-12-14 11:49:47 -05:00