Commit Graph

6347 Commits

Author SHA1 Message Date
Mike Thomsen 82c84492ce
NIFI-7906 Fixed a bug in how record paths were handled.
NIFI-7906 Fixed bugs in unit tests.

NIFI-7906 Updated a few things based on a code review.

NIFI-7906: Fixed typo in record.count attribute

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4739
2021-01-12 10:32:08 -05:00
exceptionfactory 5f7558cecf NIFI-8069 Set invalid status when Controller Services are enabling
This closes #4710.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-11 13:42:52 -05:00
Peter Turcsanyi 84b561ad33
NIFI-8131: Support aws_s3_v2_directory in Atlas reporting task
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4751.
2021-01-11 21:53:12 +04:00
exceptionfactory d41f2e1d0a NIFI-8121 Updated ListenHTTP with inferred Client Authentication Policy
- Added default property value for automatic determination of Client Authentication Policy based on SSLContextService Trust Store properties
- Added new ClientAuthentication enum with values specific to ListenHTTP

This closes #4749.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-11 18:02:09 +01:00
exceptionfactory a4027e8e77 NIFI-8120 Added RuntimeException handling on HttpContextMap.complete()
NIFI-8120 Renamed exception variable and reordered log statements

This closes #4747.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-08 17:13:10 +00:00
sjyang18 f330078fff NIFI-7924 Add fallback claims for identifying user to OIDC provider
This closes #4630

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-01-07 14:57:57 -06:00
exceptionfactory 817f621d6f NIFI-8096 Deprecated ClientAuth references in SSLContextService
- Added SSLContextService.createContext() and refactored referencing components
- Removed references to ClientAuth from SslContextFactory methods

This closes #4737.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-06 16:24:26 -05:00
Mark Payne 783633cac5
NIFI-8021: Fixed bug in ConsumeKafka_2_6 and ConsumeKafkaRecord_2_6 where explicit partition assignment causes issues with more than 1 concurrent task. Also fixed bug that prevented more nifi nodes than partitions because it didn't properly handle empty string for the list of partitions
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4744.
2021-01-06 19:28:09 +01:00
Mark Payne ea80dad16a
NIFI-8021: Fixed bug in ConsumeKafka_2_0 and ConsumeKafkaRecord_2_0 where explicit partition assignment causes issues with more than 1 concurrent task. Also fixed bug that prevented more nifi nodes than partitions because it didn't properly handle empty string for the list of partitions
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4744.
2021-01-06 19:27:33 +01:00
tlsmith 7214dc0f85 NIFI-6242 PutFileTransfer generating incorrect provenance event 2021-01-06 12:10:20 -05:00
Mark Bean 954c09d0c3 NIFI-7387: update ComponentLog API to accept Object varargs instead of array
This closes #4225.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-06 11:09:07 -05:00
Otto Fowler 8b2712e537 NIFI-7436 Ability to walk Record FieldValue to root
This closes #4262.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-06 11:02:45 -05:00
Pierre Villard 80eb570ee1 NIFI-7894 - ConsumeMQTT - allow EL on Client ID property with shared subscription
This closes #4586.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-06 16:46:17 +01:00
Pierre Villard c9d778a8ee NIFI-7889 - ConsumeMQTT - use offer instead of add
This closes #4578.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-06 14:15:27 +01:00
Joey Frazee 1e227ca643 NIFI-7964 Force PutAzureBlobStorage to stream writes
NIFI-7964 Remove unused import
NIFI-7964 Reverted to using BufferedInputStream along with unmarkable
NIFI-7964 Made UnmarkableInputStream static and added factory method
NIFI-7964 Remove unnecessary factory method from UnmarkableInputStream

This closes #4632.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-06 13:47:05 +01:00
exceptionfactory bb178f371b
NIFI-6576 Added Basic Authentication support to ConfluentSchemaRegistry
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4743.
This closes #4508.
This closes #4224.
2021-01-06 09:34:43 +01:00
Peter Turcsanyi 584adc3b91
NIFI-8067 - Fix 1-way SSL in GRPC processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4733.
2021-01-05 11:31:00 +01:00
Otto Fowler ceb9dff3b9
NIFI-7761 Allow HandleHttpRequest to add specified form data to FlowFile attributes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4513.
2021-01-05 09:42:41 +01:00
exceptionfactory e7c6bdad42 NIFI-7937 Added StandardFlowFileMediaType enum to replace string references to FlowFile Media Types 2021-01-04 14:20:05 -05:00
Kevin Barranco 0f667cb4f3 MonitorActivity THRESHOLD to use Variables
When using MonitorActivity, it would be interesting to use variables in "Threshold Duration", which will help maintain Version Control in ProcessGroups (Avoiding "breaking" versions when including the value manually). 

I've included the option expressionLanguageSupported(ExpressionLanguageScope.VARIABLE_REGISTRY), so we can use variables in "Threshold Duration".
2021-01-04 14:14:29 -05:00
tlsmith 112b893bf2 NIFI-7225 FetchSFTP processor routing to not.found error given when Private Key Path property is invalid 2021-01-04 13:41:03 -05:00
Shane Ardell 5c79553af6 NIFI-8062: make tabs functional with keyboard 2021-01-04 11:58:47 -05:00
Matthew Burgess de88ce7a61 NIFI-7906: Implemented RecordSetWriter support for ExecuteGraphQueryRecord
This closes #4704

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-23 12:41:42 -05:00
dependabot[bot] 19bf89f7ed
NIFI-8098 - Bump jetty.version from 9.4.34.v20201102 to 9.4.35.v20201120
dependabot[bot] <support@github.com> Updates `jetty-server` from 9.4.34.v20201102 to 9.4.35.v20201120
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](https://github.com/eclipse/jetty.project/compare/jetty-9.4.34.v20201102...jetty-9.4.35.v20201120)

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4731.
2020-12-22 11:27:49 +01:00
Denes Arvay 31c5dc5ab4 NIFI-8102 TailFile can skip characters if tailing a file on NFS mount
- Force the TailFile processor to recreate and reposition the reader
  by setting it to null in case of a NulCharacterEncounteredException
- Updated the TestTailFile.testNULContent() to not initialize the
  processor when calling the second run()

Update the reader's position instead of abandoning it.

This closes #4736.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2020-12-18 14:20:41 -05:00
sjyang18 942030579a NIFI-7386 Added Azure Azurite emulator credentials service
This closes #4286

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-12-16 18:11:06 -06:00
Tamas Palfy 989287adaf
NIFI-8027 In AbstractExecuteSQL make 'SQL Pre-Query' and 'SQL Post-Query' properties support escaping semicolons to allow them be part of statements.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4732
2020-12-16 14:57:59 -05:00
Peter Turcsanyi 02665d7561
NIFI-8092: Fix ITPutS3Object test failure due to Outposts storage class
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4728.
2020-12-16 12:43:24 +01:00
Matthew Burgess f29d6a6046 NIFI-7989: Add support to UpdateHiveTable for creating external tables
NIFI-7989: Add support for creating partitions, quote identifiers
NIFI-7989: Quote table name when getting description

This closes #4697.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-12-15 22:05:53 +01:00
exceptionfactory 28ca7478d6 NIFI-8019 Added TlsPlatform to provide runtime TLS protocol configuration
NIFI-8019 Renamed getDefaultProtocols() to getSupportedProtocols()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
2020-12-14 19:34:58 -05:00
exceptionfactory 5bcb5abc86 NIFI-1930 Updated ListenHTTP to set TLS included protocols based on SSLContextService
NIFI-1930 Removed unused import in SSLContextServiceTest

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
2020-12-14 14:31:08 -05:00
Mark Payne a73cd6a610
NIFI-7856: If a Provenance Event File is ready to be rolled over due to the maximum amount of time having elapsed, avoid rolling over unless there is at least one event written to the event file. Otherwise, we can have multiple RecordWriters / RecordWriterLeases pointing to the same file. This can result in data being overwritten, as well as failing to compress the event file upon rollover. Also added significant DEBUG/TRACE level logging.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4580
2020-12-14 11:49:47 -05:00
Peter Turcsanyi 91f6b42985
NIFI-8085 Use poll(Duration) in ConsumeKafka_2_x processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4725.
2020-12-13 10:23:35 +01:00
Peter Turcsanyi ec3d5f89f0
NIFI-8086: Fix file separator char in PutS3Object multipart state directory path
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4726.
2020-12-13 10:18:32 +01:00
David Mollitor 8eb0db6b38
NIFI-8083: SSLSocketChannel Logging Improvement
Fixed additional logs messages with same issue

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4722
2020-12-11 10:06:06 -05:00
exceptionfactory 7bff64b3cf NIFI-7913 Added getEnabledProtocols() to TlsConfiguration and updated ListenSMTP to set enabled protocols on SSL Sockets
NIFI-7913 Changed order of supported protocols to match existing comments in SSLContextService

This closes #4599

Signed-off-by: Nathan Gough <thenatog@gmail.com>
2020-12-10 11:53:20 -05:00
Mike Thomsen 8e4948322e
NIFI-8074 Switched ReplaceText to use line by line evaluation as its default evaluation mode.
This closes #4711

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-10 10:30:11 -05:00
Matthew Burgess 1f8b4e4779
NIFI-8080: Move script compilation to configurator init method
This closes #4718

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-09 21:05:44 -05:00
Sushil Kumar 1d31434c48 NIFI-8055 Fix validation message class-name for AzureCosmosDBClientService
This closes #4695

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-12-09 17:13:25 -06:00
Peter Turcsanyi 8d2fd39bdb
NIFI-8066: Bump GRPC dependency versions (#4716) 2020-12-09 09:37:01 -05:00
exceptionfactory 0af736dc0b
NIFI-7885 Added Environment Variable to deny LFS access using Hadoop (#4712)
* NIFI-7885 Added Environment Variable to deny LFS access using Hadoop

* NIFI-7885 Changed Hadoop Processor validation to check LFS access
2020-12-09 09:29:42 -05:00
Matthew Burgess 2c0671cf80
NIFI-8080: Compile Jython scripts before evaluating
This closes #4717

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-09 08:57:21 -05:00
exceptionfactory cfbcecc4c6
NIFI-7884 Added and applied Distributed File System permissions (#4713) 2020-12-08 15:56:46 -05:00
Bryan Bende 039a09923a
NIFI-8073 Correcting isBackPressureEnabled in PrometheusMetricsUtil 2020-12-07 10:03:16 -05:00
DataMoTrain d7ca4c920c
NIFI-8073 corrected condition for label isBackPressureEnabled
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-12-07 10:03:04 -05:00
Matthew Burgess 405c393cb5
NIFI-8031: Add UPSERT capability for MySQL in PutDatabaseRecord
This closes #4678

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-07 08:51:07 -05:00
r65535 2f99d6fce4
NIFI-4540 - Added FIFO options to PutSQS
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4705.
2020-12-07 13:11:22 +01:00
Mark Payne 37c2284d04
NIFI-8068: Ensure that when we determine the best of multiple possible types in a UNION that we handle Arrays of Records properly. Also refactored code to be a bit cleaner by extracting blocks of it into appropriately named methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4706.
2020-12-04 19:31:23 +01:00
Matthew Burgess 71d5162965
NIFI-6878: Added 'Use statement.type Attribute' to ConvertJSONToSQL
This closes #3893

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-04 07:39:08 -05:00
Mark Payne 29ea872f2c
NIFI-8042: Fixed bug that was escaping Expression Language references for use in a Regular Expression (i.e., Pattern.quote) even though it wasn't being used in a Regular Expression
This closes #4685

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-04 07:30:09 -05:00