Commit Graph

6536 Commits

Author SHA1 Message Date
Kent Nguyen 87c02c17d2
NIFI-8674: Update Apache Calcite version to 1.27.0
This closes #5138

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-14 15:47:47 -05:00
Mark Payne 576338cd55 NIFI-8697: When login endpoint is encountered and JWT is no longer valid, request cookie to be deleted. Also fixed NPE that was encountered when going to /logout without the expected cookie being present
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5155.
2021-06-14 16:06:18 -04:00
Bryan Bende de7fef8a0a
NIFI-8690 Set FAIL_ON_UNKNOWN_PROPERTIES to false in JacksonExtensionManifestParser
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5151
2021-06-14 10:04:05 -04:00
Mark Payne 20c889cf82
NIFI-8620: Ensure that we provider appropriate error messages if attempting to migrate FlowFiles from one session to another without including full hierarchy; added tests to verify behavior
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5099
2021-06-14 10:00:49 -04:00
Peter Turcsanyi 48befe22f6
NIFI-8645: Disable LongRunningTaskMonitor by default
This closes #5111

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-14 08:50:34 -05:00
exceptionfactory ab851b9cde NIFI-8672 Added syncUninterruptibly() to Netty shutdown and close methods
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5139.
2021-06-12 17:14:34 -04:00
Peter Turcsanyi 1a515ee74a NIFI-8656 Support EL for SAS Token in the ADLS Gen2 processors
This closes #5119

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-06-11 14:11:07 -07:00
Joe Gresock 6f04b45773
NIFI-8643: Correcting nifi.cluster.load.balance.address in properties (#5146)
NIFI-8643: Correcting nifi.cluster.load.balance.address in properties
2021-06-11 16:58:20 -04:00
markap14 38cf25c7cf
NIFI-8647: Updated VersionedPropertyDescriptor to include information about which properties are referencing resources, how many resource, and the types of resources; updated NiFiRegistryFlowMapper to perform the mapping. (#5114) 2021-06-11 16:48:58 -04:00
Joe Gresock 1ccc4fbb0f
NIFI-8651: Refactor Sensitive Properties Providers for extension
This closes #5131

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-11 15:44:37 -05:00
Mark Payne 64f600d0ce
NIFI-8689: This closes #5150. Avoid flushing the socket buffer unnecessarily when sending a series of FlowFiles via site-to-site
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-06-11 13:15:03 -07:00
Mark Payne 172afac6ab
NIFI-8633: This closes #5104. When reading a Content/Resource Claim from FileSystemRepository, avoid the unnecessary Files.exists call and instead just create a FileInputStream, catching FileNotFoundException
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-06-11 13:10:32 -07:00
Matthew Burgess 3e774bc5be
NIFI-8625: Refactor scripted components to use ScriptRunner to fix concurrency issues (#5116)
NIFI-8625: Refactor scripted components to use ScriptRunner to fix concurrency issues
2021-06-11 14:44:55 -04:00
exceptionfactory db40989b48 NIFI-8516 Enabled HTTPS and Single User Authentication in default configuration
- Set default HTTPS Port to 9443
- Set default authorizer to single-user-authorizer
- Set default login-identity-provider to single-user-provider
- Updated README.md with authentication instructions using generated credentials
- Updated default URL and port information in Administration and User Guides
- Updated Getting Started Guide with authentication and URL changes
- Updated Docker images to set HTTPS as default configuration
- Updated default HTTPS port to 8443
- Set Cluster Protocol secure property in Docker start scripts
- Added set-single-user-credentials command
- Refactored shared classes to nifi-single-user-utils
- Updated Getting Started documentation and logging
- Updated documentation and TLS Toolkit default ports
- Updated Toolkit Guide and Administration Guide
- Updated README.md with HTTPS links
2021-06-11 14:18:53 -04:00
Timea Barna d7a8d275c9 NIFI-8642 Select the default Old Gen Memory Pool for Memory Reporting Task
This closes #5115.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-06-11 14:06:15 +02:00
Mark Payne 5c91143dc2
NIFI-8680: Ensure that if commitAsync() is called and an Exception caught that it is rethrown
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5143
2021-06-10 10:10:51 -04:00
exceptionfactory 4df2a79c8a
NIFI-8678 Forced Calcite 1.27.0 and Calcite Avatica 1.6.0 for Hive Bundle
- Overriding Calcite incubating versions avoids dependencies from third party repositories

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5142
2021-06-10 10:02:50 -04:00
Peter Gyori 7cb3bce6a7
NIFI-8622: Reuse of GenericRecord instance eliminated from AvroReaderWithExplicitSchema to avoid issues when parsing fields of type "bytes" (#5090) 2021-06-09 15:22:22 -04:00
markap14 d44dec7345
NIFI-8670: Fixed bug in which a Parameter Context Update would fail if an updated parameter was referenced by a Controller Service whose state was ENABLING. Created system test to verify and addressed bug that was encountered in SingleFlowFileConcurrencyIT. (#5137) 2021-06-09 13:07:33 -04:00
M Tien 69c10f5a69
NIFIREG-395 - Implemented the ability to import and export versioned flows through the UI. (#5107)
- Added REST endpoints in BucketFlowResource for importVersionedFlow and exportVersionedFlow.
- Added import and export dialogs.
- Set the initial value for the Bucket dropdown menu in the Import dialogs.
- Added frontend and backend integration tests.
- Created ExportedVersionedFlowSnapshot object.
- Added test resource file and updated rat configuration to skip the file during contrib-check.
- Refactored frontend and server side code.
- Updated Flow Actions menu hover and focus styles.
2021-06-09 11:26:04 -04:00
Emilio Setiadarma 8641b54a49
NIFI-6667 Added variable to accept nifi.sensitive.props.key in Dockerfiles
This closes #5128

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-08 15:46:31 -05:00
Paul Grey a3c1cd074b
NIFI-8499 - Added encrypted FlowFile repository swap file implementation
This closes #5122

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-08 13:23:22 -05:00
Mark Payne 07ff4f2592
NIFI-8667: When marking a Controller Service as enabled, ensure that we release the write lock before calling validation methods of referencing components. Otherwise, we can encounter a deadlock.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5134
2021-06-08 11:59:24 -04:00
Matthew Burgess 659fda10f3
NIFI-8659: Support multiple output records in JoltTransformRecord (#5126)
NIFI-8659: Support multiple output records in JoltTransformRecord
2021-06-07 15:30:41 -04:00
Dominik Przybysz f07e17ba74
[NIFI-8610] Do not reuse generic records in convertAvroToORC
[NIFI-8610] Simplify decimal test for convertAvroToORC

Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #1081
2021-06-07 11:26:16 +02:00
Mark Payne c9dee30294
NIFI-8658: Allow Filter Functions and expressions to be specified as a RecordPaths
NIFI-8658: Addressed issue where the RecordField that was provided from Function Filters were not accurate

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5125
2021-06-04 17:17:33 -04:00
exceptionfactory 9af136ad13
NIFI-8654 Changed SNMP TestAgent to use getAvailableUdpPort()
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5120.
2021-06-04 23:10:51 +02:00
Mark Payne d340ad79ed
NIFI-8661: Updated ReaderLookup and RecordSetWriterLookup to use a property that indicates which reader/writer to use instead of requiring a specific attribute be provided
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5129
2021-06-04 16:21:05 -04:00
Chris Sampson e883aa6b0b
Rename RecordPath un/escape JSON functions (#5124)
Signed-off-by: Otto Fowler <ottobackwards@gmail.com>

This closes #5124.
2021-06-04 11:56:28 -04:00
Chris Sampson bc5204d4df
NIFI-8137 Record Path EscapeJson/UnescapeJson functions (#4756)
* NIFI-8137 Record Path EscapeJson/UnescapeJson functions

* Correct jackson-databind dependency version

* Add negative tests for RecordPath JSON handling; rename RecordPath JSON classes to better match existing functions

Signed-off-by: Otto Fowler <ottobackwards@gmail.com>

This closes #4756.
2021-06-04 09:19:24 -04:00
denes 5045adf29c
NIFI-8655 Intermittent test failures in TestUnpackContent#testThreadSafetyUsingAutoDetect (#5117)
Fixed the issue that the lists storing the log messages in org.apache.nifi.util.CapturingLogger
weren't thread safe.
2021-06-03 14:14:05 -04:00
exceptionfactory 40dd45b71c
NIFI-8646 Aligned NiFi Registry dependencies with NiFi root properties
Adjusted the following libraries to share dependency versions:

- Bouncy Castle
- Groovy
- Jackson
- Jetty
- Jersey
- SLF4J
- Maven Surefire Plugin

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5112.
2021-06-03 12:22:16 +02:00
s9514171 66f0f90252
NIFI-8471 Parameter Contexts - show referencing process groups
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5048.
2021-06-02 18:22:35 +02:00
Timea Barna f23dcb05f6 NIFI-8640 Regression with NIFI-8522 NiFi can duplicate controller service during template generation
This closes #5109.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-06-01 14:37:51 +02:00
Arpad Boda 96d521159b Fixing keys of Adam Debreceni and Ferenc Gerlits 2021-06-01 12:32:57 +02:00
Chris Sampson e0a1cb8a01
NIFI-8133 Add ability to supress null/empty values in ElasticSearchClientService for PutElasticsearchRecord output
NIFI-8133 pass null/empty field handling from PutElasticsearchRecord to ElasticSearchClientImpl

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4755
2021-05-29 13:29:14 -04:00
Timea Barna bf960cae2e
NIFI-8522 NiFi can duplicate controller services when generating templates
Adding final keywords and capitalize comment for process group section

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5086.
2021-05-29 16:42:20 +02:00
Joe Gresock 9fe1f56019
NIFI-8632: Using available port in StandardOidcIdentityProviderGroovyIT.groovy
This closes #5106

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-05-27 20:42:33 -05:00
exceptionfactory 7fb0293c3e NIFI-8626 Upgraded okhttp-digest to 2.5
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5096.
2021-05-27 12:41:11 -04:00
Mark Payne 08edc33eb7
NIFI-8629: Implemented the LogComponentStatuses task that runs periodically in stateless.
Also noticed a typo in the ControllerStatusReportingTask and found in comparing outputs
that it had a bug that caused it to log counters generated only by processors at the root level so fixed that.

This closes #5101

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-05-26 20:07:26 -05:00
Mark Payne 46b1f6755c NIFI-8631: Ensure that GCP Pub/Sub messages are not acknowledged until session has been committed, in order ot ensure that we don't have data loss
This closes #5102.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-05-26 21:54:31 +02:00
exceptionfactory 1e6161c0aa
NIFI-8361 Upgraded Zip4j to 2.8.0
- Upgrade resolves issue unpacking Zip files with temporary spanning markers

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5103.
2021-05-26 20:21:11 +02:00
s9514171 1e1c446243
NIFI-8628 - Variable Registry - Variable count doesn't reset when opening the variable dialog
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5097.
2021-05-26 18:04:03 +02:00
tpalfy dfa683af0e
NIFI-8528 Migrate NiFi Registry into NiFi codebase (#5065)
NIFI-8528 Migrate NiFi Registry fully codebase into NiFi as a module. No changes except certain dependency scopes to preserve the NiFi Registry original by overriding the new parent (nifi).
- Version adjustments. Removed distinct checkstye rules form nifi-registry. (Using nifi's instead.)
- Made some tests Windows-compatible.
- Consolidated LICENSE, NOTICE and README.md.
- Fixed CryptoKeyLoaderGroovyTest.groovy.
- Disable frontend-maven-plugin on Windows.
- Skipping all goals of the frontend-maven-plugin on Windows.
- Registry integration tests not to run in github jobs (same as the original settings). Skip all registry tests (build and run) on Windows.
- Removed Husky from registry.
2021-05-26 09:34:55 -04:00
exceptionfactory 103aae64cb
NIFI-8614 Adjusted NodeClusterCoordinatorFactoryBean to handle null ClusterNodeFirewall (#5100)
- Changed FileBasedClusterNodeFirewallFactoryBean to return null when configuration file is not found
2021-05-25 16:53:02 -04:00
s9514171 beb1d2f445
NIFI-8520 - Parameter Contexts - Show the wrong information of referencing components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5060.
2021-05-25 19:45:21 +02:00
exceptionfactory a3365c8833 NIFI-8462 Refactored PutSyslog and ListenSyslog using Netty
- Added nifi-event-transport module encapsulating Netty classes
- Refactored unit tests for PutSyslog and ListenSyslog
- Removed integration tests for PutSyslog and ListenSyslog

NIFI-8462 Added context.yield() in PutSyslog when no FlowFiles and addressed other issues

NIFI-8462 Removed unused import of ExpressionLanguageScope

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5044.
2021-05-25 10:54:15 -04:00
Tamas Palfy 5108d7cdd0 NIFI-8439 Update parquet-avro to allow reading parquet INT96 timestamps as byte arrays (instead of throwing an exception).
Also allow to write them as such (byte-arrays) - again, instead of throwing an exception.

NIFI-8439 Fixed unit tests.
NIFI-8439 Allow writing parquet INT96 timestamps if they were read by the same parquet-avro library.

This closes #5006.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-05-25 13:18:46 +02:00
Mohammed Nadeem 622507f994
NIFI-8627: Upgrade apache derby to 10.14.2.0 to mitigate CVE_2015_1832
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5095
2021-05-24 14:35:27 -04:00
exceptionfactory 01783a295c NIFI-8037 Changed SSLContextServices to use runtime supported protocols for TLSv1.3
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4827.
2021-05-23 23:52:01 -04:00