Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,551 Commits 146 Branches 201 Tags 409 MiB
Commit Graph

6551 Commits

Author SHA1 Message Date
rhavermans 9fd8042cfb
NIFI-8664 Update json-path lib from 2.4.0 -> 2.6.0 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5132
 2021-06-21 11:01:10 -04:00
Peter Turcsanyi 820b2cff29 NIFI-8662: Using the configured AWS region when parsing from VPCE endpoint URL fails in AbstractAWSProcessor 
This closes #5140.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
 2021-06-16 21:50:25 +02:00
Bernhard Geisberger 90f44d9d62
NiFi-8152: Fix NPE in RedisDistributedMapCacheClientService caused by newer versions of Jedis 
This closes #4783

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2021-06-16 14:07:16 -04:00
exceptionfactory 9be9b9dbe2
NIFI-8708 Upgraded Spring Framework to 5.3.8 for several extensions 
- nifi-vault-utils
- nifi-email-bundle
- nifi-redis-bundle

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5163.
 2021-06-16 18:18:54 +02:00
Paul Grey 0f1c9445f0
NIFI-8701 - Log Self-Signed Certificate Hash on Generate 
This closes #5159

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-16 07:15:49 -05:00
Abhishek Kumar 520ee82745
NIFI-8709 - added XSAnyImpl in attribute check for group 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5164.
 2021-06-16 13:42:04 +02:00
exceptionfactory 3cdab0d752
NIFI-8707 Upgraded SSHJ to 0.31.0 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5162.
 2021-06-16 12:06:06 +02:00
Pierre Villard f923b757f7
NIFI-8705 - Upgrade Jetty to 9.4.42.v20210604 
This closes #5161

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-15 15:03:15 -05:00
exceptionfactory 8ea27d515a
NIFI-8704 Upgraded Spring Framework from 5.3.6 to 5.3.8 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5160.
 2021-06-15 20:06:04 +02:00
Mohammed Nadeem 14265a4015
NIFI-8682: Upgrade opencsv from 4.5 to 5.4 to mitigate CVE_2014_0114 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5144.
 2021-06-15 19:53:43 +02:00
Mark Payne e06afbdd22
NIFI-8609: Optimized AvroTypeUtil Record creation and conversion 
Added unit test that is ignored so that it can be manually run for testing performance before/after changes to AvroTypeUtil. Updated AvroTypeUtil to be more efficient by not using Record.getValue() and instead iterating over the Map of values directly. getValue() is less efficient here because we know the RecordField's we are iterating over exist in the schema since they are retrieved from there directly; as a result, any null values still have be looked up by aliaases, but that step can be skipped in this situation. Also avoided looking for fields that exist in Avro Schema and not in RecordSchema just to set default values on GenericRecord - there's no need to set them if they are default values.

This closes #5080

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-15 09:05:38 -05:00
Mark Payne 8004aa5e6e
NIFI-8698: If using a Data RecordPath and handling schema drift, ensure that the RecordPath is evaluated against the data before attempting to determine the fields to update. Also refactored to move the handling of schema drift into its own method for the purpose of clarity 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5156
 2021-06-15 09:45:18 -04:00
markap14 96a8b2d090
NIFI-8666: Allow users to escape parameter names in Expression Language using quotes. (#5133) 2021-06-15 09:37:34 -04:00
Nathan Gough b49a62e1b5
NIFI-8699 - Upgrade Lucene to 8.8.2 in Provenance Bundle 
This closes #5157

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-15 08:30:50 -05:00
Andrew Lim e88d610da6
NIFI-8700 Corrections/improvements to doc added for default HTTPS 
This closes #5158

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-14 19:49:53 -05:00
Kent Nguyen 87c02c17d2
NIFI-8674: Update Apache Calcite version to 1.27.0 
This closes #5138

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-14 15:47:47 -05:00
Mark Payne 576338cd55 NIFI-8697: When login endpoint is encountered and JWT is no longer valid, request cookie to be deleted. Also fixed NPE that was encountered when going to /logout without the expected cookie being present 
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5155.
 2021-06-14 16:06:18 -04:00
Bryan Bende de7fef8a0a
NIFI-8690 Set FAIL_ON_UNKNOWN_PROPERTIES to false in JacksonExtensionManifestParser 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5151
 2021-06-14 10:04:05 -04:00
Mark Payne 20c889cf82
NIFI-8620: Ensure that we provider appropriate error messages if attempting to migrate FlowFiles from one session to another without including full hierarchy; added tests to verify behavior 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5099
 2021-06-14 10:00:49 -04:00
Peter Turcsanyi 48befe22f6
NIFI-8645: Disable LongRunningTaskMonitor by default 
This closes #5111

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-14 08:50:34 -05:00
exceptionfactory ab851b9cde NIFI-8672 Added syncUninterruptibly() to Netty shutdown and close methods 
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5139.
 2021-06-12 17:14:34 -04:00
Peter Turcsanyi 1a515ee74a NIFI-8656 Support EL for SAS Token in the ADLS Gen2 processors 
This closes #5119

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-06-11 14:11:07 -07:00
Joe Gresock 6f04b45773
NIFI-8643: Correcting nifi.cluster.load.balance.address in properties (#5146) 
NIFI-8643: Correcting nifi.cluster.load.balance.address in properties
 2021-06-11 16:58:20 -04:00
markap14 38cf25c7cf
NIFI-8647: Updated VersionedPropertyDescriptor to include information about which properties are referencing resources, how many resource, and the types of resources; updated NiFiRegistryFlowMapper to perform the mapping. (#5114) 2021-06-11 16:48:58 -04:00
Joe Gresock 1ccc4fbb0f
NIFI-8651: Refactor Sensitive Properties Providers for extension 
This closes #5131

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-11 15:44:37 -05:00
Mark Payne 64f600d0ce
NIFI-8689: This closes #5150. Avoid flushing the socket buffer unnecessarily when sending a series of FlowFiles via site-to-site 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-06-11 13:15:03 -07:00
Mark Payne 172afac6ab
NIFI-8633: This closes #5104. When reading a Content/Resource Claim from FileSystemRepository, avoid the unnecessary Files.exists call and instead just create a FileInputStream, catching FileNotFoundException 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-06-11 13:10:32 -07:00
Matthew Burgess 3e774bc5be
NIFI-8625: Refactor scripted components to use ScriptRunner to fix concurrency issues (#5116) 
NIFI-8625: Refactor scripted components to use ScriptRunner to fix concurrency issues
 2021-06-11 14:44:55 -04:00
exceptionfactory db40989b48 NIFI-8516 Enabled HTTPS and Single User Authentication in default configuration 
- Set default HTTPS Port to 9443
- Set default authorizer to single-user-authorizer
- Set default login-identity-provider to single-user-provider
- Updated README.md with authentication instructions using generated credentials
- Updated default URL and port information in Administration and User Guides
- Updated Getting Started Guide with authentication and URL changes
- Updated Docker images to set HTTPS as default configuration
- Updated default HTTPS port to 8443
- Set Cluster Protocol secure property in Docker start scripts
- Added set-single-user-credentials command
- Refactored shared classes to nifi-single-user-utils
- Updated Getting Started documentation and logging
- Updated documentation and TLS Toolkit default ports
- Updated Toolkit Guide and Administration Guide
- Updated README.md with HTTPS links
 2021-06-11 14:18:53 -04:00
Timea Barna d7a8d275c9 NIFI-8642 Select the default Old Gen Memory Pool for Memory Reporting Task 
This closes #5115.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
 2021-06-11 14:06:15 +02:00
Mark Payne 5c91143dc2
NIFI-8680: Ensure that if commitAsync() is called and an Exception caught that it is rethrown 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5143
 2021-06-10 10:10:51 -04:00
exceptionfactory 4df2a79c8a
NIFI-8678 Forced Calcite 1.27.0 and Calcite Avatica 1.6.0 for Hive Bundle 
- Overriding Calcite incubating versions avoids dependencies from third party repositories

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5142
 2021-06-10 10:02:50 -04:00
Peter Gyori 7cb3bce6a7
NIFI-8622: Reuse of GenericRecord instance eliminated from AvroReaderWithExplicitSchema to avoid issues when parsing fields of type "bytes" (#5090) 2021-06-09 15:22:22 -04:00
markap14 d44dec7345
NIFI-8670: Fixed bug in which a Parameter Context Update would fail if an updated parameter was referenced by a Controller Service whose state was ENABLING. Created system test to verify and addressed bug that was encountered in SingleFlowFileConcurrencyIT. (#5137) 2021-06-09 13:07:33 -04:00
M Tien 69c10f5a69
NIFIREG-395 - Implemented the ability to import and export versioned flows through the UI. (#5107) 
- Added REST endpoints in BucketFlowResource for importVersionedFlow and exportVersionedFlow.
- Added import and export dialogs.
- Set the initial value for the Bucket dropdown menu in the Import dialogs.
- Added frontend and backend integration tests.
- Created ExportedVersionedFlowSnapshot object.
- Added test resource file and updated rat configuration to skip the file during contrib-check.
- Refactored frontend and server side code.
- Updated Flow Actions menu hover and focus styles.
 2021-06-09 11:26:04 -04:00
Emilio Setiadarma 8641b54a49
NIFI-6667 Added variable to accept nifi.sensitive.props.key in Dockerfiles 
This closes #5128

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-08 15:46:31 -05:00
Paul Grey a3c1cd074b
NIFI-8499 - Added encrypted FlowFile repository swap file implementation 
This closes #5122

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-06-08 13:23:22 -05:00
Mark Payne 07ff4f2592
NIFI-8667: When marking a Controller Service as enabled, ensure that we release the write lock before calling validation methods of referencing components. Otherwise, we can encounter a deadlock. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5134
 2021-06-08 11:59:24 -04:00
Matthew Burgess 659fda10f3
NIFI-8659: Support multiple output records in JoltTransformRecord (#5126) 
NIFI-8659: Support multiple output records in JoltTransformRecord
 2021-06-07 15:30:41 -04:00
Dominik Przybysz f07e17ba74
[NIFI-8610] Do not reuse generic records in convertAvroToORC 
[NIFI-8610] Simplify decimal test for convertAvroToORC

Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #1081
 2021-06-07 11:26:16 +02:00
Mark Payne c9dee30294
NIFI-8658: Allow Filter Functions and expressions to be specified as a RecordPaths 
NIFI-8658: Addressed issue where the RecordField that was provided from Function Filters were not accurate

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5125
 2021-06-04 17:17:33 -04:00
exceptionfactory 9af136ad13
NIFI-8654 Changed SNMP TestAgent to use getAvailableUdpPort() 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5120.
 2021-06-04 23:10:51 +02:00
Mark Payne d340ad79ed
NIFI-8661: Updated ReaderLookup and RecordSetWriterLookup to use a property that indicates which reader/writer to use instead of requiring a specific attribute be provided 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5129
 2021-06-04 16:21:05 -04:00
Chris Sampson e883aa6b0b
Rename RecordPath un/escape JSON functions (#5124) 
Signed-off-by: Otto Fowler <ottobackwards@gmail.com>

This closes #5124.
 2021-06-04 11:56:28 -04:00
Chris Sampson bc5204d4df
NIFI-8137 Record Path EscapeJson/UnescapeJson functions (#4756) 
* NIFI-8137 Record Path EscapeJson/UnescapeJson functions

* Correct jackson-databind dependency version

* Add negative tests for RecordPath JSON handling; rename RecordPath JSON classes to better match existing functions

Signed-off-by: Otto Fowler <ottobackwards@gmail.com>

This closes #4756.
 2021-06-04 09:19:24 -04:00
denes 5045adf29c
NIFI-8655 Intermittent test failures in TestUnpackContent#testThreadSafetyUsingAutoDetect (#5117) 
Fixed the issue that the lists storing the log messages in org.apache.nifi.util.CapturingLogger
weren't thread safe.
 2021-06-03 14:14:05 -04:00
exceptionfactory 40dd45b71c
NIFI-8646 Aligned NiFi Registry dependencies with NiFi root properties 
Adjusted the following libraries to share dependency versions:

- Bouncy Castle
- Groovy
- Jackson
- Jetty
- Jersey
- SLF4J
- Maven Surefire Plugin

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5112.
 2021-06-03 12:22:16 +02:00
s9514171 66f0f90252
NIFI-8471 Parameter Contexts - show referencing process groups 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5048.
 2021-06-02 18:22:35 +02:00
Timea Barna f23dcb05f6 NIFI-8640 Regression with NIFI-8522 NiFi can duplicate controller service during template generation 
This closes #5109.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
 2021-06-01 14:37:51 +02:00
Arpad Boda 96d521159b Fixing keys of Adam Debreceni and Ferenc Gerlits 2021-06-01 12:32:57 +02:00