786f17182b
NIFI-8630 Upgraded javax.mail 1.4.7 to jakarta.mail 2.0.1 for PutEmail
...
- Added jakarata.activation 2.0.1 to support jakarta.mail 2.0.1
- Clarified description of SMTP TLS property enabling STARTTLS
NIFI-8630 Added final to several variables and adjusted variable declaration
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5179 .
2021-06-25 19:18:16 +02:00
1dc528ae80
NIFI-8699 - Adding the lucene-backward-codecs dependency to maintain backward compatibility with old provenance repos.
...
This closes #5187
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-25 11:53:29 -05:00
88cc232f15
NIFI-8731: If a processor is running but made invalid due to a parameter update, it ends up in a state of STARTING. If the parameter is then updated again, it transitions the state to STOPPING but the processor is not fully stopped yet. At that point, the parameter is updated and the processor is attempted to be started again. Fixed this by keeping the number of active threads to >= 1 if processor is STOPPING in order to convey that it is not fully stopped. Also addressed a few minor bugs discovered in the process: when stopping a processor, if status == invalid, it should be skipped instead of waiting for the status to become stopped since it never will be. In the DTO's run status use Stopped instead of Invalid if there is at least 1 active thread / if stopping but not stopped. When considering if a processor has transitioned to the desired state for parameter updates, do not consider validation status if still transitioning to stopped or if the desired state has already been reached. Added new system tests to verify behavior. ( #5180 )
...
This closes #5180
2021-06-25 12:40:49 -04:00
1313ee3d90
NIFI-8735 - Increase polling frequency for NAR autoloading providers ( #5183 )
2021-06-25 17:37:51 +02:00
49d10dbcbd
NIFI-5573 Allow overriding of nifi-env.sh
...
This closes #2985 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2021-06-25 10:46:23 -04:00
39ffa4a8ac
NIFI-8737: Fixed incorrect provenance data in HDFS processors when Directory property is inconsistent with core-site.xml
2021-06-25 14:19:57 +02:00
726082ffa6
NIFI-8447 Added HashiCorp Vault Transit Sensitive Properties Provider
...
- Added default bootstrap-hashicorp-vault.conf
- Updated Toolkit Guide documentation with HashiCorp Vault properties
This closes #5154
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-24 22:06:42 -05:00
5e4f32663e
Revert "NIFI-8195: add default connection settings to process group configuration"
...
This reverts commit 5ebbe0028b
2021-06-24 18:52:17 -04:00
27c35c8c42
NIFI-8463: Support custom SASL protocol name in PutKudu ( #5023 )
...
As of KUDU-1884, Kudu supports custom Kerberos principals on server-side
and custom SASL protocol (service) names on client-side which must match
the SPN base, i.e. if the SPN is kudu/_HOST, SASL protocol name *must*
be "kudu" in the client to be able to connect to the cluster.
This patch adds the ability to configure this in the PutKudu processor.
Signed-off-by: Attila Bukor <abukor@apache.org>
2021-06-24 17:42:04 -04:00
5ebbe0028b
NIFI-8195: add default connection settings to process group configuration
...
NIFIDEVS-8195: fixed properties not properly inheriting from template/snippet values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5094
2021-06-24 14:03:51 -04:00
a3f54fa578
NIFI-8736 Adding capability to override HDFS location for NAR autoloading
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5185 .
2021-06-24 19:37:19 +02:00
115bba9ab0
NIFI-8523 Added SFTP algorithm and cipher properties
...
- Updated secure FTP processors to configure which algorithms, ciphers and message authentication codes are allowed to be used by the SSH Client
- Included Expression Language Variable Registry support for properties
This closes #5061
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-24 11:51:04 -05:00
ea710e44a3
NIFI-8722: Updated Quest DB to account for newly added connection status metrics ( #5181 )
...
Co-authored-by: Bence Simon <simonbence>
2021-06-23 16:50:10 -04:00
1d9ea6d4cf
NIFI-8725 Added Single User Environment Variables for Docker ( #5178 )
...
* NIFI-8725 Added Single User Environment Variables for Docker
- Updated Docker README.md with example command and link to Administration Guide section
- Updated Docker integration test to check HTTP response status
- Disabled integration test plugin for dockerhub because it depends on changes on the main branch. Can be re-enabled after 1.14.0 is released.
2021-06-23 12:42:44 -04:00
0c748a5a2b
NIFI-4344: Improve bulletin messages with exception details.
...
This closes #5093 .
Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-06-23 17:34:01 +02:00
8e5ce46f6c
NIFI-8721 Upgraded Spring Boot to 2.5.1 for Registry
...
- Upgraded spring-jdbc to 5.3.8 for Registry
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5172 .
2021-06-23 10:38:19 +02:00
6a83115d6a
NIFI-7468 Updated SSLSocketChannel to support TLS 1.3
...
- Handling additional FINISHED Handshake Status for TLS 1.3 Post-Handshake Messages per RFC 8446 Section 4.6
- Removed clearing buffers after handshake to avoid losing packets
- Updated read() method to check Handshake Status after SSLEngine.unwrap()
- Changed SSLSocketChannelSender to close SSLSocketChannel before other resources
- Added ChannelStatus enum and convenience logging methods for tracing status
- Added unit tests for TLS 1.2 and 1.3 using Netty server and client handlers
NIFI-8704 Updated netty-handler to 4.1.65.Final
NIFI-7468 Corrected SSLSocketChannel.read() to return byte read
NIFI-7468 Adjusted comment formatting
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #5152 .
2021-06-22 22:29:16 -04:00
73363d9aea
NIFI-8717 Refactoring PutHDFS ( #5175 )
...
NIFI-8717 Refactoring PutHDFS
2021-06-22 13:13:14 -04:00
bd265bd508
NIFIREG-455 upgrade jgit version for nifi-registry GitFlowPersistenceProvider
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5123
2021-06-22 12:28:28 -04:00
f2698a4e1e
NIFI-8723 Upgraded Jackson to 2.12.3
...
- Updated MiNiFi to reference root jackson.version
- Updated Registry assembly to reference root jackson.version
- Added dependency management in NAR modules to override transitive versions
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5174
2021-06-22 11:21:45 -04:00
006e3498b7
NIFI-8724 Upgraded Bouncy Castle to 1.69
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5177
2021-06-22 11:13:37 -04:00
9744644b9d
NIFI-8025 - Refactored SAML and OIDC Resources to separate classes
...
This closes #5079
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-21 16:37:06 -05:00
02b4e33aa6
NIFI-8683 support Expression Language for the Truststore/Keystore properties of SSLContextService
...
This closes #5147
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-21 14:39:35 -05:00
5196ba9e14
Update developer-guide.adoc
...
Typo: "created created" (twice)
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5168
2021-06-21 13:14:10 -04:00
6fc9f33ba2
NIFI-8720: Ensure that when we use Expression Language for Records Per Split property of SplitRecord, we treat the result as a value of 1 if it's less than 1.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5171
2021-06-21 13:09:20 -04:00
b1ad13c835
NIFI-8719: Ensure that when OutputStream is returned from StandardProcessSession.write, upon close of the OutputStream we close the underlying resources.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5170
2021-06-21 12:55:17 -04:00
2efc2b6b8b
NIFI-8718 Upgraded Apache Commons IO to 2.10.0
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5169
2021-06-21 11:29:27 -04:00
9fd8042cfb
NIFI-8664 Update json-path lib from 2.4.0 -> 2.6.0
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5132
2021-06-21 11:01:10 -04:00
820b2cff29
NIFI-8662: Using the configured AWS region when parsing from VPCE endpoint URL fails in AbstractAWSProcessor
...
This closes #5140 .
Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-06-16 21:50:25 +02:00
90f44d9d62
NiFi-8152: Fix NPE in RedisDistributedMapCacheClientService caused by newer versions of Jedis
...
This closes #4783
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-06-16 14:07:16 -04:00
9be9b9dbe2
NIFI-8708 Upgraded Spring Framework to 5.3.8 for several extensions
...
- nifi-vault-utils
- nifi-email-bundle
- nifi-redis-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5163 .
2021-06-16 18:18:54 +02:00
0f1c9445f0
NIFI-8701 - Log Self-Signed Certificate Hash on Generate
...
This closes #5159
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-16 07:15:49 -05:00
520ee82745
NIFI-8709 - added XSAnyImpl in attribute check for group
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5164 .
2021-06-16 13:42:04 +02:00
3cdab0d752
NIFI-8707 Upgraded SSHJ to 0.31.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5162 .
2021-06-16 12:06:06 +02:00
f923b757f7
NIFI-8705 - Upgrade Jetty to 9.4.42.v20210604
...
This closes #5161
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-15 15:03:15 -05:00
8ea27d515a
NIFI-8704 Upgraded Spring Framework from 5.3.6 to 5.3.8
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5160 .
2021-06-15 20:06:04 +02:00
14265a4015
NIFI-8682: Upgrade opencsv from 4.5 to 5.4 to mitigate CVE_2014_0114
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5144 .
2021-06-15 19:53:43 +02:00
e06afbdd22
NIFI-8609: Optimized AvroTypeUtil Record creation and conversion
...
Added unit test that is ignored so that it can be manually run for testing performance before/after changes to AvroTypeUtil. Updated AvroTypeUtil to be more efficient by not using Record.getValue() and instead iterating over the Map of values directly. getValue() is less efficient here because we know the RecordField's we are iterating over exist in the schema since they are retrieved from there directly; as a result, any null values still have be looked up by aliaases, but that step can be skipped in this situation. Also avoided looking for fields that exist in Avro Schema and not in RecordSchema just to set default values on GenericRecord - there's no need to set them if they are default values.
This closes #5080
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-15 09:05:38 -05:00
8004aa5e6e
NIFI-8698: If using a Data RecordPath and handling schema drift, ensure that the RecordPath is evaluated against the data before attempting to determine the fields to update. Also refactored to move the handling of schema drift into its own method for the purpose of clarity
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5156
2021-06-15 09:45:18 -04:00
96a8b2d090
NIFI-8666: Allow users to escape parameter names in Expression Language using quotes. ( #5133 )
2021-06-15 09:37:34 -04:00
b49a62e1b5
NIFI-8699 - Upgrade Lucene to 8.8.2 in Provenance Bundle
...
This closes #5157
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-15 08:30:50 -05:00
e88d610da6
NIFI-8700 Corrections/improvements to doc added for default HTTPS
...
This closes #5158
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-14 19:49:53 -05:00
87c02c17d2
NIFI-8674: Update Apache Calcite version to 1.27.0
...
This closes #5138
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-14 15:47:47 -05:00
576338cd55
NIFI-8697: When login endpoint is encountered and JWT is no longer valid, request cookie to be deleted. Also fixed NPE that was encountered when going to /logout without the expected cookie being present
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #5155 .
2021-06-14 16:06:18 -04:00
de7fef8a0a
NIFI-8690 Set FAIL_ON_UNKNOWN_PROPERTIES to false in JacksonExtensionManifestParser
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5151
2021-06-14 10:04:05 -04:00
20c889cf82
NIFI-8620: Ensure that we provider appropriate error messages if attempting to migrate FlowFiles from one session to another without including full hierarchy; added tests to verify behavior
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5099
2021-06-14 10:00:49 -04:00
48befe22f6
NIFI-8645: Disable LongRunningTaskMonitor by default
...
This closes #5111
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-06-14 08:50:34 -05:00
ab851b9cde
NIFI-8672 Added syncUninterruptibly() to Netty shutdown and close methods
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #5139 .
2021-06-12 17:14:34 -04:00
1a515ee74a
NIFI-8656 Support EL for SAS Token in the ADLS Gen2 processors
...
This closes #5119
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-06-11 14:11:07 -07:00
6f04b45773
NIFI-8643: Correcting nifi.cluster.load.balance.address in properties ( #5146 )
...
NIFI-8643: Correcting nifi.cluster.load.balance.address in properties
2021-06-11 16:58:20 -04:00
exceptionfactory
Nathan Gough
markap14
Pierre Villard
Lars Francke
Peter Turcsanyi
Joe Gresock
Matthew Burgess
Attila Bukor
Mark Bean
Bence Simon
Jon Kessler
Lehel Boér
simonbence
Chris Sampson
Mathieu Rossignol
rhavermans
Bernhard Geisberger
Paul Grey
Abhishek Kumar
Mohammed Nadeem
Andrew Lim
Kent Nguyen
Bryan Bende