74ea3840ac
NIFI-8357: Updated Kafka 2.6 processors to automatically handle recreating Consumer Lease objects when an existing one is poisoned, even if using statically assigned partitions
...
This closes #4926 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-03-24 14:59:13 +01:00
2f08d1f466
NIFI-8357: Updated Kafka 2.0 processors to automatically handle recreating Consumer Lease objects when an existing one is poisoned, even if using statically assigned partitions
...
This closes #4926 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-03-24 14:58:51 +01:00
057b4af482
NIFI-8296 - Use API to retrieve all subjects associated with a schema id for Confluent Schema Registry v5.4.0+
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4872 .
2021-03-24 14:23:41 +01:00
1719e36165
NIFI-8348: upgrade jersey version to one fully compatible with Java 11
2021-03-24 09:18:31 -04:00
7fe8858d22
NIFI-8359 resolving unused import
2021-03-23 14:30:28 -07:00
788abe9eb3
NIFI-8359 removing test that cannot be reliable. Random data doesn't guarantee it will be detected as octet-stream and there is no obvious 'will never match' set of bytes so this test is not reliable or valuable
2021-03-23 17:18:54 -04:00
22fcb594d9
NIFI-8346 Route to failure in PutAzureBlobStorage for auth, IO exceptions
...
This closes #4917
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-03-23 11:28:04 -07:00
321e979673
NIFI-8353: When receiving data via load-balanced connection, throw an Exception (resulting in an ABORT_TRANSACTION status code) when attempting to add received FlowFiles to the FlowFile queue, if the node is not currently connected to cluster. In this case, ensure that we remove the received FlowFiles from the FlowFile Repository and emit a DROP event to the repository (with appropriate details) to coincide with the already-committed Provenance events. Also ensure that when a node is disconnected that we don't keep sending to that node until it reconnects. While testing the fixes via LoadBalancedQueueIT, also noticed that unit test logging was not working properly in nifi-framework-core because of the (erroneous) dependency on logback-class; removed this dependency and updated unit tests that were created that depended on its existence. ( #4924 )
2021-03-23 14:17:54 -04:00
e505e8b42d
NIFI-8352 This closes #4922 . Changed assertServerConnections to loop and sleep while evaluating
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-03-23 07:15:48 -07:00
4189a1c1eb
NIFI-8350 This closes 4921. updated worfklow
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-03-23 07:09:59 -07:00
e1b9548ab6
NIFI-8344: Introduced new Rollover Tail Period property
...
This closes #4916 .
Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-03-22 18:22:00 +01:00
3508b5b12f
NIFI-7850 Adds nifi.cluster.protocol.is.secure to Docker secure.sh
...
This closes #4896
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-03-19 15:30:23 -07:00
07a4966d10
NIFI-8329 - Updated dependencies with no build failures
...
NIFI-8329 - Removed unnecessary jackson.version from azure bundle to use the global property instead.
NIFI-8329 - Updated jackson/jackson-databind version and removed the 'jackson-databind.version' pom property in favor of 'jackson.version'
Updated dependencies include the following:
- jackson-core
- jackson-databind
- icu4j
- snakeyaml
- spring-integration-mail
- spring-core and framework modules
- activemq-client
- activemq-broker
- xercesImpl
This closes #4911
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-19 14:46:33 -05:00
0e659981d4
NIFI-8298 Refactored Kerberos and Socket classes from security-utils to new modules
...
- Created nifi-security-socket-ssl
- Created nifi-security-kerberos
- Removed nifi-security-utils dependency from nifi-processor-utils
- Updated modules to reference new dependencies
- Eliminated unnecessary transitive dependencies on bcprov-jdk15on from over 30 modules
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4881 .
2021-03-19 13:12:19 -04:00
4d68509212
NIFI-8308 Remove unnecessary field adjustments from QuestDB row creation
...
This closes #4888 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-03-19 17:55:11 +01:00
fedeafb43f
NIFI-8300 Make non-source processors invalid if scheduled for Primary Node only
...
This closes #4913 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-03-19 10:48:29 -04:00
446401b6f1
NIFI-8328: Allow RestLookupService to use FlowFile attributes in header properties
...
This closes #4908
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-19 09:26:00 -05:00
61c4261bb7
NIFI-8335 Remove the nifi-storm-spout module that is no longer maintained
...
This closes #4912
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-03-18 12:52:33 -07:00
105a76b7b7
NIFI-8314: Add controller-level bulletin message for long-running tasks.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4906 .
2021-03-18 02:40:39 +04:00
a7ba5bb4f8
NIFI-8319 Added AES/CBC/NoPadding for decryption in EncryptContent Processor
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4894 .
2021-03-18 01:40:18 +04:00
8202bffc98
NIFI-8304 This closes #4907 . Replaced HttpsURLConnection with OkHttpClient in TestListenHTTP
...
NIFI-8304 Updated TestPutTCP to shutdown server before checking connections
NIFI-8304 Changed TestListenTCP to send messages in one byte array
NIFI-8304 Added check for expected jdk.tls.disabledAlgorithms
2021-03-17 14:15:25 -07:00
cf4e966d91
NIFI-8337: This closes #4910 . Fixed bug in StandardProcessSession where the session didn't account for FlowFile's contentClaimOffset when seeking to the appropriate location in the stream.
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-03-17 14:12:35 -07:00
e16cc9df46
NIFI-8336: Change BULLETINS table bulletinTimestamp column to Long
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4909 .
2021-03-17 22:58:25 +04:00
04cd418618
NIFI-8312: Support PKCS12 and BCFKS truststores in Atlas reporting task
...
- Generate ssl-client.xml on NiFi side in order to be able to configure non-JKS truststores.
- Close FileOutputStream in tests to prevent error during clean-up.
- Removed generating Hadoop Credential Store.
- The credential store is not related to Atlas REST API SSL connection but would eliminate a warning from Atlas Kafka client. Removed because it caused test failure on Windows due to missing Hadoop native libraries.
This closes #4893
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-17 13:53:47 -05:00
f9e469ffa2
NIFI-8324 Fix NGINX X-ProxiedEntitiesChain examples in Admin Guide
...
This closes #4897
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-17 08:10:40 -05:00
be7233d252
NIFI-8304 Changed TestListenTCPRecord to loop until files found
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4904 .
2021-03-17 11:41:21 +04:00
2ad88bbfff
NIFI-8304 This closes #4900 . Improved Socket test reliability for several Processors
...
- Refactored TestPutTCP to single class
- Improved TestListenRELP
- Improved TestListenTCP
- Improved TestListenUDP
- Improved TestListenTCPRecord
- Changed OnUnscheduled to OnStopped in AbstractListenEventProcessor
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-03-16 15:30:11 -07:00
f00f0ad269
NIFI-8314: Generate warning for long-running processor tasks
2021-03-16 14:36:51 -04:00
b1f513a2ca
NIFI-8304 Refactored InvokeHTTP unit tests using OkHttp MockWebServer
...
- Replaced Joda Time with java.time for date formatting
- Replaced Guava Files with java.nio.file.Files for cache directory
- Updated PutTCP test server to close connection when testing connection per FlowFile
NIFI-8304 Removed Thread wrapper for TestListenHTTP client requests
NIFI-8304 Disabled InvokeHTTP Connection Pooling for testing
NIFI-8304 Set 60 second timeout for testing TLS connections
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4892 .
2021-03-15 21:28:40 +04:00
57cca88eea
NIFI-8289 Refine QuestDB status repository rollover and add time zone support
...
This closes #4883
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-03-12 09:10:02 -08:00
b039606cf8
NIFI-8297: Report incompatible value if it doesn't fit in an Integer
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4886 .
2021-03-12 19:40:19 +04:00
931f8fe798
NIFI-8316: Pass empty collections instead of null when calling write(ConfigurableComponent component)
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4891 .
2021-03-12 12:24:06 +04:00
09692c5f69
NIFI-8313 Upgraded net.lingala.zip4j:zip4j to 2.7.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4889 .
2021-03-12 12:21:07 +04:00
9f0b47af77
NIFI-2702 Support named captures in ExtractText
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4384 .
2021-03-12 12:11:09 +04:00
97b2e69101
NIFI-8309 updating to latest Jetty
2021-03-10 17:18:04 -05:00
a9b435e8d3
NIFI-8307: When StandardControllerServiceProvider.enableControllerServiceAndDependencies is called, ensure that it recursively calls itself for any dependent controller services. Updated toString() of ControllerServiceNode and passed itself to the ServiceStateTransition in order to facilitate better logging
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4882 .
2021-03-10 20:13:42 +04:00
160297f6ba
NIFI-7717 Add ARGs to Docker build for parent image and tag
...
This closes #4460
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-03-10 01:11:41 +00:00
97536e9070
NIFI-8303 Exclude com.io7m.xom:xom when depending on spring-security-saml
...
Update LICENSE files to account for esapi BSD license
This closes #4878
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-03-09 14:39:46 -07:00
f09f2a6c85
NIFI-8212: When instantiating a temp component, ensure that nar class loader is set as the context class loader
...
This closes #4877
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-09 11:43:07 -06:00
79121a142e
NIFI-6518: If processor is scheduled to run on Primary Node Only, and 'this' node is not primary node, yield for the bored yield duration.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4875 .
2021-03-09 11:51:52 +04:00
8c0f0a40cc
NIFI-8301: When we create a PreparedQuery in the StandardProcessContext, we do so with the effective property values. As a result, the Parameters have already been evaluated, so we need to use Query.prepareWithParametersPreEvaluated instead of Query.prepare
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4874 .
2021-03-09 11:48:44 +04:00
dc94ef568a
NIFI-8299: Because we now iterate over stored events in an unordered map, we need to update maxEventId to Math.max( <current value>, <next value> ) instead of just assigning the next value.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4873 .
2021-03-09 11:44:51 +04:00
98ab42aebc
NIFI-8302 Corrected FingerprintFactory to use decrypt() method removing wrapping
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4876 .
2021-03-08 22:16:21 -05:00
b523698534
NIFI-8212: Refactored StandardExtensionDiscoveringManager to avoid using ServiceLoader
...
Instead, it will look at the ServiceLoader file and read the names of the classes but avoid instantiating all of the objects or loading the classes into memory.
- Updated Doc Generation so that if the documentation for a given NAR already exists, it doesn't delete it and re-generate it. This was necessary because we are no longer instantiating an instance of each component and instead lazily creating the components as necessary.
- Removed stateless version of extension registry because it's no longer necessary
This closes #4852
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-08 12:21:19 -06:00
0965523bab
NIFI-8266: Fix NPE when validating supported properties against validation context
...
- Removed schema properties from FreeFormTextRecordSetWriter causing validation issues
This closes #4851 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-03-08 11:30:13 -05:00
c5b5be89a2
NIFI-8267 - Fix for HWX Schema Registry to use integers ( #4850 )
2021-03-08 09:12:37 -05:00
f2a03fca2a
NIFI-8285 Prevent HBase client services to throw NPE in non-kerberized environment. ( #4868 )
...
* NIFI-8285 Prevent HBase client services to throw NPE in non-kerberized environment.
* NIFI-8285 Improve exception handling.
2021-03-08 09:10:12 -05:00
9266212117
NIFI-8284: Removed diff merge leftover from the assembly NOTICE file ( #4865 )
2021-03-08 09:08:34 -05:00
29ebec071e
NIFI-4974: Add try/catch around blob.free() to support JDBC spec
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4861 .
2021-03-07 18:51:07 +04:00
ff93ec42c3
NIFI-8280: Remove Lumberjack NAR from assembly
...
This closes #4864
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-03-04 19:55:44 -05:00
Mark Payne
Dmitry Ibragimov
Mark Bean
Joe Witt
Denes Arvay
exceptionfactory
Karthick Narendran
Nathan Gough
Bence Simon
s9514171
Matthew Burgess
Peter Turcsanyi
Joey Frazee
Otto Fowler
Mike Thomsen
Bryan Bende
Pierre Villard
tpalfy
Peter Turcsanyi