Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,471 Commits 146 Branches 201 Tags 406 MiB
Commit Graph

6471 Commits

Author SHA1 Message Date
Matthew Burgess a5dbf56114
NIFI-8368: If decimal scale > precision, set precision = scale 
This closes #4938

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-29 10:53:46 -05:00
Eric Olson bff3e94c01
NIFI-7172 Trim trailing whitespace from NiFi properties 
This closes #4854

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-25 15:40:35 -05:00
exceptionfactory 1cd3fbb4eb NIFI-8288 Removed OkHttpClientUtils to reduce reliance on nifi-security-utils 
- Added createTrustManager() on SSLContextService
- Removed nifi-security-utils and okhttp dependencies from nifi-web-utils

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4869.
 2021-03-25 15:38:24 -04:00
Florimond Manca 66e2741871
NIFI-5535 NIFI-4713 This closes #4858. Change metric tagging in DataDogReportingTask 
Remove low-value default tags

Send processor name as tag instead of as part of metric name

Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-03-25 09:59:59 -07:00
exceptionfactory 54d2222fb0
NIFI-8364 This closes #4935. Refactored TestQuerySolr and TestGetSolr to reuse embedded SolrClient 
- Replaced Gson with Jackson for parsing JSON
- Corrected assertion argument ordering
- Simplified relative path determination for EmbeddedSolrServerFactory
- Replaced SimpleDateFormat with java.time.Instant parsing and formatting

Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-03-25 09:33:19 -07:00
exceptionfactory 36e0187648 NIFI-8347 Set Thread Context ClassLoader for provided jetty-server classes 
- Updated unit test with WebSocket connect method

NIFI-8347 Replaced init() method with ServletContextHandler.setClassLoader()

This closes #4918.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-03-25 15:51:22 +01:00
Timea Barna 9df717f69b
NIFI-8283 Value handling in ScanAccumulo processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4931.
 2021-03-25 13:00:04 +01:00
Hsin-Ying Lee 0f28702b47
NIFI-8354 ExecuteStreamCommand processor doesn't delete the temp file… (#4923) 
* NIFI-8354 ExecuteStreamCommand processor doesn't delete the temp file if the process start failed
* NIFI-8354 Record the log when delete file failed


This closes #4923

Signed-off-by: Otto Fowler <otto@apache.org>
 2021-03-24 12:26:56 -04:00
Peter Turcsanyi 4473d23ccd
NIFI-8356: Add unit test for LongRunningTaskMonitor. 
This closes #4925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-24 10:29:59 -05:00
Mark Payne 91313a2e75
NIFI-8360: Fixed an overflow issue where we used an integer to store the number of bytes encountered when reading data and searching for a given pattern 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4929.
 2021-03-24 15:30:22 +01:00
Mark Payne 74ea3840ac NIFI-8357: Updated Kafka 2.6 processors to automatically handle recreating Consumer Lease objects when an existing one is poisoned, even if using statically assigned partitions 
This closes #4926.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-03-24 14:59:13 +01:00
Mark Payne 2f08d1f466 NIFI-8357: Updated Kafka 2.0 processors to automatically handle recreating Consumer Lease objects when an existing one is poisoned, even if using statically assigned partitions 
This closes #4926.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-03-24 14:58:51 +01:00
Dmitry Ibragimov 057b4af482
NIFI-8296 - Use API to retrieve all subjects associated with a schema id for Confluent Schema Registry v5.4.0+ 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4872.
 2021-03-24 14:23:41 +01:00
Mark Bean 1719e36165 NIFI-8348: upgrade jersey version to one fully compatible with Java 11 2021-03-24 09:18:31 -04:00
Joe Witt 7fe8858d22
NIFI-8359 resolving unused import 2021-03-23 14:30:28 -07:00
Joe Witt 788abe9eb3 NIFI-8359 removing test that cannot be reliable. Random data doesn't guarantee it will be detected as octet-stream and there is no obvious 'will never match' set of bytes so this test is not reliable or valuable 2021-03-23 17:18:54 -04:00
Denes Arvay 22fcb594d9 NIFI-8346 Route to failure in PutAzureBlobStorage for auth, IO exceptions 
This closes #4917

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-03-23 11:28:04 -07:00
markap14 321e979673
NIFI-8353: When receiving data via load-balanced connection, throw an Exception (resulting in an ABORT_TRANSACTION status code) when attempting to add received FlowFiles to the FlowFile queue, if the node is not currently connected to cluster. In this case, ensure that we remove the received FlowFiles from the FlowFile Repository and emit a DROP event to the repository (with appropriate details) to coincide with the already-committed Provenance events. Also ensure that when a node is disconnected that we don't keep sending to that node until it reconnects. While testing the fixes via LoadBalancedQueueIT, also noticed that unit test logging was not working properly in nifi-framework-core because of the (erroneous) dependency on logback-class; removed this dependency and updated unit tests that were created that depended on its existence. (#4924) 2021-03-23 14:17:54 -04:00
exceptionfactory e505e8b42d
NIFI-8352 This closes #4922. Changed assertServerConnections to loop and sleep while evaluating 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-03-23 07:15:48 -07:00
Joe Witt 4189a1c1eb
NIFI-8350 This closes 4921. updated worfklow 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-03-23 07:09:59 -07:00
Mark Payne e1b9548ab6 NIFI-8344: Introduced new Rollover Tail Period property 
This closes #4916.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
 2021-03-22 18:22:00 +01:00
Karthick Narendran 3508b5b12f NIFI-7850 Adds nifi.cluster.protocol.is.secure to Docker secure.sh 
This closes #4896

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-03-19 15:30:23 -07:00
Nathan Gough 07a4966d10
NIFI-8329 - Updated dependencies with no build failures 
NIFI-8329 - Removed unnecessary jackson.version from azure bundle to use the global property instead.

NIFI-8329 - Updated jackson/jackson-databind version and removed the 'jackson-databind.version' pom property in favor of 'jackson.version'

Updated dependencies include the following:

- jackson-core
- jackson-databind
- icu4j
- snakeyaml
- spring-integration-mail
- spring-core and framework modules
- activemq-client
- activemq-broker
- xercesImpl

This closes #4911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-19 14:46:33 -05:00
exceptionfactory 0e659981d4 NIFI-8298 Refactored Kerberos and Socket classes from security-utils to new modules 
- Created nifi-security-socket-ssl
- Created nifi-security-kerberos
- Removed nifi-security-utils dependency from nifi-processor-utils
- Updated modules to reference new dependencies
- Eliminated unnecessary transitive dependencies on bcprov-jdk15on from over 30 modules

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4881.
 2021-03-19 13:12:19 -04:00
Bence Simon 4d68509212 NIFI-8308 Remove unnecessary field adjustments from QuestDB row creation 
This closes #4888.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2021-03-19 17:55:11 +01:00
s9514171 fedeafb43f NIFI-8300 Make non-source processors invalid if scheduled for Primary Node only 
This closes #4913.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-03-19 10:48:29 -04:00
Matthew Burgess 446401b6f1
NIFI-8328: Allow RestLookupService to use FlowFile attributes in header properties 
This closes #4908

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-19 09:26:00 -05:00
Nathan Gough 61c4261bb7 NIFI-8335 Remove the nifi-storm-spout module that is no longer maintained 
This closes #4912

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-03-18 12:52:33 -07:00
Peter Turcsanyi 105a76b7b7
NIFI-8314: Add controller-level bulletin message for long-running tasks. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4906.
 2021-03-18 02:40:39 +04:00
exceptionfactory a7ba5bb4f8
NIFI-8319 Added AES/CBC/NoPadding for decryption in EncryptContent Processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4894.
 2021-03-18 01:40:18 +04:00
exceptionfactory 8202bffc98
NIFI-8304 This closes #4907. Replaced HttpsURLConnection with OkHttpClient in TestListenHTTP 
NIFI-8304 Updated TestPutTCP to shutdown server before checking connections
NIFI-8304 Changed TestListenTCP to send messages in one byte array
NIFI-8304 Added check for expected jdk.tls.disabledAlgorithms
 2021-03-17 14:15:25 -07:00
Mark Payne cf4e966d91
NIFI-8337: This closes #4910. Fixed bug in StandardProcessSession where the session didn't account for FlowFile's contentClaimOffset when seeking to the appropriate location in the stream. 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-03-17 14:12:35 -07:00
Matthew Burgess e16cc9df46
NIFI-8336: Change BULLETINS table bulletinTimestamp column to Long 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4909.
 2021-03-17 22:58:25 +04:00
Peter Turcsanyi 04cd418618
NIFI-8312: Support PKCS12 and BCFKS truststores in Atlas reporting task 
- Generate ssl-client.xml on NiFi side in order to be able to configure non-JKS truststores.
- Close FileOutputStream in tests to prevent error during clean-up.
- Removed generating Hadoop Credential Store.
- The credential store is not related to Atlas REST API SSL connection but would eliminate a warning from Atlas Kafka client. Removed because it caused test failure on Windows due to missing Hadoop native libraries.

This closes #4893

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-17 13:53:47 -05:00
Joey Frazee f9e469ffa2
NIFI-8324 Fix NGINX X-ProxiedEntitiesChain examples in Admin Guide 
This closes #4897

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-17 08:10:40 -05:00
exceptionfactory be7233d252
NIFI-8304 Changed TestListenTCPRecord to loop until files found 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4904.
 2021-03-17 11:41:21 +04:00
exceptionfactory 2ad88bbfff
NIFI-8304 This closes #4900. Improved Socket test reliability for several Processors 
- Refactored TestPutTCP to single class
- Improved TestListenRELP
- Improved TestListenTCP
- Improved TestListenUDP
- Improved TestListenTCPRecord
- Changed OnUnscheduled to OnStopped in AbstractListenEventProcessor

Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-03-16 15:30:11 -07:00
Peter Turcsanyi f00f0ad269 NIFI-8314: Generate warning for long-running processor tasks 2021-03-16 14:36:51 -04:00
exceptionfactory b1f513a2ca
NIFI-8304 Refactored InvokeHTTP unit tests using OkHttp MockWebServer 
- Replaced Joda Time with java.time for date formatting
- Replaced Guava Files with java.nio.file.Files for cache directory
- Updated PutTCP test server to close connection when testing connection per FlowFile

NIFI-8304 Removed Thread wrapper for TestListenHTTP client requests

NIFI-8304 Disabled InvokeHTTP Connection Pooling for testing

NIFI-8304 Set 60 second timeout for testing TLS connections

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4892.
 2021-03-15 21:28:40 +04:00
Bence Simon 57cca88eea NIFI-8289 Refine QuestDB status repository rollover and add time zone support 
This closes #4883

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-03-12 09:10:02 -08:00
Matthew Burgess b039606cf8
NIFI-8297: Report incompatible value if it doesn't fit in an Integer 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4886.
 2021-03-12 19:40:19 +04:00
Mark Payne 931f8fe798
NIFI-8316: Pass empty collections instead of null when calling write(ConfigurableComponent component) 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4891.
 2021-03-12 12:24:06 +04:00
exceptionfactory 09692c5f69
NIFI-8313 Upgraded net.lingala.zip4j:zip4j to 2.7.0 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4889.
 2021-03-12 12:21:07 +04:00
Otto Fowler 9f0b47af77
NIFI-2702 Support named captures in ExtractText 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4384.
 2021-03-12 12:11:09 +04:00
Joe Witt 97b2e69101 NIFI-8309 updating to latest Jetty 2021-03-10 17:18:04 -05:00
Mark Payne a9b435e8d3
NIFI-8307: When StandardControllerServiceProvider.enableControllerServiceAndDependencies is called, ensure that it recursively calls itself for any dependent controller services. Updated toString() of ControllerServiceNode and passed itself to the ServiceStateTransition in order to facilitate better logging 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4882.
 2021-03-10 20:13:42 +04:00
Mike Thomsen 160297f6ba NIFI-7717 Add ARGs to Docker build for parent image and tag 
This closes #4460

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-03-10 01:11:41 +00:00
Bryan Bende 97536e9070
NIFI-8303 Exclude com.io7m.xom:xom when depending on spring-security-saml 
Update LICENSE files to account for esapi BSD license

This closes #4878

Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-03-09 14:39:46 -07:00
Mark Payne f09f2a6c85
NIFI-8212: When instantiating a temp component, ensure that nar class loader is set as the context class loader 
This closes #4877

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-03-09 11:43:07 -06:00
Mark Payne 79121a142e
NIFI-6518: If processor is scheduled to run on Primary Node Only, and 'this' node is not primary node, yield for the bored yield duration. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4875.
 2021-03-09 11:51:52 +04:00