Commit Graph

6243 Commits

Author SHA1 Message Date
Joe Witt 434c995185
NIFI-7873 relaxing github ci test speeds to help restore reliability
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-02-01 15:13:19 -07:00
Joe Witt 0a82946946
NIFI-7873 removing defunct modules and relaxing github ci test speeds to help restore reliability 2021-02-01 15:11:59 -07:00
Moncef Abboud 5fea9179c4
NIFI-7783 Add CA Common Name as DNS Subject Alternative Name
This closes #4709

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-02-01 15:12:13 -06:00
Bryan Bende e0a8b479fd NIFI-8190 Protect against property that references missing controller service 2021-02-01 15:47:52 -05:00
exceptionfactory b4e213cb2c
NIFI-8186 Excluded bcprov-ext-jdk15on from spring-security-saml2-core dependency (#4793) 2021-02-01 13:21:46 -05:00
Grant Henke 29a1d6badc NIFI-7987: Support ignore operations in the PutKudu processor 2021-02-01 12:10:19 -05:00
Pierre Villard d72bfc76b5
NIFI-8155 - add banner text in page title
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4768
2021-01-29 19:20:34 -05:00
Matthew Burgess 5e84cf6ff9 NIFI-8175: Add WindowsEventLogReader controller service
This closes #4785

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-01-29 15:16:19 -06:00
exceptionfactory 11e9ff3773
NIFI-8178 This closes #4787. Replaced StandardSSLContextService in unit tests with SslContextUtils
- Removed references to StandardSSLContextService from nifi-standard-processors
- Removed TestGetHTTPGroovy and TestPostHTTPGroovy since these are testing deprecated processors
- Optimized HandleHttpRequest, GetHTTP, PostHTTP to use SSLContextService.createContext()
NIFI-8178 Changed TestGetHTTP to ITGetHTTP since GetHTTP is deprecated
NIFI-8178 Changed TestPostHTTP to ITPostHTTP since PostHTTP is deprecated

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-01-27 17:48:06 -07:00
exceptionfactory 8c1fe84f62
NIFI-8177 This closes #4786. Added timeout to Sender Pool polling to avoid blocking indefinitely
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-01-27 15:04:23 -07:00
snorlaxa 04fb1aca47
NIFI-8142: Add "Insert Ignore" option to PutDatabaseRecord
NIFI-8142: Fix Checkstyle error

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4778
2021-01-27 11:50:40 -05:00
Joe Witt d08a0babb7
NIFI-7873 increasing test parallelism to use all cores available 2021-01-27 09:26:41 -07:00
Joe Witt 6a0fb3e09e
NIFI-7873 Removed older/less commonly used nars from convenience assembly build to get back under max 1.5GB size
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-01-26 23:12:10 -07:00
Waleed Al Aibani 813ac539b3
NIFI-7263 This closes #4167. Add No Tracking Listing Strategy to ListFile/ListFTP processors
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-01-26 22:13:26 -07:00
Mark Payne 4ff9cddf15
NIFI-8173, NIFI-8174: This closes #4784. Updated Parameter Contexts to allow for unsetting a parameter value / setting it to null. Allow Parameters to make use of Expression Language. Updated docs to illustrated how EL is evaluated
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-01-26 21:55:18 -07:00
exceptionfactory abb6ed3128
NIFI-8171 This closes #4779. Upgraded Bouncy Castle libraries to 1.68 and centralized dependency version
NIFI-8171 Increased response and idle timeouts for HTTP unit tests
NIFI-8171 Increased TestServer idle timeout to 45 seconds for HTTP unit tests
NIFI-8171 Adjusted timeout and sleep on TestPutTCPCommon.testPruneSenders
NIFI-8171 Increased TestServer idle timeout to 60 seconds and removed 500ms Thread.sleep() in TestInvokeHttpSSL
NIFI-8171 Optimized OkHttpClientUtils to avoid reading trust store twice during initialization
NIFI-8171 Added static variable for server startup sleep
NIFI-8171 Increased TestInvokeHTTP Connect Timeout and TestListenHTTP Response Timeout to 30 seconds
NIFI-8171 Refactored unit tests for InvokeHTTP and ListenHTTP to optimize SSLContext creation
NIFI-8171 Updated TestListenHTTP for static creation of SSLContext
NIFI-8171 Added started check for ListenHTTP Server in TestListenHTTP
NIFI-8171 Refactored TestPutTCP classes to optimize SSLContext creation
NIFI-8171 Increased TestListenHTTP timeout for server start to 120 seconds and added exception when not connected
NIFI-8171 Increased Connect and Read Timeouts for InvokeHTTP SSL unit tests

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-01-26 21:24:07 -07:00
exceptionfactory 2cdb0fb6a3 NIFI-8088 Removed deprecation warning log for PKCS12 trust stores
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4727.
2021-01-26 16:50:33 -05:00
Peter Turcsanyi 67d06003b7 NIFI-8023: Convert java.sql.Date between UTC/local time zone normalized forms before/after database operations
This closes #4781

Signed-off-by: David Handermann <exceptionfactory@gmail.com>
2021-01-26 14:39:02 -06:00
Bence Simon 0a10557dd5 NIFI-7801 Adding support for HTTP based Splunk put and indexed acknowledgement
This closes #4714.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-26 15:20:20 -05:00
Nathan Gough 0ff4367781
NIFI-8166 - Upgraded jackson-databind to 2.9.10.8
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4777.
2021-01-22 09:57:51 +04:00
Nathan Gough 1c361d45ae NIFI-6999 - Made changes to load flow.xml files using streams. Updated tests.
NIFI-6999 - Slight change to test to check for WARN message.

NIFI-6999 - Removed very large flow file and test that uses it. This test ran for about 2 minutes so was excessive to keep in. The other changed tests to handle streams proves the functionality. A large file can be used on the command line to manually test large flow files. Some other cleanup.

NIFI-6999 - Removed comments and altered the code a little bit for readability as per code review.

NIFI-6999 - Removed commented code

NIFI-6999 - Renamed variable and removed assert comment.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4715.
2021-01-21 15:29:29 -05:00
Mark Payne f2a16cd02e NIFI-8163: When counting number of components, we traverse into all Process Groups, but then call findAllRemoteProcessGroups, which is a recursive call, instead of calling getRemoteProcessGroups(). This results in counting the Process Groups many times. So fixed that.
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4775.
2021-01-21 15:09:42 -05:00
Troy Melhase 76648bdc0b NIFI-7356 - Config TLS for embedded ZooKeeper when NiFi TLS enabled.
NIFI-7356 - Addresses PR feedback.

NIFI-7356 - Additional changes from PR feedback.

NIFI-7356 - Adding integration tests for ZooKeeperStateServer for TLS.

NIFI-7356 - TLS + Zookeeper now working with single and quorum. Needs code cleanup, need to fix IT tests and docs.

NIFI-7356 - Fixed up tests and removed some irrelevant ones. Refactored some of ZooKeeperStateServer. Tested successfully with a secure and insecure 3 node NiFi + Quorum.

NIFI-7356 - Checkstyle fixes.

NIFI-7356 - Updated administration guide with embedded ZooKeeper TLS configuration.

NIFI-7356 - Updated the way ZooKeeper TLS properties are set/mapped from NiFi properties.

NIFI-7356 - Updated per review, using NiFiProperties keystore strings, classname for ocnnection factory, adjusted TLS configuration checks in NiFiProperties.

NIFI-7356 - Updated configuration validation logic and added tests.

NIFI-7356 - Codestyle check fixes.

NIFI-7356 - Updated some of the log messages.

NIFI-7356 - Updated as per code review.

NIFI-7356 - Fixed max port number.

NIFI-7356 - Updated admin guide and updated small code issues as per code review.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4753.
2021-01-21 13:47:53 -05:00
Mark Payne 6741317cc4 NIFI-8162: Fixed outdated docs. Self-merging as this is a trivial docs fix.
Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-21 12:52:30 -05:00
Peter Turcsanyi 400d180ae7 NIFI-8034: Fixed PropertyValue.isExpressionLanguagePresent always returns true for non-null values
This closes #4746.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-21 12:31:39 -05:00
exceptionfactory 8c49f0688b
NIFI-7243 Upgraded com.hierynomus.sshj to 0.30.0 to resolve authentication race condition in version 0.27.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4774.
2021-01-21 21:21:47 +04:00
Mark Payne 525e4105eb NIFI-8095: Created StatelessNiFi Sink Connector and Source Connector. Minor updates to stateless nifi api to accommodate.
Self-merging PR based on comments from @joewitt
2021-01-21 10:56:28 -05:00
Pierre Villard 93a5823f8a NIFI-7890 - Added record support to ConsumeMQTT processor
This closes #4738.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-21 11:16:07 +00:00
Mike Thomsen 953327cdf5
NIFI-8156 Fixed byte handling bug in cassandra.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4771.
2021-01-21 11:23:14 +04:00
Matthew Burgess fb2a8b5820
NIFI-8043: Quote update key column names in PutDatabaseRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4772.
2021-01-21 11:17:13 +04:00
Andrew Lim 27f57e6463
NIFI-8150 Change Download flow to Download flow definition for process groups (#4766) 2021-01-20 16:00:41 -05:00
Mark Payne 803ba882aa
NIFI-8146: Ensure that we close the Connection/Statement/PreparedStatement objects in finally blocks or try-with-resources
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4770
2021-01-20 13:48:57 -05:00
Mark Payne 25ab050ed7
NIFI-8149: Updated Apache Calcite version from 1.21.0 to 1.26.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4765.
2021-01-20 13:04:08 +04:00
Pierre Villard 88de03aebb NIFI-7895 - Fix NPE in ConsumeMQTT with truststore only SSL CS
This closes #4587.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-20 00:29:30 +01:00
Mark Payne 930e8d9e0e
NIFI-7698: Added a merge.reason attribute for flowfiles indicating why they were merged by MergeContent. Also updated logs to indicate the reason and added additional documentation for processor
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4764
2021-01-19 17:20:06 -05:00
s9514171 b4ddeb8997 NIFI-8116 The old peers do not be deleted when the URIs of the remote process group are changed
This closes #4745.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-19 16:25:09 -05:00
Mark Payne f02079c2fa
NIFI-8146: Added RecordPath for Statement Type and to specify where to find the data within the incoming Record. Also performed some minor code refactoring to avoid lots of large lambdas, as it results in code that is more readable and more maintainable. Updated some properties to use dependsOn() notation now that this is available.
NIFI-8146: Updated PutDatabaseRecord to avoid using the functional style framework that had previously been used. Doing so resulted in code that was difficult to understand and maintain. Added additional unit tests and improved MockRecordParser so that it could throw configurable types of exceptions

NIFI-8146: Fixed checkstyle issues

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4763
2021-01-19 13:23:54 -05:00
eduardofontes 3e72dfe421
NIFI-8109 - Update MongoDBControllerService to externalize username and password
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4759.
2021-01-19 21:21:44 +04:00
Chris Sampson 40f193098b
NIFI-7726 correct versionedFlowState field name in SiteToSiteStatusReportingTask schema
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4762.
2021-01-19 10:40:38 +04:00
Mark Payne 097edf4f7c
NIFI-8136: Added getState/setState/replaceState/clearState methods to ProcessSession, updated processors to use these methods instead of StateManager version where appropriate
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4757
2021-01-15 10:02:09 -05:00
Matthew Burgess b9076ca26e NIFI-7989: Add Update Field Names and Record Writer to UpdateHiveTable processors
NIFI-7989: Only rewrite records if a field name doesn't match a table column name exactly
NIFI-7989: Rewrite records for created tables if Update Field Names is set

This closes #4750.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-13 23:26:44 +01:00
Nissim Shiman 3cc8d767b3 NIFI-7738 Reverse Provenance Query
This closes #4563.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-13 09:35:05 -05:00
Matthew Burgess 382439c1d0 NIFI-7973: Add default precision and scale properties to remaining SQL-based components
This closes #4682.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-13 08:41:12 -05:00
tlsmith 0b966cdb14
NIFI-7991 Flow Configuration History displays "annotation data not found/available" from "Advanced" changes
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4668
2021-01-12 16:09:38 -05:00
Matthew Burgess 2d69179184
NIFI-8138: Add Sensitive Property value to property tooltip
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4752.
2021-01-13 00:44:03 +04:00
exceptionfactory 7d76bcd520 NIFI-8094 Added support for BCFKS Keystore Type
NIFI-8094 Updated Administration Guide to include BCFKS

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4729.
2021-01-12 10:52:49 -05:00
Mike Thomsen 82c84492ce
NIFI-7906 Fixed a bug in how record paths were handled.
NIFI-7906 Fixed bugs in unit tests.

NIFI-7906 Updated a few things based on a code review.

NIFI-7906: Fixed typo in record.count attribute

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4739
2021-01-12 10:32:08 -05:00
exceptionfactory 5f7558cecf NIFI-8069 Set invalid status when Controller Services are enabling
This closes #4710.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-01-11 13:42:52 -05:00
Peter Turcsanyi 84b561ad33
NIFI-8131: Support aws_s3_v2_directory in Atlas reporting task
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4751.
2021-01-11 21:53:12 +04:00
exceptionfactory d41f2e1d0a NIFI-8121 Updated ListenHTTP with inferred Client Authentication Policy
- Added default property value for automatic determination of Client Authentication Policy based on SSLContextService Trust Store properties
- Added new ClientAuthentication enum with values specific to ListenHTTP

This closes #4749.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-01-11 18:02:09 +01:00