Commit Graph

6266 Commits

Author SHA1 Message Date
Denes Arvay d05d0c6240 NIFI-7925: ValidateRecord reports false positive for avro arrays with null elements 2020-10-21 09:17:29 -04:00
Joey Frazee 55cb8d73cb NIFI-7401 Add ZooKeeper client TLS to CuratorLeaderElectionManager
NIFI-7401 Rebased to 1.13.0-SNAPSHOT and simplified tests

NIFI-7401 Added keystore types and changed properties to match nifi.security.*

NIFI-7401 Removed dead code from SecureClientZooKeeperFactory test

NIFI-7401 Renamed bean methods, moved helper code into NiFiProperties

NIFI-7401 Changed connection socket constants to use .class.getName()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4592.
2020-10-20 11:20:43 -04:00
eylonronen b442df58e2
NIFI-7935 Add reason to flow file on error
This closes #4608

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-16 18:44:27 -04:00
Indrajeet Gour 4a370eae8c
NIFI-7933 - Set proper property descriptor for CSV Escape
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4606.
2020-10-16 18:13:29 +02:00
Dan Kim 5b5b9a7800
NIFI-7916 refactor CountText to ignore whitespace words when counting
This closes #4595

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-14 09:09:42 -04:00
Pierre Villard 52f1fe54a5
Merge pull request #4597 from apache/dependabot/maven/nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin/junit-junit-4.13.1
Bump junit from 4.13 to 4.13.1 in /nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin
2020-10-13 11:32:11 +02:00
Pierre Villard 2d3b171d63
Merge pull request #4598 from apache/dependabot/maven/junit-junit-4.13.1
Bump junit from 4.13 to 4.13.1
2020-10-13 11:31:36 +02:00
dependabot[bot] 8aa001a918
Bump junit from 4.13 to 4.13.1
Bumps [junit](https://github.com/junit-team/junit4) from 4.13 to 4.13.1.
- [Release notes](https://github.com/junit-team/junit4/releases)
- [Changelog](https://github.com/junit-team/junit4/blob/main/doc/ReleaseNotes4.13.1.md)
- [Commits](https://github.com/junit-team/junit4/compare/r4.13...r4.13.1)

Signed-off-by: dependabot[bot] <support@github.com>
2020-10-12 21:54:52 +00:00
Matthew Burgess 4c235f0405
NIFI-7909: Change DataTypeUtils.toInteger() to use Math.toIntExact()
This closes #4596

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-12 17:53:27 -04:00
dependabot[bot] 99a75e833b
Bump junit in /nifi-nar-bundles/nifi-ranger-bundle/nifi-ranger-plugin
Bumps [junit](https://github.com/junit-team/junit4) from 4.13 to 4.13.1.
- [Release notes](https://github.com/junit-team/junit4/releases)
- [Changelog](https://github.com/junit-team/junit4/blob/main/doc/ReleaseNotes4.13.1.md)
- [Commits](https://github.com/junit-team/junit4/compare/r4.13...r4.13.1)

Signed-off-by: dependabot[bot] <support@github.com>
2020-10-12 19:17:09 +00:00
Pierre Villard c2960998ac
NIFI-7869 - adding a GCP profile for GCS connector (#4565) 2020-10-09 09:42:20 -04:00
kpsngh1998 a95ffce6bd
NIFI-7534 Consume MQTT Processor. Support Expression Language for Topic Filter property
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4573.
2020-10-08 15:38:37 +02:00
Andy LoPresto 82d3fd6cd6 NIFI-7898 Fixed unit test which failed with simultaneous services running on localhost:80. 2020-10-08 08:58:14 -04:00
Peter Gyori 668c278e30
NIFI-7815: Enhance the logging in MergeContent processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4534.
2020-10-08 11:44:52 +02:00
Andrew Lim dee2fcedfe
NIFI-7871 Correct errors for UUID3, UUID5 and hash functions in EL Guide
Added links to UUID function in docs.

This closes #4583.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-10-07 16:35:21 -07:00
exceptionfactory efb629e37d
NIFI-7777 Removed support for Expression Language from Password property
Added unit test for no password configured on Zip files

This closes #4572.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-10-07 10:59:50 -07:00
exceptionfactory ea6b01159d
NIFI-7777 Added optional Password property to UnpackContent for decrypting Zip archives
This closes #4572.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-10-07 10:56:23 -07:00
M Tien de39a3d9f4
NIFI-7892 Created a Logout page to inform users of a complete logout when OIDC is configured. (#4579) 2020-10-07 12:17:00 -04:00
Matthew Burgess 325a49556c
NIFI-7592: Allow NiFi to be started without a GUI/REST interface (#4509)
* NIFI-7592: Allow NiFi to be started without a GUI/REST interface

* NIFI-7592: Enable all controller services when starting headless

* NIFI-7592: Marked duplicate dependencies as provided

* NIFI-7592: Incorporated additional review comments
2020-10-07 09:12:16 -04:00
Matthew Burgess 7cc3713389
NIFI-7796: Add Prometheus counters for total bytes sent/received (#4522)
* NIFI-7796: Add Prometheus metrics for total bytes sent/received, fixed read/written metrics

* NIFI-7796: Incorporated review comments
2020-10-06 09:26:27 -04:00
Matthew Burgess f4473afad6
Add hacktoberfest label to repo 2020-10-05 16:23:01 -04:00
Dan Kim 0d9f2087fa
NIFI-7883 replace explicit type with diamond type
This closes #4571

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-05 09:27:12 -04:00
abrown b4faf210d8
NIFI-4897 Add documentation to user guide for terminating a processor
NIFI-4897 fixed typos in new section

Fixed some typoes

This closes #4568

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-05 09:17:27 -04:00
Ofirmgr be72dbb815
rename onConfigured to OnEnabled to make code more clear
This closes #4547

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-04 14:55:57 -04:00
Mark Payne 5d37809d30
NIFI-7874: Fixed bug that results in buffering all S3 elements in heap before emitting any of them. Added Batch Size property to ListS3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4566.
2020-10-02 19:12:40 +02:00
Pierre Villard f32405ed16
NIFI-7844 - substring should return empty instead of throwing IndexOutOfBoundsException
This closes #4553

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-01 19:45:26 -04:00
Denes Arvay 6990f0d3a9
NIFI-7685: Add UTF8 support for FetchFTP
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4446
2020-10-01 17:35:46 -04:00
Mohammed Nadeem e2ccfbbacf
NIFI-7859: Support for capturing execution duration of query run as attributes in SelectHiveQL processors
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4560
2020-10-01 09:06:01 -04:00
markap14 b2489f7644
NIFI-7868: Track number of flowfiles/bytes sent/received/fetched in provenance reporter so that events that are emitted with 'immediate' flag true are still counted (#4564) 2020-09-30 19:58:20 -04:00
Matthew Burgess 62f4d09883 NIFI-7867: Add break statement to prevent diagnostics from running env afterward 2020-09-30 11:42:39 -04:00
Mike Thomsen a66c3d8168
NIFI-2580 Added a little explanation note about a common issue new users face with jsonpath.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4561.
2020-09-30 14:15:07 +02:00
Peter Turcsanyi f9ae3bb9c9
NIFI-7830: Support large files in PutAzureDataLakeStorage
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4556.
2020-09-30 11:16:31 +02:00
Pierre Villard a57d38c58d
NIFI-7827 - PutS3Object - configuration of the multipart temp dir (#4541) 2020-09-29 09:15:09 -04:00
Pierre Villard fa0a1df23f
NIFI-7817 - Fix ParquetReader instantiation error (#4538) 2020-09-29 09:08:29 -04:00
Pierre Villard 740bfee8f4
NIFI-7833 - Add Ozone support in Hadoop components where appropriate (#4545)
* NIFI-7833 - Add Ozone support in Hadoop components where appropriate

* added fs dependency
2020-09-29 09:06:13 -04:00
Matthew Burgess 95fb8e3144
NIFI-7503: PutSQL - only call commit() and rollback() if autocommit is disabled
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4558.
2020-09-29 11:08:44 +02:00
doodzio 02ee999efb NIFI-4303 Add routingKey to ConsumeAMQP processor
Add exchange to ConsumeAMQP processor
Update test
Refactoring tests

This closes #4464.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-09-28 23:12:29 +02:00
Denes Arvay f73a019f36 NIFI-7843 Recursive avro schemas fail to write with RecordWriter
NIFI-7843 Recursive avro schemas fail to write with RecordWriter
Add new test case to TestSimpleRecordSchema to test the scenario
when schema name and schema namespace match.

This closes #4550.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-09-28 19:52:41 +02:00
Mohammed Nadeem 9c83908c9c
NIFI-7852: Small correction in additional details of LookupRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4555.
2020-09-28 15:10:46 +02:00
Greg Solovyev e09317223e
NIFI-7565 Add support for DATE to Kudu NAR bundle
- update Kudu dependencies to Kudu 1.13.0
- add support for passing java.sql.Date for Kudu DATE columns
- add tests for passing java.sql.Date to DATE columns

more about DATE type support in Kudu:
https://issues.apache.org/jira/browse/KUDU-2632

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4549.
2020-09-28 15:08:07 +02:00
VKadam 7e0bcb98e1
NIFI-7841: Made corrections in the nifi-walkthroughs docs (#4548)
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-09-23 16:37:26 -07:00
Pierre Villard 0996674522 NIFI-7834 - InvokeAWSGatewayAPI should not be annotated with @TriggerWhenEmpty 2020-09-22 15:58:16 -04:00
Bryan Bende caf79601ac
NIFI-7832 Resetting boolean that indicates password is being used when service is disabled (#4543)
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-09-22 09:11:46 -07:00
Paul Kelly 73df6f1edf NIFI-7794 Adding a property to PutAzureStorageBlob to determine whether to check the existence of a container and create it if necessary.
This closes #4535.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-09-21 14:18:56 -05:00
Mohammed Nadeem 4040664886
NIFI-7816: Correct documentation example for urlEncode function in Expression Language Guide (#4536)
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-09-21 12:12:23 -07:00
Peter Wicks dbf92b9a72
NIFI-5829 Create Lookup Controller Services for RecordSetWriter and RecordReader
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3188
2020-09-21 14:57:06 -04:00
abrown 953abba6d6
NIFI-5061-NiFi documentation incomplete/wrong for EL hierarchy.
Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4530.
2020-09-20 19:48:14 +02:00
Matthew Burgess f531b7a780
NIFI-7811: Prevent NPE and bad behavior when PrometheusReportingTask can't start
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4531.
2020-09-18 16:13:46 +02:00
Matthew Burgess 7e145142e1
NIFI-7799: Relogin with Kerberos on connect exception in DBCPConnectionPool (#4519) 2020-09-17 13:33:54 -04:00
Andy LoPresto 9370571131
NIFI-7804 Split nifi-security-utils into sub-module for nifi-security… (#4533)
* NIFI-7804 Split nifi-security-utils into sub-module for nifi-security-utils-api (no external dependencies).
Separated interface and implementation of TlsConfiguration.
Reabsorbed nifi-security-xml-config into nifi-security-utils.

* NIFI-7804 Resolved failing unit test on Java 8.
Removed accidental module dependency.

* NIFI-7804 Resolved failing unit test.

* NIFI-7804 Removed legacy dependency.

* NIFI-7804 Marked nifi-security-utils-api as provided and overrode with compile scope in specific modules which are not children of nifi-standard-services-api-nar.
2020-09-17 12:52:22 -04:00