7cc3713389
NIFI-7796: Add Prometheus counters for total bytes sent/received ( #4522 )
...
* NIFI-7796: Add Prometheus metrics for total bytes sent/received, fixed read/written metrics
* NIFI-7796: Incorporated review comments
2020-10-06 09:26:27 -04:00
f4473afad6
Add hacktoberfest label to repo
2020-10-05 16:23:01 -04:00
0d9f2087fa
NIFI-7883 replace explicit type with diamond type
...
This closes #4571
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-05 09:27:12 -04:00
b4faf210d8
NIFI-4897 Add documentation to user guide for terminating a processor
...
NIFI-4897 fixed typos in new section
Fixed some typoes
This closes #4568
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-05 09:17:27 -04:00
be72dbb815
rename onConfigured to OnEnabled to make code more clear
...
This closes #4547
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-04 14:55:57 -04:00
5d37809d30
NIFI-7874: Fixed bug that results in buffering all S3 elements in heap before emitting any of them. Added Batch Size property to ListS3
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4566 .
2020-10-02 19:12:40 +02:00
f32405ed16
NIFI-7844 - substring should return empty instead of throwing IndexOutOfBoundsException
...
This closes #4553
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-10-01 19:45:26 -04:00
6990f0d3a9
NIFI-7685: Add UTF8 support for FetchFTP
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4446
2020-10-01 17:35:46 -04:00
e2ccfbbacf
NIFI-7859: Support for capturing execution duration of query run as attributes in SelectHiveQL processors
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4560
2020-10-01 09:06:01 -04:00
b2489f7644
NIFI-7868: Track number of flowfiles/bytes sent/received/fetched in provenance reporter so that events that are emitted with 'immediate' flag true are still counted ( #4564 )
2020-09-30 19:58:20 -04:00
62f4d09883
NIFI-7867: Add break statement to prevent diagnostics from running env afterward
2020-09-30 11:42:39 -04:00
a66c3d8168
NIFI-2580 Added a little explanation note about a common issue new users face with jsonpath.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4561 .
2020-09-30 14:15:07 +02:00
f9ae3bb9c9
NIFI-7830: Support large files in PutAzureDataLakeStorage
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4556 .
2020-09-30 11:16:31 +02:00
a57d38c58d
NIFI-7827 - PutS3Object - configuration of the multipart temp dir ( #4541 )
2020-09-29 09:15:09 -04:00
fa0a1df23f
NIFI-7817 - Fix ParquetReader instantiation error ( #4538 )
2020-09-29 09:08:29 -04:00
740bfee8f4
NIFI-7833 - Add Ozone support in Hadoop components where appropriate ( #4545 )
...
* NIFI-7833 - Add Ozone support in Hadoop components where appropriate
* added fs dependency
2020-09-29 09:06:13 -04:00
95fb8e3144
NIFI-7503: PutSQL - only call commit() and rollback() if autocommit is disabled
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4558 .
2020-09-29 11:08:44 +02:00
02ee999efb
NIFI-4303 Add routingKey to ConsumeAMQP processor
...
Add exchange to ConsumeAMQP processor
Update test
Refactoring tests
This closes #4464 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-09-28 23:12:29 +02:00
f73a019f36
NIFI-7843 Recursive avro schemas fail to write with RecordWriter
...
NIFI-7843 Recursive avro schemas fail to write with RecordWriter
Add new test case to TestSimpleRecordSchema to test the scenario
when schema name and schema namespace match.
This closes #4550 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-09-28 19:52:41 +02:00
9c83908c9c
NIFI-7852: Small correction in additional details of LookupRecord
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4555 .
2020-09-28 15:10:46 +02:00
e09317223e
NIFI-7565 Add support for DATE to Kudu NAR bundle
...
- update Kudu dependencies to Kudu 1.13.0
- add support for passing java.sql.Date for Kudu DATE columns
- add tests for passing java.sql.Date to DATE columns
more about DATE type support in Kudu:
https://issues.apache.org/jira/browse/KUDU-2632
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4549 .
2020-09-28 15:08:07 +02:00
7e0bcb98e1
NIFI-7841: Made corrections in the nifi-walkthroughs docs ( #4548 )
...
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-09-23 16:37:26 -07:00
0996674522
NIFI-7834 - InvokeAWSGatewayAPI should not be annotated with @TriggerWhenEmpty
2020-09-22 15:58:16 -04:00
caf79601ac
NIFI-7832 Resetting boolean that indicates password is being used when service is disabled ( #4543 )
...
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-09-22 09:11:46 -07:00
73df6f1edf
NIFI-7794 Adding a property to PutAzureStorageBlob to determine whether to check the existence of a container and create it if necessary.
...
This closes #4535 .
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-09-21 14:18:56 -05:00
4040664886
NIFI-7816: Correct documentation example for urlEncode function in Expression Language Guide ( #4536 )
...
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2020-09-21 12:12:23 -07:00
dbf92b9a72
NIFI-5829 Create Lookup Controller Services for RecordSetWriter and RecordReader
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3188
2020-09-21 14:57:06 -04:00
953abba6d6
NIFI-5061-NiFi documentation incomplete/wrong for EL hierarchy.
...
Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4530 .
2020-09-20 19:48:14 +02:00
f531b7a780
NIFI-7811: Prevent NPE and bad behavior when PrometheusReportingTask can't start
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4531 .
2020-09-18 16:13:46 +02:00
7e145142e1
NIFI-7799: Relogin with Kerberos on connect exception in DBCPConnectionPool ( #4519 )
2020-09-17 13:33:54 -04:00
9370571131
NIFI-7804 Split nifi-security-utils into sub-module for nifi-security… ( #4533 )
...
* NIFI-7804 Split nifi-security-utils into sub-module for nifi-security-utils-api (no external dependencies).
Separated interface and implementation of TlsConfiguration.
Reabsorbed nifi-security-xml-config into nifi-security-utils.
* NIFI-7804 Resolved failing unit test on Java 8.
Removed accidental module dependency.
* NIFI-7804 Resolved failing unit test.
* NIFI-7804 Removed legacy dependency.
* NIFI-7804 Marked nifi-security-utils-api as provided and overrode with compile scope in specific modules which are not children of nifi-standard-services-api-nar.
2020-09-17 12:52:22 -04:00
624678466b
NIFI-7580-Add documentation around autoloading NARs
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4529 .
2020-09-17 12:50:13 +02:00
266433e13d
NIFI-7624: ListenFTP processor
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4481 .
2020-09-17 12:37:58 +02:00
fc610eaeda
NIFI-5583: Add cdc processor for MySQL referring to GTID.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2997 .
2020-09-17 12:28:32 +02:00
f4ee9fefa9
NIFI-7768 Added support for monogdb+srv connection strings.
...
This closes #4514 .
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-09-16 18:40:02 -07:00
800655c938
NIFI-7805 ResultSetRecordSet can't generate a schema if first row contains NULL Decimal
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4532 .
2020-09-16 18:05:12 +02:00
df64416e91
NIFI-7800: Fix line endings for changed files
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4527 .
2020-09-16 09:26:15 +02:00
60a5d71809
NIFI-7803: Allow ExecuteSQL(Record) properties to evaluate flowfile attributes where possible
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4523 .
2020-09-15 21:02:52 +02:00
b3ae27a4ca
NIFI-7807 Updating in-class documentation to be more clear & adding additionalDetails with examples
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4526 .
2020-09-14 19:13:57 +02:00
dc4daa2923
NIFI-7742: remove defined and null check
...
This closes #4524
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2020-09-14 10:50:06 -04:00
80bc40a9af
NIFI-7742: update case clause logic
2020-09-14 10:03:41 -04:00
e3d551e87d
NIFI-7742: add case for controller service selections
2020-09-14 10:03:41 -04:00
b5c3a2d7f9
NIFI-7802 Remove commons-configuration2 dependency from nifi-security-utils which ends up nifi-standard-services-api and on the classpath of any standard services
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4525
2020-09-12 19:25:20 -04:00
fd8b0b286f
NIFI-7800: Provide an option to omit XML declaration for XMLRecordSetWriter
...
NIFI-7800: Mark new property as required
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4520
2020-09-11 13:05:40 -04:00
f6d6e4adc9
NIFI-7798 Upgrade to apache ranger 2.1.0 client
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4518 .
2020-09-11 16:51:43 +02:00
6b34a8b36e
NIFI-7759: Minor misspelling in rollover help for 'Stream When Available' process group configuration
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4521 .
2020-09-11 16:41:25 +02:00
0dff3bc065
NIFI-7429 Adding status history for system level metrics
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4420 .
2020-09-10 16:19:11 +02:00
73b7ff8fd4
NIFI-7770 Add features to csv lookup services
...
Add the following functionalities:
- Custom value separator (default is comma)
- Custom quote char to use (default is " i.e. quote sign)
- Quote mode
- Escape character to use (default is no escape character)
- Comment marker
- Trim fields
- Character set to use
The above features use a common implementation with "CSVReader".
Also append a sentence to the capability description that first line of
csv file is considered header. Setting custom header instead of using
the first line is not supported (yet).
Also, a minor refactor: CSVRecordLoopkupService and
SimpleCsvFileLookupService now share common logic in implementation.
CSV Format is extended to the same list as CSVReader. In addition,
lookup services still have the "default" csv format for compatibility
reasons.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4494 .
2020-09-08 10:46:29 +02:00
44738b72cd
NIFI-7754 - Support HTTP Proxy for JettyWebSocketClient
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4502 .
2020-09-07 17:10:11 +02:00
85501e08e6
NIFI-7506 add snappy-hadoop to CompressContent
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4321 .
2020-09-07 13:54:33 +02:00
Matthew Burgess
Dan Kim
abrown
Ofirmgr
Mark Payne
Pierre Villard
Denes Arvay
Mohammed Nadeem
Mike Thomsen
Peter Turcsanyi
doodzio
Greg Solovyev
VKadam
Bryan Bende
Paul Kelly
Peter Wicks
Andy LoPresto
Peter Gyori
yoshiata
Shane Ardell
Bence Simon
Tamás Bunth
Andreas Schöneck
noedetore