Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,183 Commits 146 Branches 201 Tags 406 MiB
Commit Graph

6183 Commits

Author SHA1 Message Date
Pierre Villard fa0a1df23f
NIFI-7817 - Fix ParquetReader instantiation error (#4538) 2020-09-29 09:08:29 -04:00
Pierre Villard 740bfee8f4
NIFI-7833 - Add Ozone support in Hadoop components where appropriate (#4545) 
* NIFI-7833 - Add Ozone support in Hadoop components where appropriate

* added fs dependency
 2020-09-29 09:06:13 -04:00
Matthew Burgess 95fb8e3144
NIFI-7503: PutSQL - only call commit() and rollback() if autocommit is disabled 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4558.
 2020-09-29 11:08:44 +02:00
doodzio 02ee999efb NIFI-4303 Add routingKey to ConsumeAMQP processor 
Add exchange to ConsumeAMQP processor
Update test
Refactoring tests

This closes #4464.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-09-28 23:12:29 +02:00
Denes Arvay f73a019f36 NIFI-7843 Recursive avro schemas fail to write with RecordWriter 
NIFI-7843 Recursive avro schemas fail to write with RecordWriter
Add new test case to TestSimpleRecordSchema to test the scenario
when schema name and schema namespace match.

This closes #4550.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-09-28 19:52:41 +02:00
Mohammed Nadeem 9c83908c9c
NIFI-7852: Small correction in additional details of LookupRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4555.
 2020-09-28 15:10:46 +02:00
Greg Solovyev e09317223e
NIFI-7565 Add support for DATE to Kudu NAR bundle 
- update Kudu dependencies to Kudu 1.13.0
- add support for passing java.sql.Date for Kudu DATE columns
- add tests for passing java.sql.Date to DATE columns

more about DATE type support in Kudu:
https://issues.apache.org/jira/browse/KUDU-2632

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4549.
 2020-09-28 15:08:07 +02:00
VKadam 7e0bcb98e1
NIFI-7841: Made corrections in the nifi-walkthroughs docs (#4548) 
Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-09-23 16:37:26 -07:00
Pierre Villard 0996674522 NIFI-7834 - InvokeAWSGatewayAPI should not be annotated with @TriggerWhenEmpty 2020-09-22 15:58:16 -04:00
Bryan Bende caf79601ac
NIFI-7832 Resetting boolean that indicates password is being used when service is disabled (#4543) 
Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-09-22 09:11:46 -07:00
Paul Kelly 73df6f1edf NIFI-7794 Adding a property to PutAzureStorageBlob to determine whether to check the existence of a container and create it if necessary. 
This closes #4535.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2020-09-21 14:18:56 -05:00
Mohammed Nadeem 4040664886
NIFI-7816: Correct documentation example for urlEncode function in Expression Language Guide (#4536) 
Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-09-21 12:12:23 -07:00
Peter Wicks dbf92b9a72
NIFI-5829 Create Lookup Controller Services for RecordSetWriter and RecordReader 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #3188
 2020-09-21 14:57:06 -04:00
abrown 953abba6d6
NIFI-5061-NiFi documentation incomplete/wrong for EL hierarchy. 
Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4530.
 2020-09-20 19:48:14 +02:00
Matthew Burgess f531b7a780
NIFI-7811: Prevent NPE and bad behavior when PrometheusReportingTask can't start 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4531.
 2020-09-18 16:13:46 +02:00
Matthew Burgess 7e145142e1
NIFI-7799: Relogin with Kerberos on connect exception in DBCPConnectionPool (#4519) 2020-09-17 13:33:54 -04:00
Andy LoPresto 9370571131
NIFI-7804 Split nifi-security-utils into sub-module for nifi-security… (#4533) 
* NIFI-7804 Split nifi-security-utils into sub-module for nifi-security-utils-api (no external dependencies).
Separated interface and implementation of TlsConfiguration.
Reabsorbed nifi-security-xml-config into nifi-security-utils.

* NIFI-7804 Resolved failing unit test on Java 8.
Removed accidental module dependency.

* NIFI-7804 Resolved failing unit test.

* NIFI-7804 Removed legacy dependency.

* NIFI-7804 Marked nifi-security-utils-api as provided and overrode with compile scope in specific modules which are not children of nifi-standard-services-api-nar.
 2020-09-17 12:52:22 -04:00
abrown 624678466b
NIFI-7580-Add documentation around autoloading NARs 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4529.
 2020-09-17 12:50:13 +02:00
Peter Gyori 266433e13d
NIFI-7624: ListenFTP processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4481.
 2020-09-17 12:37:58 +02:00
yoshiata fc610eaeda
NIFI-5583: Add cdc processor for MySQL referring to GTID. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2997.
 2020-09-17 12:28:32 +02:00
Mike Thomsen f4ee9fefa9 NIFI-7768 Added support for monogdb+srv connection strings. 
This closes #4514.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2020-09-16 18:40:02 -07:00
Peter Wicks 800655c938
NIFI-7805 ResultSetRecordSet can't generate a schema if first row contains NULL Decimal 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4532.
 2020-09-16 18:05:12 +02:00
Matthew Burgess df64416e91
NIFI-7800: Fix line endings for changed files 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4527.
 2020-09-16 09:26:15 +02:00
Matthew Burgess 60a5d71809
NIFI-7803: Allow ExecuteSQL(Record) properties to evaluate flowfile attributes where possible 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4523.
 2020-09-15 21:02:52 +02:00
abrown b3ae27a4ca
NIFI-7807 Updating in-class documentation to be more clear & adding additionalDetails with examples 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4526.
 2020-09-14 19:13:57 +02:00
Shane Ardell dc4daa2923 NIFI-7742: remove defined and null check 
This closes #4524

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2020-09-14 10:50:06 -04:00
Shane Ardell 80bc40a9af NIFI-7742: update case clause logic 2020-09-14 10:03:41 -04:00
Shane Ardell e3d551e87d NIFI-7742: add case for controller service selections 2020-09-14 10:03:41 -04:00
Bryan Bende b5c3a2d7f9 NIFI-7802 Remove commons-configuration2 dependency from nifi-security-utils which ends up nifi-standard-services-api and on the classpath of any standard services 
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4525
 2020-09-12 19:25:20 -04:00
Mohammed Nadeem fd8b0b286f
NIFI-7800: Provide an option to omit XML declaration for XMLRecordSetWriter 
NIFI-7800: Mark new property as required

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4520
 2020-09-11 13:05:40 -04:00
Bryan Bende f6d6e4adc9
NIFI-7798 Upgrade to apache ranger 2.1.0 client 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4518.
 2020-09-11 16:51:43 +02:00
Mohammed Nadeem 6b34a8b36e
NIFI-7759: Minor misspelling in rollover help for 'Stream When Available' process group configuration 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4521.
 2020-09-11 16:41:25 +02:00
Bence Simon 0dff3bc065
NIFI-7429 Adding status history for system level metrics 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4420.
 2020-09-10 16:19:11 +02:00
Tamás Bunth 73b7ff8fd4
NIFI-7770 Add features to csv lookup services 
Add the following functionalities:
- Custom value separator (default is comma)
- Custom quote char to use (default is " i.e. quote sign)
- Quote mode
- Escape character to use (default is no escape character)
- Comment marker
- Trim fields
- Character set to use

The above features use a common implementation with "CSVReader".

Also append a sentence to the capability description that first line of
csv file is considered header. Setting custom header instead of using
the first line is not supported (yet).

Also, a minor refactor: CSVRecordLoopkupService and
SimpleCsvFileLookupService now share common logic in implementation.

CSV Format is extended to the same list as CSVReader. In addition,
lookup services still have the "default" csv format for compatibility
reasons.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4494.
 2020-09-08 10:46:29 +02:00
Andreas Schöneck 44738b72cd
NIFI-7754 - Support HTTP Proxy for JettyWebSocketClient 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4502.
 2020-09-07 17:10:11 +02:00
noedetore 85501e08e6
NIFI-7506 add snappy-hadoop to CompressContent 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4321.
 2020-09-07 13:54:33 +02:00
Mohammed Nadeem 0d4def7843
NIFI-7789: Small Correction in additionalDetials of ScriptedTransformRecord processor documentation 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4511
 2020-09-04 11:41:33 -04:00
Mark Payne fd068fe978
NIFI-7557: uses a canonical representation of strings when recovering data from FlowFile Repository in order to avoid using huge amounts of heap when not necessary 
- Fixed some problems with unit/integration tests

This closes #4507.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-09-03 10:21:50 -04:00
Andrew Lim 29e23e57b9
NIFI-7743 Document Empty all queues option for Process Groups 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4506
 2020-09-02 17:14:17 -04:00
Cameron E. Tidd 9a1ae469d8
NIFI-7167 This closes #4486. Fixing resource leaks in IdentifyMimeType 
The TikaInputStream and FileInputStream instances utilized in IdentifyMimeType are now explicitly closed. The FileInputStream is additionally wrapped by a BufferedInputStream.

Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-09-02 13:22:26 -05:00
Kotaro Terada c3cab48325
NIFI-7730 Added regression tests for multiple certificate keystores. 
Cleaned up JettyServer code.
Changed test logging severity to include debug statements.
Added test resources.

This closes #4498.

Co-authored-by: Kotaro Terada <kotarot@apache.org>
 2020-09-01 18:32:03 -07:00
Nathan Gough 1e6619b91f
NIFI-7767 - Fixed issue with tls-toolkit not adding SANs to generated certificates. Added tests. 
NIFI-7767 - Fixed up TlsCertificateAuthorityTest to include SAN in tests.
 2020-09-01 16:32:16 -07:00
VKadam e884b3cdb2
NIFI-7778: Made corrections in descriptions of padLeft, padRight, plus (#4504) 
Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-09-01 13:07:47 -07:00
Matthew Burgess b4a820e7c3
Updated docker-compose.yml to latest snapshot version 2020-09-01 13:21:56 -04:00
Matthew Burgess 45470b0984 NIFI-7740: Add Records Per Transaction and Transactions Per Batch properties to PutHive3Streaming 
NIFI-7740: Incorporated review comments

NIFI-7740: Restore RecordsEOFException superclass to SerializationError

This closes #4489.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-09-01 17:17:02 +02:00
Mohammed Nadeem 943904c12c NIFI-7779: Avoid NPE when a ExecuteScript Processor has null value properties during a component search from canvas 2020-09-01 09:40:32 -04:00
jmconte bdead4d040 NIFI-7762 - support copy-paste on Disabled ports 2020-08-31 15:56:12 -04:00
Bryan Bende 87685dd4e1 NIFI-7661 Change validation of controller service against it's API to use comparison of inteface methods instead of bundle coordinates 2020-08-31 15:33:45 -04:00
Matthew Burgess 3952c70448 NIFI-7745: Add SampleRecord processor 
This closes #4482.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2020-08-28 14:28:19 -05:00
Kristjan Antunovic 483af3a460
NIFI-6767 Persist registry URL after service restart. 
This closes #4006.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-08-28 09:58:39 -04:00