Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-11 20:45:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,013 Commits 148 Branches 203 Tags
Commit Graph

4007 Commits

Author SHA1 Message Date
Mike Thomsen
f4ee9fefa9 NIFI-7768 Added support for monogdb+srv connection strings. 
This closes #4514.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2020-09-16 18:40:02 -07:00
Matthew Burgess
df64416e91
NIFI-7800: Fix line endings for changed files 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4527.
 2020-09-16 09:26:15 +02:00
Matthew Burgess
60a5d71809
NIFI-7803: Allow ExecuteSQL(Record) properties to evaluate flowfile attributes where possible 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4523.
 2020-09-15 21:02:52 +02:00
abrown
b3ae27a4ca
NIFI-7807 Updating in-class documentation to be more clear & adding additionalDetails with examples 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4526.
 2020-09-14 19:13:57 +02:00
Shane Ardell
dc4daa2923 NIFI-7742: remove defined and null check 
This closes #4524

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2020-09-14 10:50:06 -04:00
Shane Ardell
80bc40a9af NIFI-7742: update case clause logic 2020-09-14 10:03:41 -04:00
Shane Ardell
e3d551e87d NIFI-7742: add case for controller service selections 2020-09-14 10:03:41 -04:00
Bryan Bende
b5c3a2d7f9 NIFI-7802 Remove commons-configuration2 dependency from nifi-security-utils which ends up nifi-standard-services-api and on the classpath of any standard services 
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4525
 2020-09-12 19:25:20 -04:00
Mohammed Nadeem
fd8b0b286f
NIFI-7800: Provide an option to omit XML declaration for XMLRecordSetWriter 
NIFI-7800: Mark new property as required

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4520
 2020-09-11 13:05:40 -04:00
Bryan Bende
f6d6e4adc9
NIFI-7798 Upgrade to apache ranger 2.1.0 client 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4518.
 2020-09-11 16:51:43 +02:00
Mohammed Nadeem
6b34a8b36e
NIFI-7759: Minor misspelling in rollover help for 'Stream When Available' process group configuration 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4521.
 2020-09-11 16:41:25 +02:00
Bence Simon
0dff3bc065
NIFI-7429 Adding status history for system level metrics 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4420.
 2020-09-10 16:19:11 +02:00
Tamás Bunth
73b7ff8fd4
NIFI-7770 Add features to csv lookup services 
Add the following functionalities:
- Custom value separator (default is comma)
- Custom quote char to use (default is " i.e. quote sign)
- Quote mode
- Escape character to use (default is no escape character)
- Comment marker
- Trim fields
- Character set to use

The above features use a common implementation with "CSVReader".

Also append a sentence to the capability description that first line of
csv file is considered header. Setting custom header instead of using
the first line is not supported (yet).

Also, a minor refactor: CSVRecordLoopkupService and
SimpleCsvFileLookupService now share common logic in implementation.

CSV Format is extended to the same list as CSVReader. In addition,
lookup services still have the "default" csv format for compatibility
reasons.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4494.
 2020-09-08 10:46:29 +02:00
Andreas Schöneck
44738b72cd
NIFI-7754 - Support HTTP Proxy for JettyWebSocketClient 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4502.
 2020-09-07 17:10:11 +02:00
noedetore
85501e08e6
NIFI-7506 add snappy-hadoop to CompressContent 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4321.
 2020-09-07 13:54:33 +02:00
Mohammed Nadeem
0d4def7843
NIFI-7789: Small Correction in additionalDetials of ScriptedTransformRecord processor documentation 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4511
 2020-09-04 11:41:33 -04:00
Mark Payne
fd068fe978
NIFI-7557: uses a canonical representation of strings when recovering data from FlowFile Repository in order to avoid using huge amounts of heap when not necessary 
- Fixed some problems with unit/integration tests

This closes #4507.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-09-03 10:21:50 -04:00
Cameron E. Tidd
9a1ae469d8
NIFI-7167 This closes #4486. Fixing resource leaks in IdentifyMimeType 
The TikaInputStream and FileInputStream instances utilized in IdentifyMimeType are now explicitly closed. The FileInputStream is additionally wrapped by a BufferedInputStream.

Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-09-02 13:22:26 -05:00
Kotaro Terada
c3cab48325
NIFI-7730 Added regression tests for multiple certificate keystores. 
Cleaned up JettyServer code.
Changed test logging severity to include debug statements.
Added test resources.

This closes #4498.

Co-authored-by: Kotaro Terada <kotarot@apache.org>
 2020-09-01 18:32:03 -07:00
Matthew Burgess
45470b0984 NIFI-7740: Add Records Per Transaction and Transactions Per Batch properties to PutHive3Streaming 
NIFI-7740: Incorporated review comments

NIFI-7740: Restore RecordsEOFException superclass to SerializationError

This closes #4489.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-09-01 17:17:02 +02:00
Mohammed Nadeem
943904c12c NIFI-7779: Avoid NPE when a ExecuteScript Processor has null value properties during a component search from canvas 2020-09-01 09:40:32 -04:00
jmconte
bdead4d040 NIFI-7762 - support copy-paste on Disabled ports 2020-08-31 15:56:12 -04:00
Bryan Bende
87685dd4e1 NIFI-7661 Change validation of controller service against it's API to use comparison of inteface methods instead of bundle coordinates 2020-08-31 15:33:45 -04:00
Matthew Burgess
3952c70448 NIFI-7745: Add SampleRecord processor 
This closes #4482.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2020-08-28 14:28:19 -05:00
Kristjan Antunovic
483af3a460
NIFI-6767 Persist registry URL after service restart. 
This closes #4006.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-08-28 09:58:39 -04:00
Denes Arvay
ca43615702 NIFI-7714: QueryCassandra loses precision when converting timestamps to JSON 
Updated the patch based on @tpalfy's review
Updated the patch based on @mattyb149's review
Rename DATE_FORMAT_PATTERN to JSON_TIMESTAMP_FORMAT_PATTERN
Changed convertToJsonStream method's visibility to package private.
Removed json prefix from timestamp-format-pattern property to make it more generic

This closes #4463.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-08-27 17:06:57 +02:00
Tamás Bunth
aaab9ee0cf NIFI-7760 Remove invalid permission check 
Because even though permissions are only the 7 least significant bits of the file
mode but the file mode can be wider and can contain further info (like the
sticky bit).

Extend unit test for converting file mode with sticky bit into 'rwx' style
permission string.

Remove old test cases

This closes #4490.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-08-25 19:37:18 +02:00
Pierre Villard
d0c0f9704c
NIFI-7751 - This closes #4483. fix for TestExecuteStreamCommand unit tests 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-08-24 12:52:07 -07:00
Joe Witt
8baa5c9940
NIFI-7692 updating for next dev release 1.13.0 2020-08-18 14:48:02 -07:00
Joe Witt
fb57bcbc11
NIFI-7692-RC1 prepare for next development iteration 2020-08-13 09:20:39 -07:00
Joe Witt
303d6c59ba
NIFI-7692-RC1 prepare release nifi-1.12.0-RC1 2020-08-13 09:20:36 -07:00
Joe Witt
1b121ba18f
NIFI-7692 reduced excessive test file size 
Self merging as part of RC1 generation.

Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-08-13 08:49:07 -07:00
Tamas Palfy
6c3c2c173b NIFI-7736 Fix: Empty All Queues performance - When authorizing request, checking read/write credentials on encapsulated process groups and connections was doubly recursive (for each element it added all child elements multiple times again, making this exponential instead of linear). 2020-08-13 10:42:44 -04:00
Matthew Burgess
b7b2533ffe NIFI-7734: Added Record Separator property to CSVReader 2020-08-12 22:05:08 -04:00
Joe Witt
4417b9d64a
NIFI-6666 removing all modifications to the nifi-api and the newly created builder class 
This closes #4475.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-08-12 17:49:51 -07:00
Tamas Palfy
3e18d5b236 NIFI-7722 Catching 'Throwable' instead of 'Exception' in 'NodeHttpRequest.run()' to make sure subsequent 'Object.notify()' (when request replication has completed) is not missed out even if an 'Error' is thrown. 2020-08-12 12:38:56 -04:00
Mark Payne
869c4236c4
NIFI-7729: Ensure that if a script used in the ScriptedTransformRecord processor introduces a new field to the schema that the field gets incorporated into the schema. 
NIFI-7729: Updated docs to explain how to add new fields to Records via ScriptedTransformRecord and added example. Fixed checkstyle violation.

NIFI-7729: Always call Record.incorporateInactiveFields with ScriptedTransformRecord

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4470
 2020-08-11 18:06:55 -04:00
Kyle Miracle
a79493082c
NIFI-XXXX Fixed typo in documentation. 
This closes #4455.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-08-11 14:43:06 -07:00
Andy LoPresto
96810f677f NIFI-7723 Upgraded BouncyCastle version to 1.66. 2020-08-11 14:08:57 -04:00
Bryan Bende
cea569169f NIFI-7672 Remove filtering of invalid components when getting service ids to enable, lower layers will already skip enabling invalid services, so we want to include services that may become valid when enabling their dependent services 2020-08-10 14:33:49 -04:00
bibistroc
51091a5fca
NIFI-7338 This closes #4169. Added comment about com.hierynomus.smbj.SMBClient syncronicity 
- added file.size attribute on GetSmbFile

Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-08-10 09:44:52 -07:00
si
71d155e874
NIFI-7338 fixed provenance, top level dir, 
chatty smbj log, pw validation
update accessmask to be more restrictive

Author:    si <si.sun@roche.com>

Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-08-10 09:43:43 -07:00
Joe Witt
58e324e9f1
NIFI-7522 bumping from Apache Kafka 2.5 to Apache Kafka 2.6 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4462.
 2020-08-10 09:55:53 +02:00
Mark Payne
0f18c5966e NIFI-7592: Updated nifi system test to no longer include nifi-server-nar and also changed a unit test to an integration test because it starts an embedded server on a specific port 
This closes #4459.
 2020-08-07 12:51:17 -04:00
Matthew Burgess
55adb11f06 Revert "NIFI-7592: Allow NiFi to be started without a GUI/REST interface" 
This reverts commit 1b91a6caf32f60e08c2b4f0a7b2d95d9fb8ed22d.
 2020-08-07 12:50:48 -04:00
Pierre Villard
27e7d0b02a
NIFI-7707 - This closes #4451. fixed Publish GCP PubSub processor for binary data 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-08-07 08:14:19 -07:00
Tamas Palfy
3ef566f7da NIFI-7663 Added option for emptying all queues in a process group. Available from context menu. 
NIFI-7663 Minor changes (variable name refactor, javadoc, GUI message). Merging Drop All Flowfiles responses across all nodes in a cluster.

NIFI-7663 Reloading the canvas after completing a Drop All Flowfiles request.

NIFI-7663 Fixed typos.

This closes #4425.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-08-07 16:23:00 +02:00
Matthew Burgess
6488db1376
NIFI-7572: Force ScriptedTransformRecord to recompile the script when started 
This closes #4458.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-08-06 17:40:12 -07:00
Peter Gyori
5cc7c0485a NIFI-7708: Add Azure SDK for Java (and transitive dependencies) to LICENCE and NOTICE files 
This closes #4452

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2020-08-06 10:55:31 -07:00
Mark Payne
eca7f153d0
NIFI-7706, NIFI-5702: Allow NiFi to keep FlowFiles if their queue is unknown. This way, if a Flow is inadvertently removed, updated, etc., and NiFi is restarted, the data will not be dropped by default. The old mechanism of dropping data is exposed via a property 
This closes #4454.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-08-06 10:55:56 -04:00