Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-09 11:35:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,614 Commits 147 Branches 203 Tags
Commit Graph

1962 Commits

Author SHA1 Message Date
Shane Ardell
80bc40a9af NIFI-7742: update case clause logic 2020-09-14 10:03:41 -04:00
Shane Ardell
e3d551e87d NIFI-7742: add case for controller service selections 2020-09-14 10:03:41 -04:00
Mohammed Nadeem
6b34a8b36e
NIFI-7759: Minor misspelling in rollover help for 'Stream When Available' process group configuration 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4521.
 2020-09-11 16:41:25 +02:00
Bence Simon
0dff3bc065
NIFI-7429 Adding status history for system level metrics 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4420.
 2020-09-10 16:19:11 +02:00
Mark Payne
fd068fe978
NIFI-7557: uses a canonical representation of strings when recovering data from FlowFile Repository in order to avoid using huge amounts of heap when not necessary 
- Fixed some problems with unit/integration tests

This closes #4507.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-09-03 10:21:50 -04:00
Kotaro Terada
c3cab48325
NIFI-7730 Added regression tests for multiple certificate keystores. 
Cleaned up JettyServer code.
Changed test logging severity to include debug statements.
Added test resources.

This closes #4498.

Co-authored-by: Kotaro Terada <kotarot@apache.org>
 2020-09-01 18:32:03 -07:00
jmconte
bdead4d040 NIFI-7762 - support copy-paste on Disabled ports 2020-08-31 15:56:12 -04:00
Bryan Bende
87685dd4e1 NIFI-7661 Change validation of controller service against it's API to use comparison of inteface methods instead of bundle coordinates 2020-08-31 15:33:45 -04:00
Kristjan Antunovic
483af3a460
NIFI-6767 Persist registry URL after service restart. 
This closes #4006.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-08-28 09:58:39 -04:00
Joe Witt
8baa5c9940
NIFI-7692 updating for next dev release 1.13.0 2020-08-18 14:48:02 -07:00
Joe Witt
fb57bcbc11
NIFI-7692-RC1 prepare for next development iteration 2020-08-13 09:20:39 -07:00
Joe Witt
303d6c59ba
NIFI-7692-RC1 prepare release nifi-1.12.0-RC1 2020-08-13 09:20:36 -07:00
Tamas Palfy
6c3c2c173b NIFI-7736 Fix: Empty All Queues performance - When authorizing request, checking read/write credentials on encapsulated process groups and connections was doubly recursive (for each element it added all child elements multiple times again, making this exponential instead of linear). 2020-08-13 10:42:44 -04:00
Tamas Palfy
3e18d5b236 NIFI-7722 Catching 'Throwable' instead of 'Exception' in 'NodeHttpRequest.run()' to make sure subsequent 'Object.notify()' (when request replication has completed) is not missed out even if an 'Error' is thrown. 2020-08-12 12:38:56 -04:00
Andy LoPresto
96810f677f NIFI-7723 Upgraded BouncyCastle version to 1.66. 2020-08-11 14:08:57 -04:00
Bryan Bende
cea569169f NIFI-7672 Remove filtering of invalid components when getting service ids to enable, lower layers will already skip enabling invalid services, so we want to include services that may become valid when enabling their dependent services 2020-08-10 14:33:49 -04:00
si
71d155e874
NIFI-7338 fixed provenance, top level dir, 
chatty smbj log, pw validation
update accessmask to be more restrictive

Author:    si <si.sun@roche.com>

Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-08-10 09:43:43 -07:00
Matthew Burgess
55adb11f06 Revert "NIFI-7592: Allow NiFi to be started without a GUI/REST interface" 
This reverts commit 1b91a6caf32f60e08c2b4f0a7b2d95d9fb8ed22d.
 2020-08-07 12:50:48 -04:00
Tamas Palfy
3ef566f7da NIFI-7663 Added option for emptying all queues in a process group. Available from context menu. 
NIFI-7663 Minor changes (variable name refactor, javadoc, GUI message). Merging Drop All Flowfiles responses across all nodes in a cluster.

NIFI-7663 Reloading the canvas after completing a Drop All Flowfiles request.

NIFI-7663 Fixed typos.

This closes #4425.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
 2020-08-07 16:23:00 +02:00
Mark Payne
eca7f153d0
NIFI-7706, NIFI-5702: Allow NiFi to keep FlowFiles if their queue is unknown. This way, if a Flow is inadvertently removed, updated, etc., and NiFi is restarted, the data will not be dropped by default. The old mechanism of dropping data is exposed via a property 
This closes #4454.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-08-06 10:55:56 -04:00
Scott Aslan
6596fb1f87
[NIFI-7705] update fronted deps 
make variable and parameters tables position relative

Signed-off-by: Rob Fellows <rob.fellows@gmail.com>

This closes #4449
 2020-08-06 10:48:24 -04:00
Joe Witt
536dbb72bb
NIFI-7703 updated all commons codec references to 1.14 
This closes #4448.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-08-04 12:11:57 -07:00
shreeju
24d4ad348a
NIFI-7702 This closes #4447. validate requestentity not null 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-08-04 09:48:54 -07:00
Karthikeyan Singaravelan
6a497aa8c3 NIFI-7691: Validate request object to be not null. 2020-07-31 15:31:32 -04:00
Matthew Burgess
1b91a6caf3 NIFI-7592: Allow NiFi to be started without a GUI/REST interface 
- Rename MiNiFi references to Headless NiFi, added profile to build headless assembly

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2020-07-31 14:09:12 -04:00
Jan Hentschel
84586a6772 NIFI-7315 Fixed typo in bootstrap.conf for 17th argument 2020-07-31 11:17:17 -04:00
Joey Frazee
633fd8883d
NIFI-7693: Bump aspectjweaver version to resolve BeanCreationException on Java 11 2018-09-25 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4444.
 2020-07-31 10:44:47 +02:00
Andy LoPresto
716ba992f5
NIFI-7669 Changed custom PBE AEAD algorithm to derive key once rather than on every encrypt/decrypt operation, leading to substantial performance gains. 
Updated documentation.
Added unit tests.

NIFI-7669 Moved time-based encryption tests to integration tests to avoid running during CI builds.

NIFI-7669 Fixed failing test due to nifi.properties initialization.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4435.
 2020-07-29 09:29:00 +02:00
Andy LoPresto
7f0416ee8b
NIFI-7680 Added convenience methods for creating XML DocumentBuilder instances. 
Added unit tests.

NIFI-7680 Duplicated DocumentBuilder creation method in NotificationServiceManager to avoid nifi-bootstrap dependency on nifi-security-utils.
Explicitly added commons-lang3 to lib/bootstrap/ directory in nifi-assembly.

NIFI-7680 Reverted unnecessary dependency changes.
Added explicit dependencies where necessary.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4436
 2020-07-28 17:02:42 -04:00
Karthikeyan Singaravelan
cee6cfddf2
NIFI-7682: Check for request object to be null. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4437.
 2020-07-28 21:17:46 +02:00
Andy LoPresto
90c9db8208
NIFI-7679 Changed flow fingerprint masking logic to derive a static key once (slowly) from nifi.sensitive.props.key and use a (fast) HMAC/SHA-256 operation during fingerprinting to resolve unacceptable delays. 
Added unit tests.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4434.
 2020-07-28 10:22:24 +02:00
Mark Payne
0b9f2fbe3b
NIFI-7678: Fixed memory leak, improved some logic that constantly created collections unnecessarily. Changed types of Collections being used to much more efficient implementations. Removed using Streams for performance-critical parts of application 
NIFI-7678: Check if debug is enabled before logging message about processor.onTrigger because obtaining class name is expensive

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4431.
 2020-07-27 13:28:15 +02:00
Andy LoPresto
7d20c03f89
NIFI-7638 Implemented custom nifi.sensitive.props.algorithm for AES-G/CM with Argon2 KDF. 
Added documentation for encryption of flow sensitive values.
Added unit tests.

This closes #4427.
 2020-07-24 18:11:37 -07:00
Bryan Bende
5cb8d24689
NIFI-7622 Use param context name from inside nested versioned PG when importing 
This closes #4401.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-07-24 14:15:57 -07:00
Nathan Gough
d846a74730
NIFI-7568 - Applied Kerberos mappings to authentication requests. Kerberos mappings should now be applied correctly in H2 database for username/password based login. Added tests. 
Logout now deletes signing key by key ID rather than identity.
Validate token expiration now uses mapped identity instead, which allows logging of the mapped identity.
Updated delete key to expect only 0 or 1 keys deleted.

This closes #4416.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2020-07-24 13:28:01 -07:00
Andy LoPresto
eeeda84474
NIFI-7122 Introduced improvements to EncryptContent processor. 
Added unit tests.
Refactored shared logic from various algorithm-specific secure hasher implementations to AbstractSecureHasher.
Introduced secure hasher implementations for various KDFs.
Added custom validation to EncryptContent processor.
Implemented logic for EncryptContent to write operational metadata to flowfile attributes.
Added encryption metadata attribute annotations to EncryptContent.
Added Argon2 KDF documentation and Bcrypt key derivation change notes to Admin Guide.
Updated unit tests to calculate default/recommended cost parameters for Argon2.

This closes #4421.

Co-authored-by: mtien <mtien.apache@gmail.com>
 2020-07-24 12:31:39 -07:00
Bryan Bende
e9a443fe2e
NIFI-7521 Remove additional unused property from nifi proeprties 
This closes #4327.
 2020-07-23 08:14:39 -04:00
Mark Payne
e371f4ac7c
NIFI-7521: Removed unused properties from nifi properties. Updated the defaults to use for File System's archive cleanup, flowfile checkpoint interval 2020-07-23 08:14:21 -04:00
Pierre Villard
7f0b188be4 NIFI-7531 - changed RW to RO access requirement on autoload NARs directory 2020-07-22 14:31:48 -04:00
Bryan Bende
2c45a80ef4
NIFI-7517 Fixing unit test, checkstyle issue, and duplicate property 
This closes #4324.
 2020-07-22 14:20:09 -04:00
Mark Payne
43c6ecd3eb
NIFI-7517: When mapping a ProcessGroup to a VersionedProcessGroup, take into account FlowFile Concurrency and FlowFile Outbound Policy 2020-07-22 14:19:51 -04:00
Andy LoPresto
78d88b46ef
NIFI-7657 Introduced AccessTokenUnnecessaryException for authentication calls to HTTP NiFi server. 
Added exception mapper.

NIFI-7657 Renamed exception & exception mapper to reflect scope of authentication not supported.
Registered exception mapper.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4418.
 2020-07-22 14:35:09 +02:00
Andy LoPresto
f80b844907
NIFI-7660 This closes #4419. Resolved failing unit test on Azul Zulu JDK 8 update 262. 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2020-07-21 16:46:46 -07:00
Andy LoPresto
6297310a90
NIFI-7658 Lowered log severity to DEBUG when web request max content length is blank. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4415.
 2020-07-21 13:42:43 +02:00
Mark Payne
a473fc0373
NIFI-7633: Added FlowFileConcurrency of SINGLE_BATCH_PER_NODE to allow data to be pulled into a ProcessGroup as a batch 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4405.
 2020-07-20 12:02:54 +02:00
Joey Frazee
a72c3d685c
NIFI-7372 Added test for ZooKeeperStateServer 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4241.
 2020-07-17 14:25:56 +02:00
Pierre Villard
5da596ea8d
NIFI-7552 - fixed checkstyle issue 2020-07-17 13:53:13 +02:00
Vasily Makarov
950437b2d7
NIFI-6603 Add cancel button to the variables. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4366.
 2020-07-17 11:54:57 +02:00
Mark Payne
44fc4d9f27
NIFI-7552: When Process Group is configured to transfer data in batch, add an attribute to each outbound FlowFile that indicates how many FlowFiles went to each port. Updated user guide to explain the new attributes. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4345.
 2020-07-17 10:33:59 +02:00
Joe Witt
77078a85d9
NIFI-7304 resolving a contrib check issue with line length 2020-07-14 13:30:53 -07:00