Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-09 11:35:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,778 Commits 147 Branches 203 Tags
Commit Graph

1972 Commits

Author SHA1 Message Date
exceptionfactory
bbd37b8db7
NIFI-8264 Replaced commons-logging with jcl-over-slf4j in framework modules 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4848
 2021-03-01 15:18:42 -05:00
exceptionfactory
5608f4389a NIFI-7668 Implemented support for additional AEAD property encryption methods 
- Added support for PBKDF2 and Scrypt property encryption methods in addition to Argon2
- Refactored StringEncryptor class to PropertyEncryptor interface with implementations
- Added PasswordBasedCipherPropertyEncryptor and KeyedCipherPropertyEncryptor
- Replaced direct instantiation of encryptor with PropertyEncryptorFactory
- Refactored applicable unit tests to use mocked PropertyEncryptor

NIFI-7668 Consolidated similar methods to CipherPropertyEncryptor

NIFI-7668 Updated AbstractTimeBasedSchedulingAgent with PropertyEncryptor

NIFI-7668 Added support for bcrypt secure hashing algorithm

NIFI-7668 Updated comments to clarify implementation of bcrypt key derivation

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4809.
 2021-02-25 17:00:32 -05:00
Bence Simon
7730777d66 NIFI-8113 Adding persistent status history repository backed by embedded QuestDB 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-02-25 15:59:01 -05:00
Mark Payne
82eedea659
NIFI-8261: When gathering the states of affected components, make sure that we properly obtain the state of Input Ports and Output Ports 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4844.
 2021-02-25 22:21:03 +04:00
Mark Payne
528fce2407
NIFI-7646, NIFI-8222: Instead of having StandardProcessSession call ContentRepository.read(ContentClaim), introduced a new ContentRepository.read(ResourceClaim) and hold open the InputStream to the ResourceClaim. This can't be supported by EncryptedContentRepository, so introduced a method to allow using this or not. The benefit here is that when we have many FlowFiles read within a session, such as when using MergeContent/MergeRecord or a processor configured with a Run Duration, we can hold open a single InputStream instead of constantly opening FileInputStreams and seeking to the appropriate location. This is much faster. 
- Instead of entering a 'synchronized' block for every provenance event, serialize up to 1 MB worth of data, and then enter synchronized block to write that data out. This avoids large amounts of lock contention and context switches

NIFI-7646: Removed TODO and unused Jackson dependency

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4818
 2021-02-23 10:57:54 -05:00
exceptionfactory
418e2cc2cb NIFI-8132 Replaced framework uses of MD5 with SHA-256 
NIFI-8132 Added FileDigestUtils in nifi-nar-utils to avoid dependency on nifi-utils

NIFI-8132 Removed unused imports from NarUnpacker

NIFI-8132 Removed MD5 references from FileUtils documentation

NIFI-8132 Replaced StringBuffer with StringBuilder and made new DigestUtils classes final

NIFI-8132 Replaced Collections.sort() with Stream.sorted()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4788.
 2021-02-22 17:52:24 -05:00
Bryan Bende
ebef823cb9
NIFI-8241 This closes #4833. Set the SAML context provider to use the EmptyStorageFactory 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-02-22 08:53:32 -07:00
Lehel Boér
80da0cf47d
NIFI-7496: Regex pattern changed to match dashes in filters. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4811.
 2021-02-22 12:59:03 +04:00
Bryan Bende
6ed496c714
NIFI-8242 Ensure NiFi URL for redirects has a trailing slash in AccessResource 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4834.
 2021-02-22 12:48:42 +04:00
Mark Payne
cd6418cdaf
NIFI-8238: When FlowFile Concurrency/Outbound Policy is changed on child group, and child group is directly under version control, ensure that those fields are maintained on the generated VersionedProcessGroup when nested components are stripped out 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4831.
 2021-02-19 14:44:42 +04:00
exceptionfactory
f532b3ae1d
NIFI-5623 Upgraded OkHttp3 to 4.9.1 and updated unit tests 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4826.
 2021-02-19 14:42:16 +04:00
Tamas Palfy
aa726040c5 NIFI-8188 - Add 'Run Once' for processors in context menu. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-02-18 14:51:28 -05:00
Joe Witt
88fab00e29
NIFI-7873 merging release branch to latest and updating to 1.14.0-SNAPSHOT 2021-02-15 12:09:32 -07:00
Joe Witt
4afb2ba743
NIFI-7873-RC4 prepare for next development iteration 2021-02-15 12:09:31 -07:00
Joe Witt
487280bee9
NIFI-7873-RC4 prepare release nifi-1.13.0-RC4 2021-02-15 12:09:30 -07:00
Pierre Villard
a1c82a66a1
NIFI-7361 - increase actions column width for reporting tasks 
This closes #4214

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-02-15 10:42:19 -06:00
Nathan Gough
8057f8f6c5
NIFI-8221 - Set the default HTTP listening interface to 127.0.0.1. 
This closes #4817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2021-02-10 14:46:37 -06:00
Bryan Bende
1d82fb8e01
NIFI-8218 This closes #4816. Use proxy headers when available when getting request values while processing SAML responses 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-02-10 13:34:57 -07:00
Peter Gyori
b9b131239c NIFI-8215 --wait-for-init in nifi.sh refactored for POSIX sh 
This fixes #4814

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-02-09 11:10:15 -08:00
Mark Payne
749d05840b
NIFI-8204, NIFI-7866: Send revision update count in heartbeats. If update count in heartbeat is greater than that of cluster coordinator, request that node reconnect to get most up-to-date revisions. Cannot check exact equality, as the values may change between the time a heartbeat is created and the time the cluster coordinator receives it. However, it should be safe to assume that the revision won't be greater than that of the cluster coordinator. There is a tiny window in which it could be, as the sending node may update its revision, create the heartbeat, send it, and cluster coordinator process it before updating its own revision. However, this window is incredibly small and would only result in the sending node reconnecting, which will resolve itself. Also, when testing this fix, encountered NIFI-7866 and addressed that NullPointerException. 
This closes #4806.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2021-02-05 15:18:44 -05:00
Mark Payne
03fd59eb2f
NIFI-8196: When node is reconnected to cluster, ensure that it re-registers for election of cluster coordinator / primary node. On startup, if cluster coordinator is already registered and is 'this node' then register silently as coordinator and do not join the cluster until there is no Cluster Coordinator or another node is elected. This allows the zookeeper session timeout to elapse. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2021-02-05 15:18:07 -05:00
Mark Bean
a9b8635ac9
NIFI-6522: Referencing Components link from Reporting Task Constroller Services links to proper Controller Settings tab 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4794.
 2021-02-05 23:53:29 +04:00
Jon Kessler
3f26e54521 NIFI-8194 Updated log level from WARN to DEBUG for various authentication protocols not being configured 2021-02-05 13:20:37 -05:00
Peter Gyori
5a8b18b12d NIFI-8123: Added support for --wait-for-init when NiFi started with the 'start' command 
This closes #4748.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-02-03 09:40:09 -05:00
Joe Witt
d826416217
NIFI-8192 updating Copyright years for nifi things to include 2021 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4802.
 2021-02-03 12:56:28 +04:00
Bryan Bende
e0a8b479fd NIFI-8190 Protect against property that references missing controller service 2021-02-01 15:47:52 -05:00
Pierre Villard
d72bfc76b5
NIFI-8155 - add banner text in page title 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4768
 2021-01-29 19:20:34 -05:00
Mark Payne
4ff9cddf15
NIFI-8173, NIFI-8174: This closes #4784. Updated Parameter Contexts to allow for unsetting a parameter value / setting it to null. Allow Parameters to make use of Expression Language. Updated docs to illustrated how EL is evaluated 
Signed-off-by: Joe Witt <joewitt@apache.org>
 2021-01-26 21:55:18 -07:00
exceptionfactory
2cdb0fb6a3 NIFI-8088 Removed deprecation warning log for PKCS12 trust stores 
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4727.
 2021-01-26 16:50:33 -05:00
Mark Payne
f2a16cd02e NIFI-8163: When counting number of components, we traverse into all Process Groups, but then call findAllRemoteProcessGroups, which is a recursive call, instead of calling getRemoteProcessGroups(). This results in counting the Process Groups many times. So fixed that. 
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4775.
 2021-01-21 15:09:42 -05:00
Troy Melhase
76648bdc0b NIFI-7356 - Config TLS for embedded ZooKeeper when NiFi TLS enabled. 
NIFI-7356 - Addresses PR feedback.

NIFI-7356 - Additional changes from PR feedback.

NIFI-7356 - Adding integration tests for ZooKeeperStateServer for TLS.

NIFI-7356 - TLS + Zookeeper now working with single and quorum. Needs code cleanup, need to fix IT tests and docs.

NIFI-7356 - Fixed up tests and removed some irrelevant ones. Refactored some of ZooKeeperStateServer. Tested successfully with a secure and insecure 3 node NiFi + Quorum.

NIFI-7356 - Checkstyle fixes.

NIFI-7356 - Updated administration guide with embedded ZooKeeper TLS configuration.

NIFI-7356 - Updated the way ZooKeeper TLS properties are set/mapped from NiFi properties.

NIFI-7356 - Updated per review, using NiFiProperties keystore strings, classname for ocnnection factory, adjusted TLS configuration checks in NiFiProperties.

NIFI-7356 - Updated configuration validation logic and added tests.

NIFI-7356 - Codestyle check fixes.

NIFI-7356 - Updated some of the log messages.

NIFI-7356 - Updated as per code review.

NIFI-7356 - Fixed max port number.

NIFI-7356 - Updated admin guide and updated small code issues as per code review.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4753.
 2021-01-21 13:47:53 -05:00
Mark Payne
525e4105eb NIFI-8095: Created StatelessNiFi Sink Connector and Source Connector. Minor updates to stateless nifi api to accommodate. 
Self-merging PR based on comments from @joewitt
 2021-01-21 10:56:28 -05:00
Andrew Lim
27f57e6463
NIFI-8150 Change Download flow to Download flow definition for process groups (#4766) 2021-01-20 16:00:41 -05:00
s9514171
b4ddeb8997 NIFI-8116 The old peers do not be deleted when the URIs of the remote process group are changed 
This closes #4745.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-19 16:25:09 -05:00
Mark Payne
097edf4f7c
NIFI-8136: Added getState/setState/replaceState/clearState methods to ProcessSession, updated processors to use these methods instead of StateManager version where appropriate 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4757
 2021-01-15 10:02:09 -05:00
Nissim Shiman
3cc8d767b3 NIFI-7738 Reverse Provenance Query 
This closes #4563.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-13 09:35:05 -05:00
tlsmith
0b966cdb14
NIFI-7991 Flow Configuration History displays "annotation data not found/available" from "Advanced" changes 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4668
 2021-01-12 16:09:38 -05:00
Matthew Burgess
2d69179184
NIFI-8138: Add Sensitive Property value to property tooltip 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4752.
 2021-01-13 00:44:03 +04:00
exceptionfactory
7d76bcd520 NIFI-8094 Added support for BCFKS Keystore Type 
NIFI-8094 Updated Administration Guide to include BCFKS

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4729.
 2021-01-12 10:52:49 -05:00
exceptionfactory
5f7558cecf NIFI-8069 Set invalid status when Controller Services are enabling 
This closes #4710.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-11 13:42:52 -05:00
sjyang18
f330078fff NIFI-7924 Add fallback claims for identifying user to OIDC provider 
This closes #4630

Signed-off-by: Joey Frazee <jfrazee@apache.org>
 2021-01-07 14:57:57 -06:00
exceptionfactory
817f621d6f NIFI-8096 Deprecated ClientAuth references in SSLContextService 
- Added SSLContextService.createContext() and refactored referencing components
- Removed references to ClientAuth from SslContextFactory methods

This closes #4737.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2021-01-06 16:24:26 -05:00
Shane Ardell
5c79553af6 NIFI-8062: make tabs functional with keyboard 2021-01-04 11:58:47 -05:00
exceptionfactory
28ca7478d6 NIFI-8019 Added TlsPlatform to provide runtime TLS protocol configuration 
NIFI-8019 Renamed getDefaultProtocols() to getSupportedProtocols()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4673.
 2020-12-14 19:34:58 -05:00
exceptionfactory
0af736dc0b
NIFI-7885 Added Environment Variable to deny LFS access using Hadoop (#4712) 
* NIFI-7885 Added Environment Variable to deny LFS access using Hadoop

* NIFI-7885 Changed Hadoop Processor validation to check LFS access
 2020-12-09 09:29:42 -05:00
Matthew Burgess
04aaf25131 NIFI-1121: Use display name for dependent property documentation 2020-12-03 16:39:46 -05:00
mtien
8055c47a84
NIFI-8058 Fixed a UI error to correctly delete dynamic properties while configuring processors. 
Changed to check the length of all unfiltered properties instead of only filtered properties.
Added additional check if descriptor is a dynamic property.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4707
 2020-12-03 15:44:56 -05:00
Bryan Bende
312fa8e85e NIFI-8064 Convert TestSecureClientZooKeeperFactory to integration test 2020-12-03 14:46:13 -05:00
markap14
aaa1452d04
NIFI-8054: Updated ReflectionUtils to use a WeakHashMap for the mapping of annotations to methods with that annotation. This way, the ReflectionUtils class will not hold a reference to Classes that are no longer referenced elsewhere. (#4694) 2020-11-30 16:14:12 -05:00
Mark Payne
7ad9520079
NIFI-8041: Refactored API for stateless nifi so that calling StatelessDataflow.trigger() returns an object that allows the caller to wait for the result, cancel the result, etc. and then optionally acknowledge the completion. This allows the caller to block the completion of ProcessSession.commit() until it has handled the output of the dataflow execution. 
NIFI-8038: Fixed deadlock that can occur when updating Parameter Context

This closes #4684.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2020-11-24 15:12:51 -05:00