a54f739229
NIFI-7969: ValidateRecord enhanced with Force Types From Schema property
...
NIFI-7969: Documentation update
Clarified that the Force Types From Schema property applies to the data read, whereas the Strict Type Checking property applies to the validation.
NIFI-7969: Documentation update - updated the property name in additionalDetails.html
This closes #4825 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-03-01 16:04:11 +01:00
5608f4389a
NIFI-7668 Implemented support for additional AEAD property encryption methods
...
- Added support for PBKDF2 and Scrypt property encryption methods in addition to Argon2
- Refactored StringEncryptor class to PropertyEncryptor interface with implementations
- Added PasswordBasedCipherPropertyEncryptor and KeyedCipherPropertyEncryptor
- Replaced direct instantiation of encryptor with PropertyEncryptorFactory
- Refactored applicable unit tests to use mocked PropertyEncryptor
NIFI-7668 Consolidated similar methods to CipherPropertyEncryptor
NIFI-7668 Updated AbstractTimeBasedSchedulingAgent with PropertyEncryptor
NIFI-7668 Added support for bcrypt secure hashing algorithm
NIFI-7668 Updated comments to clarify implementation of bcrypt key derivation
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4809 .
2021-02-25 17:00:32 -05:00
99fe548e6b
NIFI-8113: Minor updates to admin guide to clarify documentation of some new properties
2021-02-25 16:08:07 -05:00
7730777d66
NIFI-8113 Adding persistent status history repository backed by embedded QuestDB
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-02-25 15:59:01 -05:00
82eedea659
NIFI-8261: When gathering the states of affected components, make sure that we properly obtain the state of Input Ports and Output Ports
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4844 .
2021-02-25 22:21:03 +04:00
68d38dd0a6
NIFI-6752 Add ASN.1 RecordReader
...
NIFI-6752 Refactored type and value conversion logic. Added support for more types. Added more tests.
Removed 'parent' from 'Recursive'. (Caused issues. The recursive nature is still there as it has a child with the same type).
Updated jasn1 1.11.2 to asn1bean 1.12.0. If an asn field name is a Java reserved keyword, the field gets a trailing "_" but the getter remains normal. In JASN1Utils adjusted logic when looking for the getter.
Added support for inherited types. OctetStrings are converted to Strings instead of byte arrays.
Service takes care of the compilation of the ASN files. Test sources are generated and removed from source control.
NIFI-6752 Removed obsolete TODOs.
NIFI-6752 Updated nifi-asn1-nar version to 1.13.0-SNAPSHOT. Fixed checkstyle violations (unused imports).
NIFI-6752 ASN.1 reader - ASN.1 bundle requires 'include-asn1' profile to be active to be part of assembly.
NIFI-6752 ASN.1 reader - Updated ASN1.xml template.
NIFI-6752 ASN.1 reader - Updated versions.
NIFI-6752 ASN.1 reader - Update example generator. Updated ASN1.xml template. Updated (fixed) nifi-asn1-nar version in pom.xml.
NIFI-6752 ASN.1 reader - Added missing license for ASN1.xml.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4577
2021-02-25 12:58:05 -05:00
29cc3886fc
NIFI-8259: Infer CSV field types as strings if no records are present
2021-02-25 12:45:12 -05:00
93b1a05dc3
NIFI-8030: Added property to ReportLineageToAtlas to configure file/directory level logging of [hd]fs_path entities to Atlas
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4813 .
2021-02-25 18:37:19 +04:00
34fc94454f
NIFI-8249: Fixed issue with error during multiple FlowFile results in ExecuteSQL processors
2021-02-24 10:10:32 -05:00
2322b2cddf
NIFI-6113 Refactoring GetHDFSFileInfo to remove instance level variable to make it stateless.
...
This closes #4837 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-02-24 13:15:12 +01:00
2dedd8bf0f
NIFI-8253: Restore call to session.commit() in GenerateTableFetch
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4840 .
2021-02-24 15:57:16 +04:00
f101a2bba5
NIFI-8198: ConsumeAMQP detects if Queue is deleted on server
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4805 .
2021-02-24 12:04:52 +04:00
f2555f27f1
NIFI-8119: properly free database resources when done with the processing of BLOBs
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4791
2021-02-23 16:47:32 -05:00
d049bca794
NIFI-8205: Documentation improvements for the Wait processor
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4808 .
2021-02-23 21:22:19 +04:00
528fce2407
NIFI-7646, NIFI-8222: Instead of having StandardProcessSession call ContentRepository.read(ContentClaim), introduced a new ContentRepository.read(ResourceClaim) and hold open the InputStream to the ResourceClaim. This can't be supported by EncryptedContentRepository, so introduced a method to allow using this or not. The benefit here is that when we have many FlowFiles read within a session, such as when using MergeContent/MergeRecord or a processor configured with a Run Duration, we can hold open a single InputStream instead of constantly opening FileInputStreams and seeking to the appropriate location. This is much faster.
...
- Instead of entering a 'synchronized' block for every provenance event, serialize up to 1 MB worth of data, and then enter synchronized block to write that data out. This avoids large amounts of lock contention and context switches
NIFI-7646: Removed TODO and unused Jackson dependency
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4818
2021-02-23 10:57:54 -05:00
200c04c6d0
NIFI-8237: This closes #4835 . Added missing SQL types to getDataTypeFromSQLTypeValue(), added defensive code
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-02-23 08:08:09 -07:00
9101160cbf
NIFI-8250 - This closes #4838 . UTF8 encoding for FTP processors
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-02-23 08:05:32 -07:00
3cb26aec72
NIFI-8232 CSV Parsers optionally allow/reject duplicate header names
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4828 .
2021-02-23 09:50:18 +04:00
418e2cc2cb
NIFI-8132 Replaced framework uses of MD5 with SHA-256
...
NIFI-8132 Added FileDigestUtils in nifi-nar-utils to avoid dependency on nifi-utils
NIFI-8132 Removed unused imports from NarUnpacker
NIFI-8132 Removed MD5 references from FileUtils documentation
NIFI-8132 Replaced StringBuffer with StringBuilder and made new DigestUtils classes final
NIFI-8132 Replaced Collections.sort() with Stream.sorted()
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4788 .
2021-02-22 17:52:24 -05:00
ebef823cb9
NIFI-8241 This closes #4833 . Set the SAML context provider to use the EmptyStorageFactory
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-02-22 08:53:32 -07:00
703c3cfe63
NIFI-5906 - Removed FILE_EXISTS_VALIDATOR on JARs and Files to be added in the session
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4810 .
2021-02-22 13:04:03 +04:00
80da0cf47d
NIFI-7496: Regex pattern changed to match dashes in filters.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4811 .
2021-02-22 12:59:03 +04:00
b08d6071dd
NIFI-8224: Add LoggingRecordSink controller service
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4820 .
2021-02-22 12:55:53 +04:00
6ed496c714
NIFI-8242 Ensure NiFi URL for redirects has a trailing slash in AccessResource
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4834 .
2021-02-22 12:48:42 +04:00
51e7bdf940
NIFI-3669 Add SSL Support to CaptureChangeMySQL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4594 .
2021-02-22 11:29:59 +04:00
59ad21fbaa
NIFI-8200 Modified PutAzureDataLakeStorage to delete temp file if exception was thrown in uploadContent()
...
This closes #4815
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-02-21 13:35:28 -08:00
662a35b7de
NIFI-8240: Unify Kudu versions
...
The Kudu versions for the controller service and processors
currently doesn’t match. This patch unifies the version in
the parent bundle pom to ensure they match going forward.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4832 .
2021-02-19 20:42:30 +04:00
cd6418cdaf
NIFI-8238: When FlowFile Concurrency/Outbound Policy is changed on child group, and child group is directly under version control, ensure that those fields are maintained on the generated VersionedProcessGroup when nested components are stripped out
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4831 .
2021-02-19 14:44:42 +04:00
f532b3ae1d
NIFI-5623 Upgraded OkHttp3 to 4.9.1 and updated unit tests
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4826 .
2021-02-19 14:42:16 +04:00
aa726040c5
NIFI-8188 - Add 'Run Once' for processors in context menu.
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-02-18 14:51:28 -05:00
6801704846
NIFI-8235 UnsupportedOpertationException in PutAccumuloRecord
2021-02-18 13:12:09 -05:00
042b34cb43
NIFI-8231 Clarify behavior of allowed values for Memory Pools in MonitorMemory
2021-02-18 09:58:48 -05:00
fd50d6f042
NIFI-3383 Check if usage operations are supported in MonitorMemory
...
This closes #4790
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-02-16 17:25:28 -06:00
a69313e34c
NIFI-7873 updating docker files
2021-02-15 12:12:51 -07:00
88fab00e29
NIFI-7873 merging release branch to latest and updating to 1.14.0-SNAPSHOT
2021-02-15 12:09:32 -07:00
4afb2ba743
NIFI-7873-RC4 prepare for next development iteration
2021-02-15 12:09:31 -07:00
487280bee9
NIFI-7873-RC4 prepare release nifi-1.13.0-RC4
2021-02-15 12:09:30 -07:00
a1c82a66a1
NIFI-7361 - increase actions column width for reporting tasks
...
This closes #4214
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-02-15 10:42:19 -06:00
d08f02428d
NIFI-8223: This closes #4819 . Use column datatype in PutDatabaseRecord when calling setObject()
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-02-10 18:01:43 -07:00
8057f8f6c5
NIFI-8221 - Set the default HTTP listening interface to 127.0.0.1.
...
This closes #4817
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-02-10 14:46:37 -06:00
1d82fb8e01
NIFI-8218 This closes #4816 . Use proxy headers when available when getting request values while processing SAML responses
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-02-10 13:34:57 -07:00
d5d520764d
NIFI-8210: When Index Reader/Searcher is used, do not allow the Lucene Index to be deleted until the reader/searcher is finsihed being used and closed.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4812
2021-02-09 15:32:15 -05:00
b9b131239c
NIFI-8215 --wait-for-init in nifi.sh refactored for POSIX sh
...
This fixes #4814
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-02-09 11:10:15 -08:00
13d6da73ac
NIFI-7818 - bump hadoop-client to 3.3.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4604 .
2021-02-09 21:22:59 +04:00
4ebeb4e146
NIFI-8181 - Added Disable HTTP/2 property to InvokeHTTP
...
This closes #4804
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-02-08 14:53:35 -06:00
40d8c41656
NIFI-8193: Fixed PutSQL reordering FlowFiles
...
Also removed sorting of transferred MockFlowFiles in test framework.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4803
2021-02-05 16:17:10 -05:00
749d05840b
NIFI-8204, NIFI-7866: Send revision update count in heartbeats. If update count in heartbeat is greater than that of cluster coordinator, request that node reconnect to get most up-to-date revisions. Cannot check exact equality, as the values may change between the time a heartbeat is created and the time the cluster coordinator receives it. However, it should be safe to assume that the revision won't be greater than that of the cluster coordinator. There is a tiny window in which it could be, as the sending node may update its revision, create the heartbeat, send it, and cluster coordinator process it before updating its own revision. However, this window is incredibly small and would only result in the sending node reconnecting, which will resolve itself. Also, when testing this fix, encountered NIFI-7866 and addressed that NullPointerException.
...
This closes #4806 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2021-02-05 15:18:44 -05:00
03fd59eb2f
NIFI-8196: When node is reconnected to cluster, ensure that it re-registers for election of cluster coordinator / primary node. On startup, if cluster coordinator is already registered and is 'this node' then register silently as coordinator and do not join the cluster until there is no Cluster Coordinator or another node is elected. This allows the zookeeper session timeout to elapse.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2021-02-05 15:18:07 -05:00
b77dbd5030
NIFI-8172: Provide schema name to getPrimaryKeys call in PutDatabaseRecord
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4782 .
2021-02-06 00:00:58 +04:00
a9b8635ac9
NIFI-6522: Referencing Components link from Reporting Task Constroller Services links to proper Controller Settings tab
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4794 .
2021-02-05 23:53:29 +04:00
Peter Gyori
exceptionfactory
Mark Payne
Bence Simon
Koji Kawamura
Matthew Burgess
Peter Turcsanyi
Stan Antyufeev
Christian Gumpert
Pierre Villard
Chris Sampson
exceptionfactory
Bryan Bende
Celso Marques
Lehel Boér
Timea Barna
Grant Henke
Tamas Palfy
Zsihovszki Krisztina
Joey Frazee
Joe Witt
Nathan Gough
Mark Bean