Commit Graph

6865 Commits

Author SHA1 Message Date
exceptionfactory 30293b2339
NIFI-9375 Refactored Registry using OSUtils from nifi-bootstrap-utils
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5520.
2021-11-14 15:57:01 +01:00
exceptionfactory 8a85e5c16f
NIFI-9376 Updated Admin Guide removing reference to default password
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5519.
2021-11-14 15:54:39 +01:00
Lehel f05443ddf7
NIFI-9308: Added EmailRecordSink
This closes #5471

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-10 16:19:35 -06:00
Tamas Palfy 2730a9000e NIFI-9334 Add support for upsert in 'PutMongoRecord'. Use 'bulkWrite' for both insert and upsert.
This closes #5482.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-11-10 18:39:35 +01:00
exceptionfactory 5aced2b4bc
NIFI-9371 Removed synchronized keyword from Active Threads methods (#5513)
- ConcurrentHashMap collection for Active Threads eliminates the need for method synchronization
- Replaced System.out.println() with Logger.info() in nifi-system-test-suite classes
2021-11-10 09:18:41 -05:00
Mark Payne 119ba17bf1
NIFI-9365: Changed HashMap to ConcurrentHashMap in StandardProcessorNode for activeThreads
- Methods without the synchronized keyword, such as terminate(), iterate over activeThreads

This closes #5509

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-09 09:50:48 -06:00
Peter Turcsanyi 9d54fc6a3c
NIFI-9368: Fixed the ordering of the log entries on the processor level bulletin pop-up
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5512.
2021-11-09 15:57:41 +01:00
Laurent Edel ca5a92399a
NIFI-9367 Updated Docker README describing generated credentials
This closes #5511

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-09 08:49:54 -06:00
Peter Turcsanyi 01f9d59ee3
NIFI-9338 - Add Azure Blob processors using Azure Blob Storage client library v12 for Java
- changed default credential type to SAS Token
- added endpointSuffix property in integration tests
- added AzureServiceEndpoints to provide endpoint suffix constants and methods to get endpoint urls
- fixed typos, validators
- downgraded azure-identity to 1.3.7 due to a bug in the latest version
- added Access Token credential type (similar to the existing Blob/ADLS processors)
- used JUnit 5 in tests

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5486.
2021-11-09 11:38:36 +01:00
Roberto Santos e906c1d70f
NIFI-9194: Upsert for Oracle12+
Fixes pr #5366.

Fixes pr #5366. Replace tabchars fot whitespaces.

Fixes pr #5366. Replaced tabchars for whitespaces. Removed unnecessary comments.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5366
2021-11-08 20:45:25 -05:00
noblenumbat360 f410c8df0a
NIFI-8272 Delete stale metrics from REST API Prometheus endpoint.
Added <scope>test</scope> tag to the nifi-web-api pom.xml and corrected imports.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5447
2021-11-08 20:26:30 -05:00
Timea Barna 8491486181
NIFI-9185 Add Avro logical type to SelectHive3QL processor
Modifying unit test to avoid systemdefault timezone usuage

NIFI-9185 Applying review recommendations removing duplicate dependency from pom.xml

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5358
2021-11-08 13:59:46 -05:00
Pierre Villard 37c0527a72
NIFI-9304 - Adding PublishGCPubSubLite and ConsumeGCPubSubLite processors
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5460.
2021-11-08 09:25:35 -05:00
Bryan Bende c96809012b
NIFI-9350 Add NiFi Registry NarProvider implementation
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5497.
2021-11-08 09:18:10 -05:00
Chris Sampson f86fe0d61a
NIFI-9366 Create and remove provenance repository directory in test methods
- Updated nifi-persistent-provenance-repository tests

This closes #5510

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-08 07:40:05 -06:00
Joe Witt 9e845d87ff
Merge branch 'NIFI-9344-RC3' 2021-11-07 16:23:10 -07:00
Mark Payne 373498445f
NIFI-9364: Ensure that we delegate calls to write(byte[]) and write(byte[], int, int) to the underlying OutputStream when writing to the file-based content repository for stateless
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5508.
2021-11-04 16:48:24 -04:00
Bence Simon 9b724df6d9 NIFI-9260 Making the 'write and rename' behaviour optional for PutHDFS
This closes #5423.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-11-04 20:19:26 +01:00
Mark Payne 705c65c86c
NIFI-9362: Ensure that we update the StateMap in AbstractListProcessor to hold any files whose date matches the latest before setting cluster-wide state
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5507
2021-11-04 13:46:41 -04:00
shadon a9685b36fc
optimize import. (#5323)
Co-authored-by: pengxd <pengxd@hua-cloud.com.cn>
2021-11-04 09:29:11 -04:00
Tamas Palfy 2bd752d868
NIFI-9202 Improve Allowable Values merging to handle cases when different nodes have different set of Allowable Values.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5380
2021-11-03 15:09:37 -04:00
Joe Witt c055895952
NIFI-9344-RC3 prepare for next development iteration 2021-11-03 08:53:37 -07:00
Joe Witt 7fdc07cccd
NIFI-9344-RC3 prepare release nifi-1.15.0-RC3 2021-11-03 08:53:32 -07:00
Pierre Villard decfad394d
NIFI-9349 - add attribute with request duration in InvokeHTTP (#5501)
This closes #9349

Signed-off-by: Otto Fowler <ottobackwards@gmail.com>
2021-11-03 09:25:57 -04:00
Paul Grey 362a243e0f
NIFI-9360 Update PutHDFS to handle filesystems which do not support getAclStatus()
This closes #5505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-02 21:57:03 -05:00
exceptionfactory f01fb17555 NIFI-9354 Removed material-design-icons from Registry
- Registry bootstrap imports Material Icons font from covalent/core instead of material-design-icons

This closes #5500

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2021-11-01 15:28:54 -04:00
exceptionfactory 12edc865f6
NIFI-9356 Corrected HashiCorp Vault Key Value Provider Identifier documentation
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5502.
2021-11-01 09:35:36 -04:00
Mark Payne 09feed9df6
NIFI-9352: Consider all property values in component references
- Ensure that we consider all property values to determine if a component references a variable, not just 'supported' (i.e., well-known/non-user-defined) properties

This closes #5499

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-10-30 11:16:57 -05:00
exceptionfactory 1c4ee93e68
NIFI-9351 Excluded test dependencies from nifi-scripting-nar
NIFI-9351 Excluded Groovy test dependencies

- Updated nifi-scripting-nar
- Updated nifi-groovyx-nar

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5498
2021-10-29 17:25:14 -04:00
exceptionfactory 16e6045d13 NIFI-9346 Added closing of EventSender to TestListenRELP
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5492.
2021-10-28 13:10:04 -04:00
exceptionfactory 9865ea2bfb NIFI-9322 Refactored OIDC and SAML Access Resources
- Removed parent AccessResource from OIDCAccessResource and SAMLAccessResource to avoid unexpected inherited methods
- Moved Token Expiration validation from AccessResource to StandardBearerTokenProvider

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5489.
2021-10-28 12:12:57 -04:00
Joe Gresock 28cd5d1300
NIFI-9345: Resolving NPE in ProcessorEntityMerger (#5491)
NIFI-9345: Resolving NPE in ProcessorEntityMerger, Streamlining forEach calls
2021-10-28 12:06:56 -04:00
Joe Witt 74151eab1f
NIFI-9344 updating docker versions for nifi release 2021-10-28 08:35:45 -07:00
Bence Simon 75d1d7f6e7
NIFI-9265 Fixing path handling for HDFS processors when there are multiplied separators in the path
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5437.
2021-10-28 10:47:53 +02:00
exceptionfactory 60d6d469bf
NIFI-9342 Upgraded to Netty 3.10.6 and 4.1.69
- Replaced Netty 3.6.9 and 3.7.1 with 3.10.6
- Replaced Netty 4.1 with 4.1.69

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5490.
2021-10-28 09:34:31 +02:00
Mark Payne 3114bdb701
NIFI-9311: When determining property values, be sure to fetch the property descriptor from the component itself, rather than using the PropertyDescriptor in the Map. This allows us to ensure that if the definition of the PropertyDescriptor changes, the most up-to-date definition is picked up
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5488
2021-10-27 17:08:06 -04:00
Lehel Boér 059f14fd62
NIFI-8385: Add FlowFiles from logging to bulletins (#4952) 2021-10-27 16:06:30 -04:00
Matthew Burgess 104078868e
NIFI-7012: Refactored OnConfigurationRestored to support sensitive property validation (#5415) 2021-10-27 14:40:17 -04:00
Joe Gresock ca530f40d8
NIFI-9317: Updating config verification for ListS3 (#5485) 2021-10-27 13:47:58 -04:00
Mark Payne 0eee70c4b9 NIFI-9339: Fixed headers to include appropriate Reqest-Token header for all requests to the server for JoltTransformJSON UI
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5487.
2021-10-27 11:40:30 -04:00
Lance Kinley 30efcd35e4
NIFI-8208: Upgrade MongoDB driver to 4.3 series
- Add AllowableValue objects for write concern values
- Remove warnings for using deprecated write concerns in PutMongo

This closes #5392

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-10-26 16:14:55 -05:00
exceptionfactory 67ccdf6159
NIFI-9326 Added Socket Keep Alive property to ListenSyslog
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5479.
2021-10-26 19:44:56 +02:00
Lehel d7e41e2005
NIFI-9328: Transfer cleanup and reuse added to FetchFileTransfer in case of FileNotFound and PermissionDenied exceptions.
- Corrects connection handling in FetchFTP and FetchSFTP

This closes #5478

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-10-26 11:17:33 -05:00
Mark Payne 1191e511a5
NIFI-9335: Updated AvroTypeUtil#createAvroRecord to ensure that if the given Avro Schema contains a field whose value is defaulted, the produced Avro Record has that value populated. Also added a unit test to verify behavior. Ran performance test (which is igonred and must be manually enabled) - about 2.1 seconds before the change and about 2.5 seconds after the change for each iteration.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5483
2021-10-26 12:15:54 -04:00
omkadmi 8506a6012f
NIFI-9337: added missing enum value SINGLE_BATCH_PER_NODE of FlowFileConcurrencyType (#5484) 2021-10-26 11:25:52 -04:00
Alasdair Brown 27da172f4e
NIFI-9029: Documented Missing Properties in the Sys Admin Guide (#5438)
NIFI-9029: Documented Missing Properties in the Sys Admin Guide
Co-authored-by: exceptionfactory <exceptionfactory@apache.org>
2021-10-26 10:22:50 -04:00
exceptionfactory a9af5d3465
NIFI-9332 Corrected SecureHasher conditional test methods
- Removed GroovyTestCase super class
- Replaced shouldFail() with assertThrows()

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5481.
2021-10-26 09:59:08 +02:00
exceptionfactory 7b2f364cf5
NIFI-9331 Corrected ThreadUtils using Objects.equals() for LockedStackFrame
- Removed unused arguments from ThreadUtils.createStackTrace()

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5480.
2021-10-26 09:56:28 +02:00
Mike Thomsen 8d513c5ed3
NIFI-9080 Converted nifi-commons to use JUnit 5
This closes #5332

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-10-25 21:07:54 -05:00
Nathan Gough 309ab8f4ab
NIFI-8792 - Modified ListenRELP to use Netty
- Refactored RELP encoders and decoders

This closes #5398

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-10-25 15:53:58 -05:00