Commit Graph

5542 Commits

Author SHA1 Message Date
Shane Ardell 60a8b3bc5f
NIFI-10698: Add filtering options to summary table (#6610)
* NIFI-10698: Add filtering options to summary table

* NIFI-10698: fix checkbox spacing and alignment

* NIFI-10698: fix spacing between dropdowns

Merged #6610 into main.
2022-11-07 10:34:42 -08:00
exceptionfactory 4f80233575
NIFI-10733 Upgraded Curator from 5.3.0 to 5.4.0
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6621
2022-11-07 10:00:06 -05:00
Marco Carlino 6ce2e3799c
NIFI-10349 add maximum object age property to list s3
This closes #6293.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-07 14:44:53 +01:00
Chris Sampson 2acfd1e496 NIFI-9398 add verification to ElasticSearchClientService (with integration tests) and Elasticsearch REST API processors
NIFI-9398 processor verification integration-tests for nifi-elasticsearch-restapi-processors using common nifi-elasticsearch-test-utils refactored from nifi-elasticsearch-client-service
NIFI-9398 fail index exists verification for Elasticsearch processors whose operations would not create the index if it doesn't already exist

This closes #6544

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-05 18:17:13 -04:00
exceptionfactory d9e494f976
NIFI-10713 Added Deprecation Warning for PGP in EncryptContent
NIFI-10713 Removed OpenPGP, PGP, and GPG tags

This closes #6613
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-04 18:04:37 -04:00
Mark Payne 381e0f84e1
NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception
This closes #6623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 16:20:22 -05:00
Mark Bean 61e1a37d2e
NIFI-10228: parse json flow using instanceIdentifier as the UUID
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6217
2022-11-04 13:09:29 -04:00
Mark Bean 4e4f6437ee
NIFI-4798 allow empty value for UpdateAttribute property
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6585
2022-11-04 12:29:19 -04:00
Mike Thomsen 19658df52b
NIFI-10675 Corrected SSL support in Neo4j V4 Cypher Service
- Added Testcontainers for Neo4j integration tests

This closes #6559

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 09:23:34 -05:00
Ferenc Erdei 86acde2fe2
NIFI-10750 Move C2NiFiClientService to minifi-framework
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #6612.
2022-11-04 08:53:53 +01:00
Nathan Gough d237fd228f
NIFI-10738 Updated SNMP tests to retry BindExceptions
This closes #6606

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 17:43:57 -05:00
Nissim Shiman f4069ab77a
NIFI-10287 ExecuteScript - Allow python scripts to use external modules
Co-authored-by: Nissim Shiman <nshiman@yahoo.com>
Co-authored-by: dan-s1 <dstieg1@gmail.com>

NIFI-10287 changes for code review

NIFI-10287 modification based on reviewer comment

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6254
2022-11-02 16:18:41 -04:00
mr1716 6fed5dee17
NIFI-10732 Upgraded ASN1Bean from 1.12.0 to 1.13.0
NIFI-10731 Upgraded asn1bean-compiler from 1.12.0 to 1.13.0

This closes #6609

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 10:34:41 -05:00
Matt Gilman ec22504d6e
NIFI-10709 Showed log in link on logout complete page
- Fixing issue remove token when logging out from the canvas.

This closes #6592

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 10:28:18 -05:00
Nathan Gough c40639a51f
NIFI-10332 Selected OIDC Logout method using Discovery URLs
This closes #6594

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-01 21:33:26 -05:00
TheGreatRandall 238c356219
NIFI-10637 Simplified Locale validation in ParseCEF
This closes #6522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 18:43:19 -05:00
BoyuLi4 56d26be3ca
NIFI-10630 Updated TestWaitNotifyProtocol comparing JSON Objects
This closes #6526

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 15:56:31 -05:00
priyanka-28 6f65cd1f32
NIFI-10629 Updated TestJsonEntitySerializer with sorted properties
This closes #6515

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 15:09:04 -05:00
zhewenf2 65201ab88b
NIFI-10642 Fix flaky test groupByStringMixedNumberOfRecords
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6528
2022-10-31 15:58:27 -04:00
Mike Thomsen 2a45d4ac89
NIFI-10729 Added Cassandra testcontainers.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6604
2022-10-31 14:39:26 -04:00
Mike Thomsen b6d95faa95
NIFI-10711 Made the script runner more debuggable.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6590
2022-10-31 13:39:42 -04:00
mr1716 8d2789dbc4 NIFI-10725 Update ICU4J to 72.1
This closes #6603

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-30 08:44:48 -04:00
mr1716 60d7f437a6
NIFI-10720 Update bval-jsr to 2.0.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6600.
2022-10-29 10:29:43 +02:00
M Tien e862a02df6
NIFI-10715: improve tooltips in parameter providers (#6598)
* NIFI-10715: clean up tooltips in parameter providers

* more clean up

This closes #6598
2022-10-28 16:23:18 -04:00
UcanInfosec 557a1a7869 NIFI-10718 Update mongo.driver.version to 4.7.2
This closes #6599

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-28 15:51:53 -04:00
Paul Grey 61ccb23b47
NIFI-10704 - include API name of properties in processor documentation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6586
2022-10-28 14:13:16 -04:00
Ferenc Kis 65558accda
NIFI-10679 MiNiFi C2 Update Asset Command
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #6583.
2022-10-28 20:09:15 +02:00
mr1716 438d8ec1eb NIFI-10688 Update javax.json-api & javax.json
This closes #6572

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-28 08:02:28 -04:00
exceptionfactory c6ae69e054
NIFI-10716 Upgraded Flume from 1.10.1 to 1.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6595.
2022-10-28 10:59:29 +02:00
M Tien be64f5560c
NIFI-10603: fix showing the referencing components border in the fetch parameters dialog (#6491)
This closes #6491
2022-10-27 13:45:24 -04:00
Csaba Bejan ac7306f582
NIFI-10693 Remove proxy configuration properties from PutBigQuery
This closes #6580.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-27 16:57:11 +02:00
UcanInfosec ef0793c8fc
NIFI-10695 Update org.eclipse.paho.client.mqttv3 to 1.2.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6578.
2022-10-27 07:29:19 +02:00
Matt Gilman b05bd988b6 NIFI-10700:
- Only restart ports if their scheduledState is Running.
- Adding unit tests.
- Fixing unit test to properly verify Port isn't restarted.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6582.
2022-10-26 16:31:27 -04:00
Mark Payne d390a0becf
NIFI-10673: When a component is added to a ProcessGroup, we had a method called ensureUniqueVersionControlId but the method only took into accounts in that Process Group. Updated methods to now consider components in any Process Group that is part of the same Versioned Flow. Also added system test to verify the problem and the fix. Added Toolkit clients and additional methods as necessary in order to implement system tests
NIFI-10673: Addresed checkstyle issue

NIFI-10673: Removed TODO comment
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2022-10-26 14:38:01 -04:00
Chris Sampson b6026f5709 NIFI-10303 route GetElasticsearch to failure if _id is blank after attribute evaluation
This closes #6573

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-25 14:30:09 -04:00
Chris Sampson db49a861b3 NIFI-10687 set Elasticsearch document _id to null if ID attribute evaluated to blank String for PutElasticsearchRecord or PutElasticsearchJson; use @timestamp default value if @timestamp record path evaluates to blank String in PutElasticsearchRecord
This closes #6575

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-25 14:23:19 -04:00
Andrew Lim 2d5a8b8b0d NIFI-10503 Changed flow file references to FlowFile in GenerateTableFetch processor docs
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6577.
2022-10-25 11:13:07 -04:00
Denes Arvay 3ed87a2982
NIFI-10594 Render empty lines in Labels
This closes #6519

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:39:29 -05:00
UcanInfosec 3d1bf497a3
NIFI-10686 Upgraded questdb-core from 6.5.2 to 6.5.3
This closes #6570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:22:26 -05:00
mtien 643b6a6c1d
NIFI-10689 Fixed Parameter Provider Name encoding in context dialog
This closes #6576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:16:36 -05:00
Joe Witt c92a30734f
NIFI-10680 Corrected Bouncy Castle references in optional profiles
NIFI-10691 Removed duplicate Bouncy Castle dependencies from nifi-standard-processors

This closes #6571

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 17:46:51 -05:00
Timea Barna 7c33516aee NIFI-9437 Flowfile Expiration cannot exceed 24 days
NIFI-9437 Addressing review comments, correcting setter in StatelessFlowQueue class

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6558.
2022-10-24 14:46:56 -04:00
mr1716 753cb1b9df
NIFI-10683 Upgraded JNA to 5.12.1 for Windows Event Log
This closes #6568

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 09:53:43 -05:00
Malthe Borch 831a11d0b5
NIFI-7823 Added groups mapping from OIDC token claim
This closes #6454

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 09:12:24 -05:00
markap14 d64574b565
NIFI-10682: When determining effective property values, ensure that we always use the up-to-date version of Property Descriptors (#6567)
This closes #6567
2022-10-24 09:59:16 -04:00
mr1716 f23318a361
NIFI-10670 Update commons-csv from 1.8 to 1.9.0
This closes #6554

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 15:18:00 -05:00
Lehel Boér feb3148b68
NIFI-10628: Added Default Schedule Time and Run Duration to processors
This closes #6512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 14:57:46 -05:00
Nandor Soma Abonyi 2049268372
NIFI-10668 Persist proxy password in remote process group (#6557)
* NIFI-10668 Persist proxy password in remote process group
2022-10-21 11:44:12 -04:00
Joe Witt c155d29658
NIFI-10614 Upgraded Bouncy Castle from 1.70 to 1.71
- Blocked Bouncy Castle jdk15on dependencies
- Forced jdk18on dependencies and validated across entire build

This closes #6498

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 19:35:02 -05:00
exceptionfactory 9f2ad260bd NIFI-10667 Added Private Key Service interface and implementation
- Defined PrivateKeyService in nifi-key-service-api
- Implemented StandardPrivateKeyService using Bouncy Castle library

NIFI-10667 Improved custom validation to avoid repetitive reads

NIFI-10667 Added onPropertyModified() to clear Key Reference for validation

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6553.
2022-10-20 18:08:18 -04:00
Nathan Gough c22181e79f
NIFI-10672 - Removed intermittently failing method from DBCPServiceTest
This closes #6555

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 16:33:35 -05:00
markap14 e83e3eb849
NIFI-10663: When ProcessorNode.stop() is called, it returns a Future. That future, however, may be completed when the processor is fully stopped or whenever it becomes stopping. Fixed this behavior by only completing the future whenever the processor has fully stopped. Also addressed an issue in the synchronizer in which we did not stop a processor when it had a state of STARTING. (#6561)
This closes #6561
2022-10-20 15:42:37 -04:00
yiteng3 a5d93d96a3
NIFI-10631 Changed HashMap to LinkedHashMap in TestHBase_2_ClientService
- Adjustment avoids non-deterministic warnings related to HashMap ordering

This closes #6516

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-19 09:54:47 -05:00
dependabot[bot] 531a9de28f
NIFI-10669 Upgraded Jettison from 1.3.7 to 1.5.1
- Upgraded Jettison in nifi-framework-bundle
- Upgraded Jettison in nifi-registry-ranger
- Upgraded Jettison in nifi-spark-bundle

This closes #6548
This closes #6549
This closes #6550

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-19 09:45:49 -05:00
Peter Turcsanyi 2be5c26f28
NIFI-10659: Extracted DBCP common code to nifi-dbcp-base module for use in Snowflake NAR
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6543
2022-10-18 17:04:14 -04:00
UcanInfosec 808d3d6664
NIFI-10636 Update Jython-standalone to 2.7.3
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6521
2022-10-18 16:57:32 -04:00
exceptionfactory dd93fbeb7a
NIFI-10661 Corrected JSLT tests using parsed JSON comparison
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6551
2022-10-18 16:50:01 -04:00
exceptionfactory fcefd051d2
NIFI-10652 Corrected dependency scopes for nifi-iceberg-processors
- Marked nifi-iceberg-services-api as provided
- Marked multiple Hadoop and Hive dependencies as provided to avoid duplicate inclusion in nifi-iceberg-processors-nar

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6535
2022-10-18 13:25:11 -04:00
exceptionfactory 523dd94045
NIFI-10651 Upgraded Iceberg transitive dependencies
- Followed dependency override approach from nifi-hive-bundle based on Hive dependencies

NIFI-10651 Removed unnecessary Calcite dependency references

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6533
2022-10-18 13:23:15 -04:00
exceptionfactory b64b4fcce5
NIFI-10661 Added support for File Resources to JSLTTransformJSON
- Refactored unit test methods for reuse of shared operations
- Added link to JSLT Tutorial in property description

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6546
2022-10-18 13:16:29 -04:00
Matthew Burgess dfbc7dfc21
NIFI-8111: Add JSLTTransformJSON Processor
This closes #4797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-17 16:14:18 -05:00
Matt Burgess f43b989c99
NIFI-10617: Add missing DynamicProperty annotation to processors that use them (#6509)
This closes #6509
2022-10-17 12:46:37 -04:00
Matthew Burgess a76abef270 NIFI-10635: Fix handling of enums in PutDatabaseRecord
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6518.
2022-10-17 11:29:53 -04:00
Nandor Soma Abonyi 298dd2024e
NIFI-10644 Add Message Demarcator-style processing in PublishMQTT
This closes #6530.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-16 23:20:28 +02:00
Nandor Soma Abonyi eecb6bfb38 NIFI-10650 Fix demarcator is appended to the end of the FlowFile's content by ConsumeMQTT
This closes #6534.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-15 18:10:04 +02:00
Joe Gresock 704ca63cc7
NIFI-10643: Paging secrets in AwsSecretsManagerParameterProvider
This closes #6532

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-15 09:09:14 -05:00
Joe Gresock 2d7f86b265
NIFI-10641: Resolving typo on ParameterProvider warning message
This closes #6527

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-15 09:05:57 -05:00
exceptionfactory 0dc02e26d2 NIFI-10648 Upgraded Apache Commons Text to 1.10.0
- Added org.apache.commons.text.version property in root Maven configuration
- Removed direct version references in favor of managed dependency version

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6531.
2022-10-14 14:07:23 -04:00
Joe Gresock 283669ced3
NIFI-10633 Adding references to Key/Value Version 1 secrets engine in HashiCorp Vault documentation
This closes #6520

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-14 09:55:18 -05:00
exceptionfactory ed8197eacb
NIFI-10567 Corrected Sensitive Dynamic Property handling for flow.xml (#6524)
- Updated XmlFlowSynchronizer to filter parsed Sensitive Dynamic Property Names using dynamic status of component Property Descriptor
- Lack of access to the Component Property Descriptor when parsing DOM elements required subsequent dynamic status filtering
2022-10-13 19:38:17 -04:00
Denes Arvay b784d6e8ee
NIFI-10621 Allow ExecuteGroovyScript classpath properties to accept commas or semicolons
ExecuteGroovyScript's "Additional classpath" property treats commas and semicolons
as delimiters

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6523
2022-10-13 15:08:28 -04:00
Mike Thomsen 08a1f09905 NIFI-10437 Converted SearchResponseTest from Groovy to Java.
NIFI-10437 Removed old Maven Elasticsearch integration testing plugin and replaced with Testcontainers.
NIFI-10437 Converted TestSchemaRegistry from Groovy to Java.
NIFI-10437 Converted TestElasticsearchClientService from Groovy to Java.
NIFI-10437 Converted a unit test from Groovy to Java.
NIFI-10437 Converted a unit test from Groovy to Java.
NIFI-10437 Converted ElasticSearchLookupService_IT from Groovy to Java.
NIFI-10437 Converted ElasticSearchClientService_IT from Groovy to Java.
NIFI-10437 Migrated to Testcontainers.
NIFI-10437 Converted all nifi-elasticsearch-restapi-processors unit tests from Groovy to Java.

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6487
2022-10-13 12:52:20 +01:00
exceptionfactory 11314e8132
NIFI-10624 Removed sensitive properties key warning
- Corrected logging statements with placeholders instead of concatenation
- Removed unused NiFiServerStub

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6513
2022-10-12 21:58:29 -04:00
UcanInfosec 14a2249c0e
NIFI-10626 Update jruby-complete to 9.3.8.0
This closes #6510

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-12 20:32:17 -04:00
Mark Bathori e87bced147
NIFI-10442: Create PutIceberg processor
This closes #6368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-11 21:51:18 +02:00
mr1716 14d3ac3229
NIFI-10620 Upgraded Spring Integration from 5.5.14 to 5.5.15
This closes #6505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-11 11:03:16 -04:00
Lehel Boér ad08e8befc
NIFI-10602: Fix GetHubSpot and GetShopify state handling on NiFi restart
This closes #6495.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-10 23:44:03 +02:00
Andrew Lim da0fb234d6
NIFI-10288 Better describe forward slash requirements for Prefix property in ListS3
This closes #6477

Co-authored-by: Andrew Lim <andrewlim.apache@gmail.com>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-10 11:40:57 -05:00
Jon Shoemaker 9a4ce2607d
NIFI-9878 Added timeout handling for Cache Client handshaking
This closes #6414

Co-authored-by: Nissim Shiman <nshiman@yahoo.com>
Co-authored-by: Jon Shoemaker <jon.l.shoemaker@systolic.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-10 11:31:40 -05:00
Matt Gilman e638bcee2f
NIFI-10617:
- Adding dynamic property annotation on a number of extensions that were missing it.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6501
2022-10-10 10:32:50 -04:00
Nathan Gough 9ff1dadcf6
NIFI-10604 Added Idle Connection Timeout property to ListenTCP
This closes #6492

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 14:30:37 -05:00
zhangcheng b5f4101fa0
NIFI-10352: remove the meaningless code of GenerateTableFetch.java, It is confusing for reading code.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6299
2022-10-07 14:50:26 -04:00
exceptionfactory 97dc4b67aa NIFI-10569 Added Maximum Thread property to HandleHttpRequest
- Added simple unit test for HandleHttpRequest to run without requests
- Removed cleanup integration test method for HandleHttpRequest

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6465.
2022-10-07 14:37:04 -04:00
Michael 81877 572799a201
NIFI-10273 Supported file entries larger than 8.5GB for TAR in MergeContent
This closes #6369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 10:36:10 -05:00
dan-s1 5da9ce525c
NIFI-10565 Removed duplicated test dependencies
This closes #6482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 09:07:51 -05:00
Joe Witt c6a9d70814
Merge branch 'NIFI-10521-RC4' 2022-10-06 14:13:30 -07:00
exceptionfactory d1145ee34e NIFI-10586 Prioritized ssh-rsa algorithm in SFTP Processors
- The default configuration prioritizes ssh-rsa when Key Algorithms Allowed is not specified

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6479.
2022-10-06 14:31:10 -04:00
krisztina-zsihovszki 1ec8c84b6a NIFI-10597 Change 'App Config File' property to external resource in Box processors
This closes #6489.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-10-06 18:54:47 +02:00
Nandor Soma Abonyi 2405b0ef71
NIFI-10543 Support broker failover in MQTT processors (#6447)
NIFI-10543 Support broker failover in MQTT processors

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-06 18:24:54 +02:00
Yanni bcec883344
NIFI-10592 This closes #6486. fix flaky tests using wrong map impl.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-10-05 14:49:07 -07:00
Ferenc Erdei 504baae227
NIFI-10531 Add supported operations to c2 heartbeat:
This closes #6438

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-10-04 17:16:51 +02:00
Ferenc Kis 16bcb8f145
NIFI-10458 MiNiFi: Add C2 handler for Transfer/Debug operation
This closes #6434

Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
2022-10-04 10:35:39 +02:00
Andrew Lim d29f67465a
NIFI-10564 Update text for access the controller access policy in UI and Admin Guide
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6476.
2022-10-03 20:50:31 -04:00
exceptionfactory 7a01e22125
NIFI-10577 Fix Sensitive Checkbox rendering for Fetch Parameters (#6473)
* NIFI-10577 Fixed Sensitive Checkbox rendering for Fetch Parameters

- Corrected rendering of Sensitive status checkbox on Firefox using standard nf-checkbox

* NIFI-10577 Corrected canvas rendering in Safari

Merged #6473 in main.
2022-10-03 13:24:36 -07:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Joe Gresock 10a5e9194c
NIFI-10572: Allowing variables to be deleted between versions, and considering ancestor variable additions to be environmental
This closes #6474

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-03 12:44:07 -05:00
M Tien 5546b7ab01
NIFI-10566: update availability text in Controller Settings (#6463)
* NIFI-10566: update availability text in Controller Settings
- fix link in controller service referencing a parameter provider

* add Registry Clients to the availability message

This closes #6463
2022-10-03 08:23:52 -04:00
Peter Turcsanyi 271c773ee4
NIFI-10574: Fixed PutAzureDataLakeStorage fails with HTTP 412 error
This closes #6470

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-02 16:44:53 -05:00
Joe Gresock 518f413d9f NIFI-9637: Adding GcpSecretManagerParameterProvider
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6394.
2022-09-30 13:15:36 -04:00
Emilio Setiadarma abf88c3aab
NIFI-10240 Removed custom validation for SSL Context Service in ListenSyslog
- Made sure to check TCP is protocol set before using SSL Context Service during runtime

This closes #6441

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-30 11:03:39 -05:00
Aerilym 4b691b133b
NIFI-10192 Caffeine cache schema request for reuse
This closes #6364

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 15:07:42 -04:00
Joe Gresock 315e54a812
NIFI-9636: Adding AwsSecretsManagerParameterProvider
This closes #6392

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-29 11:59:04 -05:00
Matthew Hawkins 3e60414d48
NIFI-10436 Initial basic brotli support
NIFI-10436 Add Brotli-compressed SampleFile.txt.br for unit testing
NIFI-10436 Fixup basic usage of Brotli4j API
NIFI-10436 NOTICE ok, LICENSE updated
NIFI-10436 style fixup CompressContent.java
NIFI-10436 Update CompressContent.java

This closes #6432

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 12:03:09 -04:00
Lance Kinley 8c2b8cb6bc
NIFI-10557 Upgrade MongoDB driver to 4.7.1
This closes #6455

Fully supports MongoDB 6.0

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 11:40:08 -04:00
Lehel da05ba0165 NIFI-10213: Create GetShopify processor
This closes #6303.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-29 16:12:53 +02:00
Joe Gresock 094222260c
NIFI-9402: Adding DatabaseParameterProvider
Adding provided scope to api dependency in nifi-standard-parameter-providers module

Adding additional documentation, other minor code cleanup

Correcting error handling in StandardParameterProviderNode, updating additional details for DatabaseParameterProvider

Correcting null columm value handling

NIFI-9402: Fixed Checkstyle violation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6391
2022-09-28 17:41:57 -04:00
exceptionfactory 013d01a9fc
NIFI-10558 This closes #6456. Updated Ranger modules to skip tests on AArch64
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-28 13:54:42 -07:00
Joe Witt 1a99b9611c
NIFI-10559 Clarified remote path can come from flowfile attributes and made inherited prop descriptors more obvious
This closes #6457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-28 15:52:32 -05:00
exceptionfactory 6461061e8f
NIFI-10381 Refactored Azure Event Hubs components with current SDK
- Upgraded Azure Event Hubs components from legacy version 3 to current version 5
- Refactored Azure dependencies using azure-sdk-bom
- Merged nifi-azure-record-sink-nar with nifi-azure-nar
- Refactored PutAzureCosmosDBRecordTest to use Jackson instead of Gson

This closes #6319.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-28 18:22:01 +02:00
Zoltan Kornel Torok b28a211bf3
NIFI-10552 This closes #6453. Fix ranger credential builder NoClassDefFoundError
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-27 10:58:07 -07:00
Lehel Boér 63aac1a31d NIFI-10513: Added capture non-record fields to JsonTreeRowRecordReader, added pagination to QuerySalesforceObject
This closes #6444.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-27 19:53:10 +02:00
Tamas Palfy 1d9e119084
NIFI-10523 - Improved Google Drive processor documentations.
This closes #6430.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 19:42:26 +02:00
Lehel Boér f14f940389
NIFI-10551: Improve GetHubSpot documentation
This closes #6452.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 16:50:49 +02:00
M Tien 34084d083a
NIFI-10542: set sensitivity for new parameters in a synced parameter context (#6446)
* NIFI-10542: set sensitivity for new parameters in a synced parameter context

* show removed or missing but referenced parameters with tooltip in the selectable parameters table
- remove default parameter value

* address review feedback
- fix showing a referencing icon for a missing but removed parameter

* fix discovering new parameters

This closes #6446
2022-09-26 19:32:00 -04:00
Eduardo Fontes 9bc63920aa
NIFI-10289 This closes #6256. Change getConflictColumnsClause
NIFI-10289 Test upsert to catch this issue

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-26 15:38:42 -07:00
Joe Witt 9e6ee656b5
NIFI-10532 ensuring client gets reset if any of the key values host/port/user/pw change on a per ff basis (#6445) 2022-09-26 17:00:23 -04:00
simonbence e5059e0514
NIFI-10550 Fixing SSH Context Service validation for NifiRegistryFlowRegistryClient (#6451) 2022-09-26 16:28:00 -04:00
Shane Ardell 17084a1f09
NIFI-10538: UI updates for making RegistryClient an extension point (#6437)
* init commit

* remove test string

* display only class name for types combo

* remove commented code

* add UI support for dynamic properties

* add support for controller services

* address review feedback:

* fix syntax error
* remove console logs
* move contents of editRegistry into callback
* add name and description fields back to edit dialog

* add referencing component logic for registry clients

* implement reload logic

* more review findings
* increase size of description textarea in config
* remove location column from registry table
* remove commented out code

* post-rebase tweaks
* change if condition from assignment to evaluation
* add missing semicolons
* refactor new registry initialization into function

* more feedback addressed
* fix rebase error around controller service reference
* render registry references in their own list
* remove duplicate updateValidationError function
* remove TODO comment

* expose reload through nfSettings public variable

* show add registry dialog only after available types returns

* fix css class name

This closes #6437
2022-09-26 16:03:51 -04:00
Lehel 5d2bd1e47b
NIFI-10463: Fix GetHubSpot incremental loading
This closes #6379.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 21:33:22 +02:00
Ferenc Kis 0fa923159f
NIFI-10460 GetZendesk processor
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6411
2022-09-26 20:47:17 +02:00
simonbence 94fdc794b0
NIFI-10497 Making RegistryClient an extension point (#6433)
- NIFI-10497 Mae FlowRegistryClient an extension point
2022-09-26 12:16:21 -04:00
Nandor Soma Abonyi 320aed024f
NIFI-10152 Storage client caching in Azure ADLS processors
This closes #6158.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 08:26:44 +02:00
M Tien d82ce18f88
NIFI-9514 NIFI-9515: Add UI support for Parameter Providers in Controller Services (#5671)
* NIFI-9514 - Add UI support for Parameter Providers in Controller Services

* - Fix a dialog closing issue

* - Hide fetch parameters button if there are config errors

* - Update Fetch Parameters dialog with new UX
- Implement checkbox logic for Selectable Parameters table

* - add createNewParameterContext property to track if group will be created as a new parameter context
- update fetch parameters dialog views for editing and after applying changes
- show affected referencing components after applying changes
- disable apply button if no parameter contexts will be updated
- refactor showing and hiding fetched parameters and selectable parameters tables logic
- add tooltip for parameter context icon

* - update parameter contexts view for provided contexts

* - add affected referencing components after applying fetched parameters
- add referencing parameter contexts to the provider settings tab
- update checkbox style in the selectable parameters table
- fix updating the referencing components border
- fix lint errors

* - fix selectable parameters table checkbox styles

* - fix hasParameterContextChanged checks
- checkbox style tweaks

* - add status bar to fetch parameters dialog

* - more style tweaks and remove unnecessary code

* - fix the selectable parameters table not saving and loading correctly

* - add tooltips
- fix styles

* - link from the parameter context to the associated parameter provider

* 9514: support navigating to the controller service created in parameter providers

* fix bulletins format in status bar

* address review feedback
- manage permissions for parameter providers
- disable/enable Fetch Parameters dialog Apply button

* manage authorizations to access parameter providers and parameter contexts

* fix lint errors

* fix and refactor hasGroupsChanged to determine the Apply button state

* new parameter context name input cannot be empty in Fetch Parameters dialog

* address review feedback

* fix duplicate code

* more fixes

* update fetch parameters checkbox states

* replace slickgrid checkbox selection plugin with custom implementation for different selection types
- check for affected parameters using the parameter status

* fixed showing the correct referencing components when switching groups

* fixed selectable parameters table shifting contents on row selection

* leverage slickgrid onClick to set user-selected parameter sensitivities in the selectable parameters table

* fix statusbar bulletins in processor details
- fix updating borders for referencing components
- update referencing parameter icon
- update table title in fetch parameters dialog

* address review feedback

* populate controller services referencing components of a referenced provider
- update controller services tab name

* showing parameter providers in CS controller service

* update tooltip messages in fetch parameters dialog
- fix dialog height to make room for the status bar

* reload the parameter providers table after a referenced parameter provider change in controller services
- fix conditions for enabling/disabling fetch parameters dialog Apply button
- add affected components no permissions message in the dialog

* fix always reloading the parameter providers table
- fix disableApplyButton checks
- add dialog message for a missing new parameter context name

* remove extra reload

* more fixes for disableApplyButton
- fixed styles for dialog message

* add a check in disableApplyButton for changed parameter values that are not referenced
- add changed value icon for parameters that are not referenced
- fix border on the referencing affected components container

* removed unnused plugins

This closes #5671
2022-09-24 08:43:27 -04:00
Nathan Gough a52974780d
NIFI-10525 - Upgraded hadoop.version to 3.3.4.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6431.
2022-09-24 10:33:18 +04:00
Bryan Bende 8d04ba5427
NIFI-10529 Add DynamicProperties to AvroSchemaRegistry
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6436.
2022-09-24 10:31:15 +04:00
Joe Gresock ece83709f4
NIFI-10473: Removing referencing components check on param provider f… (#6388)
* NIFI-10473: Removing referencing components check on param provider fetch

* NIFI-10473: Adding parameter status DTO to ParameterProviderDTO

* Allowing parameterStatus to be populated even when no parameters were updated

* Adding ParameterStatus enum for parameter fetching

* Adding MISSING_BUT_REFERENCED ParameterStatus

This closes #6388
2022-09-23 13:44:52 -04:00
Bryan Bende 27e3ee1915 NIFI-10528 Create nifi-json-record-utils and updated Salesforce NAR dependencies to use it
This closes #6435.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-23 17:11:13 +02:00
Emilio Setiadarma f586f8f4cf NIFI-9451 - Add 'Input Character Set' property for PutEmail and additional tests
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6313.
2022-09-23 00:20:23 -04:00
Ferenc Kis 1b1d388ef7
NIFI-10530 MiNiFi: Add option to compress c2 requests
This closes #6439

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-09-22 16:23:28 +02:00
mr1716 cfb1597e10
NIFI-10520: Upgrade Hazelcast version to 4.2.5
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6429
2022-09-21 10:47:12 -04:00
kulikg cea924bc6b
NIFI-10507 removed absolute.path from ListSmb (#6422) 2022-09-19 16:49:20 -04:00
Tamas Palfy dd9739a28c
NIFI-10427 - Added ListBoxFile and FetchBoxFile processors
This closes #6355.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 19:46:56 +02:00
Joe Gresock 43931b1504
NIFI-10518: Adding intended state to ScheduledStateChangeListener (#6428)
- NIFI-10518: Adding intended state to ScheduledStateChangeListener
- Notifying of scheduled state change when transitionComponentState is called
- Notifying scheduled state change when reporting task state is changed
- Notifying scheduledState changes for remote group port start/stop components calls
2022-09-19 10:38:00 -04:00
Csaba Bejan 35fb66f50f
NIFI-10403 Add processor supporting the new BigQuery Write API
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6344
2022-09-19 14:32:11 +02:00
krisztina-zsihovszki 111c7ac0a4
NIFI-10444 FetchDropbox processor
NIFI-10444 Add ProxyConfiguration to ListDropbox and FetchDropbox processors

This closes #6401.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 13:08:49 +02:00
Mark Payne ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6421
2022-09-16 17:58:19 -04:00
Mark Payne eaa275a5e4
NIFI-10515: If propopsed controller service is disabled, ensure that we don't re-enable the service and references when synchronize(ControllerServiceNode...) is called
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6425.
2022-09-16 16:36:55 -04:00
exceptionfactory abbd7a89c8
NIFI-10455 Removed unused import from GetWorkdayReport
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 13:49:38 -05:00
Ferenc Erdei 903a487cf8
NIFI-10455 Added GetWorkdayReport Processor
This closes #6376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 12:56:03 -05:00
mr1716 62811f5afe NIFI-10492 - Update pom.xml for graphics2d from 0.32 to 0.40
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6412.
2022-09-16 12:45:46 -04:00
exceptionfactory 6398c2deb7
NIFI-10505 Removed unused HttpClient dependency from nifi-web-api
- Removing org.apache.httpcomponents:httpclient from nifi-web-api avoids Linkage Errors with Sensitive Property Providers

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6423.
2022-09-16 10:19:28 +02:00
Mark Payne 3f0ef9e977
NIFI-10406: Updated Maven assemblies to ensure that we always use at least two of the GAVC parameters for includes and excludes. Updated Maven assembly plugin to version 3.4.2. Removed some includes and excludes from dependencies that previously were not matching and were generating Maven WARNING messages.
This closes #6415

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-15 11:02:08 -05:00
Joe Gresock 51d01f874e
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer (#6341)
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer
2022-09-15 09:15:44 -04:00
Joe Gresock 3987d39cdc
NIFI-9401 Added HashiCorpVaultParameterProvider
- Refactored nifi-vault-utils to nifi-hashicorp-vault-api and nifi-hashcorp-vault modules
- Added HashiCorpVaultClientService and Standard implementation

This closes #6304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-14 19:46:09 -05:00
Peter Turcsanyi 5303aadda3
NIFI-10500: Improved property ordering in MQTT processors
Signed-off-by: Arpad Boda <aboda@apache.org>
2022-09-14 21:13:01 +02:00
Robert Kalmar 4b0568e6fe
NIFI-10242 Create QueryAirtableTable processor
This closes #6350.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-14 20:31:34 +02:00
UcanInfosec a9013a61ec
NIFI-10494 Upgrade Camel-Salesforce to 3.14.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6413.
2022-09-14 16:48:16 +02:00
exceptionfactory 04c0df1723
NIFI-10471 Documented and applied standard deprecation logging
- Updated Admin Guide with section on Logging Configuration and Deprecation Logging
- Updated Developer Guide with section on Deprecating Components and Features
- Added Deprecation Logging when adding components marked with DeprecationNotice to the Flow Configuration
- Added Deprecation Logging on deprecated methods in standard Controller Service implementations
- Removed integration tests for deprecated PersistentProvenanceRepository
- Updated logging and added documentation on minor upgrade steps
- Updated logging for HDFSNarProvider and RocksDB Repository

This closes #6390
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-13 19:40:03 -04:00
Csaba Bejan e26aa233d7 NIFI-10458 Add support for the DESCRIBE/MANIFEST Operation
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #6375
2022-09-13 19:22:35 +02:00