Commit Graph

6101 Commits

Author SHA1 Message Date
mr1716 53f64badbf NIFI-11931 Update iotdb.sdk.version to 1.1.2
This closes #7595

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:43:55 -04:00
mr1716 c878310e36 NIFI-11930 Update aws-kinesis-client-library-version to 1.15.0
This closes #7594

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:42:14 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Peter Turcsanyi 2e6eaaeb38
NIFI-11926: Added proxy handling in Azure Storage Credentials Services
Added Proxy Configuration Service property in AzureStorageCredentialsControllerService_v12 and ADLSCredentialsControllerService used by Service Principal and Managed Identity authentication modes.

This closes #7590

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:46:31 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
mr1716 0643e1db96
NIFI-11925 Upgraded smbj from 0.12.1 to 0.12.2
This closes #7589

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 14:46:17 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
exceptionfactory 84326ba4b2 NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7586
2023-08-09 13:00:55 -04:00
Mike Thomsen cba6b00271
NIFI-11383 Updated Java documentation links from 8 to 17
This closes #7581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 09:17:48 -05:00
exceptionfactory bbd8fb6f63
NIFI-11895 Removed deprecated Repository Encryption configuration
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7557.
2023-08-09 07:07:31 -04:00
krisztina-zsihovszki 0446990d54
NIFI-11916 Iceberg processor extensibility improvement
This closes #7583.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-08 22:31:52 +02:00
Peter Turcsanyi 2a3ce1cb69
NIFI-11918 Used java.security.cert in ListenGRPC
This closes #7580

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-08 10:04:52 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
exceptionfactory ff87060b16 NIFI-11915 Upgraded gRPC from 1.57.0 to 1.57.1
This closes #7577

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-07 17:22:47 -04:00
Pierre Villard 62487f575a
NIFI-11891 Added No Tracking listing strategy to ListGCS
This closes #7570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 14:06:17 -05:00
Mike Thomsen 5cb15b484c
NIFI-11913 Added enum handling to StandardSchemaValidator
This closes #7576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 13:58:43 -05:00
Pierre Villard b056bf8f7b
NIFI-11823 - fix NUMERIC support in PutBigQuery
This closes #7489.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-05 23:21:48 +02:00
Mark Payne 485112e54f
NIFI-11911 Updated FetchGoogleDrive to support Export Types
- Export API support includes Google Docs, Presentations, Spreadsheets, Drawings, and AppScripts

This closes #7575

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 16:28:44 -05:00
Yolanda M. Davis f8e3b9ebac
NIFI-11899 Correct Bulletin Metrics Registry to return latest Bulletins
This closes #7567

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:20:00 -05:00
Pierre Villard 572e661d12
NIFI-11901 Added name and version subtitle in Processor Details view
This closes #7563

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:14:14 -05:00
exceptionfactory 5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
Matt Burgess 63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
This closes #7561

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
mr1716 1fda6bca7a
NIFI-11906 Updated nifi-resources description for consistency
This closes #7571

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 13:02:30 -05:00
mr1716 66fc11d7c5
NIFI-11905 Update snowflake-jdbc to 3.14.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7569.
2023-08-03 17:33:59 +02:00
exceptionfactory 04cd6c216e
NIFI-11896 Corrected QuestDB Status Repository Shutdown handling
- Updated QuestDB Status Repository shutdown method to cancel scheduled tasks before immediate shutdown of Scheduled Executor Service
- Updated QuestDB Scheduled Tasks to include initial delay to avoid unnecessary execution when starting
- Updated QuestDB test class to minimize logging for QuestDB 7
- Improved logging and exception messages

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7564.
2023-08-03 17:25:52 +02:00
Lehel Boer 6a8a8caa4c
NIFI-11902: Fix ListHDFS closes FileSystem in first run
This closes #7565.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-03 16:02:42 +02:00
Mike Thomsen 49a350a765
NIFI-11900 Catch RuntimeException in ResizeImage failures
This closes #7558

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-02 14:02:56 -05:00
mr1716 5a8519ebd1
NIFI-11888 Upgraded Saxon-HE from 12.2 to 12.3
This closes #7553

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 20:31:56 -05:00
mr1716 011986c431
NIFI-11885 Upgraded asn1bean from 1.13.0 to 1.14.0
This closes #7552

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:57:48 -05:00
mr1716 f081bcb311
NIFI-11887 Upgraded Iceberg from 1.3.0 to 1.3.1
This closes #7551

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:56:27 -05:00
mr1716 83ca3687ad
NIFI-11884 Upgraded snowflake-ingest-sdk from 2.0.1 to 2.0.2
This closes #7549

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:55:35 -05:00
mr1716 91d86513d1
NIFI-11876 Upgraded gRPC from 1.56.1 to 1.57.0
This closes #7540

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:50:00 -05:00
mr1716 87cd4b5817
NIFI-11868 Upgraded Cassandra Driver from 3.11.3 to 3.11.4
This closes #7535

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:45:39 -05:00
mr1716 225296435d
NIFI-11867 Upgraded Neo4j Driver from 4.4.11 to 4.4.12
This closes #7534

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:42:27 -05:00
mr1716 32c80ac294
NIFI-11866 Upgraded mvel2 from 2.4.15 to 2.5.0
This closes #7533

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:37:13 -05:00
exceptionfactory 118ee0d00e
NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7531.
2023-07-31 18:21:48 +02:00
Timea Barna 42910e80d1
NIFI-11658 Streamline using single Parameter Context for nested PGs
This closes #7353

Co-authored-by: Matt Gilman <mcgilman@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-27 15:02:54 -05:00
mr1716 a61add22c2
NIFI-11856 Upgraded MongoDB Driver from 4.9.1 to 4.10.2
This closes #7526

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-25 09:53:29 -05:00
mr1716 13d7850702
NIFI-11855 Upgraded mysql-binlog-connector-java from 0.28.0 to 0.28.1
This closes #7525

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-25 09:50:40 -05:00
exceptionfactory 3a078c0c31
NIFI-11780 Added Certificate SAN Attributes to HandleHttpRequest
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7521.
2023-07-25 16:09:25 +02:00
exceptionfactory 72618b1817
NIFI-11853 Changed Embedded QuestDB Tests to use JUnit5 TempDir
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7523.
2023-07-25 15:48:45 +02:00
Pierre Villard 319c974e7c
NIFI-11828 - Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID (#7495)
* NIFI-11828 - Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID
* removed hard coded version 1
2023-07-25 09:42:50 -04:00
Matt Burgess d201119f0d
NIFI-11830 Added Transformation Strategy property to JSLTTransformJSON
This closes #7509

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 15:04:17 -05:00
Pierre Villard dbb2d6905f
NIFI-11842 - remove getTargetUri() and code cleanup
This closes #7511

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:53:17 -05:00
Paul Grey 5cad5838c5
NIFI-11840 Add Kafka Partition and Topic Attributes before handoff to RecordReader
This closes #7510

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:40:22 -05:00
Mark Payne c68f5ec9a2
NIFI-11793 Added Python debugging properties and documentation
Added documentation to indicate how to debug Python side of nifi framework, as well as debugging Python processors themselves using VSCode's Remote debugger.
This also provides the ability to launch the Controller process in such a way that it will listen to incoming remote debug connections.

This closes #7469

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:23:19 -05:00
Mark Payne 0eebf6b14e
NIFI-3065 When copying a PG, do not set the Log File Suffix if not already set
This closes #7522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:05:27 -05:00
Pierre Villard 969679e43b
NIFI-11846 - Change version should not show keep existing parameter context
This closes #7517

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 11:35:05 -05:00
Mark Payne c009b55762
NIFI-11813: Fixed a bug in nf-processor-configuration.js that caused the UI to ignore the Scheduling Period when using a Timer-Driven strategy; removed some additional remnants of event-driven strategy from the UI
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7518.
2023-07-24 17:24:26 +02:00
mr1716 ca2ee34bc2
NIFI-11843 Upgraded Box SDK from 4.1.0 to 4.2.0
This closes #7512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:46 -05:00