fb502cdf9a
NIFI-11480 add option to group PutElasticsearchRecord errors by Elasticsearch _bulk error type
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7441
2023-08-23 16:00:28 -04:00
1e12800912
NIFI-11978 Fix: NPE when trying to disable Management Controller Service
...
This closes #7637
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 13:58:58 -05:00
c08560447f
NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
...
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7622
2023-08-23 14:42:59 -04:00
c0c1b386f6
NIFI-11981 - PublishGCPubSub failure / Record-based processing / AVRO
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7638
2023-08-23 14:29:19 -04:00
016834efaa
NIFI-11976 Removed error log check in TestListenTCPRecord
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7635
2023-08-22 15:16:25 -04:00
680acf89ed
NIFI-11980 Upgraded Apache Ivy from 2.5.1 to 2.5.2
...
This closes #7633
This closes #7632
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 11:52:48 -05:00
9432f302c6
NIFI-11877 Added Comments field for Rules in UpdateAttribute
...
This closes #7541
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 09:49:19 -05:00
7340bb8153
NIFI-11924 Closing FileSystem after using in HDFSExternalResourceProvider
...
This closes #7588 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-22 13:18:10 +02:00
baea7ffee9
NIFI-11971: Ensure that when creating a new content claim that we always treat an existing claim length of -1 as 0, to ensure that we never add -1 to our offset
...
This closes #7631
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 12:07:16 -05:00
52cc831a2a
NIFI-11303 Added a go-to entry on the right click context menu for th… ( #7461 )
...
* NIFI-11303 Added a go-to entry on the right click context menu for the provenance lineage tree to take you to the specified component in the graph
* nifi-11303 Removed unused variable.
Merged #7461 into main.
2023-08-21 09:23:38 -07:00
5d90c9c14b
NIFI-9164 Refactored tests in nifi-windows-event-log to JUnit 5
...
- Used LauncherInterceptor to handle custom class loading
This closes #7623
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:12:29 -05:00
96ae5252f5
NIFI-11970 Upgraded gRPC from 1.57.1 to 1.57.2
...
This closes #7628
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:04:11 -05:00
83cba2c5ad
NIFI-11969 Upgraded excel-streaming-reader from 4.1.0 to 4.1.1
...
This closes #7627
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:03:37 -05:00
e83fc230ac
NIFI-11968 Upgraded zstd-jni to 1.5.5-5 for compress-processors
...
This closes #7626
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:02:00 -05:00
5e2a10c328
NIFI-11971: Ensure that if we do not write any bytes to a file after calling ProcessSession.write() that we set content claim's length to 0 when closing OutputStream; otherwise it remains -1, which causes issues, since the length will later be added to the offset to determine the position in the ste stream
...
This closes #7629
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 07:56:57 -05:00
dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
...
This closes #7617
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
a9f29f209e
NIFI-11928 Update gremlin.version to 3.7.0
...
This closes #7592
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-18 09:04:10 -04:00
3aa02a022e
NIFI-11514 Flow JSON support and deprecating YAML format. Revised parameter generation. Generic refactors.
...
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #7344
2023-08-18 11:33:23 +02:00
0d119f6f39
NIFI-11955 Upgraded maven-clean-plugin from 3.2.0 to 3.3.1
...
This closes #7616
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:05:01 -05:00
46cdcf9dac
NIFI-11954 Upgraded license-maven-plugin from 2.0.0 to 2.2.0
...
This closes #7614
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:04:26 -05:00
70c756ff78
NIFI-11953 Upgraded download-maven-plugin from 1.6.8 to 1.7.1
...
This closes #7613
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:03:41 -05:00
71abd77727
NIFI-11944 Removed validation warning from ExecuteStreamCommand
...
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7607
2023-08-14 16:34:49 -04:00
b55b712b38
NIFI-11949 Upgraded Spring Integration from 5.5.15 to 5.5.18
...
This closes #7605
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-14 12:20:58 -05:00
12f736a6b0
NIFI-11943 Update activemq-client and broker to 5.18.2
...
This closes #7602
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 21:51:30 -04:00
b78dc5ca57
NIFI-11942 Update zstd-jni to 1.5.5-5
...
This closes #7601
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
c0156e3429
NIFI-11936 Update msal4j.version to 1.13.10
...
This closes #7599
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:48:41 -04:00
99a590ec0c
NIFI-11935 Update Redis spring.data.redis.version to 2.7.14
...
This closes #7598
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:47:33 -04:00
0c03521676
NIFI-11933 Update spring.integration.version For Email Bundle To 5.5.18
...
This closes #7597
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:46:06 -04:00
53f64badbf
NIFI-11931 Update iotdb.sdk.version to 1.1.2
...
This closes #7595
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:43:55 -04:00
c878310e36
NIFI-11930 Update aws-kinesis-client-library-version to 1.15.0
...
This closes #7594
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:42:14 -04:00
02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
...
This closes #7578
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
2e6eaaeb38
NIFI-11926: Added proxy handling in Azure Storage Credentials Services
...
Added Proxy Configuration Service property in AzureStorageCredentialsControllerService_v12 and ADLSCredentialsControllerService used by Service Principal and Managed Identity authentication modes.
This closes #7590
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:46:31 -05:00
88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
...
This closes #7585
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
0643e1db96
NIFI-11925 Upgraded smbj from 0.12.1 to 0.12.2
...
This closes #7589
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 14:46:17 -05:00
b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
...
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds
Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.
Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.
When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning
When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.
This closes #7253
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
84326ba4b2
NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7586
2023-08-09 13:00:55 -04:00
cba6b00271
NIFI-11383 Updated Java documentation links from 8 to 17
...
This closes #7581
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 09:17:48 -05:00
bbd8fb6f63
NIFI-11895 Removed deprecated Repository Encryption configuration
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7557 .
2023-08-09 07:07:31 -04:00
0446990d54
NIFI-11916 Iceberg processor extensibility improvement
...
This closes #7583 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-08 22:31:52 +02:00
2a3ce1cb69
NIFI-11918 Used java.security.cert in ListenGRPC
...
This closes #7580
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-08 10:04:52 -05:00
964f56043c
NIFI-11910: Clarified some points in docs
...
This closes #7574
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
ff87060b16
NIFI-11915 Upgraded gRPC from 1.57.0 to 1.57.1
...
This closes #7577
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-07 17:22:47 -04:00
62487f575a
NIFI-11891 Added No Tracking listing strategy to ListGCS
...
This closes #7570
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 14:06:17 -05:00
5cb15b484c
NIFI-11913 Added enum handling to StandardSchemaValidator
...
This closes #7576
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 13:58:43 -05:00
b056bf8f7b
NIFI-11823 - fix NUMERIC support in PutBigQuery
...
This closes #7489 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-05 23:21:48 +02:00
485112e54f
NIFI-11911 Updated FetchGoogleDrive to support Export Types
...
- Export API support includes Google Docs, Presentations, Spreadsheets, Drawings, and AppScripts
This closes #7575
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 16:28:44 -05:00
f8e3b9ebac
NIFI-11899 Correct Bulletin Metrics Registry to return latest Bulletins
...
This closes #7567
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:20:00 -05:00
572e661d12
NIFI-11901 Added name and version subtitle in Processor Details view
...
This closes #7563
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:14:14 -05:00
5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
...
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
...
This closes #7561
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
1fda6bca7a
NIFI-11906 Updated nifi-resources description for consistency
...
This closes #7571
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 13:02:30 -05:00
66fc11d7c5
NIFI-11905 Update snowflake-jdbc to 3.14.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7569 .
2023-08-03 17:33:59 +02:00
04cd6c216e
NIFI-11896 Corrected QuestDB Status Repository Shutdown handling
...
- Updated QuestDB Status Repository shutdown method to cancel scheduled tasks before immediate shutdown of Scheduled Executor Service
- Updated QuestDB Scheduled Tasks to include initial delay to avoid unnecessary execution when starting
- Updated QuestDB test class to minimize logging for QuestDB 7
- Improved logging and exception messages
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7564 .
2023-08-03 17:25:52 +02:00
6a8a8caa4c
NIFI-11902: Fix ListHDFS closes FileSystem in first run
...
This closes #7565 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-03 16:02:42 +02:00
49a350a765
NIFI-11900 Catch RuntimeException in ResizeImage failures
...
This closes #7558
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-02 14:02:56 -05:00
5a8519ebd1
NIFI-11888 Upgraded Saxon-HE from 12.2 to 12.3
...
This closes #7553
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 20:31:56 -05:00
011986c431
NIFI-11885 Upgraded asn1bean from 1.13.0 to 1.14.0
...
This closes #7552
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:57:48 -05:00
f081bcb311
NIFI-11887 Upgraded Iceberg from 1.3.0 to 1.3.1
...
This closes #7551
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:56:27 -05:00
83ca3687ad
NIFI-11884 Upgraded snowflake-ingest-sdk from 2.0.1 to 2.0.2
...
This closes #7549
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:55:35 -05:00
91d86513d1
NIFI-11876 Upgraded gRPC from 1.56.1 to 1.57.0
...
This closes #7540
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:50:00 -05:00
87cd4b5817
NIFI-11868 Upgraded Cassandra Driver from 3.11.3 to 3.11.4
...
This closes #7535
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:45:39 -05:00
225296435d
NIFI-11867 Upgraded Neo4j Driver from 4.4.11 to 4.4.12
...
This closes #7534
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:42:27 -05:00
32c80ac294
NIFI-11866 Upgraded mvel2 from 2.4.15 to 2.5.0
...
This closes #7533
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:37:13 -05:00
118ee0d00e
NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7531 .
2023-07-31 18:21:48 +02:00
42910e80d1
NIFI-11658 Streamline using single Parameter Context for nested PGs
...
This closes #7353
Co-authored-by: Matt Gilman <mcgilman@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-27 15:02:54 -05:00
a61add22c2
NIFI-11856 Upgraded MongoDB Driver from 4.9.1 to 4.10.2
...
This closes #7526
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-25 09:53:29 -05:00
13d7850702
NIFI-11855 Upgraded mysql-binlog-connector-java from 0.28.0 to 0.28.1
...
This closes #7525
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-25 09:50:40 -05:00
3a078c0c31
NIFI-11780 Added Certificate SAN Attributes to HandleHttpRequest
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7521 .
2023-07-25 16:09:25 +02:00
72618b1817
NIFI-11853 Changed Embedded QuestDB Tests to use JUnit5 TempDir
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7523 .
2023-07-25 15:48:45 +02:00
319c974e7c
NIFI-11828 - Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID ( #7495 )
...
* NIFI-11828 - Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID
* removed hard coded version 1
2023-07-25 09:42:50 -04:00
d201119f0d
NIFI-11830 Added Transformation Strategy property to JSLTTransformJSON
...
This closes #7509
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 15:04:17 -05:00
dbb2d6905f
NIFI-11842 - remove getTargetUri() and code cleanup
...
This closes #7511
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:53:17 -05:00
5cad5838c5
NIFI-11840 Add Kafka Partition and Topic Attributes before handoff to RecordReader
...
This closes #7510
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:40:22 -05:00
c68f5ec9a2
NIFI-11793 Added Python debugging properties and documentation
...
Added documentation to indicate how to debug Python side of nifi framework, as well as debugging Python processors themselves using VSCode's Remote debugger.
This also provides the ability to launch the Controller process in such a way that it will listen to incoming remote debug connections.
This closes #7469
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:23:19 -05:00
0eebf6b14e
NIFI-3065 When copying a PG, do not set the Log File Suffix if not already set
...
This closes #7522
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:05:27 -05:00
969679e43b
NIFI-11846 - Change version should not show keep existing parameter context
...
This closes #7517
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 11:35:05 -05:00
c009b55762
NIFI-11813: Fixed a bug in nf-processor-configuration.js that caused the UI to ignore the Scheduling Period when using a Timer-Driven strategy; removed some additional remnants of event-driven strategy from the UI
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7518 .
2023-07-24 17:24:26 +02:00
ca2ee34bc2
NIFI-11843 Upgraded Box SDK from 4.1.0 to 4.2.0
...
This closes #7512
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:46 -05:00
8d5a6ce8d2
NIFI-11807 Reverted inadvertent changes to HandleHttpRequest
...
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:08 -05:00
8a5f7f0092
NIFI-11827 Added AWS Glue Schema Registry Service
...
This closes #7492
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 14:07:25 -05:00
8f5392dd11
NIFI-11837: When determining whether or not a queue should exit 'swap mode' we need to look at the updated size of the queue after migrating data from swapped queue to active queue. Previously, we were looking at the size variable that was obtained from before the migration happened.
...
This closes #7506
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 12:55:16 -05:00
20b19992d2
NIFI-11816 - Removed deprecated Primary Node Scheduling Strategy
...
This closes #7501
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:49:03 -05:00
0a774f231a
NIFI-11835 Upgraded json-schema-validator from 1.0.84 to 1.0.86
...
This closes #7505
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:45:57 -05:00
c06bb97e85
NIFI-11833 - remove deprecated classes in nifi-commons ( #7503 )
...
Signed-off-by: Otto Fowler <ottobackwards@gmail.com>
2023-07-20 11:58:51 -04:00
323f148d27
NIFI-11783: Fixed a bug in which a FlowFile split into multiple and then removed did not properly handle retries when one of the outputs was retried.
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7500
2023-07-19 15:51:21 -04:00
7405dcb510
NIFI-11814 Optimized Cluster Replication Component status evaluation
...
When waiting for all controller services to reach the desired status in the ClusterReplicationComponentLifecycle component, return immediately if there are no services to wait for. Otherwise, request that referencing components not be included in the return value of the Controller Services
This closes #7493
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 14:19:11 -05:00
7db956fea7
NIFI-11825 Fixed QueryRecord closing of resources
...
This closes #7496
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:48:15 -05:00
f6a14bc475
NIFI-11807 Added ExtractRecordSchema Processor
...
This closes #7482
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:32:59 -05:00
16c4004d58
NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7497
2023-07-18 18:29:20 -04:00
150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
...
This closes #7483
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
779eea6453
NIFI-11824 Upgraded JAX-RS API from 2.1 to 2.1.1
...
This closes #7490
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 10:50:30 -05:00
a3fe9d121d
NIFI-11817: Improve ListHDFS extensibility
...
Fix review items
This closes #7484
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-07-18 15:56:08 +02:00
bdd2a2b24b
NIFI-11819 Update derby.version to 10.16.1.1
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7491 .
2023-07-18 10:14:05 +02:00
34a6d8a0a1
NIFI-8128 Added Sentinel Password to Redis Service
...
- Replaced embedded-redis and with Testcontainers for Redis integration tests
This closes #7481
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-15 19:53:24 -05:00
95bb23d403
NIFI-11781 Corrected OIDC Claim Identity Processing
...
- Added StandardOidcUserService supporting fallback claim names
- Updated StandardClientRegistrationProvider to use standard Subject claim
- Updated OIDC Security Configuration to use customized OidcUserService for claim handling
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7468 .
2023-07-15 11:03:58 -04:00
437995b75a
NIFI-11758: Added FileResourceService and used it in PutAzure*Storage processors for local file upload
...
- Renamed classes from DataUpload to ResourceTransfer and updated references
- Disabled testNonReadableFile() on Windows due to Posix permissions
- Replaced utility methods with functional handling of FileResource
- Corrected FlowFile InputStream access using Optional.orElseGet()
This closes : #7458
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-07-14 23:48:27 +02:00
e5362c5eb7
NIFI-11798 Update smbj to 0.12.1
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7480 .
2023-07-14 20:30:51 +02:00
8a61d5bdbf
NIFI-11794 - Fix NPE + configure max attempts for Redis State Provider ( #7473 )
...
Signed-off-by: Otto Fowler<ottobackwards@gmail.com>
This closes #7473 .
2023-07-14 11:51:18 -04:00
e812951c57
NIFI-11810 Removed unused JSTL and EL API libraries
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7479 .
2023-07-14 10:30:27 +02:00
65f9bcf0cf
NIFI-11804 Upgraded excel-streaming-reader from 4.0.5 to 4.1.0
...
This closes #7477
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:32:48 -05:00
77b194303b
NIFI-11801 Upgraded RabbitMQ AMQP Client from 5.17.0 to 5.18.0
...
This closes #7475
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:30:08 -05:00
3f72032112
NIFI-11800 Upgraded icu4j from 73.1 to 73.2
...
This closes #7474
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:29:24 -05:00
21e5ebc840
NIFI-7343: Add support for SchemaRegistryService to scripted components
...
This closes #7467
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-12 17:21:28 -05:00
d2c70d1d2f
NIFI-11434 added support for optionally allowing zip entries with dat… ( #7462 )
...
* NIFI-11434 added support for optionally allowing zip entries with data descriptors
* set default value and ensured all zip tests use various configs
2023-07-12 17:09:03 -04:00
5bd4bc5190
NIFI-11178: Improve ListHDFS performance, incremental loading refactor.
2023-07-11 13:22:29 +02:00
a04cbe7f07
NIFI-11779 - Override endpoint in PutBigQuery
...
review
use default from code instead of hardcoding
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7460
2023-07-10 12:15:24 -04:00
a85ef2c1f4
NIFI-11536 Corrected Keystore and Truststore auto-reloading
...
- Replaced Jetty KeyStoreScanner and custom TrustStoreScanner with shared StoreScanner
- New StoreScanner uses TLS Configuration to reload SSLContext instead of relying on Jetty SslContextFactory properties
This closes #7446
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-10 11:07:04 -05:00
d24318cdb8
NIFI-11767 Refactored Groovy tests in nifi-web-error and nifi-web-security to Java
...
This closes #7457
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-06 16:30:34 -05:00
b3372900b3
NIFI-11774 Upgraded gRPC from 1.55.1 to 1.56.1
...
This closes #7456
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-05 17:01:49 -05:00
f69b457757
NIFI-11770: Replace java-faker with Data Faker for GenerateRecord
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7454 .
2023-07-03 11:33:50 +02:00
b1be71f918
NIFI-11334: Fixed PutIceberg processor instance interference due to same class loader usage
...
This closes #7449 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-30 20:36:33 +02:00
5f4cc106f1
NIFI-11769 Adding details on Registry Clients and Registrty Client types on UI ( #7453 )
...
Co-authored-by: Shane Ardell <shane.m.ardell@gmail.com>
Merged #7453 into main.
2023-06-30 11:33:41 -07:00
cadf2fb6f2
NIFI-11706 Add option to create dedicated Parameter Contexts for Imported Flows
...
This closes #7401
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-30 12:56:27 -05:00
50b01ffd63
NIFI-11714 Added Error Handler to Jetty Server
...
- Configured Error Handler with Stack Traces disabled for NiFi and Registry
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7447 .
2023-06-29 16:44:01 -04:00
3aba769cc3
NIFI-11762 Upgraded Hadoop dependencies from 3.3.5 to 3.3.6
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7445 .
2023-06-28 19:35:38 +02:00
7b5853363f
NIFI-11759: Remove Distributed Map Cache Client property from ListHDFS
...
This closes #7443
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-28 11:07:56 -04:00
12b7dd0243
NIFI-11760 Upgraded Riemann Client from 0.4.1 to 0.5.3
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7444 .
2023-06-28 09:55:45 +02:00
2a7fa6d17b
NIFI-11754 Refactored Groovy test in nifi-jetty to Java (and JUnit 5)
...
This closes #7442
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-27 14:39:08 -05:00
09e36f4d3e
NIFI-11757 Upgraded Google Cloud Libraries from 26.15.0 to 26.17.0
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7439
2023-06-27 12:48:51 -04:00
c90625a3e8
NIFI-11753: Remove deprecated JRuby and Luaj script engines
...
This closes #7436
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:35:57 -05:00
7748d9d1e5
NIFI-11747 Refactored Groovy tests in nifi-web-api to Java (and JUnit 5)
...
This closes #7434
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:18:48 -05:00
3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
...
This closes #6816
Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00
c5946b2e6c
NIFI-11745 Upgraded QuestDB from 6.7 to 7.2
...
This closes #7430
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:45:36 -05:00
1f1c5df5a3
NIFI-11673 Removed Legacy TLS Configuration Versions
...
This closes #7367
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-26 11:10:39 +02:00
ba6797bb94
NIFI-3065 Per Process Group logging ( #7315 )
...
* NIFI-3065 Per Process Group logging
2023-06-23 21:14:34 -04:00
7d6af0dbb0
NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7428
2023-06-23 18:27:36 -04:00
bdd7ef3671
NIFI-11744 Added Required Permission to Reference Remote Resources
...
- Applied Required Permission to components supporting URL Resource References
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7426
2023-06-23 18:07:16 -04:00
dceee57dfd
NIFI-11705 Append Operating System section in NiFi diagnostic tool
...
This closes #7388
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-23 16:36:51 -05:00
40014486a4
NIFI-11492 Allow authorization to proceed based on request groups even if user does not exist
...
This closes #7425
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 15:50:23 -05:00
bd33f2c911
NIFI-8294 Added QueryAzureDataExplorer and StandardKustoQueryService
...
This closes #7122
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 15:26:47 -05:00
ce623632cf
NIFI-11243: Implemented Dependent Properties on the Python side
...
This closes #7323
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 13:03:43 -05:00
0f736e060a
NIFI-11735 Refactored Identity Provider Groups Handling ( #7419 )
...
- Removed H2 database approach in favor of passing groups in Application Bearer Token
2023-06-22 11:07:23 -04:00
3ddac48c6d
NIFI-11734 Upgraded Apache Accumulo from 2.1.0 to 2.1.1
...
This closes #7418
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 15:42:05 -04:00
f62e1eb1e9
NIFI-11732 Upgraded Saxon from 12.1 to 12.2
...
- Adjusted spacing in test HTML to match Saxon 12.2 serialization
This closes #7414
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-21 11:01:45 -05:00
5db06437a3
NIFI-11638 Refactored Groovy tests in nifi-cdc/nifi-cdc-mysql-bundle/nifi-cdc-mysql-processors to Java (and JUnit 5)
...
NIFI-11638 Removed groovy-json dependency
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7408
2023-06-21 10:25:17 -04:00
84fdb5e32f
NIFI-7016: Fix Groovy File functions available for FlowFile in ExecuteGroovyScript
...
This closes #7016
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 06:23:59 -04:00
26d02fff49
NIFI-11729 Upgraded OWASP Dependency Check from 8.2.1 to 8.3.1
...
- Updated OWASP suppressions to exclude several JSON and Kafka false positives
- Excluded JUnit dependency from Hive 3 JDBC
This closes #7411
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 06:14:22 -04:00
05322fa8ce
NIFI-11730 Upgraded UnboundID LDAP SDK from 6.0.8 to 6.0.9
...
This closes #7412
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-20 17:12:05 -05:00
305277b833
NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
...
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7415
2023-06-20 16:22:00 -04:00
7b6a51aa9f
NIFI-11728 Removed RethinkDB Processors
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7410
2023-06-20 16:15:13 -04:00
3ac1876ecb
NIFI-11731 Update json-schema-validator to 1.0.84
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7413
2023-06-20 12:52:50 -04:00
4082951506
NIFI-11708: Upgraded snowflake-ingest-sdk to 2.0.1 and snowflake-jdbc to 3.13.33
...
This closes #7393
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-20 18:12:34 +02:00
a5ae155839
NIFI-11725 Upgraded Woodstox from 6.5.0 to 6.5.1
...
This closes #7407
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:05:01 -05:00
b8c5bb661e
NIFI-11724 Upgraded parquet-avro from 1.13.0 to 1.13.1
...
This closes #7406
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:04:15 -05:00
69ef6c6971
NIFI-11723 Upgraded Jedis from 3.9.0 to 3.10.0
...
This closes #7405
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:03:32 -05:00
d252ed5e1b
NIFI-11722 Upgraded Spring Data Redis from 2.7.10 to 2.7.13
...
This closes #7404
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:02:07 -05:00
8be9b01677
NIFI-11720 Upgraded HBase from 2.5.3 to 2.5.5
...
This closes #7402
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:01:15 -05:00
0ed1efc50a
NIFI-11712 Removed java.net.preferIPv4Stack from bootstrap.conf
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7392 .
2023-06-19 10:22:31 +02:00
b6b621bf9e
NIFI-11717 Updated Required Java Version to 17.0.6
...
- Added Groovy Plugin Repository for groovy-eclipse-compiler
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7397 .
2023-06-19 10:19:55 +02:00
8a696c1dfa
NIFI-11715 Removed unused user-defined property support from PutDatabaseRecord and DistributedMapCacheLookupService
...
This closes #7395
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 16:23:43 -05:00
e4d1dab8f7
NIFI-11167 Added ExcelReader to nifi-poi-nar
...
- Moved shared schema inference components to nifi-record-serialization-services-shared
This closes #7194
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:50:08 -05:00
bc6ac4b700
NIFI-11682 Correct Quoting for UPSERT and INSERT_IGNORE keys in PutDatabaseRecord
...
This closes #7385
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:05:03 -05:00
ce019071a4
NIFI-11713 Removed Deprecated ECMAScript Support
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7394
2023-06-16 14:23:51 -04:00
b36570f2cd
NIFI-11699 Fixed dynamic properties in SnowflakeComputingConnectionPool
...
Also fixed driver class name handling (caused IT test failure).
Other test fixes to make IT tests work.
This closes #7387
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:40:57 -05:00
7c7b7c026b
NIFI-11710 Corrected nifi-kafka-2-6-nar Description
...
This closes #7390
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:39:46 -05:00
6b19ab8eaa
NIFI-11696 Upgraded Bouncy Castle from 1.71 to 1.74
...
- Adjusted nifi-repository-encryption to remove dependency on Bouncy Castle Provider
- Updated Google Cloud Provider dependencies to remove exclusions and dependencies on Bouncy Castle that no longer apply to current versions
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7384
2023-06-15 16:33:20 -04:00
4638d2e251
NIFI-11635 Upgraded IoTDB from 1.0.1 to 1.1.1
...
- Excluded transitive test dependencies to avoid SNAPSHOT versions
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7382 .
2023-06-15 13:39:11 +02:00
760949922c
NIFI-11691 Support VARBINARY and LONGVARBINARY in PutDatabaseRecord
...
This closes #7380
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 21:01:02 -05:00
991e5e24de
NIFI-4957 Add Resource File Support for Jolt Specifications
...
This closes #4044
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 16:01:02 -05:00
17efd87bae
NIFI-11687 Upgraded Hazelcast from 5.3.0 to 5.3.1
...
This closes #7375
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:45 -05:00
8cd1b4b76c
NIFI-11685 Upgraded zstd-jni from 1.5.5-3 to 1.5.5-4
...
This closes #7376
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:07 -05:00
4b6209ed20
NIFI-11684 Upgraded Brotli4j from 1.11.0 to 1.12.0
...
This closes #7377
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:27:26 -05:00
8382b0a7a3
NIFI-11540 Removed legacy segment attributes from MergeContent
...
This closes #7305
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 18:37:48 -05:00
ca6c7f7041
NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
...
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests
NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7233
2023-06-13 15:36:23 -04:00
31e1c17d44
NIFI-11642 Updated PutSNS using AWS SDK 2
...
This closes #7362
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 13:50:22 -05:00
336b857442
NIFI-11553 Add Record handling and more Properties for GCP PubSub
...
- Added Message Derivation Strategy to PublishGCPubSub with FlowFile and Record options
- Added API Endpoint property to PublishGCPPubSub and ConsumeGCPubSub
- Added Batch configuration properties
This closes #7274
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 11:00:51 -05:00
9c2f15cc18
NIFI-11680 Corrected Buffer Size Calculation for Connection Balancing ( #7370 )
...
- Resolved BufferOverflowException in PeerChannel with Bouncy Castle Provider
- Changed prepareForWrite() to use Destination Buffer remaining instead of Application Buffer Size
- Changed encrypt() to Packet Buffer Size instead of Application Buffer Size
2023-06-13 11:01:27 -04:00
787e0d8261
NIFI-11681: Terminate Process Sessions before interrupting processor threads
...
This closes #7371
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 08:24:03 -05:00
45e8226f89
NIFI-11672 Adjusted ListSFTP to handle incomplete File Types
...
- Modified file handling to include both REGULAR and UNKNOWN File Types returned from an SFTP server
This closes #7365
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 11:25:22 -05:00
702c635034
NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile
...
Rather than creating many FlowFiles with the same Content Claim, refactored content repos' OutputStreams and ClaimWriteCache so that a new ContentClaim is created for each FlowFile. This ensures that we have a content claim offset of 0. The poor performance was due to having to use StreamUtils.skip() in conjunction with the CipherInputStream, which would only skip a max of 511 bytes at a time. By using a separate Content Claim per FlowFile, we no longer need to seek after creating the CipherInputStream
This closes #7363
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 09:47:44 -05:00
7485687d4b
NIFI-11657 Removed Deprecated PutBigQueryBatch and PutBigQueryStreaming
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7351 .
2023-06-11 15:49:42 +02:00
9374039312
NIFI-11674 Upgraded Apache Iceberg from 1.2.1 to 1.3.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7364 .
2023-06-11 15:43:58 +02:00
054df20aed
NIFI-11665 Upgraded oauth2-oidc-sdk from 9.43.1 to 9.43.3
...
This closes #7358
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
5e6f3abdd2
NIFI-11655 Fixed float and double handling in GenerateRecord
...
This closes #7356
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
4509f5de80
NIFI-11666 Added Exception to Error Log for ModifyCompression
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7360
2023-06-08 11:19:05 -04:00
f3e8651522
NIFI-11647: Support UUID type in DataTypeUtils.getSQLTypeValue
...
This closes #7355
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-08 11:13:07 -04:00
10a2815527
NIFI-11659 Removed unnecessary Jackson 1 dependencies
...
This closes #7354
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-07 15:04:43 -05:00
9195b586e5
NIFI-11656 Removed deprecated Azure Queue Storage Processors
...
- Removed AzureStorageCredentialsControllerService and related implementations
- Removed com.micrsoft.azure:azure-storage dependencies
This closes #7350
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-07 16:19:38 +02:00
dd2486d3e0
NIFI-11587: Update questdb to 6.7
...
This closes #7319
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-06-07 09:39:44 +02:00
e72ca689c2
NIFI-11643 Upgraded geoip2 from 2.16.1 to 4.0.1
...
This closes #7341
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 15:31:39 -05:00
4faf3ea598
NIFI-11653 This closes #7349 . Added Connection URL Validation for Database Services
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-06 09:29:48 -07:00
d956ede743
NIFI-11649 Upgraded icu4j from 72.1 to 73.1
...
This closes #7346
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:42:17 -05:00
e6c2c7c7ee
NIFI-11652 Upgraded Jolt from 0.1.7 to 0.1.8
...
This closes #7348
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:30:36 -05:00
c5c711c91d
NIFI-11645 This closes #7342 . Upgraded Guava from 31.1 to 32.0.0
...
- Added selective overrides to upgrade transitive dependencies
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
b11373af7b
NIFI-11549 Added AzureQueueStorage_v12 Processors
...
- Deprecated GetAzureQueueStorage and PutAzureQueueStorage
This closes #7269
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 16:26:02 -05:00
7a7f6f6229
NIFI-11593: Fix hiding logic for properties ( #7339 )
...
* NIFI-11593: fix hiding logic for properties with references or without dependent values
* NIFI-11593: remove arrow functions
Merged #7339 into main.
2023-06-05 13:36:49 -07:00
88d7b3905b
NIFI-11644 Upgraded Hazelcast from 4.2.7 to 5.3.0
...
This closes #7282
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 14:49:22 -05:00
d200186096
NIFI-11567: Auto-reload database file in GeoEnrichIP processors ( #7266 )
...
NIFI-11567: Auto-reload database file in GeoEnrichIP processors
2023-06-05 13:54:17 -04:00
ce50ffbe0e
NIFI-11464 Improvements for importing nested versioned flows ( #7218 )
...
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:11:33 -04:00
963518d943
NIFI-11586 Added AzureStorageCredentialsControllerServiceLookup_v12
...
Also added client caching in blob v_12 processors which was needed to support multiple credentials provided by the new lookup service
This closes #7300
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-05 13:07:02 +02:00
803868935a
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
...
This closes #7362
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 14:59:07 -05:00
df9f8ddcfb
NIFI-11636: Do not buffer Parquet content into memory unnecessarily
...
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7334
2023-06-02 15:35:10 -04:00
ec525b0437
NIFI-11629 This closes #7327 . Added Socket Write Timeout to InvokeHTTP
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-02 08:04:25 -07:00
3ef4439879
NIFI-8287 Upgraded SQS Processors to use AWS SDK 2
...
This closes #7211
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 21:53:33 -05:00
7a10ba6165
[NIFI-11560] call forEach on Map ( #7297 )
...
* [NIFI-11560] call forEach on Map
* getComponentRestrictions returns Map, use forEach
This closes #7297
2023-06-01 16:13:08 -04:00
3ebe8f2983
NIFI-11538: This closes #7239 . Fix primitive type conversion for PutIceberg
2023-06-01 12:29:38 -07:00
50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
...
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability
This closes #7299
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
b042eb01e8
NIFI-11614 Improved Validation for JndiJmsConnectionFactoryProvider
...
This closes #7313 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-01 19:53:18 +02:00
d4f301f473
NIFI-11620 Upgraded Google libraries-bom from 26.12.0 to 26.15.0
...
This closes #7321
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:44 -05:00
06b49cbc32
NIFI-11619 Upgraded Azure BOM from 1.2.11 to 1.2.13
...
This closes #7320
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:04 -05:00
4b7e20740e
NIFI-11591: Added additional logging for DynamicallyModifyClasspath system test
...
This closes #7312
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:23:07 -05:00
ac810671c5
NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7322
2023-05-31 17:07:39 -04:00
645618a609
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery
...
This closes #7316
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 14:32:01 -05:00
007bf3bcec
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
...
This closes #7295
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 11:02:48 -05:00
b6802ffed8
NIFI-11598 Upgrade gremlin.version from 3.6.2 to 3.6.4
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7311 .
2023-05-31 15:06:39 +02:00
02374798d2
NIFI-11615: Logging fixes in AMQP bundle
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7314 .
2023-05-31 13:03:41 +02:00
eca4f5d68f
NIFI-11392 for CRON scheduled components, improved cancellation of … ( #7232 )
...
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:06 -04:00
3bd4b49abe
NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent
2023-05-30 16:25:28 +02:00
bfa4b178ee
NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10
...
This closes #7307
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 14:07:44 -04:00
cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
...
This closes #7294 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
de62c6261f
Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
...
This reverts commit 4e304ac586
2023-05-26 11:07:45 +02:00
4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
...
This closes #7294 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
...
This closes #7231
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
...
- Added thread naming based on Component Type and Component Identifier
This closes #7281
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
...
This closes #7293
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
...
This closes #7292
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
...
This closes #7287
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
...
This closes #7290
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change ( #7273 )
...
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
ca2a829d47
NIFI-11584 Improved MergeContent stream handling
...
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it
This closes #7286
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7268 .
2023-05-24 11:40:48 +02:00
df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4901 .
2023-05-24 10:43:30 +02:00
3833b51764
NIFI-11583 Removed GetIgniteCache and PutIgniteCache Processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7285 .
2023-05-24 09:49:34 +02:00
a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
...
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #7265
2023-05-23 14:29:29 -04:00
ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
...
- Incremental adjustment avoids breaking test on slower environments
This closes #7260
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:14:39 -05:00
c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7264 .
2023-05-21 07:17:52 -04:00
a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4
...
This closes #7277
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:58 -05:00
0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
...
This closes #7275
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
...
- Upgrade applies to nifi-azure-graph-authorizer
This closes #7262
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor.
...
NIFI-11221 Style check fixes
NIFI-11221 Removed dead code.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #7213
2023-05-19 10:53:28 -04:00
28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer ( #7261 )
2023-05-19 08:24:13 -04:00
6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #7263
2023-05-18 15:54:08 -04:00
1a38bf003e
NIFI-11547 Fixed DBCPConnectionPool verification
...
- Added unit test for AbstractDBCPConnectionPool
This closes #7249
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 10:51:29 -05:00
607b53504b
NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3
...
This closes #7252
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-16 15:48:57 -05:00
bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations ( #7222 )
...
* NIFI-11513 Removed deprecated NarProvider and implementations
- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
335365874a
NIFI-11535: Transfer ConnectWebsocket connection configuration FlowFile to relationships
...
Also moved dto and util packages under org.apache.nifi.websocket.jetty
This closes #7246 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 15:26:35 +02:00
78fd7fadcd
NIFI-11380: Refactor CaptureChangeMySQL with improvements
...
This closes #7116
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-16 12:12:18 +02:00
8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0
...
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7251 .
2023-05-16 10:34:23 +02:00
3051b69a6c
NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
...
This closes #7241 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:43:47 +02:00
bec6ceda1f
NIFI-11548 Upgraded Apache Tika from 2.7.0 to 2.8.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7247 .
2023-05-15 20:41:22 +02:00
658f2547d8
NIFI-11430 - PaginatedJsonQueryElasticsearch processors should not output empty FlowFile if hits have been found; PaginatedJsonQueryElasticsearch processors should be able to use _source and _meta only result formats when grouping by query
...
This closes #7163
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-05-13 19:35:20 +01:00
f7e36a07ac
NIFI-11228 Removed deprecated Azure Blob Storage Processors
...
This closes #7234
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-12 17:33:28 +02:00
fd2138b8cf
NIFI-10756 Generate error message when processor and/or controller
...
service is unable to transition to start and/or enabled state
Signed-off-by: Mike Moser <mosermw@apache.org>
2023-05-12 14:40:47 +00:00
09cef4ff99
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) ( #7117 )
...
* NIFI-11287: detect dependent properties when the property it depends on references a parameter
* address review feedback
* address more review comments
* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class
* add type parameter to all places calling loadProperties
* get reference parameters by invoking provided callbacks from the client
* check for user permissions before requesting for referenced parameters
* address review feedback
This closes #7117
2023-05-11 17:00:57 -04:00
2049d5068b
NIFI-11524 Improved ExecuteStreamCommand documentation and configuration
...
This closes #7228
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-11 14:52:21 -05:00
e302f2aff7
NIFI-10976 Added Previous Cluster State Provider configuration ( #7235 )
...
- Added methods to enumerate Stored Component Identifiers on State Provider interface and implementations
- Added nifi.state.management.provider.cluster.previous to nifi.properties
- Updated State Manager Provider to restore Cluster State from Previous Cluster Provider
- Updated Configuring State Providers documentation for new property
2023-05-10 16:22:05 -04:00
5811a9c579
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics
...
This closes #7124
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-08 08:11:20 -05:00
340b5fcb00
NIFI-11526 Refactored DatabaseRecordSinkTest to Java from Groovy
...
This closes #7229
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-05 08:53:00 -05:00
265b132e73
NIFI-11493: Defaulted dynamically modified classpath fix
...
This closes #7201 .
Co-authored-by: Peter Turcsanyi <turcsanyi@apache.org>
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-04 15:20:56 +02:00
4e9675475c
NIFI-11523 Refining schema handling for ScriptedTransfromRecord
...
This closes #7226
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:34:28 -04:00
Chris Sampson
Tamas Palfy
exceptionfactory
Paul Grey
dependabot[bot]
Mark Bean
Bence Simon
Mark Payne
Freedom9339
Emilio Setiadarma
mr1716
Ferenc Kis
Peter Turcsanyi
Matt Burgess
Mike Thomsen
krisztina-zsihovszki
Pierre Villard
Yolanda M. Davis
Lehel Boer
Timea Barna
Lehel
EndzeitBegins
Joe Witt
dan-s1
Mark Bathori
simonbence
timeabarna
Bryan Bende
Tanmaya Panda
Jeyassri Balchandran
Nandor Soma Abonyi
siddr
Shane Ardell
Joe Gresock
Scott Aslan
Steven Matison
Michael Moser
NissimShiman
Ryan Van Den Bos
Nissim Shiman
M Tien