Commit Graph

5923 Commits

Author SHA1 Message Date
Matthew Burgess a2b98e0c9c NIFI-11094: Allow CaptureChangeMySQL to send multiple events per FlowFile
This closes #6907.

Co-authored-by: Tamas Palfy <tpalfy@apache.org>

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-22 19:27:42 +01:00
Lehel 7e97c1ce19
NIFI-11045: Sensitive dynamic property support for parameterized queries in ExecuteSQL and ExecuteSQLRecord
This closes #6853.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-22 12:37:07 +01:00
exceptionfactory 85f2162021 NIFI-11201 Added include-iotdb Maven build profile
This closes #6975

- Corrected Fetch Size property evaluation in QueryIoTDBRecord for FlowFile attributes

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:53:23 -05:00
exceptionfactory a0ef378a42 NIFI-11207 Removed HBase 1.1.2 Services
This closes #6979

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:51:02 -05:00
exceptionfactory 57a1144f34
NIFI-11187 Removed ActiveMQ from Standard Processors
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6961
2023-02-21 16:54:37 -05:00
exceptionfactory 0fa1060297
NIFI-11208 Removed Hortonworks Schema Registry
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6980
2023-02-21 16:48:45 -05:00
exceptionfactory 0255c0c4ed NIFI-11185 Removed GetTwitter Processor
This closes #6958

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 09:21:12 -05:00
Pierre Villard 21394038cd NIFI-11198 - Upgrade snowflake-ingest-sdk to 1.0.3
This closes #6972

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 09:15:29 -05:00
Pierre Villard 3115b9f28d
NIFI-10803 - Upgrade Dropbox SDK to 5.4.4
This closes #6971.

Reviewed-by: krisztina-zsihovszki <zsikrisz@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-21 11:09:29 +01:00
Lehel 1b951818e1
NIFI-11190: Added provenance events to GetHubSpot and GetShopify
This closes #6965.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-20 22:13:29 +01:00
lizhizhou 7cb86dd42d
NIFI-10784 Added QueryIoTDBRecord Processor
This closes #6844

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-18 19:58:39 -06:00
dan-s1 22a4bce1ed
NIFI-11156 Updated SchemaValidator to include error message for ValidateXml
- Restores behavior so that XML parsing failure details will be included in FlowFile error attribute from ValidateXml

This closes #6970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-18 10:28:50 -06:00
exceptionfactory 5507bfa4b2
NIFI-11191 Refactored HikariCPConnectionPoolTest with Mock Driver (#6966)
- Removed Derby dependencies from HikariCP module no longer required for testing

Signed-off-by: Kevin Doran <kdoran@apache.org>
2023-02-16 17:34:57 -05:00
exceptionfactory 284804ac42
NIFI-11188 Removed ProcessContext encrypt and decrypt methods
- Removed unnecessary references to PropertyEncryptor from multiple framework components

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6962.
2023-02-16 12:16:15 -05:00
Nandor Soma Abonyi 0d4f1523fe NIFI-11144 Fix failing tests for ConsumeJMS/PublishJMS
This closes #6930.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-16 15:50:07 +01:00
Mark Payne fed175d46f NIFI-11189: When synchronizing a ProcessGroup to match a VersionedProcessGroup, do not remove the temporary funnel until the very end. This is important if the temporary funnel already exists in the flow on startup
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6963
2023-02-16 14:18:50 +01:00
exceptionfactory 4f11550e97
NIFI-11174 Removed deprecated Standard Processors
- Base64EncodeContent
- GetHTTP
- GetJMSQueue
- GetJMSTopic
- HashAttribute
- HashContent
- PostHTTP
- PutJMS

Removed deprecated Proxy properties from InvokeHTTP

- Proxy Host
- Proxy Port
- Proxy Type
- Proxy Username
- Proxy Password

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6953.
2023-02-15 13:14:56 -05:00
Matthew Burgess 9c5ae0d098
NIFI-11149 Added PutRedisHashRecord Processor
This closes #6943

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-15 11:28:24 -06:00
Pierre Villard b56b1da842
NIFI-11180 Removed Ambari Reporting Task
- Updated TestRuntimeManifest to reference Prometheus Reporting Task

This closes #6952

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-15 08:25:22 -06:00
Pierre Villard aae6bafc6c
NIFI-11183 Removed Hive 1.x components
This closes #6957

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 22:39:16 -06:00
Pierre Villard 46f89e3226
NIFI-11182 Removed Kafka 1.x components
This closes #6955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 18:38:42 -06:00
Pierre Villard 35cf9f87be
NIFI-11179 Removed Flume components
This closes #6950

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 16:25:44 -06:00
mkalavala 0d0ba1ca41
NIFI-9131 Refactor nifi-ldap-iaa-providers-bundle to use JUnit 5
This closes #6946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 16:03:31 -06:00
Nandor Soma Abonyi dd2fc4bb9d
NIFI-11173 Add default values to DeleteAzureBlobStorage_v12
This closes #6945.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-14 11:42:37 +01:00
Nissim Shiman dbef536ebd
NIFI-10950 DistributeLoad processor - this closes #6924. removed Load Distribution
Service

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 19:18:57 -05:00
Mark Payne 471cccbbda
NIFI-11176: This closes #6948. When comparing a VersionedConnection with an existing connection, we examined the source component's VersionedComponentId. But the existing component may not have a VersionedComponentId. We should only be comparing these if they are populated
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 18:52:15 -05:00
Chris Sampson 6542505a50
NIFI-10797 add customisable Elasticsearch REST Client config and Elasticsearch Cluster Sniffer
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6658.
2023-02-13 13:22:18 -05:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Chris Sampson 7393ce294e
NIFI-11168 Removed deprecated Elasticsearch Processors and properties
This closes #6942

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-13 10:41:53 -06:00
Pierre Villard 18ef2a57a5
NIFI-11164 Updated minimum Java version from 8 to 11.0.16
- Updated GitHub workflows from Java 8 to 11
- Updated Maven Compiler Source and Target version from 1.8 to 11
- Disabled JASN1 tests failing on Windows with Java 11

This closes #6940

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-10 23:31:37 -06:00
Bence Simon b0ec28a452 NIFI-11159 Fixing connections with source having reassigned id 2023-02-10 11:12:51 -05:00
exceptionfactory a66727c4d1
NIFI-11160 Upgraded Apache Tika from 2.6.0 to 2.7.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6938.
2023-02-10 11:38:25 +01:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
Joe Witt 3b9a518387
Merge branch 'NIFI-11103-RC1' 2023-02-09 15:13:42 -07:00
Robert Kalmar 9906f0a952
NIFI-11150 Add Service Account JSON credentials support to Google Pub/Sub Lite procesors
This closes #6933.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-09 12:53:27 +01:00
exceptionfactory 2e55498771
NIFI-11154 Removed Default Schedule from ConsumeMQTT
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6936.
2023-02-09 11:15:11 +01:00
exceptionfactory 8abfced7e1
NIFI-11152 Upgraded Splunk SDK from 1.9.1 to 1.9.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6934.
2023-02-09 11:13:25 +01:00
dan-s1 99b0cd42ef
NIFI-11130 Further updates from JUnit 4 to 5
This closes #6927

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-08 13:58:28 -06:00
krisztina-zsihovszki 3e2e081d4b
NIFI-11146 Proxy usage in BoxFile processors
This closes #6932.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-08 15:58:17 +01:00
Mark Bathori b375f4b138
NIFI-11124: Add hadoop.file.url attribute to HDFS processors
This closes #6916.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-07 23:10:16 +01:00
Joe Witt 896fdacbbd
NIFI-11103-RC1 prepare for next development iteration 2023-02-06 11:41:41 -07:00
Joe Witt 81296b5b69
NIFI-11103-RC1 prepare release nifi-1.20.0-RC1 2023-02-06 11:41:39 -07:00
Joe Witt 4f91420cc1
NIFI-11139 Updated multiple Maven Plugins
This closes #6925

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 16:07:02 -06:00
exceptionfactory cd76dc0366
NIFI-11140 This closes #6922. Upgraded Tomcat from 8.5.82 to 8.5.85 for Flume
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:03:16 -07:00
Mark Payne 28b9f6fc02
NIFI-11118: This closes #6909. When changing version of a versioned flow, ensure that we properly set the Version Control Information's StorageLocation for the NiFi Registry client in order to maintain backward compatibility
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:02:38 -07:00
exceptionfactory b3319c7119
NIFI-11141 This closes #6923. Upgraded Azure SDK BOM from 1.2.6 to 1.2.9
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-03 14:01:32 -07:00
Emilio Setiadarma 0b61a6226c
NIFI-11092 Fixed ConsumeTwitter handling on Primary Node changes
This closes #6901

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-03 13:12:58 -06:00
Peter Turcsanyi 0c171bbb08 NIFI-10846: Added SMB Dialect and Use Encryption properties in SMB processors
This closes #6917.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-03 14:04:56 +01:00
Tamas Palfy 56d8879e91
NIFI-11107 In ConsumeIMAP and ConsumePOP3 added support for OAUTH based authorization.
This closes #6900.

Reviewed-by: Nandor Soma Abonyi <abonyisoma@gmail.com>

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-03 13:57:43 +01:00
exceptionfactory 6877e84931
NIFI-11135 Upgraded Commons CSV from 1.9.0 to 1.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6921.
2023-02-03 12:26:47 +01:00
Joe Gresock 2609fd5f55
NIFI-11122 Corrected provided parameter context inheritance after creation
This closes #6913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-02 13:20:35 -06:00
Kalman Jantner 027e2b9bc1 NIFI-11123: fix default value and update docs
This closes #6899.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-02-02 18:48:47 +01:00
Mark Bathori 869e2b3d66
NIFI-11110: Create processor for triggering HMS events
Review comment fixes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6902
2023-02-02 11:31:44 -05:00
krisztina-zsihovszki 653631cc67
NIFI-11059 PutBoxFile processor
This closes #6892.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-02-02 15:33:37 +01:00
dan-s1 e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
exceptionfactory 8bc7593d34
NIFI-11126 Delete MultiPart files in ListenHTTP after processing
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6915
2023-02-02 12:23:44 +00:00
dan-s1 d46aa89788
NIFI-8005 Added warning message for Excel sheets not found
This closes #6897

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-01 16:26:06 -06:00
Joe Gresock afdf49b3cd
NIFI-11100: Limiting scope of external controller services during version sync to services outside the versioning context (#6898) 2023-02-01 12:14:38 -05:00
Mark Bathori 3f04fae5a5
NIFI-11112 Corrected location of additionalDetails for GetZendesk
This closes #6904

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-31 16:25:11 -06:00
krisztina-zsihovszki 92ccb79670
NIFI-11117 Remove folder creation from PutGoogleDrive
This closes #6910.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-31 19:58:44 +01:00
exceptionfactory 5daf01e760
NIFI-11120 This closes #6912. Upgraded Zip4j from 2.11.2 to 2.11.3
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 11:49:12 -07:00
exceptionfactory bdede27447
NIFI-11119 This closes #6911. Excluded snakeyaml:android from javafaker
- Added direct dependency on standard snakeyaml version to nifi-standard-processors

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 10:05:23 -07:00
exceptionfactory a7206f187b
NIFI-9989 This closes #6908. Upgraded SSHJ from 0.34.0 to 0.35.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-31 09:18:54 -07:00
simonbence ae66ebdc22
NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes (#6870)
* NIFI-10973 Introduce differention of comparing embedded versioned flows for UI and synchronisation purposes
2023-01-31 10:58:42 -05:00
Ferenc Erdei e4748e15f4
NIFI-11087 Added VerifyContentMAC Processor
This closes #6877

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-27 12:11:14 -06:00
Kalman Jantner cc8d108975
NIFI-10710 Added Processors for AWS Polly, Textract, Translate, Transcribe
This closes #6589

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-27 11:46:28 -06:00
exceptionfactory 0c676b9633
NIFI-11022 Added DecryptContent Compatibility Processors
- Added nifi-cipher-bundle with nifi-cipher-nar for new Processors
- Added DecryptContentCompatibilityMode Processor supporting PKCS5 and PKCS12 Password-Based Encryption Schemes
- Added DecryptContentEncoded Processor supporting NiFi Key Derivation Functions and associated formatting
- Added nifi-security-crypt-key module with Key Derivation Functions and Parameter Readers
- Added Additional Details documentation for Processors

This closes #6821
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-26 17:56:02 -05:00
Mark Payne d9f35b8974
NIFI-11105: This closes #6895. When mapping Parameter Context to VersionedParameterContext, don't bother mapping those that have already been mapped, as it is redundant
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-26 15:35:18 -07:00
Malthe Borch 41649660be
NIFI-10721 Avoid querying properties after Azure Blob upload
This closes #6730

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-26 15:45:52 -06:00
krisztina-zsihovszki 96a6594680
NIFI-11068 Introduced ConflictResolutionStrategy enum
This closes #6861

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-26 15:34:43 -06:00
exceptionfactory d913f8046a
NIFI-10581 Upgraded Apache Tika from 2.4.1 to 2.6.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6894.
2023-01-26 19:52:17 +01:00
exceptionfactory d60f541d7e
NIFI-11098 Deprecated ProcessContext encrypt and decrypt methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6891.
2023-01-26 18:18:09 +01:00
exceptionfactory 97cb3c4eaa
NIFI-11101 Deprecated ConsumeEWS Processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6893.
2023-01-26 18:00:16 +01:00
Mark Bathori c3dd2569db NIFI-10974: Incorrect warning message on memory usage from MonitorMemory 2023-01-26 13:25:07 +01:00
Priyanka Awatramani b3f2d95092
NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes
- Updated TestAttributesToCSV with LinkedHashMap for deterministic test behavior
- Updated TestHttpFlowFileServerProtocol with adjusted checksums to match expectations from LinkedHashMap changes

This closes #6748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 16:19:20 -06:00
exceptionfactory 5101db2ab7
NIFI-11096 This closes #6889. Added EncodeContent to Processor services definition
- Deprecated Base64EncodeContent in favor of EncodeContent
- Updated EncodeContent to use Commons Codec for Hexadecimal encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 15:01:38 -07:00
Joe Gresock 7d99521d4c
NIFI-11089: Resolving previously resolved parameter providers when possible on version sync (#6886) 2023-01-25 13:42:52 -05:00
Paul Grey 567e95aa28
NIFI-11047 - Issue when upgrading version of dataflow with external service
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6849
2023-01-25 12:52:52 -05:00
exceptionfactory 4fe2c318e6
NIFI-11091 This closes #6884. Upgraded Google libraries-bom from 25.4.0 to 26.4.0
- Upgraded Google Drive library to v3-rev20221219-2.0.0
- Corrected test encryption keys to match expected encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 10:00:00 -07:00
Pierre Villard 1148738c19
NIFI-11095 This closes #6888. Deprecate Hortonworks Schema Registry
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:59:00 -07:00
Mark Payne 228a3441b5
NIFI-11001: This closes #6836. When new components are added, track a mapping of its Versioned Compoenent ID to the component itself. Then, use this when creating connections. This is important because if a Process Group has multiple components with the same Versioned Component ID across multiple child groups, the Versioned Component ID may be changed upon adding the component. Maintaining this mapping allows us to still create the connection correctly.
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:55:16 -07:00
Nissim Shiman b7f7b411ef
NIFI-10853 Allow UpdateAttribute dynamic property to validate nifi
expressions

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6770
2023-01-25 11:43:12 -05:00
Peter Gyori 4d3fcb6843
NIFI-11000 Add compression example to CreateHadoopSequenceFile documentation
This closes #6801

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 10:33:29 -06:00
exceptionfactory f32a60af33
NIFI-11064 Removed unstable TestPutSFTP.testRunTransitUriDifferentHosts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6885.
2023-01-25 11:07:13 +01:00
exceptionfactory 84f48b5e8c
NIFI-11090 This closes #6883. Removed unused Jasypt test dependency
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-24 08:42:33 -07:00
krisztina-zsihovszki 4700fed249
NIFI-10965 PutGoogleDrive
This closes #6832.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 22:20:33 +01:00
Bence Simon 0ab1fbccc8
NIFI-10934 Added uniqueness check for Registry Client creation
This closes #6750

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Chris Sampson <12159006+ChrisSamo632@users.noreply.github.com>
2023-01-23 14:57:17 -06:00
Joe Gresock bf871e0b8d
NIFI-11032: Addressing NPE when retrieving registry client info with unauthorized user (#6879) 2023-01-23 15:51:25 -05:00
Paul Grey b426226207
NIFI-10993 - PublishKafkaRecord should use correct record schema
This closes #6833.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 21:40:29 +01:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Joe Gresock 8640989ad7
NIFI-11039: Fixing bug when importing parameter providers from nifi-registry (#6868)
* NIFI-11039: Fixing NPE in registry retrieval
* NIFI-11039: Fixing bug when importing parameter providers from nifi registry
2023-01-23 11:59:34 -05:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Joe Gresock 29618ae5c6
NIFI-11076: Resolving deadlock issue in StandardParameterContext (#6865)
* NIFI-11076: Resolving deadlock issue in StandardParameterContext

* NIFI-11076: Resolving deadlock issue in StandardParameterContext
2023-01-23 10:54:38 -05:00
Nandor Soma Abonyi eb5d172693
NIFI-10991 Add AWS MSK IAM support to Kafka processors
This closes #6846.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 12:33:49 +01:00
mr1716 bc02470b00
NIFI-11085 Update graphics2d to 0.42
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6876.
2023-01-23 11:54:58 +01:00
mr1716 78a2c4e14a
NIFI-11072 Updated xz from 1.8 to 1.9
This closes #6871

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-20 16:18:03 -06:00
mr1716 bdcefe4a98
NIFI-11081 Updated gRPC from 1.50.2 to 1.52.1
This closes #6875

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-20 16:17:06 -06:00
Timea Barna a9274c12c5
NIFI-11079 Extend QueryNifiReportingTask and ProcessGroup Summary Table
Correcting EmbeddedQuestDbStatusHistoryRepositoryForComponentsTest

Correcting TestQueryNiFiReportingTask

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6869
2023-01-20 15:22:20 -05:00
exceptionfactory 7db6f17350
NIFI-11064 Changed TestPutSFTP run iterations based on files queued
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6863.
2023-01-19 21:20:43 +01:00
krisztina-zsihovszki 312c6190e9
NIFI-11069 PutDropbox: remove upload cancellation, unify conflict resolution naming
This closes #6855.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 17:33:04 +01:00
Kalman Jantner 67925b171a NIFI-10953: Implement GCP Vision AI processors
This closes #6762.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-01-19 16:20:58 +01:00
Tamas Palfy 464e0a96ee
NIFI-11050 In PutEmail added OAuth authorization option. StandardOauth2AccessTokenProvider can be used with refresh_token grant type.
This closes #6845.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 16:05:28 +01:00
Matthew Burgess d7b14c0c45
NIFI-11033: Update QueryNiFiReportingTask additionalDetails page to include Flow Config History table
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6856.
2023-01-19 12:38:10 +01:00
mr1716 4518740da5
NIFI-11071 Update json-flattener to 0.16.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6860.
2023-01-19 10:56:01 +01:00
mr1716 b4f6aace53
NIFI-11070 Update json-schema-validator to 1.0.76
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6857.
2023-01-19 10:53:36 +01:00
mr1716 4b8ce44d59
NIFI-11042 Update msal4j to 1.13.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6859.
2023-01-19 10:52:17 +01:00
mr1716 4d78ebc487
NIFI-11024: Update iceberg.version to 1.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6851.
2023-01-18 14:22:15 +01:00
krisztina-zsihovszki 9ad1d8a7ae
NIFI-11028 Handle controller service 'Scheduled State' change (#6831) 2023-01-17 18:40:47 -05:00
Matthew Burgess 8986f4b33a
NIFI-6501 Refactor CaptureChangeMySQL with bounded queue of 1000
This closes #6791

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-17 16:18:55 -06:00
Matthew Burgess 6adbc1aeb0
NIFI-11036: Add Cluster Summary Metrics to Prometheus endpoint
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6834.
2023-01-17 14:44:33 +01:00
krisztina-zsihovszki b7071cbb04
NIFI-11049 Fixed flaky PutDropboxTest, attribute description corrected
This closes #6850.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-16 16:55:59 +01:00
Mike Thomsen d38f15997d
NIFI-10870 Added debug logging for the Elasticsearch REST Requests
This closes #6841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 16:11:21 -06:00
Matthew Burgess e0ec9780a5
NIFI-10449 Fixed ScriptedLookupServices reloading
- Reload script after disabled and first validation after changes made

This closes #6371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 15:09:52 -06:00
Chris Sampson 1d7ee542b1
NIFI-2161 add option to skip attribute output for unmatched JSON path expressions in EvaluateJsonPath
This closes #6817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 14:06:15 -06:00
Nissim Shiman 74e0a2002e
NIFI-11030 refactor nifi-stateless-processor-bundle to use JUnit5
This closes #6837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-11 18:43:40 -06:00
mr1716 fbb74b2c21
NIFI-11040 Update box-java-sdk to 3.8.2
This closes #6835.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-11 21:16:09 +01:00
Nissim Shiman 692e74e90d
NIFI-10241 Add comments tooltip for controller services, reporting tasks
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6768
2023-01-11 14:29:14 -05:00
Mark Payne d5c79fdcd1
NIFI-10887: Addressed performance concerned. Use String.indexOf() instead of Pattern.matcher() when using Literal Replace. Use a NonFlushableOutputStream when ProcessSession.write() is called. Implemented hashCode() on AbstractConnection. Updated default Run Schedule on ReplaceText from 0 ms to 25 ms. Added a Surround Replacement strategy that allows both prepending and appending text. Updated unit tests to account for this.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6724
2023-01-11 12:28:59 -05:00
Matthew Burgess a9baa21f87 NIFI-10996: Write out CSV header even if there are no records
This closes #6818

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-01-11 10:55:31 -05:00
lizhizhou 40ccb71f85
NIFI-10234 Added PutIoTDBRecord Processor
This closes #6416

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Xuan Ronaldo <xuanronaldo@qq.com>
Co-authored-by: Zhizhou Li <lizhizhou1983@gmail.com>
2023-01-10 20:38:33 -06:00
exceptionfactory 0c0f7e87be
NIFI-11004 Added documentation for OIDC groups claim property
This closes #6802
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-10 17:20:23 -05:00
Nissim Shiman fe25424233
NIFI-10772 Clarify logs on shutdown where controller service and/or
processor were unable to properly start

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6829
2023-01-10 13:56:00 -05:00
exceptionfactory 0d9dc6c540
NIFI-9167 Converted remaining nifi-framework tests to JUnit 5
NIFI-9167 Addressed feedback and improved tests using TempDir

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6823
2023-01-10 13:53:51 -05:00
exceptionfactory 6c517446a4
NIFI-10949 Updated MongoDB components using current driver (#6759)
- Replaced references to mongodb-driver-legacy with mongodb-driver-sync
- Updated components to use current synchronous driver classes
- Upgraded MongoDB driver from 4.7.2 to 4.8.0
2023-01-09 14:27:35 -05:00
Paul Grey e97977d61f
NIFI-10997 Ensure auditing of process group / controller service operations
This closes #6800

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 13:25:04 -06:00
nathluu ea93dec079
NIFI-10481 Support disabling ZooKeeper Ensemble Tracking
This closes #6400

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 10:42:01 -06:00
Matthew Burgess 4f77a17d19
NIFI-11031: Fix logic error in GenerateRecord for nullPercentage
This closes #6830

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-06 21:01:01 -06:00
exceptionfactory e966336e89
NIFI-11029 Added Standard XML parsing to ExtractCCDAAttributes
- Added DeprecationNotice to ExtractCCDAAttributes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6828
2023-01-06 16:10:42 -05:00
Nissim Shiman 9252dcbc76
NIFI-11019 Converted remaining nifi-scripting tests to JUnit 5
This closes #6824

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-06 11:33:18 -06:00
greyp9 b69721cac9
NIFI-10980 - correct ordering of property descriptor allowable values (#6781)
NIFI-10980 - correct ordering of property descriptor allowable values
2023-01-05 14:11:03 -05:00
exceptionfactory 53faecdcf6
NIFI-11027 Removed direct dependency on Joda Time
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6825.
2023-01-05 11:56:42 +01:00
Chris Sampson d9420afb60
NIFI-10844 Allow _source only output for GetElasticsearch and JsonQueryElasticsearch
This closes #6687

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-04 15:30:41 -06:00
Matthew Burgess c11092b2b4
NIFI-10998 Fixed SplitJson to always compile new JsonPath when property changes
This closes #6803

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-04 13:58:06 -06:00
dan-s1 06c8225bbd [NIFI-11006] Upgraded from Junit4 to Junit5
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6813
2023-01-04 16:07:20 +00:00
Nissim Shiman d229f3fd11
NIFI-10608 Process Group copies include non-processor referenced
controller services

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6685
2023-01-03 12:09:01 -05:00
dan-s1 481cdaf3db
NIFI-11018 Upgraded nifi-web-security to JUnit 5
This closes #6814

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-02 12:16:37 -06:00
dan-s1 b74c5b423f
NIFI-10979 Additional nifi-framework upgrades from JUnit 4 to 5
This closes #6806

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:18:38 -06:00
Esa Lindqvist 4716c8d715
NIFI-10456 Added Client Authentication Strategy option to OAuth2 Provider
StandardOauth2AccessTokenProvider has been updated with new property `Client Authentication Strategy` supporting Basic Authentication as recommended in RFC 6749. The changes maintain the current default implementation using Request Body parameters

This closes #6782

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:07:33 -06:00
dependabot[bot] 9915bded77
NIFI-11017 Upgraded Hazelcast from 4.2.5 to 4.2.6
This closes #6812

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:50:36 -06:00
Pierre Villard 09463b0ae5
NIFI-11012 Updated Twitter SDK from 1.1.4 to 2.0.3
This closes #6811

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:44:30 -06:00
Pierre Villard eb9f75e28f
NIFI-11009 Update Snowflake SDK to 1.0.2-beta.7
This closes #6808

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:29:58 -06:00
Pierre Villard bb886af69d NIFI-11010 - Update Kinesis client to 1.14.9
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6809
2022-12-29 11:29:48 +00:00
Mark Bathori 4b24bcd2f8
NIFI-10677: Add Choice data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6563.
2022-12-25 17:58:17 +01:00
Emilio Setiadarma bf24d575b3
NIFI-10971: improved edge case handling while fetching objects using Azure Key Vault Client and added unit tests
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6780.
2022-12-25 17:51:40 +01:00
exceptionfactory b556322749
NIFI-11005 Added Illegal and Redundant Import Modules to Checkstyle
- Updated impacted classes to remove redundant import lines
- Removed WebUtilsGroovyTest.groovy class due to use of internal sun.security classes

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6804.
2022-12-23 18:34:38 +01:00
Eric Bernard b65431564d
NIFI-10988 - Fix ConsumeGCPubSubLite processors delivering incorrect messages
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6788.
2022-12-23 18:26:13 +01:00
Matthew Burgess f38f14b363
NIFI-10585 Added GenerateRecord Processor
This closes #6480

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 19:30:05 -06:00
dan-s1 dde821cf71
NIFI-6498 Update TransformXml to send errors to Component Log
This closes #6798

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 11:15:37 -06:00
mr1716 c85a6e866f
NIFI-10921 Upgraded Apache POI from 5.2.2 to 5.2.3
This closes #6760

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-19 12:41:42 -06:00
Matthew Burgess 2a88980024 NIFI-4572: Include database and table names in CaptureChangeMySQL events even when cache is not configured
This closes #6786.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-19 17:30:33 +01:00
Nandor Soma Abonyi caee606706
NIFI-10884 log target filename
This closes #6792.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-18 22:49:52 +01:00
krisztina-zsihovszki 1d5a1bff08
NIFI-10868 PutDropbox processor
This closes #6740.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-16 18:51:31 +01:00
Bryan Bende 5c3ca9d537
NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs,… (#6785)
- NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs, and ensure the auto-loader attempts to process any NARs available before starting to watch for new files
- Add system test with NAR Provider that copies NARs from a local directory and verifies the NARs were loaded and linked correctly
- Exclude new assembly from CI test-compile
2022-12-16 11:30:37 -05:00
exceptionfactory a8974253ce
NIFI-10989 Removed SHA-1 and MD5 from TestHashContent
- Removed methods to avoid intermittent failures due to lack of Bouncy Castle Security Provider registration

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6790
2022-12-15 22:06:52 -05:00
Rajmund Takacs 1c40738997
NIFI-10618: Add Asana connector
This closes #6504.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-16 00:14:26 +01:00
Peter Turcsanyi ae5d23db47
NIFI-10987: Added default implementation of AWS SDK V2 credentials in AWSCredentialsProviderService
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6787.
2022-12-15 16:43:04 -05:00
Peter Turcsanyi 1e23e5146f NIFI-10969: Created extension point for Signer Override in AWS S3 processors
Also added Signer Override property in AWSCredentialsProviderControllerService with Custom Signer extension point.
Made Assume Role related properties dependent on Assume Role ARN property in AWSCredentialsProviderControllerService.
Fixed S3 IT tests.

This closes #6777.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-15 18:43:22 +01:00
Mark Payne 78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6725
2022-12-14 12:09:32 -05:00
Lehel Boér ed6ba53724 NIFI-10832: Create PutSalesforceRecord processor
This closes #6670.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
dan-s1 e21f622643
NIFI-10877 Converted more nifi-framework-core tests from JUnit 4 to 5
This closes #6775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-13 11:37:59 -06:00
exceptionfactory c11dff912a
NIFI-10958 Adjusted Script Engine handling to avoid exceptions
- Added empty check for list of discovered Script Engines to avoid exceptions for documentation generation on Java 17

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6774
2022-12-12 16:43:28 -05:00
Nathan Gough 2fa82179a8
NIFI-10576 Added onFinishRecordSet implementation for WriteParquetResult
This closes #6517

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-09 14:16:21 -06:00
hj28 ac8e3dae58
NIFI-10637 Deterministic TestGenerateTableFetch testMultipleColumnTypeMissing
This closes #6754

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-09 10:41:36 -06:00
exceptionfactory b0ab364f61
NIFI-10967 Corrected TestWriteJsonResult mixed arrays
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6773
2022-12-09 01:01:58 -05:00
Bryan Bende 334c9db9c3
NIFI-10915 Add additionalDetails content to runtime manifest
- Update manifests assembly to include the additionaDetails.html files
- Update C2 ExtensionDefinition to add a new field for additional details content
- Update manifest generation to read the additional details and pass through to C2 runtime manifest
- Switch to boolean to indicate presence of additional details, instead of including content

Add additionalDetails files to nifi-runtime-manifest artifact, organized by group/artifact/version/type

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6767
2022-12-08 11:02:56 -05:00
Matt Burgess b744fac479
NIFI-10956: Fix inference issues with mixed arrays (#6763) 2022-12-08 09:28:19 -05:00
exceptionfactory 45a31c7286 NIFI-10899 Added SameSite Policy to Application Cookies
- Added __Secure prefix to Application Cookie Names

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6735.
2022-12-05 14:09:39 -05:00
Paul Grey 3dc48f0894 NIFI-10916 - Controller Service allowable values dropdown list should be sorted
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6739.
2022-12-05 11:44:07 -05:00
exceptionfactory ab7ce58fb1
NIFI-10947 This closes #6758. Upgraded Apache Commons Net to 3.9.0
- Added Commons Net to managed dependencies in root Maven configuration
- Removed version references to 3.3 in MiNiFi and 3.6 in NiFi standard modules

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-05 09:01:29 -07:00
mr1716 de694ee45d
NIFI-10920 Upgraded Jettison from 1.5.1. to 1.5.2
This closes #6747

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-05 09:11:24 -06:00
exceptionfactory 87c583042e
NIFI-10941 Removed TestNG references
- Replaced TestNG assertions with JUnit 5
- Excluded testng transitive dependencies from groovy-all
- Added testng exclusion to Maven Enforcer configuration

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6753.
2022-12-05 13:11:59 +01:00
exceptionfactory 47fc3ae77d
NIFI-10898 This closes #6729. Removed unused test HTTP Servlets
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-04 21:08:14 -07:00
Mark Payne e1c8c96111 NIFI-10937, NIFI-10938, NIFI-10939: When restoring flow from XML, properly parse XML for registry clients, looking for 'id' tag instead of 'identifier' tag. Fixed typo in error message about Reporting Task for Registry Clients. Updated StandardFlowComparator so that we compare sub-process groups' contents only if the Flow Coordinates are different by more than their version
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6752.
2022-12-02 18:37:47 -05:00
Mark Payne 2473683ce5 NIFI-10918: When fetching a flow from a Flow Registry, if it references any 'internal versioned flows' instead of requiring that we have a client configured for the appropriate URL, attempt to fetch the flow from each client. We will start with the clients that do report that they can handle the URL but will try others as well. As soon as we successfully fetch the flow, we stop.
NIFI-10918: Fixed checkstyle violations

This closes #6736
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-12-02 14:24:40 +01:00
exceptionfactory c51411d360
NIFI-10925 Refactored TestPutSFTP with discrete test methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6746.
2022-12-02 10:08:18 +01:00
mr1716 beb0f920d5
NIFI-10912 This closes #6742. Upgrade JSLT To 0.1.14
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-01 12:02:35 -07:00
exceptionfactory 3399d09c46
NIFI-10923 This closes #6745. Upgraded Apache SSHD to 2.9.2
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-01 12:02:01 -07:00
exceptionfactory c3b0e1a790
NIFI-10919 Corrected SCRAM SASL Mechanism for Kafka Components
This closes #6743
Signed-off-by: Paul Grey <greyp@apache.org>
2022-12-01 11:29:29 -05:00
simonbence 570fc7f1fa
NIFI-10914 Adjusting input check for loading nested versioned flows (#6741) 2022-12-01 11:09:51 -05:00
greyp9 282c56b5ce
NIFI-10901 - PublishKafka headers not sent in ProducerRecord (#6731) 2022-11-30 13:23:23 -05:00
mr1716 c79eca94a1
NIFI-10910 Upgraded amqp-client from 5.15.0 to 5.16.0
This closes #6734

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-30 11:54:50 -06:00
Tamas Palfy f630540891
NIFI-10765 Added better error reporting in JASN1Reader
This closes #6703

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:45:18 -06:00
sopan98 ee5d557d2a
NIFI-10891 Replaced HashMap with LinkedHashMap in BinFiles
- Resolved non-deterministic behavior in TestMergeContent.testDefragmentMultipleMingledSegments

This closes #6727

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:29:08 -06:00
sopan98 ab8e9aa8df
NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader
- Updated unit test based on deterministic behavior of LinkedHashMap

This closes #6726

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:26:58 -06:00
Nandor Soma Abonyi 3a7ec5d542 NIFI-10785 Allow publishing AMQP message with null header value
NIFI-10785 addressing review comment
NIFI-10785 addressing review comments (remove unnecessary property to ignore null headers)

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6649.
2022-11-29 12:41:23 -05:00
exceptionfactory de296b5e65 NIFI-10897 Replaced Spring Security Base64 with java.util.Base64
This closes #6728

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-29 12:20:16 -05:00
exceptionfactory d55fb91b0f NIFI-10871 Skipped CSRF processing for replicated HTTP requests
- Updated Security Filter Configuration to avoid unnecessary CSRF Request Token generation for requests replicated between cluster nodes

This closes #6715.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-29 17:19:18 +01:00
priyanka-28 830a64b8e9
NIFI-10834 Updated TestPutSplunkHTTP to avoid non-deterministic tests
This closes #6672

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 21:07:18 -06:00
Yihen Liu a3c895341c
NIFI-10875 Changed TestQuerySolr to check for path elements
- Changes avoid non-deterministic expectations for query parameters

This closes #6718

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 17:12:19 -06:00
Chris Sampson 43a8b858ca
NIFI-10882 Set credentials for ElasticSearchClientService based on AuthorizationScheme
This closes #6722

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 17:01:40 -06:00
dan-s1 e8d554d9b4
NIFI-10876 Converted some nifi-framework tests from JUnit 4 to JUnit 5
This closes #6720

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 14:47:17 -06:00
Joe Gresock 31af82275e
NIFI-10791 Added AWS SDK v2 support to AWSCredentialsProviderControllerService
This closes #6661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 14:36:12 -06:00
Vasily Makarov 83feb0a02d
NIFI-7190 CaptureChangeMySQL processor remove comments from normalized query
This closes #6711

Co-authored-by: Vasily Makarov <feitgraph@gmail.com>
Co-authored-by: Matt Burgess <mattyb149@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 12:53:47 -06:00
Nandor Soma Abonyi b0a92868a9
NIFI-10872 Fix broken Java Mail links in ConsumeIMAP and ConsumePOP3 documentation
This closes #6723

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 10:47:00 -06:00
Bence Simon df21478297
NIFI-10874 Fixed issue with multiple levels of versioned flows
This closes #6719

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 10:44:12 -06:00
Joe Witt 198a27abbe
NIFI-10854 adjusting post merge for next release cycle 2022-11-28 08:49:35 -07:00
Joe Witt 1046b2c308
Merge branch 'NIFI-10854-RC1' 2022-11-28 08:43:56 -07:00
Arpad Boda a469c92f21
NIFI-10873 - GenerateFlowFile: flowfiles in a batch are not unique
This closes #6717.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-28 16:41:19 +01:00
Matthew Burgess 5f1d93f977 NIFI-5819: Support SQLServer sql_variant type
This closes #6699.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-24 16:57:50 +01:00
Ryan Van Den Bos 2ad33eea80 NIFI-10845 - JsonQueryElasticsearch processors are not outputting an empty flow file for a combined response with output_no_hits set to true
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6701
2022-11-23 18:27:28 +00:00
sssqhai 2393785765
NIFI-6428 Add 'inTransaction' value to state,fix bug
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6036
2022-11-23 09:58:06 -05:00
Peter Turcsanyi 40b46b4f5d
NIFI-10850: Fixed Query Parameters property in InvokeAWSGatewayApi should support FlowFile attributes in EL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6692.
2022-11-23 13:04:58 +01:00
exceptionfactory 9cc9692c98
NIFI-10866 Refactored Kafka 1.0 and 2.0 using nifi-kafka-shared
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6710.
2022-11-23 05:04:34 -05:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
exceptionfactory 0ca09fd52c
NIFI-10864 This closes #6707. Deprecated Hive 1.1 and 1.2 Components
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:34:26 -07:00
exceptionfactory 6062f16667
NIFI-10861 This closes #6705. Deprecated Azure Storage Processors using legacy Microsoft SDK
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:34:06 -07:00
exceptionfactory 5aa7ba9bf9
NIFI-10860 This closes #6704. Deprecated ExecuteFlumeSink and ExecuteFlumeSource
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:33:45 -07:00
sopan98 ff14ea2aab
NIFI-10862 This closes #6709. Fix Flaky tests in TestXMLReader
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:25:02 -07:00
Shane Ardell aa6f6dd61d
NIFI-10814: Display description for selected flow (#6693)
* display description for selected flow

* NIFI-10814: add border when content overflows and increase height

* NIFI-10814: add padding to description

* NIFI-10814: remove duplicate CSS property from declaration block

* NIFI-10814: a few more CSS tweaks

This closes #6693
2022-11-22 17:01:38 -05:00
exceptionfactory 8e417c890a
NIFI-10819 Restricted JndiLoginModule for Kafka JAAS Config
- Refactored property configuration and validation to nifi-kafka-shared

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6690.
2022-11-22 16:51:23 -05:00
Matthew Burgess 09bc5bcb5a
NIFI-10699: Add FLOW_CONFIG_HISTORY table to QueryNiFiReportingTask
This closes #6581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 15:35:22 -06:00
Mike Thomsen 6a9cb9c10c
NIFI-10863 Added conditional InvokeHTTP HTTP debug log
- Wrapping if statements prevent them from being called at all if debug logging is disabled

This closes #6706

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 15:31:53 -06:00
Nandor Soma Abonyi 4ea425e235
NIFI-10656 Log ignored event with info instead of warning
This closes #6540.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-22 22:13:56 +01:00
exceptionfactory 7019e182b5
NIFI-10835 Improved performance of TestControlRate
- Added LongSupplier for TimedBuffer and ControlRate classes to support overriding System.currentTimeMillis()

This closes #6671
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-22 13:14:04 -05:00
Curtis Ruck 54108689b6
NIFI-10842 Added HTTP Protocols to StandardOauth2AccessTokenProvider
This closes #6686

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:26:32 -06:00
sopan98 2d70bfb380
NIFI-10744 Changed HashSet to LinkedHashSet in SegmentContent for deterministic handling
This closes #6700

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:07:58 -06:00
exceptionfactory 6b188636ff
NIFI-10188 Added jaxws-api for ConsumeEWS on Java 11
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6697
2022-11-21 18:30:33 -05:00
dan-s1 844f311c52
NIFI-9107 Converted remaining nifi-enrich-bundle tests from JUnit 4 to 5
This closes #6698

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:54:58 -06:00
dan-s1 f3d2dfaf5c
NIFI-9165 Converted remaining nifi-standard-bundle tests from JUnit 4 to JUnit 5
This closes #6696

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:53:14 -06:00
Paul Grey 620b7365c2
NIFI-10851 Corrected removal of Controller Service references on property updates
- Convert unit test to JUnit 5

This closes #6695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:45:54 -06:00
Mark Payne 2126dbbe29
NIFI-10660: When converting Avro GenericRecord to a java Map, check GenericRecord's schema to see if field exists before calling Record.get().
NIFI-10660: Added unit tests; fixed bug to ensure that we use the desired field name when checking if it exists in schema

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6688
2022-11-21 15:09:31 -05:00
Mike Thomsen e172a3f224
NIFI-10840 Added a build profile to enable Neo4J 5 support
This closes #6684

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 14:07:27 -06:00
Chris Sampson d23e50168f
NIFI-10776 Added NONE and PKI AuthorizationSchemes for ElasticSearchClientService
This closes #6662

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 13:52:18 -06:00
aksharau a861bab34d
NIFI-9920 Fetching all bulletins of a process group on update process group (#6335) 2022-11-21 11:24:47 -05:00
Mark Bathori 594e93d97e
NIFI-10812: Remove duplicate record template creation from Iceberg record converter
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6659
2022-11-20 17:26:49 -05:00
Bence Simon 4fe65f1b81
NIFI-10828 Adding new REST API endpoint for exposing versioned flow details
NIFI-10828 Fixing documentation

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6674
2022-11-20 17:05:50 -05:00
Lehel Boér 81b36e69ae
NIFI-10389 Added mime.type to GetShopify and GetHubSpot
This closes #6682

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:42:43 -06:00
mr1716 c63a668ac5
NIFI-10808 Upgraded Guava from 31.0.1 to 31.1
This closes #6683

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:18:13 -06:00
Robert Kalmar 89426d167b
NIFI-10370 Create PutSnowflake processor using Snowpipe ingest
This closes #6584.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-18 16:19:03 +01:00
Pierre Villard 2698282615 NIFI-10804 - Update okhttp-digest to 2.7
This closes #6681

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:35:12 -05:00
Pierre Villard 87f02d26d9 NIFI-10809 - Update greenmail to 1.6.11
This closes #6679

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:33:34 -05:00
Pierre Villard 85a95550bb NIFI-10806 - update snmp4j dependencies
This closes #6677

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:32:06 -05:00
Matthew Burgess 214bd2f00c
NIFI-7862: Add UpdateDatabaseTable processor for auto table structure updates
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5523.
2022-11-17 14:38:52 -05:00
krisztina-zsihovszki dfdd86cff7 NIFI-10793 Comment is not populated when process group is created via API
This closes #6653.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-17 16:04:46 +01:00
Arpad Boda 7a449dbcee NIFI-10833 - Fix grammar error in ListenHTTP log msg 2022-11-16 19:40:20 -05:00
sedadgn 009d641576 NIFI-10787 - Cannot commit flows to nifi registry after updating our nifi release to 1.18.0
NifiRegistryFlowRegistryClient defines the PropertyDescriptor PROPERTY_URL  name as small case "url". The map bases on the name property of the PropertyDescriptor object. Here searching with uppercase value of "URL" causes the map lookup to fail and cause a NPE later on. Therefore, it is changed as "url"

NIFI-10787 - Added constant for property descriptor "url" in NiFiRegistryFlowMapper to make it more clear.

NIFI-10787 - Added change to unit test.

NIFI-10787 - Updated unit test to validate that NiFi registry url is being set and retrieved.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6655.
2022-11-16 19:07:15 -05:00
Mark Payne d7f2eb7c26
NIFI-10818: Fixed bug in which oldest bin in MergeContent was not being evicted in order to make room for a new bin when using a correlation attribute. Added additional tests for JoinEnrichment to ensure that the changes had no adverse effects on that processor. Found a bug when running that test in MockProcessSession so also addressed the bug (ConcurrentModificationException).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6668
2022-11-16 16:49:29 -05:00
greyp9 30facedc43
NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key (#6131)
* NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key
* publisher wrapper record; property naming and display order; doc updates
2022-11-16 16:07:43 -05:00
exceptionfactory bd89d66539
NIFI-7392 Corrected TestValidationJson for Windows build 2022-11-16 11:29:12 -06:00
mr1716 83ff168ac1
NIFI-10763 Upgraded mysql-binlog-connector-java from 0.26.1 to 0.27.5
This closes #6667

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:19:19 -06:00
r65535 a702a8c215
NIFI-7392 Added ValidateJson to Standard Processors
This closes #6337

Co-authored-by: dan-s1 <dsteig1@gmail.com>
Co-authored-by: r65535 <ryan77056@gchq.gov.uk>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:02:17 -06:00
Nathan Gough 1b8cd8349b
NIFI-10703 - Updated VersionedDataflow to support MaxEventDrivenThreadCount
NIFI-10703 - Also setting the maxEventDrivenThreadCount on the controller when using a versioned flow.
NIFI-10703 - Corrected to use getMaxEventDrivenThreadCount(), set a default value for event driven thread count in VersionedDataflow
NIFI-10703 - Updated log message for setMaxThreadCount in FlowController.java
NIFI-10703 - Updated default value for maxEventDrivenThreadCount
NIFI-10703 - Set private for DEFAULT_MAX_EVENT_DRIVEN_THREAD_COUNT

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6638
2022-11-15 21:08:48 -05:00
Matthew Burgess f2774c4924
NIFI-9814: Add range sampling to SampleRecord
- Incorporated review comments

This closes #5878
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-15 18:49:51 -05:00
Nandor Soma Abonyi 241d619138
NIFI-10775 Improve support for DescribedValue in PropertyDescriptor.Builder
This closes #6650.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 22:17:21 +01:00
Mark Payne bda624823b
NIFI-10817: Moved the calls in StandardProcessSession to 'resetState()' and 'acknowledgeRecords()' from the outer commit(boolean) to the inner commit(Checkpoint, boolean). By moving the call here, the logic of StandardProcessSession is unaffected. But the StatelessProcessSession that inherits from it now has the benefit of having the state cleaned up when calling super.commit(Checkpoint, boolean).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6663
2022-11-15 15:47:32 -05:00
Malthe Borch a71556f115
NIFI-10491 Added Conflict Resolution Strategy to PutAzureBlobStorage_v12
This closes #6443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:40:23 -06:00
mr1716 491f21bf90
NIFI-10727 Upgraded grpc libraries from 1.48.0 to 1.50.2
This closes #6660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:24:17 -06:00
Paul Grey 25b6e2c9cd
NIFI-10815 Fixed initial internal yield duration when processor created
This closes #6664

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:14:50 -06:00
Tamas Palfy 56af75f5bd
NIFI-10722 - Add handling of TBCD-STRING in nifi-asn1-services
This closes #6611

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:12:22 -06:00