Commit Graph

6151 Commits

Author SHA1 Message Date
exceptionfactory 97cb3c4eaa
NIFI-11101 Deprecated ConsumeEWS Processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6893.
2023-01-26 18:00:16 +01:00
Mark Bathori c3dd2569db NIFI-10974: Incorrect warning message on memory usage from MonitorMemory 2023-01-26 13:25:07 +01:00
Priyanka Awatramani b3f2d95092
NIFI-10928 Updated MockFlowFile with LinkedHashMap for attributes
- Updated TestAttributesToCSV with LinkedHashMap for deterministic test behavior
- Updated TestHttpFlowFileServerProtocol with adjusted checksums to match expectations from LinkedHashMap changes

This closes #6748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 16:19:20 -06:00
exceptionfactory 5101db2ab7
NIFI-11096 This closes #6889. Added EncodeContent to Processor services definition
- Deprecated Base64EncodeContent in favor of EncodeContent
- Updated EncodeContent to use Commons Codec for Hexadecimal encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 15:01:38 -07:00
Joe Gresock 7d99521d4c
NIFI-11089: Resolving previously resolved parameter providers when possible on version sync (#6886) 2023-01-25 13:42:52 -05:00
Paul Grey 567e95aa28
NIFI-11047 - Issue when upgrading version of dataflow with external service
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6849
2023-01-25 12:52:52 -05:00
exceptionfactory 4fe2c318e6
NIFI-11091 This closes #6884. Upgraded Google libraries-bom from 25.4.0 to 26.4.0
- Upgraded Google Drive library to v3-rev20221219-2.0.0
- Corrected test encryption keys to match expected encoding

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 10:00:00 -07:00
Pierre Villard 1148738c19
NIFI-11095 This closes #6888. Deprecate Hortonworks Schema Registry
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:59:00 -07:00
Mark Payne 228a3441b5
NIFI-11001: This closes #6836. When new components are added, track a mapping of its Versioned Compoenent ID to the component itself. Then, use this when creating connections. This is important because if a Process Group has multiple components with the same Versioned Component ID across multiple child groups, the Versioned Component ID may be changed upon adding the component. Maintaining this mapping allows us to still create the connection correctly.
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-25 09:55:16 -07:00
Nissim Shiman b7f7b411ef
NIFI-10853 Allow UpdateAttribute dynamic property to validate nifi
expressions

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6770
2023-01-25 11:43:12 -05:00
Peter Gyori 4d3fcb6843
NIFI-11000 Add compression example to CreateHadoopSequenceFile documentation
This closes #6801

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-25 10:33:29 -06:00
exceptionfactory f32a60af33
NIFI-11064 Removed unstable TestPutSFTP.testRunTransitUriDifferentHosts
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6885.
2023-01-25 11:07:13 +01:00
exceptionfactory 84f48b5e8c
NIFI-11090 This closes #6883. Removed unused Jasypt test dependency
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-24 08:42:33 -07:00
krisztina-zsihovszki 4700fed249
NIFI-10965 PutGoogleDrive
This closes #6832.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 22:20:33 +01:00
Bence Simon 0ab1fbccc8
NIFI-10934 Added uniqueness check for Registry Client creation
This closes #6750

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Chris Sampson <12159006+ChrisSamo632@users.noreply.github.com>
2023-01-23 14:57:17 -06:00
Joe Gresock bf871e0b8d
NIFI-11032: Addressing NPE when retrieving registry client info with unauthorized user (#6879) 2023-01-23 15:51:25 -05:00
Paul Grey b426226207
NIFI-10993 - PublishKafkaRecord should use correct record schema
This closes #6833.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 21:40:29 +01:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Joe Gresock 8640989ad7
NIFI-11039: Fixing bug when importing parameter providers from nifi-registry (#6868)
* NIFI-11039: Fixing NPE in registry retrieval
* NIFI-11039: Fixing bug when importing parameter providers from nifi registry
2023-01-23 11:59:34 -05:00
Peter Turcsanyi cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Joe Gresock 29618ae5c6
NIFI-11076: Resolving deadlock issue in StandardParameterContext (#6865)
* NIFI-11076: Resolving deadlock issue in StandardParameterContext

* NIFI-11076: Resolving deadlock issue in StandardParameterContext
2023-01-23 10:54:38 -05:00
Nandor Soma Abonyi eb5d172693
NIFI-10991 Add AWS MSK IAM support to Kafka processors
This closes #6846.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-23 12:33:49 +01:00
mr1716 bc02470b00
NIFI-11085 Update graphics2d to 0.42
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6876.
2023-01-23 11:54:58 +01:00
mr1716 78a2c4e14a
NIFI-11072 Updated xz from 1.8 to 1.9
This closes #6871

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-20 16:18:03 -06:00
mr1716 bdcefe4a98
NIFI-11081 Updated gRPC from 1.50.2 to 1.52.1
This closes #6875

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-20 16:17:06 -06:00
Timea Barna a9274c12c5
NIFI-11079 Extend QueryNifiReportingTask and ProcessGroup Summary Table
Correcting EmbeddedQuestDbStatusHistoryRepositoryForComponentsTest

Correcting TestQueryNiFiReportingTask

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6869
2023-01-20 15:22:20 -05:00
exceptionfactory 7db6f17350
NIFI-11064 Changed TestPutSFTP run iterations based on files queued
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6863.
2023-01-19 21:20:43 +01:00
krisztina-zsihovszki 312c6190e9
NIFI-11069 PutDropbox: remove upload cancellation, unify conflict resolution naming
This closes #6855.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 17:33:04 +01:00
Kalman Jantner 67925b171a NIFI-10953: Implement GCP Vision AI processors
This closes #6762.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-01-19 16:20:58 +01:00
Tamas Palfy 464e0a96ee
NIFI-11050 In PutEmail added OAuth authorization option. StandardOauth2AccessTokenProvider can be used with refresh_token grant type.
This closes #6845.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-19 16:05:28 +01:00
Matthew Burgess d7b14c0c45
NIFI-11033: Update QueryNiFiReportingTask additionalDetails page to include Flow Config History table
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6856.
2023-01-19 12:38:10 +01:00
mr1716 4518740da5
NIFI-11071 Update json-flattener to 0.16.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6860.
2023-01-19 10:56:01 +01:00
mr1716 b4f6aace53
NIFI-11070 Update json-schema-validator to 1.0.76
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6857.
2023-01-19 10:53:36 +01:00
mr1716 4b8ce44d59
NIFI-11042 Update msal4j to 1.13.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6859.
2023-01-19 10:52:17 +01:00
mr1716 4d78ebc487
NIFI-11024: Update iceberg.version to 1.1.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6851.
2023-01-18 14:22:15 +01:00
krisztina-zsihovszki 9ad1d8a7ae
NIFI-11028 Handle controller service 'Scheduled State' change (#6831) 2023-01-17 18:40:47 -05:00
Matthew Burgess 8986f4b33a
NIFI-6501 Refactor CaptureChangeMySQL with bounded queue of 1000
This closes #6791

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-17 16:18:55 -06:00
Matthew Burgess 6adbc1aeb0
NIFI-11036: Add Cluster Summary Metrics to Prometheus endpoint
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6834.
2023-01-17 14:44:33 +01:00
krisztina-zsihovszki b7071cbb04
NIFI-11049 Fixed flaky PutDropboxTest, attribute description corrected
This closes #6850.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-16 16:55:59 +01:00
Mike Thomsen d38f15997d
NIFI-10870 Added debug logging for the Elasticsearch REST Requests
This closes #6841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 16:11:21 -06:00
Matthew Burgess e0ec9780a5
NIFI-10449 Fixed ScriptedLookupServices reloading
- Reload script after disabled and first validation after changes made

This closes #6371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 15:09:52 -06:00
Chris Sampson 1d7ee542b1
NIFI-2161 add option to skip attribute output for unmatched JSON path expressions in EvaluateJsonPath
This closes #6817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-12 14:06:15 -06:00
Nissim Shiman 74e0a2002e
NIFI-11030 refactor nifi-stateless-processor-bundle to use JUnit5
This closes #6837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-11 18:43:40 -06:00
mr1716 fbb74b2c21
NIFI-11040 Update box-java-sdk to 3.8.2
This closes #6835.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-01-11 21:16:09 +01:00
Nissim Shiman 692e74e90d
NIFI-10241 Add comments tooltip for controller services, reporting tasks
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6768
2023-01-11 14:29:14 -05:00
Mark Payne d5c79fdcd1
NIFI-10887: Addressed performance concerned. Use String.indexOf() instead of Pattern.matcher() when using Literal Replace. Use a NonFlushableOutputStream when ProcessSession.write() is called. Implemented hashCode() on AbstractConnection. Updated default Run Schedule on ReplaceText from 0 ms to 25 ms. Added a Surround Replacement strategy that allows both prepending and appending text. Updated unit tests to account for this.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6724
2023-01-11 12:28:59 -05:00
Matthew Burgess a9baa21f87 NIFI-10996: Write out CSV header even if there are no records
This closes #6818

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-01-11 10:55:31 -05:00
lizhizhou 40ccb71f85
NIFI-10234 Added PutIoTDBRecord Processor
This closes #6416

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Xuan Ronaldo <xuanronaldo@qq.com>
Co-authored-by: Zhizhou Li <lizhizhou1983@gmail.com>
2023-01-10 20:38:33 -06:00
exceptionfactory 0c0f7e87be
NIFI-11004 Added documentation for OIDC groups claim property
This closes #6802
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-10 17:20:23 -05:00
Nissim Shiman fe25424233
NIFI-10772 Clarify logs on shutdown where controller service and/or
processor were unable to properly start

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6829
2023-01-10 13:56:00 -05:00
exceptionfactory 0d9dc6c540
NIFI-9167 Converted remaining nifi-framework tests to JUnit 5
NIFI-9167 Addressed feedback and improved tests using TempDir

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6823
2023-01-10 13:53:51 -05:00
exceptionfactory 6c517446a4
NIFI-10949 Updated MongoDB components using current driver (#6759)
- Replaced references to mongodb-driver-legacy with mongodb-driver-sync
- Updated components to use current synchronous driver classes
- Upgraded MongoDB driver from 4.7.2 to 4.8.0
2023-01-09 14:27:35 -05:00
Paul Grey e97977d61f
NIFI-10997 Ensure auditing of process group / controller service operations
This closes #6800

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 13:25:04 -06:00
nathluu ea93dec079
NIFI-10481 Support disabling ZooKeeper Ensemble Tracking
This closes #6400

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-09 10:42:01 -06:00
Matthew Burgess 4f77a17d19
NIFI-11031: Fix logic error in GenerateRecord for nullPercentage
This closes #6830

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-06 21:01:01 -06:00
exceptionfactory e966336e89
NIFI-11029 Added Standard XML parsing to ExtractCCDAAttributes
- Added DeprecationNotice to ExtractCCDAAttributes

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6828
2023-01-06 16:10:42 -05:00
Nissim Shiman 9252dcbc76
NIFI-11019 Converted remaining nifi-scripting tests to JUnit 5
This closes #6824

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-06 11:33:18 -06:00
greyp9 b69721cac9
NIFI-10980 - correct ordering of property descriptor allowable values (#6781)
NIFI-10980 - correct ordering of property descriptor allowable values
2023-01-05 14:11:03 -05:00
exceptionfactory 53faecdcf6
NIFI-11027 Removed direct dependency on Joda Time
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6825.
2023-01-05 11:56:42 +01:00
Chris Sampson d9420afb60
NIFI-10844 Allow _source only output for GetElasticsearch and JsonQueryElasticsearch
This closes #6687

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-04 15:30:41 -06:00
Matthew Burgess c11092b2b4
NIFI-10998 Fixed SplitJson to always compile new JsonPath when property changes
This closes #6803

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-04 13:58:06 -06:00
dan-s1 06c8225bbd [NIFI-11006] Upgraded from Junit4 to Junit5
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6813
2023-01-04 16:07:20 +00:00
Nissim Shiman d229f3fd11
NIFI-10608 Process Group copies include non-processor referenced
controller services

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6685
2023-01-03 12:09:01 -05:00
dan-s1 481cdaf3db
NIFI-11018 Upgraded nifi-web-security to JUnit 5
This closes #6814

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-02 12:16:37 -06:00
dan-s1 b74c5b423f
NIFI-10979 Additional nifi-framework upgrades from JUnit 4 to 5
This closes #6806

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:18:38 -06:00
Esa Lindqvist 4716c8d715
NIFI-10456 Added Client Authentication Strategy option to OAuth2 Provider
StandardOauth2AccessTokenProvider has been updated with new property `Client Authentication Strategy` supporting Basic Authentication as recommended in RFC 6749. The changes maintain the current default implementation using Request Body parameters

This closes #6782

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-30 15:07:33 -06:00
dependabot[bot] 9915bded77
NIFI-11017 Upgraded Hazelcast from 4.2.5 to 4.2.6
This closes #6812

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:50:36 -06:00
Pierre Villard 09463b0ae5
NIFI-11012 Updated Twitter SDK from 1.1.4 to 2.0.3
This closes #6811

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:44:30 -06:00
Pierre Villard eb9f75e28f
NIFI-11009 Update Snowflake SDK to 1.0.2-beta.7
This closes #6808

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-29 21:29:58 -06:00
Pierre Villard bb886af69d NIFI-11010 - Update Kinesis client to 1.14.9
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6809
2022-12-29 11:29:48 +00:00
Mark Bathori 4b24bcd2f8
NIFI-10677: Add Choice data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6563.
2022-12-25 17:58:17 +01:00
Emilio Setiadarma bf24d575b3
NIFI-10971: improved edge case handling while fetching objects using Azure Key Vault Client and added unit tests
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6780.
2022-12-25 17:51:40 +01:00
exceptionfactory b556322749
NIFI-11005 Added Illegal and Redundant Import Modules to Checkstyle
- Updated impacted classes to remove redundant import lines
- Removed WebUtilsGroovyTest.groovy class due to use of internal sun.security classes

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6804.
2022-12-23 18:34:38 +01:00
Eric Bernard b65431564d
NIFI-10988 - Fix ConsumeGCPubSubLite processors delivering incorrect messages
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6788.
2022-12-23 18:26:13 +01:00
Matthew Burgess f38f14b363
NIFI-10585 Added GenerateRecord Processor
This closes #6480

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 19:30:05 -06:00
dan-s1 dde821cf71
NIFI-6498 Update TransformXml to send errors to Component Log
This closes #6798

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-22 11:15:37 -06:00
mr1716 c85a6e866f
NIFI-10921 Upgraded Apache POI from 5.2.2 to 5.2.3
This closes #6760

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-19 12:41:42 -06:00
Matthew Burgess 2a88980024 NIFI-4572: Include database and table names in CaptureChangeMySQL events even when cache is not configured
This closes #6786.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-19 17:30:33 +01:00
Nandor Soma Abonyi caee606706
NIFI-10884 log target filename
This closes #6792.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-18 22:49:52 +01:00
krisztina-zsihovszki 1d5a1bff08
NIFI-10868 PutDropbox processor
This closes #6740.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-16 18:51:31 +01:00
Bryan Bende 5c3ca9d537
NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs,… (#6785)
- NIFI-10981 Ensure NarAutoLoader starts after provider retrieves NARs, and ensure the auto-loader attempts to process any NARs available before starting to watch for new files
- Add system test with NAR Provider that copies NARs from a local directory and verifies the NARs were loaded and linked correctly
- Exclude new assembly from CI test-compile
2022-12-16 11:30:37 -05:00
exceptionfactory a8974253ce
NIFI-10989 Removed SHA-1 and MD5 from TestHashContent
- Removed methods to avoid intermittent failures due to lack of Bouncy Castle Security Provider registration

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6790
2022-12-15 22:06:52 -05:00
Rajmund Takacs 1c40738997
NIFI-10618: Add Asana connector
This closes #6504.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-16 00:14:26 +01:00
Peter Turcsanyi ae5d23db47
NIFI-10987: Added default implementation of AWS SDK V2 credentials in AWSCredentialsProviderService
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6787.
2022-12-15 16:43:04 -05:00
Peter Turcsanyi 1e23e5146f NIFI-10969: Created extension point for Signer Override in AWS S3 processors
Also added Signer Override property in AWSCredentialsProviderControllerService with Custom Signer extension point.
Made Assume Role related properties dependent on Assume Role ARN property in AWSCredentialsProviderControllerService.
Fixed S3 IT tests.

This closes #6777.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-15 18:43:22 +01:00
Mark Payne 78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6725
2022-12-14 12:09:32 -05:00
Lehel Boér ed6ba53724 NIFI-10832: Create PutSalesforceRecord processor
This closes #6670.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
dan-s1 e21f622643
NIFI-10877 Converted more nifi-framework-core tests from JUnit 4 to 5
This closes #6775

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-13 11:37:59 -06:00
exceptionfactory c11dff912a
NIFI-10958 Adjusted Script Engine handling to avoid exceptions
- Added empty check for list of discovered Script Engines to avoid exceptions for documentation generation on Java 17

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6774
2022-12-12 16:43:28 -05:00
Nathan Gough 2fa82179a8
NIFI-10576 Added onFinishRecordSet implementation for WriteParquetResult
This closes #6517

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-09 14:16:21 -06:00
hj28 ac8e3dae58
NIFI-10637 Deterministic TestGenerateTableFetch testMultipleColumnTypeMissing
This closes #6754

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-09 10:41:36 -06:00
exceptionfactory b0ab364f61
NIFI-10967 Corrected TestWriteJsonResult mixed arrays
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6773
2022-12-09 01:01:58 -05:00
Bryan Bende 334c9db9c3
NIFI-10915 Add additionalDetails content to runtime manifest
- Update manifests assembly to include the additionaDetails.html files
- Update C2 ExtensionDefinition to add a new field for additional details content
- Update manifest generation to read the additional details and pass through to C2 runtime manifest
- Switch to boolean to indicate presence of additional details, instead of including content

Add additionalDetails files to nifi-runtime-manifest artifact, organized by group/artifact/version/type

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6767
2022-12-08 11:02:56 -05:00
Matt Burgess b744fac479
NIFI-10956: Fix inference issues with mixed arrays (#6763) 2022-12-08 09:28:19 -05:00
exceptionfactory 45a31c7286 NIFI-10899 Added SameSite Policy to Application Cookies
- Added __Secure prefix to Application Cookie Names

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6735.
2022-12-05 14:09:39 -05:00
Paul Grey 3dc48f0894 NIFI-10916 - Controller Service allowable values dropdown list should be sorted
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6739.
2022-12-05 11:44:07 -05:00
exceptionfactory ab7ce58fb1
NIFI-10947 This closes #6758. Upgraded Apache Commons Net to 3.9.0
- Added Commons Net to managed dependencies in root Maven configuration
- Removed version references to 3.3 in MiNiFi and 3.6 in NiFi standard modules

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-05 09:01:29 -07:00
mr1716 de694ee45d
NIFI-10920 Upgraded Jettison from 1.5.1. to 1.5.2
This closes #6747

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-12-05 09:11:24 -06:00
exceptionfactory 87c583042e
NIFI-10941 Removed TestNG references
- Replaced TestNG assertions with JUnit 5
- Excluded testng transitive dependencies from groovy-all
- Added testng exclusion to Maven Enforcer configuration

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6753.
2022-12-05 13:11:59 +01:00
exceptionfactory 47fc3ae77d
NIFI-10898 This closes #6729. Removed unused test HTTP Servlets
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-04 21:08:14 -07:00
Mark Payne e1c8c96111 NIFI-10937, NIFI-10938, NIFI-10939: When restoring flow from XML, properly parse XML for registry clients, looking for 'id' tag instead of 'identifier' tag. Fixed typo in error message about Reporting Task for Registry Clients. Updated StandardFlowComparator so that we compare sub-process groups' contents only if the Flow Coordinates are different by more than their version
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6752.
2022-12-02 18:37:47 -05:00
Mark Payne 2473683ce5 NIFI-10918: When fetching a flow from a Flow Registry, if it references any 'internal versioned flows' instead of requiring that we have a client configured for the appropriate URL, attempt to fetch the flow from each client. We will start with the clients that do report that they can handle the URL but will try others as well. As soon as we successfully fetch the flow, we stop.
NIFI-10918: Fixed checkstyle violations

This closes #6736
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-12-02 14:24:40 +01:00
exceptionfactory c51411d360
NIFI-10925 Refactored TestPutSFTP with discrete test methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6746.
2022-12-02 10:08:18 +01:00
mr1716 beb0f920d5
NIFI-10912 This closes #6742. Upgrade JSLT To 0.1.14
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-01 12:02:35 -07:00
exceptionfactory 3399d09c46
NIFI-10923 This closes #6745. Upgraded Apache SSHD to 2.9.2
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-12-01 12:02:01 -07:00
exceptionfactory c3b0e1a790
NIFI-10919 Corrected SCRAM SASL Mechanism for Kafka Components
This closes #6743
Signed-off-by: Paul Grey <greyp@apache.org>
2022-12-01 11:29:29 -05:00
simonbence 570fc7f1fa
NIFI-10914 Adjusting input check for loading nested versioned flows (#6741) 2022-12-01 11:09:51 -05:00
greyp9 282c56b5ce
NIFI-10901 - PublishKafka headers not sent in ProducerRecord (#6731) 2022-11-30 13:23:23 -05:00
mr1716 c79eca94a1
NIFI-10910 Upgraded amqp-client from 5.15.0 to 5.16.0
This closes #6734

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-30 11:54:50 -06:00
Tamas Palfy f630540891
NIFI-10765 Added better error reporting in JASN1Reader
This closes #6703

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:45:18 -06:00
sopan98 ee5d557d2a
NIFI-10891 Replaced HashMap with LinkedHashMap in BinFiles
- Resolved non-deterministic behavior in TestMergeContent.testDefragmentMultipleMingledSegments

This closes #6727

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:29:08 -06:00
sopan98 ab8e9aa8df
NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader
- Updated unit test based on deterministic behavior of LinkedHashMap

This closes #6726

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:26:58 -06:00
Nandor Soma Abonyi 3a7ec5d542 NIFI-10785 Allow publishing AMQP message with null header value
NIFI-10785 addressing review comment
NIFI-10785 addressing review comments (remove unnecessary property to ignore null headers)

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6649.
2022-11-29 12:41:23 -05:00
exceptionfactory de296b5e65 NIFI-10897 Replaced Spring Security Base64 with java.util.Base64
This closes #6728

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-29 12:20:16 -05:00
exceptionfactory d55fb91b0f NIFI-10871 Skipped CSRF processing for replicated HTTP requests
- Updated Security Filter Configuration to avoid unnecessary CSRF Request Token generation for requests replicated between cluster nodes

This closes #6715.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-29 17:19:18 +01:00
priyanka-28 830a64b8e9
NIFI-10834 Updated TestPutSplunkHTTP to avoid non-deterministic tests
This closes #6672

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 21:07:18 -06:00
Yihen Liu a3c895341c
NIFI-10875 Changed TestQuerySolr to check for path elements
- Changes avoid non-deterministic expectations for query parameters

This closes #6718

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 17:12:19 -06:00
Chris Sampson 43a8b858ca
NIFI-10882 Set credentials for ElasticSearchClientService based on AuthorizationScheme
This closes #6722

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 17:01:40 -06:00
dan-s1 e8d554d9b4
NIFI-10876 Converted some nifi-framework tests from JUnit 4 to JUnit 5
This closes #6720

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 14:47:17 -06:00
Joe Gresock 31af82275e
NIFI-10791 Added AWS SDK v2 support to AWSCredentialsProviderControllerService
This closes #6661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 14:36:12 -06:00
Vasily Makarov 83feb0a02d
NIFI-7190 CaptureChangeMySQL processor remove comments from normalized query
This closes #6711

Co-authored-by: Vasily Makarov <feitgraph@gmail.com>
Co-authored-by: Matt Burgess <mattyb149@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 12:53:47 -06:00
Nandor Soma Abonyi b0a92868a9
NIFI-10872 Fix broken Java Mail links in ConsumeIMAP and ConsumePOP3 documentation
This closes #6723

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 10:47:00 -06:00
Bence Simon df21478297
NIFI-10874 Fixed issue with multiple levels of versioned flows
This closes #6719

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-28 10:44:12 -06:00
Joe Witt 198a27abbe
NIFI-10854 adjusting post merge for next release cycle 2022-11-28 08:49:35 -07:00
Joe Witt 1046b2c308
Merge branch 'NIFI-10854-RC1' 2022-11-28 08:43:56 -07:00
Arpad Boda a469c92f21
NIFI-10873 - GenerateFlowFile: flowfiles in a batch are not unique
This closes #6717.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-28 16:41:19 +01:00
Matthew Burgess 5f1d93f977 NIFI-5819: Support SQLServer sql_variant type
This closes #6699.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-24 16:57:50 +01:00
Ryan Van Den Bos 2ad33eea80 NIFI-10845 - JsonQueryElasticsearch processors are not outputting an empty flow file for a combined response with output_no_hits set to true
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6701
2022-11-23 18:27:28 +00:00
sssqhai 2393785765
NIFI-6428 Add 'inTransaction' value to state,fix bug
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6036
2022-11-23 09:58:06 -05:00
Peter Turcsanyi 40b46b4f5d
NIFI-10850: Fixed Query Parameters property in InvokeAWSGatewayApi should support FlowFile attributes in EL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6692.
2022-11-23 13:04:58 +01:00
exceptionfactory 9cc9692c98
NIFI-10866 Refactored Kafka 1.0 and 2.0 using nifi-kafka-shared
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6710.
2022-11-23 05:04:34 -05:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
exceptionfactory 0ca09fd52c
NIFI-10864 This closes #6707. Deprecated Hive 1.1 and 1.2 Components
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:34:26 -07:00
exceptionfactory 6062f16667
NIFI-10861 This closes #6705. Deprecated Azure Storage Processors using legacy Microsoft SDK
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:34:06 -07:00
exceptionfactory 5aa7ba9bf9
NIFI-10860 This closes #6704. Deprecated ExecuteFlumeSink and ExecuteFlumeSource
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:33:45 -07:00
sopan98 ff14ea2aab
NIFI-10862 This closes #6709. Fix Flaky tests in TestXMLReader
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:25:02 -07:00
Shane Ardell aa6f6dd61d
NIFI-10814: Display description for selected flow (#6693)
* display description for selected flow

* NIFI-10814: add border when content overflows and increase height

* NIFI-10814: add padding to description

* NIFI-10814: remove duplicate CSS property from declaration block

* NIFI-10814: a few more CSS tweaks

This closes #6693
2022-11-22 17:01:38 -05:00
exceptionfactory 8e417c890a
NIFI-10819 Restricted JndiLoginModule for Kafka JAAS Config
- Refactored property configuration and validation to nifi-kafka-shared

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6690.
2022-11-22 16:51:23 -05:00
Matthew Burgess 09bc5bcb5a
NIFI-10699: Add FLOW_CONFIG_HISTORY table to QueryNiFiReportingTask
This closes #6581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 15:35:22 -06:00
Mike Thomsen 6a9cb9c10c
NIFI-10863 Added conditional InvokeHTTP HTTP debug log
- Wrapping if statements prevent them from being called at all if debug logging is disabled

This closes #6706

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 15:31:53 -06:00
Nandor Soma Abonyi 4ea425e235
NIFI-10656 Log ignored event with info instead of warning
This closes #6540.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-22 22:13:56 +01:00
exceptionfactory 7019e182b5
NIFI-10835 Improved performance of TestControlRate
- Added LongSupplier for TimedBuffer and ControlRate classes to support overriding System.currentTimeMillis()

This closes #6671
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-22 13:14:04 -05:00
Curtis Ruck 54108689b6
NIFI-10842 Added HTTP Protocols to StandardOauth2AccessTokenProvider
This closes #6686

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:26:32 -06:00
sopan98 2d70bfb380
NIFI-10744 Changed HashSet to LinkedHashSet in SegmentContent for deterministic handling
This closes #6700

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-22 08:07:58 -06:00
exceptionfactory 6b188636ff
NIFI-10188 Added jaxws-api for ConsumeEWS on Java 11
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6697
2022-11-21 18:30:33 -05:00
dan-s1 844f311c52
NIFI-9107 Converted remaining nifi-enrich-bundle tests from JUnit 4 to 5
This closes #6698

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:54:58 -06:00
dan-s1 f3d2dfaf5c
NIFI-9165 Converted remaining nifi-standard-bundle tests from JUnit 4 to JUnit 5
This closes #6696

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:53:14 -06:00
Paul Grey 620b7365c2
NIFI-10851 Corrected removal of Controller Service references on property updates
- Convert unit test to JUnit 5

This closes #6695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 16:45:54 -06:00
Mark Payne 2126dbbe29
NIFI-10660: When converting Avro GenericRecord to a java Map, check GenericRecord's schema to see if field exists before calling Record.get().
NIFI-10660: Added unit tests; fixed bug to ensure that we use the desired field name when checking if it exists in schema

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6688
2022-11-21 15:09:31 -05:00
Mike Thomsen e172a3f224
NIFI-10840 Added a build profile to enable Neo4J 5 support
This closes #6684

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 14:07:27 -06:00
Chris Sampson d23e50168f
NIFI-10776 Added NONE and PKI AuthorizationSchemes for ElasticSearchClientService
This closes #6662

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-21 13:52:18 -06:00
aksharau a861bab34d
NIFI-9920 Fetching all bulletins of a process group on update process group (#6335) 2022-11-21 11:24:47 -05:00
Mark Bathori 594e93d97e
NIFI-10812: Remove duplicate record template creation from Iceberg record converter
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6659
2022-11-20 17:26:49 -05:00
Bence Simon 4fe65f1b81
NIFI-10828 Adding new REST API endpoint for exposing versioned flow details
NIFI-10828 Fixing documentation

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6674
2022-11-20 17:05:50 -05:00
Lehel Boér 81b36e69ae
NIFI-10389 Added mime.type to GetShopify and GetHubSpot
This closes #6682

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:42:43 -06:00
mr1716 c63a668ac5
NIFI-10808 Upgraded Guava from 31.0.1 to 31.1
This closes #6683

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-18 10:18:13 -06:00
Robert Kalmar 89426d167b
NIFI-10370 Create PutSnowflake processor using Snowpipe ingest
This closes #6584.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-18 16:19:03 +01:00
Pierre Villard 2698282615 NIFI-10804 - Update okhttp-digest to 2.7
This closes #6681

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:35:12 -05:00
Pierre Villard 87f02d26d9 NIFI-10809 - Update greenmail to 1.6.11
This closes #6679

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:33:34 -05:00
Pierre Villard 85a95550bb NIFI-10806 - update snmp4j dependencies
This closes #6677

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-18 08:32:06 -05:00
Matthew Burgess 214bd2f00c
NIFI-7862: Add UpdateDatabaseTable processor for auto table structure updates
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5523.
2022-11-17 14:38:52 -05:00
krisztina-zsihovszki dfdd86cff7 NIFI-10793 Comment is not populated when process group is created via API
This closes #6653.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-11-17 16:04:46 +01:00
Arpad Boda 7a449dbcee NIFI-10833 - Fix grammar error in ListenHTTP log msg 2022-11-16 19:40:20 -05:00
sedadgn 009d641576 NIFI-10787 - Cannot commit flows to nifi registry after updating our nifi release to 1.18.0
NifiRegistryFlowRegistryClient defines the PropertyDescriptor PROPERTY_URL  name as small case "url". The map bases on the name property of the PropertyDescriptor object. Here searching with uppercase value of "URL" causes the map lookup to fail and cause a NPE later on. Therefore, it is changed as "url"

NIFI-10787 - Added constant for property descriptor "url" in NiFiRegistryFlowMapper to make it more clear.

NIFI-10787 - Added change to unit test.

NIFI-10787 - Updated unit test to validate that NiFi registry url is being set and retrieved.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6655.
2022-11-16 19:07:15 -05:00
Mark Payne d7f2eb7c26
NIFI-10818: Fixed bug in which oldest bin in MergeContent was not being evicted in order to make room for a new bin when using a correlation attribute. Added additional tests for JoinEnrichment to ensure that the changes had no adverse effects on that processor. Found a bug when running that test in MockProcessSession so also addressed the bug (ConcurrentModificationException).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6668
2022-11-16 16:49:29 -05:00
greyp9 30facedc43
NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key (#6131)
* NIFI-9822 - ConsumeKafkaRecord allows writing out Kafka record key
* publisher wrapper record; property naming and display order; doc updates
2022-11-16 16:07:43 -05:00
exceptionfactory bd89d66539
NIFI-7392 Corrected TestValidationJson for Windows build 2022-11-16 11:29:12 -06:00
mr1716 83ff168ac1
NIFI-10763 Upgraded mysql-binlog-connector-java from 0.26.1 to 0.27.5
This closes #6667

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:19:19 -06:00
r65535 a702a8c215
NIFI-7392 Added ValidateJson to Standard Processors
This closes #6337

Co-authored-by: dan-s1 <dsteig1@gmail.com>
Co-authored-by: r65535 <ryan77056@gchq.gov.uk>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-16 10:02:17 -06:00
Nathan Gough 1b8cd8349b
NIFI-10703 - Updated VersionedDataflow to support MaxEventDrivenThreadCount
NIFI-10703 - Also setting the maxEventDrivenThreadCount on the controller when using a versioned flow.
NIFI-10703 - Corrected to use getMaxEventDrivenThreadCount(), set a default value for event driven thread count in VersionedDataflow
NIFI-10703 - Updated log message for setMaxThreadCount in FlowController.java
NIFI-10703 - Updated default value for maxEventDrivenThreadCount
NIFI-10703 - Set private for DEFAULT_MAX_EVENT_DRIVEN_THREAD_COUNT

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6638
2022-11-15 21:08:48 -05:00
Matthew Burgess f2774c4924
NIFI-9814: Add range sampling to SampleRecord
- Incorporated review comments

This closes #5878
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-15 18:49:51 -05:00
Nandor Soma Abonyi 241d619138
NIFI-10775 Improve support for DescribedValue in PropertyDescriptor.Builder
This closes #6650.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 22:17:21 +01:00
Mark Payne bda624823b
NIFI-10817: Moved the calls in StandardProcessSession to 'resetState()' and 'acknowledgeRecords()' from the outer commit(boolean) to the inner commit(Checkpoint, boolean). By moving the call here, the logic of StandardProcessSession is unaffected. But the StatelessProcessSession that inherits from it now has the benefit of having the state cleaned up when calling super.commit(Checkpoint, boolean).
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6663
2022-11-15 15:47:32 -05:00
Malthe Borch a71556f115
NIFI-10491 Added Conflict Resolution Strategy to PutAzureBlobStorage_v12
This closes #6443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:40:23 -06:00
mr1716 491f21bf90
NIFI-10727 Upgraded grpc libraries from 1.48.0 to 1.50.2
This closes #6660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:24:17 -06:00
Paul Grey 25b6e2c9cd
NIFI-10815 Fixed initial internal yield duration when processor created
This closes #6664

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:14:50 -06:00
Tamas Palfy 56af75f5bd
NIFI-10722 - Add handling of TBCD-STRING in nifi-asn1-services
This closes #6611

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-15 14:12:22 -06:00
Mark Bathori 4083e07447
NIFI-10801: Fix hive metastore based tests in Iceberg processors
This closes #6656.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-15 20:12:37 +01:00
Mark Bean 2bfefc3e5b NIFI-10243: allow ControlRate to throttle on combination of data rate or flowfile rate
NIFI-10243: fix typos

NIFI-10243: re-ordered property in ControlRate

NIFI-10243: minor updates to make code cleaner based on PR comments

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6506.
2022-11-14 23:04:55 -05:00
Emilio Setiadarma d06c19180a
NIFI-9697: Implemented AzureKeyVaultSecretsParameterProvider and AzureKeyVaultCredentialsService; Implemented unit tests as well as the documentation for the Parameter Provider
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6545.
2022-11-14 13:25:47 -05:00
Nathan Gough 23e8a19417
NIFI-10705 - Primary keys were not being included in ConvertJSONToSQL UPDATE queries when 'User statement.type Attribute' was used.
This closes #6652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 09:23:10 -06:00
Bryan Bende 7de74ad3f0
NIFI-10802 Apply bundle updates before properties in component synchronizer (#6654)
This closes #6654
2022-11-14 09:09:44 -05:00
mr1716 5fb8cf89f0
NIFI-10730 Upgraded Splunk from 1.6.5.0 to 1.9.1
This closes #6617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:58:27 -06:00
Mike Thomsen 78dbee8b7a
NIFI-10805 Upgraded script bundle Clojure, Groovy and JRuby
- Upgraded Clojure from 1.10.1 to 1.11.1
- Upgraded Groovy from 3.0.8 to 3.0.13
- Upgraded JRuby from 9.3.8.0 to 9.3.9.0

This closes #6657

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:54:52 -06:00
Mike Thomsen 00da6d5ead
NIFI-10562 Moved MongoDB to testcontainers for integration-tests
This closes #6642

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:35:06 -06:00
Peter Gyori 412c1f2e43
NIFI-10762: Ranger Authorizer accepts multiple Ranger Admin Identity property values (#6625) 2022-11-14 08:28:24 -05:00
Emilio Setiadarma 08bc44715e
NIFI-10789 Set FlowFile attributes for errors fetching from Azure Data Lake Storage
This closes #6644

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:27:59 -06:00
Mike Thomsen ea10b62615 NIFI-10794 Made StandardOauth2AccessTokenProvider a verifiable controller service.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6645.
2022-11-13 17:04:50 +00:00
exceptionfactory b14eedfa7f
NIFI-10796 This closes #6647. Upgraded Apache Iceberg from 0.14.0 to 1.0.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-10 15:39:23 -07:00
exceptionfactory 588e04cd07 NIFI-10780 Improved Event Server to avoid dropping messages
- Improved ByteArrayMessageChannelHandler to call BlockingQueue.offer() while the server is not shutting down
- Improved NettyEventServer to use ChannelFuture.await() for closing the channel to allow shutdown to proceed
- Added test method for EventDroppedException handling

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6634.
2022-11-10 15:38:43 -05:00
Tamas Palfy 56d0061da4
NIFI-10764 Fixed handling BIT STRING in nifi-asn1-services
Representing as a string of 1s and 0s (e.g. "010011000")

This closes #6622

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-10 10:33:17 -06:00
Seokwon Yang 0643f336e8
NIFI-10130 AzureGraphUserGroupProvider handles group with transitive members
This closes #6135

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 15:47:03 -06:00
Pierre Villard 425dd6a848
NIFI-10790 Updated Snowflake JDBC driver from 3.13.21 to 3.13.24
This closes #6641

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 15:32:30 -06:00
sopan98 ad4e0b0585
NIFI-10783 Switched to LinkedHashMap for CompareFuzzyHash
This closes #6639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-09 14:27:39 -06:00
Gabor Kulik 1bd4169558 NIFI-10702 Clear server list on connection error in SMB processors
This closes #6620.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-09 21:07:24 +01:00
Bryan Bende 9c21e26e63
NIFI-10788 Ensure proposed service config is applied when component synchronizer adds a new service (#6640)
This closes #6640
2022-11-09 15:04:19 -05:00
Mike Thomsen ddfaf16f68
NIFI-10781 Made the MongoDB controller service implement VerifiableControllerService.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6635
2022-11-08 17:40:41 -05:00
exceptionfactory 01816da56f
NIFI-10645 Corrected Bouncy Castle dependencies for Iceberg
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6636
2022-11-08 17:36:57 -05:00
Nandor Soma Abonyi d374c1f399
NIFI-10760 Add API Key authentication to ElasticSearchClientServiceImpl
This closes #6619

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 16:02:49 -06:00
dependabot[bot] cc35e3e427
NIFI-10782 Upgraded Apache Ivy from 2.5.0 to 2.5.1
This closes #6630 and #6631

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 15:31:45 -06:00
sopan98 889254a9dc
NIFI-10744 Used LinkedHashMap in TestScanHBase methods
This closes #6633

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 14:51:10 -06:00
sopan98 ce18b63db0
NIFI-10743 Used LinkedHashMap in TestHBase_1_1_2_ClientService.testScan
This closes #6632

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 14:49:22 -06:00
SaumyaGurtu 747b5d4d9e NIFI-10317 Taking care of NullPointerException if AMQP header value is null
NIFI-10317 refactoring to remove repeated conversions to string from char
NIFI-10317 correctly handle null values: null vs "null"
NIFI-10317 adding test
NIFI-10317 - Updated ConsumeAMQPTest to test for null and empty header values.
NIFI-10317 - Updated ConsumeAMQPTest to use hard coded string values when testing. Made convertMapToString() private.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6382.
2022-11-08 12:14:05 -05:00
Mark Bathori 2a85264dd5
NIFI-10645: Add cloud profiles for Iceberg processors
This closes #6541.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-08 18:03:31 +01:00
exceptionfactory 7c1a7da116 NIFI-10737 Corrected ListenBeats buffer handling
- Added test class for ListenBeats
- Removed unnecessary dependencies
- Implemented BatchDecoder for reading Beats Protocol frames
- Refactored protocol and handler classes

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6608.
2022-11-07 17:09:45 -05:00
exceptionfactory e60cbd4bbb
NIFI-10768 Filter empty messages in ListenSyslog (#6624)
- Added FilteringStrategy argument to Server Factory for ListenSyslog
- Set quick shutdown quiet period for ListenSyslog and TestListenSyslog
- Added test method for batched messages with empty message included
2022-11-07 15:05:40 -05:00
Bryan Bende 83d4e5bd04
NIFI-10771 Add SINGLE_BATCH_PER_NODE to allowable values for flow file concurrency in ProcessGroupDTO
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6627
2022-11-07 13:58:49 -05:00
Joe Gresock c6dde491ec
NIFI-10770: Removing fetch parameters on startup
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6626
2022-11-07 13:46:01 -05:00
Shane Ardell 60a8b3bc5f
NIFI-10698: Add filtering options to summary table (#6610)
* NIFI-10698: Add filtering options to summary table

* NIFI-10698: fix checkbox spacing and alignment

* NIFI-10698: fix spacing between dropdowns

Merged #6610 into main.
2022-11-07 10:34:42 -08:00
exceptionfactory 4f80233575
NIFI-10733 Upgraded Curator from 5.3.0 to 5.4.0
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6621
2022-11-07 10:00:06 -05:00
Marco Carlino 6ce2e3799c
NIFI-10349 add maximum object age property to list s3
This closes #6293.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-07 14:44:53 +01:00
Chris Sampson 2acfd1e496 NIFI-9398 add verification to ElasticSearchClientService (with integration tests) and Elasticsearch REST API processors
NIFI-9398 processor verification integration-tests for nifi-elasticsearch-restapi-processors using common nifi-elasticsearch-test-utils refactored from nifi-elasticsearch-client-service
NIFI-9398 fail index exists verification for Elasticsearch processors whose operations would not create the index if it doesn't already exist

This closes #6544

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-11-05 18:17:13 -04:00
exceptionfactory d9e494f976
NIFI-10713 Added Deprecation Warning for PGP in EncryptContent
NIFI-10713 Removed OpenPGP, PGP, and GPG tags

This closes #6613
Signed-off-by: Paul Grey <greyp@apache.org>
2022-11-04 18:04:37 -04:00
Mark Payne 381e0f84e1
NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception
This closes #6623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 16:20:22 -05:00
Mark Bean 61e1a37d2e
NIFI-10228: parse json flow using instanceIdentifier as the UUID
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6217
2022-11-04 13:09:29 -04:00
Mark Bean 4e4f6437ee
NIFI-4798 allow empty value for UpdateAttribute property
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6585
2022-11-04 12:29:19 -04:00
Mike Thomsen 19658df52b
NIFI-10675 Corrected SSL support in Neo4j V4 Cypher Service
- Added Testcontainers for Neo4j integration tests

This closes #6559

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 09:23:34 -05:00
Ferenc Erdei 86acde2fe2
NIFI-10750 Move C2NiFiClientService to minifi-framework
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #6612.
2022-11-04 08:53:53 +01:00
Nathan Gough d237fd228f
NIFI-10738 Updated SNMP tests to retry BindExceptions
This closes #6606

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 17:43:57 -05:00
Nissim Shiman f4069ab77a
NIFI-10287 ExecuteScript - Allow python scripts to use external modules
Co-authored-by: Nissim Shiman <nshiman@yahoo.com>
Co-authored-by: dan-s1 <dstieg1@gmail.com>

NIFI-10287 changes for code review

NIFI-10287 modification based on reviewer comment

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6254
2022-11-02 16:18:41 -04:00
mr1716 6fed5dee17
NIFI-10732 Upgraded ASN1Bean from 1.12.0 to 1.13.0
NIFI-10731 Upgraded asn1bean-compiler from 1.12.0 to 1.13.0

This closes #6609

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 10:34:41 -05:00
Matt Gilman ec22504d6e
NIFI-10709 Showed log in link on logout complete page
- Fixing issue remove token when logging out from the canvas.

This closes #6592

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-02 10:28:18 -05:00
Nathan Gough c40639a51f
NIFI-10332 Selected OIDC Logout method using Discovery URLs
This closes #6594

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-01 21:33:26 -05:00
TheGreatRandall 238c356219
NIFI-10637 Simplified Locale validation in ParseCEF
This closes #6522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 18:43:19 -05:00
BoyuLi4 56d26be3ca
NIFI-10630 Updated TestWaitNotifyProtocol comparing JSON Objects
This closes #6526

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 15:56:31 -05:00
priyanka-28 6f65cd1f32
NIFI-10629 Updated TestJsonEntitySerializer with sorted properties
This closes #6515

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-31 15:09:04 -05:00
zhewenf2 65201ab88b
NIFI-10642 Fix flaky test groupByStringMixedNumberOfRecords
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6528
2022-10-31 15:58:27 -04:00
Mike Thomsen 2a45d4ac89
NIFI-10729 Added Cassandra testcontainers.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6604
2022-10-31 14:39:26 -04:00
Mike Thomsen b6d95faa95
NIFI-10711 Made the script runner more debuggable.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6590
2022-10-31 13:39:42 -04:00
mr1716 8d2789dbc4 NIFI-10725 Update ICU4J to 72.1
This closes #6603

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-30 08:44:48 -04:00
mr1716 60d7f437a6
NIFI-10720 Update bval-jsr to 2.0.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6600.
2022-10-29 10:29:43 +02:00
M Tien e862a02df6
NIFI-10715: improve tooltips in parameter providers (#6598)
* NIFI-10715: clean up tooltips in parameter providers

* more clean up

This closes #6598
2022-10-28 16:23:18 -04:00
UcanInfosec 557a1a7869 NIFI-10718 Update mongo.driver.version to 4.7.2
This closes #6599

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-28 15:51:53 -04:00
Paul Grey 61ccb23b47
NIFI-10704 - include API name of properties in processor documentation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6586
2022-10-28 14:13:16 -04:00
Ferenc Kis 65558accda
NIFI-10679 MiNiFi C2 Update Asset Command
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #6583.
2022-10-28 20:09:15 +02:00
mr1716 438d8ec1eb NIFI-10688 Update javax.json-api & javax.json
This closes #6572

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-28 08:02:28 -04:00
exceptionfactory c6ae69e054
NIFI-10716 Upgraded Flume from 1.10.1 to 1.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6595.
2022-10-28 10:59:29 +02:00
M Tien be64f5560c
NIFI-10603: fix showing the referencing components border in the fetch parameters dialog (#6491)
This closes #6491
2022-10-27 13:45:24 -04:00
Csaba Bejan ac7306f582
NIFI-10693 Remove proxy configuration properties from PutBigQuery
This closes #6580.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-27 16:57:11 +02:00
UcanInfosec ef0793c8fc
NIFI-10695 Update org.eclipse.paho.client.mqttv3 to 1.2.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6578.
2022-10-27 07:29:19 +02:00
Matt Gilman b05bd988b6 NIFI-10700:
- Only restart ports if their scheduledState is Running.
- Adding unit tests.
- Fixing unit test to properly verify Port isn't restarted.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6582.
2022-10-26 16:31:27 -04:00
Mark Payne d390a0becf
NIFI-10673: When a component is added to a ProcessGroup, we had a method called ensureUniqueVersionControlId but the method only took into accounts in that Process Group. Updated methods to now consider components in any Process Group that is part of the same Versioned Flow. Also added system test to verify the problem and the fix. Added Toolkit clients and additional methods as necessary in order to implement system tests
NIFI-10673: Addresed checkstyle issue

NIFI-10673: Removed TODO comment
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2022-10-26 14:38:01 -04:00
Chris Sampson b6026f5709 NIFI-10303 route GetElasticsearch to failure if _id is blank after attribute evaluation
This closes #6573

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-25 14:30:09 -04:00
Chris Sampson db49a861b3 NIFI-10687 set Elasticsearch document _id to null if ID attribute evaluated to blank String for PutElasticsearchRecord or PutElasticsearchJson; use @timestamp default value if @timestamp record path evaluates to blank String in PutElasticsearchRecord
This closes #6575

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-25 14:23:19 -04:00
Andrew Lim 2d5a8b8b0d NIFI-10503 Changed flow file references to FlowFile in GenerateTableFetch processor docs
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6577.
2022-10-25 11:13:07 -04:00
Denes Arvay 3ed87a2982
NIFI-10594 Render empty lines in Labels
This closes #6519

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:39:29 -05:00
UcanInfosec 3d1bf497a3
NIFI-10686 Upgraded questdb-core from 6.5.2 to 6.5.3
This closes #6570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:22:26 -05:00
mtien 643b6a6c1d
NIFI-10689 Fixed Parameter Provider Name encoding in context dialog
This closes #6576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-25 09:16:36 -05:00
Joe Witt c92a30734f
NIFI-10680 Corrected Bouncy Castle references in optional profiles
NIFI-10691 Removed duplicate Bouncy Castle dependencies from nifi-standard-processors

This closes #6571

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 17:46:51 -05:00
Timea Barna 7c33516aee NIFI-9437 Flowfile Expiration cannot exceed 24 days
NIFI-9437 Addressing review comments, correcting setter in StatelessFlowQueue class

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6558.
2022-10-24 14:46:56 -04:00
mr1716 753cb1b9df
NIFI-10683 Upgraded JNA to 5.12.1 for Windows Event Log
This closes #6568

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 09:53:43 -05:00
Malthe Borch 831a11d0b5
NIFI-7823 Added groups mapping from OIDC token claim
This closes #6454

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-24 09:12:24 -05:00
markap14 d64574b565
NIFI-10682: When determining effective property values, ensure that we always use the up-to-date version of Property Descriptors (#6567)
This closes #6567
2022-10-24 09:59:16 -04:00
mr1716 f23318a361
NIFI-10670 Update commons-csv from 1.8 to 1.9.0
This closes #6554

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 15:18:00 -05:00
Lehel Boér feb3148b68
NIFI-10628: Added Default Schedule Time and Run Duration to processors
This closes #6512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 14:57:46 -05:00
Nandor Soma Abonyi 2049268372
NIFI-10668 Persist proxy password in remote process group (#6557)
* NIFI-10668 Persist proxy password in remote process group
2022-10-21 11:44:12 -04:00
Joe Witt c155d29658
NIFI-10614 Upgraded Bouncy Castle from 1.70 to 1.71
- Blocked Bouncy Castle jdk15on dependencies
- Forced jdk18on dependencies and validated across entire build

This closes #6498

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 19:35:02 -05:00
exceptionfactory 9f2ad260bd NIFI-10667 Added Private Key Service interface and implementation
- Defined PrivateKeyService in nifi-key-service-api
- Implemented StandardPrivateKeyService using Bouncy Castle library

NIFI-10667 Improved custom validation to avoid repetitive reads

NIFI-10667 Added onPropertyModified() to clear Key Reference for validation

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6553.
2022-10-20 18:08:18 -04:00
Nathan Gough c22181e79f
NIFI-10672 - Removed intermittently failing method from DBCPServiceTest
This closes #6555

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-20 16:33:35 -05:00
markap14 e83e3eb849
NIFI-10663: When ProcessorNode.stop() is called, it returns a Future. That future, however, may be completed when the processor is fully stopped or whenever it becomes stopping. Fixed this behavior by only completing the future whenever the processor has fully stopped. Also addressed an issue in the synchronizer in which we did not stop a processor when it had a state of STARTING. (#6561)
This closes #6561
2022-10-20 15:42:37 -04:00
yiteng3 a5d93d96a3
NIFI-10631 Changed HashMap to LinkedHashMap in TestHBase_2_ClientService
- Adjustment avoids non-deterministic warnings related to HashMap ordering

This closes #6516

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-19 09:54:47 -05:00
dependabot[bot] 531a9de28f
NIFI-10669 Upgraded Jettison from 1.3.7 to 1.5.1
- Upgraded Jettison in nifi-framework-bundle
- Upgraded Jettison in nifi-registry-ranger
- Upgraded Jettison in nifi-spark-bundle

This closes #6548
This closes #6549
This closes #6550

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-19 09:45:49 -05:00
Peter Turcsanyi 2be5c26f28
NIFI-10659: Extracted DBCP common code to nifi-dbcp-base module for use in Snowflake NAR
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6543
2022-10-18 17:04:14 -04:00
UcanInfosec 808d3d6664
NIFI-10636 Update Jython-standalone to 2.7.3
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6521
2022-10-18 16:57:32 -04:00
exceptionfactory dd93fbeb7a
NIFI-10661 Corrected JSLT tests using parsed JSON comparison
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6551
2022-10-18 16:50:01 -04:00
exceptionfactory fcefd051d2
NIFI-10652 Corrected dependency scopes for nifi-iceberg-processors
- Marked nifi-iceberg-services-api as provided
- Marked multiple Hadoop and Hive dependencies as provided to avoid duplicate inclusion in nifi-iceberg-processors-nar

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6535
2022-10-18 13:25:11 -04:00
exceptionfactory 523dd94045
NIFI-10651 Upgraded Iceberg transitive dependencies
- Followed dependency override approach from nifi-hive-bundle based on Hive dependencies

NIFI-10651 Removed unnecessary Calcite dependency references

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6533
2022-10-18 13:23:15 -04:00
exceptionfactory b64b4fcce5
NIFI-10661 Added support for File Resources to JSLTTransformJSON
- Refactored unit test methods for reuse of shared operations
- Added link to JSLT Tutorial in property description

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6546
2022-10-18 13:16:29 -04:00
Matthew Burgess dfbc7dfc21
NIFI-8111: Add JSLTTransformJSON Processor
This closes #4797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-17 16:14:18 -05:00
Matt Burgess f43b989c99
NIFI-10617: Add missing DynamicProperty annotation to processors that use them (#6509)
This closes #6509
2022-10-17 12:46:37 -04:00
Matthew Burgess a76abef270 NIFI-10635: Fix handling of enums in PutDatabaseRecord
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6518.
2022-10-17 11:29:53 -04:00
Nandor Soma Abonyi 298dd2024e
NIFI-10644 Add Message Demarcator-style processing in PublishMQTT
This closes #6530.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-16 23:20:28 +02:00
Nandor Soma Abonyi eecb6bfb38 NIFI-10650 Fix demarcator is appended to the end of the FlowFile's content by ConsumeMQTT
This closes #6534.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-15 18:10:04 +02:00
Joe Gresock 704ca63cc7
NIFI-10643: Paging secrets in AwsSecretsManagerParameterProvider
This closes #6532

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-15 09:09:14 -05:00
Joe Gresock 2d7f86b265
NIFI-10641: Resolving typo on ParameterProvider warning message
This closes #6527

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-15 09:05:57 -05:00
exceptionfactory 0dc02e26d2 NIFI-10648 Upgraded Apache Commons Text to 1.10.0
- Added org.apache.commons.text.version property in root Maven configuration
- Removed direct version references in favor of managed dependency version

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6531.
2022-10-14 14:07:23 -04:00
Joe Gresock 283669ced3
NIFI-10633 Adding references to Key/Value Version 1 secrets engine in HashiCorp Vault documentation
This closes #6520

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-14 09:55:18 -05:00
exceptionfactory ed8197eacb
NIFI-10567 Corrected Sensitive Dynamic Property handling for flow.xml (#6524)
- Updated XmlFlowSynchronizer to filter parsed Sensitive Dynamic Property Names using dynamic status of component Property Descriptor
- Lack of access to the Component Property Descriptor when parsing DOM elements required subsequent dynamic status filtering
2022-10-13 19:38:17 -04:00
Denes Arvay b784d6e8ee
NIFI-10621 Allow ExecuteGroovyScript classpath properties to accept commas or semicolons
ExecuteGroovyScript's "Additional classpath" property treats commas and semicolons
as delimiters

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6523
2022-10-13 15:08:28 -04:00
Mike Thomsen 08a1f09905 NIFI-10437 Converted SearchResponseTest from Groovy to Java.
NIFI-10437 Removed old Maven Elasticsearch integration testing plugin and replaced with Testcontainers.
NIFI-10437 Converted TestSchemaRegistry from Groovy to Java.
NIFI-10437 Converted TestElasticsearchClientService from Groovy to Java.
NIFI-10437 Converted a unit test from Groovy to Java.
NIFI-10437 Converted a unit test from Groovy to Java.
NIFI-10437 Converted ElasticSearchLookupService_IT from Groovy to Java.
NIFI-10437 Converted ElasticSearchClientService_IT from Groovy to Java.
NIFI-10437 Migrated to Testcontainers.
NIFI-10437 Converted all nifi-elasticsearch-restapi-processors unit tests from Groovy to Java.

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6487
2022-10-13 12:52:20 +01:00
exceptionfactory 11314e8132
NIFI-10624 Removed sensitive properties key warning
- Corrected logging statements with placeholders instead of concatenation
- Removed unused NiFiServerStub

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6513
2022-10-12 21:58:29 -04:00
UcanInfosec 14a2249c0e
NIFI-10626 Update jruby-complete to 9.3.8.0
This closes #6510

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-12 20:32:17 -04:00
Mark Bathori e87bced147
NIFI-10442: Create PutIceberg processor
This closes #6368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-11 21:51:18 +02:00
mr1716 14d3ac3229
NIFI-10620 Upgraded Spring Integration from 5.5.14 to 5.5.15
This closes #6505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-11 11:03:16 -04:00
Lehel Boér ad08e8befc
NIFI-10602: Fix GetHubSpot and GetShopify state handling on NiFi restart
This closes #6495.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-10 23:44:03 +02:00
Andrew Lim da0fb234d6
NIFI-10288 Better describe forward slash requirements for Prefix property in ListS3
This closes #6477

Co-authored-by: Andrew Lim <andrewlim.apache@gmail.com>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-10 11:40:57 -05:00
Jon Shoemaker 9a4ce2607d
NIFI-9878 Added timeout handling for Cache Client handshaking
This closes #6414

Co-authored-by: Nissim Shiman <nshiman@yahoo.com>
Co-authored-by: Jon Shoemaker <jon.l.shoemaker@systolic.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-10 11:31:40 -05:00
Matt Gilman e638bcee2f
NIFI-10617:
- Adding dynamic property annotation on a number of extensions that were missing it.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6501
2022-10-10 10:32:50 -04:00
Nathan Gough 9ff1dadcf6
NIFI-10604 Added Idle Connection Timeout property to ListenTCP
This closes #6492

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 14:30:37 -05:00
zhangcheng b5f4101fa0
NIFI-10352: remove the meaningless code of GenerateTableFetch.java, It is confusing for reading code.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6299
2022-10-07 14:50:26 -04:00
exceptionfactory 97dc4b67aa NIFI-10569 Added Maximum Thread property to HandleHttpRequest
- Added simple unit test for HandleHttpRequest to run without requests
- Removed cleanup integration test method for HandleHttpRequest

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6465.
2022-10-07 14:37:04 -04:00
Michael 81877 572799a201
NIFI-10273 Supported file entries larger than 8.5GB for TAR in MergeContent
This closes #6369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 10:36:10 -05:00
dan-s1 5da9ce525c
NIFI-10565 Removed duplicated test dependencies
This closes #6482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-07 09:07:51 -05:00
Joe Witt c6a9d70814
Merge branch 'NIFI-10521-RC4' 2022-10-06 14:13:30 -07:00
exceptionfactory d1145ee34e NIFI-10586 Prioritized ssh-rsa algorithm in SFTP Processors
- The default configuration prioritizes ssh-rsa when Key Algorithms Allowed is not specified

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6479.
2022-10-06 14:31:10 -04:00
krisztina-zsihovszki 1ec8c84b6a NIFI-10597 Change 'App Config File' property to external resource in Box processors
This closes #6489.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-10-06 18:54:47 +02:00
Nandor Soma Abonyi 2405b0ef71
NIFI-10543 Support broker failover in MQTT processors (#6447)
NIFI-10543 Support broker failover in MQTT processors

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-06 18:24:54 +02:00
Yanni bcec883344
NIFI-10592 This closes #6486. fix flaky tests using wrong map impl.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-10-05 14:49:07 -07:00
Ferenc Erdei 504baae227
NIFI-10531 Add supported operations to c2 heartbeat:
This closes #6438

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-10-04 17:16:51 +02:00
Ferenc Kis 16bcb8f145
NIFI-10458 MiNiFi: Add C2 handler for Transfer/Debug operation
This closes #6434

Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
2022-10-04 10:35:39 +02:00
Andrew Lim d29f67465a
NIFI-10564 Update text for access the controller access policy in UI and Admin Guide
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6476.
2022-10-03 20:50:31 -04:00
exceptionfactory 7a01e22125
NIFI-10577 Fix Sensitive Checkbox rendering for Fetch Parameters (#6473)
* NIFI-10577 Fixed Sensitive Checkbox rendering for Fetch Parameters

- Corrected rendering of Sensitive status checkbox on Firefox using standard nf-checkbox

* NIFI-10577 Corrected canvas rendering in Safari

Merged #6473 in main.
2022-10-03 13:24:36 -07:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Joe Gresock 10a5e9194c
NIFI-10572: Allowing variables to be deleted between versions, and considering ancestor variable additions to be environmental
This closes #6474

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-03 12:44:07 -05:00
M Tien 5546b7ab01
NIFI-10566: update availability text in Controller Settings (#6463)
* NIFI-10566: update availability text in Controller Settings
- fix link in controller service referencing a parameter provider

* add Registry Clients to the availability message

This closes #6463
2022-10-03 08:23:52 -04:00
Peter Turcsanyi 271c773ee4
NIFI-10574: Fixed PutAzureDataLakeStorage fails with HTTP 412 error
This closes #6470

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-02 16:44:53 -05:00
Joe Gresock 518f413d9f NIFI-9637: Adding GcpSecretManagerParameterProvider
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6394.
2022-09-30 13:15:36 -04:00
Emilio Setiadarma abf88c3aab
NIFI-10240 Removed custom validation for SSL Context Service in ListenSyslog
- Made sure to check TCP is protocol set before using SSL Context Service during runtime

This closes #6441

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-30 11:03:39 -05:00
Aerilym 4b691b133b
NIFI-10192 Caffeine cache schema request for reuse
This closes #6364

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 15:07:42 -04:00
Joe Gresock 315e54a812
NIFI-9636: Adding AwsSecretsManagerParameterProvider
This closes #6392

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-29 11:59:04 -05:00
Matthew Hawkins 3e60414d48
NIFI-10436 Initial basic brotli support
NIFI-10436 Add Brotli-compressed SampleFile.txt.br for unit testing
NIFI-10436 Fixup basic usage of Brotli4j API
NIFI-10436 NOTICE ok, LICENSE updated
NIFI-10436 style fixup CompressContent.java
NIFI-10436 Update CompressContent.java

This closes #6432

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 12:03:09 -04:00
Lance Kinley 8c2b8cb6bc
NIFI-10557 Upgrade MongoDB driver to 4.7.1
This closes #6455

Fully supports MongoDB 6.0

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-29 11:40:08 -04:00
Lehel da05ba0165 NIFI-10213: Create GetShopify processor
This closes #6303.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-29 16:12:53 +02:00
Joe Gresock 094222260c
NIFI-9402: Adding DatabaseParameterProvider
Adding provided scope to api dependency in nifi-standard-parameter-providers module

Adding additional documentation, other minor code cleanup

Correcting error handling in StandardParameterProviderNode, updating additional details for DatabaseParameterProvider

Correcting null columm value handling

NIFI-9402: Fixed Checkstyle violation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6391
2022-09-28 17:41:57 -04:00
exceptionfactory 013d01a9fc
NIFI-10558 This closes #6456. Updated Ranger modules to skip tests on AArch64
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-28 13:54:42 -07:00
Joe Witt 1a99b9611c
NIFI-10559 Clarified remote path can come from flowfile attributes and made inherited prop descriptors more obvious
This closes #6457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-28 15:52:32 -05:00
exceptionfactory 6461061e8f
NIFI-10381 Refactored Azure Event Hubs components with current SDK
- Upgraded Azure Event Hubs components from legacy version 3 to current version 5
- Refactored Azure dependencies using azure-sdk-bom
- Merged nifi-azure-record-sink-nar with nifi-azure-nar
- Refactored PutAzureCosmosDBRecordTest to use Jackson instead of Gson

This closes #6319.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-28 18:22:01 +02:00
Zoltan Kornel Torok b28a211bf3
NIFI-10552 This closes #6453. Fix ranger credential builder NoClassDefFoundError
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-27 10:58:07 -07:00
Lehel Boér 63aac1a31d NIFI-10513: Added capture non-record fields to JsonTreeRowRecordReader, added pagination to QuerySalesforceObject
This closes #6444.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-27 19:53:10 +02:00
Tamas Palfy 1d9e119084
NIFI-10523 - Improved Google Drive processor documentations.
This closes #6430.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 19:42:26 +02:00
Lehel Boér f14f940389
NIFI-10551: Improve GetHubSpot documentation
This closes #6452.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 16:50:49 +02:00
M Tien 34084d083a
NIFI-10542: set sensitivity for new parameters in a synced parameter context (#6446)
* NIFI-10542: set sensitivity for new parameters in a synced parameter context

* show removed or missing but referenced parameters with tooltip in the selectable parameters table
- remove default parameter value

* address review feedback
- fix showing a referencing icon for a missing but removed parameter

* fix discovering new parameters

This closes #6446
2022-09-26 19:32:00 -04:00
Eduardo Fontes 9bc63920aa
NIFI-10289 This closes #6256. Change getConflictColumnsClause
NIFI-10289 Test upsert to catch this issue

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-26 15:38:42 -07:00
Joe Witt 9e6ee656b5
NIFI-10532 ensuring client gets reset if any of the key values host/port/user/pw change on a per ff basis (#6445) 2022-09-26 17:00:23 -04:00
simonbence e5059e0514
NIFI-10550 Fixing SSH Context Service validation for NifiRegistryFlowRegistryClient (#6451) 2022-09-26 16:28:00 -04:00
Shane Ardell 17084a1f09
NIFI-10538: UI updates for making RegistryClient an extension point (#6437)
* init commit

* remove test string

* display only class name for types combo

* remove commented code

* add UI support for dynamic properties

* add support for controller services

* address review feedback:

* fix syntax error
* remove console logs
* move contents of editRegistry into callback
* add name and description fields back to edit dialog

* add referencing component logic for registry clients

* implement reload logic

* more review findings
* increase size of description textarea in config
* remove location column from registry table
* remove commented out code

* post-rebase tweaks
* change if condition from assignment to evaluation
* add missing semicolons
* refactor new registry initialization into function

* more feedback addressed
* fix rebase error around controller service reference
* render registry references in their own list
* remove duplicate updateValidationError function
* remove TODO comment

* expose reload through nfSettings public variable

* show add registry dialog only after available types returns

* fix css class name

This closes #6437
2022-09-26 16:03:51 -04:00
Lehel 5d2bd1e47b
NIFI-10463: Fix GetHubSpot incremental loading
This closes #6379.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 21:33:22 +02:00
Ferenc Kis 0fa923159f
NIFI-10460 GetZendesk processor
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6411
2022-09-26 20:47:17 +02:00
simonbence 94fdc794b0
NIFI-10497 Making RegistryClient an extension point (#6433)
- NIFI-10497 Mae FlowRegistryClient an extension point
2022-09-26 12:16:21 -04:00
Nandor Soma Abonyi 320aed024f
NIFI-10152 Storage client caching in Azure ADLS processors
This closes #6158.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 08:26:44 +02:00
M Tien d82ce18f88
NIFI-9514 NIFI-9515: Add UI support for Parameter Providers in Controller Services (#5671)
* NIFI-9514 - Add UI support for Parameter Providers in Controller Services

* - Fix a dialog closing issue

* - Hide fetch parameters button if there are config errors

* - Update Fetch Parameters dialog with new UX
- Implement checkbox logic for Selectable Parameters table

* - add createNewParameterContext property to track if group will be created as a new parameter context
- update fetch parameters dialog views for editing and after applying changes
- show affected referencing components after applying changes
- disable apply button if no parameter contexts will be updated
- refactor showing and hiding fetched parameters and selectable parameters tables logic
- add tooltip for parameter context icon

* - update parameter contexts view for provided contexts

* - add affected referencing components after applying fetched parameters
- add referencing parameter contexts to the provider settings tab
- update checkbox style in the selectable parameters table
- fix updating the referencing components border
- fix lint errors

* - fix selectable parameters table checkbox styles

* - fix hasParameterContextChanged checks
- checkbox style tweaks

* - add status bar to fetch parameters dialog

* - more style tweaks and remove unnecessary code

* - fix the selectable parameters table not saving and loading correctly

* - add tooltips
- fix styles

* - link from the parameter context to the associated parameter provider

* 9514: support navigating to the controller service created in parameter providers

* fix bulletins format in status bar

* address review feedback
- manage permissions for parameter providers
- disable/enable Fetch Parameters dialog Apply button

* manage authorizations to access parameter providers and parameter contexts

* fix lint errors

* fix and refactor hasGroupsChanged to determine the Apply button state

* new parameter context name input cannot be empty in Fetch Parameters dialog

* address review feedback

* fix duplicate code

* more fixes

* update fetch parameters checkbox states

* replace slickgrid checkbox selection plugin with custom implementation for different selection types
- check for affected parameters using the parameter status

* fixed showing the correct referencing components when switching groups

* fixed selectable parameters table shifting contents on row selection

* leverage slickgrid onClick to set user-selected parameter sensitivities in the selectable parameters table

* fix statusbar bulletins in processor details
- fix updating borders for referencing components
- update referencing parameter icon
- update table title in fetch parameters dialog

* address review feedback

* populate controller services referencing components of a referenced provider
- update controller services tab name

* showing parameter providers in CS controller service

* update tooltip messages in fetch parameters dialog
- fix dialog height to make room for the status bar

* reload the parameter providers table after a referenced parameter provider change in controller services
- fix conditions for enabling/disabling fetch parameters dialog Apply button
- add affected components no permissions message in the dialog

* fix always reloading the parameter providers table
- fix disableApplyButton checks
- add dialog message for a missing new parameter context name

* remove extra reload

* more fixes for disableApplyButton
- fixed styles for dialog message

* add a check in disableApplyButton for changed parameter values that are not referenced
- add changed value icon for parameters that are not referenced
- fix border on the referencing affected components container

* removed unnused plugins

This closes #5671
2022-09-24 08:43:27 -04:00
Nathan Gough a52974780d
NIFI-10525 - Upgraded hadoop.version to 3.3.4.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6431.
2022-09-24 10:33:18 +04:00
Bryan Bende 8d04ba5427
NIFI-10529 Add DynamicProperties to AvroSchemaRegistry
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6436.
2022-09-24 10:31:15 +04:00
Joe Gresock ece83709f4
NIFI-10473: Removing referencing components check on param provider f… (#6388)
* NIFI-10473: Removing referencing components check on param provider fetch

* NIFI-10473: Adding parameter status DTO to ParameterProviderDTO

* Allowing parameterStatus to be populated even when no parameters were updated

* Adding ParameterStatus enum for parameter fetching

* Adding MISSING_BUT_REFERENCED ParameterStatus

This closes #6388
2022-09-23 13:44:52 -04:00
Bryan Bende 27e3ee1915 NIFI-10528 Create nifi-json-record-utils and updated Salesforce NAR dependencies to use it
This closes #6435.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-23 17:11:13 +02:00
Emilio Setiadarma f586f8f4cf NIFI-9451 - Add 'Input Character Set' property for PutEmail and additional tests
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6313.
2022-09-23 00:20:23 -04:00
Ferenc Kis 1b1d388ef7
NIFI-10530 MiNiFi: Add option to compress c2 requests
This closes #6439

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-09-22 16:23:28 +02:00
mr1716 cfb1597e10
NIFI-10520: Upgrade Hazelcast version to 4.2.5
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6429
2022-09-21 10:47:12 -04:00
kulikg cea924bc6b
NIFI-10507 removed absolute.path from ListSmb (#6422) 2022-09-19 16:49:20 -04:00
Tamas Palfy dd9739a28c
NIFI-10427 - Added ListBoxFile and FetchBoxFile processors
This closes #6355.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 19:46:56 +02:00
Joe Gresock 43931b1504
NIFI-10518: Adding intended state to ScheduledStateChangeListener (#6428)
- NIFI-10518: Adding intended state to ScheduledStateChangeListener
- Notifying of scheduled state change when transitionComponentState is called
- Notifying scheduled state change when reporting task state is changed
- Notifying scheduledState changes for remote group port start/stop components calls
2022-09-19 10:38:00 -04:00
Csaba Bejan 35fb66f50f
NIFI-10403 Add processor supporting the new BigQuery Write API
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6344
2022-09-19 14:32:11 +02:00
krisztina-zsihovszki 111c7ac0a4
NIFI-10444 FetchDropbox processor
NIFI-10444 Add ProxyConfiguration to ListDropbox and FetchDropbox processors

This closes #6401.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 13:08:49 +02:00
Mark Payne ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6421
2022-09-16 17:58:19 -04:00
Mark Payne eaa275a5e4
NIFI-10515: If propopsed controller service is disabled, ensure that we don't re-enable the service and references when synchronize(ControllerServiceNode...) is called
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6425.
2022-09-16 16:36:55 -04:00
exceptionfactory abbd7a89c8
NIFI-10455 Removed unused import from GetWorkdayReport
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 13:49:38 -05:00
Ferenc Erdei 903a487cf8
NIFI-10455 Added GetWorkdayReport Processor
This closes #6376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 12:56:03 -05:00
mr1716 62811f5afe NIFI-10492 - Update pom.xml for graphics2d from 0.32 to 0.40
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6412.
2022-09-16 12:45:46 -04:00
exceptionfactory 6398c2deb7
NIFI-10505 Removed unused HttpClient dependency from nifi-web-api
- Removing org.apache.httpcomponents:httpclient from nifi-web-api avoids Linkage Errors with Sensitive Property Providers

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6423.
2022-09-16 10:19:28 +02:00
Mark Payne 3f0ef9e977
NIFI-10406: Updated Maven assemblies to ensure that we always use at least two of the GAVC parameters for includes and excludes. Updated Maven assembly plugin to version 3.4.2. Removed some includes and excludes from dependencies that previously were not matching and were generating Maven WARNING messages.
This closes #6415

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-15 11:02:08 -05:00
Joe Gresock 51d01f874e
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer (#6341)
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer
2022-09-15 09:15:44 -04:00
Joe Gresock 3987d39cdc
NIFI-9401 Added HashiCorpVaultParameterProvider
- Refactored nifi-vault-utils to nifi-hashicorp-vault-api and nifi-hashcorp-vault modules
- Added HashiCorpVaultClientService and Standard implementation

This closes #6304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-14 19:46:09 -05:00
Peter Turcsanyi 5303aadda3
NIFI-10500: Improved property ordering in MQTT processors
Signed-off-by: Arpad Boda <aboda@apache.org>
2022-09-14 21:13:01 +02:00
Robert Kalmar 4b0568e6fe
NIFI-10242 Create QueryAirtableTable processor
This closes #6350.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-14 20:31:34 +02:00
UcanInfosec a9013a61ec
NIFI-10494 Upgrade Camel-Salesforce to 3.14.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6413.
2022-09-14 16:48:16 +02:00
exceptionfactory 04c0df1723
NIFI-10471 Documented and applied standard deprecation logging
- Updated Admin Guide with section on Logging Configuration and Deprecation Logging
- Updated Developer Guide with section on Deprecating Components and Features
- Added Deprecation Logging when adding components marked with DeprecationNotice to the Flow Configuration
- Added Deprecation Logging on deprecated methods in standard Controller Service implementations
- Removed integration tests for deprecated PersistentProvenanceRepository
- Updated logging and added documentation on minor upgrade steps
- Updated logging for HDFSNarProvider and RocksDB Repository

This closes #6390
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-13 19:40:03 -04:00
Csaba Bejan e26aa233d7 NIFI-10458 Add support for the DESCRIBE/MANIFEST Operation
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #6375
2022-09-13 19:22:35 +02:00
UcanInfosec 5fbd3ac7a9
NIFI-10490 Upgrade influxdb-java to 2.23
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6410.
2022-09-13 15:08:21 +02:00
exceptionfactory ae14ef2d1f
NIFI-10373 Set managed version for AWS 1 and 2 SDK
- Replaced individual AWS SDK versions with root managed dependency version
- Set AWS SDK 1 version to 1.12.299
- Set AWS SDK 2 version to 2.17.270
- Suppressed false positive dependency vulnerability for aws-sdk-swf-libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6405.
2022-09-13 15:06:42 +02:00
exceptionfactory a91928e0e3
NIFI-10489 Upgraded zip4j from 2.10.0 to 2.11.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6409.
2022-09-13 15:03:54 +02:00
mr1716 d351f92104
NIFI-10486 Upgraded greenmail from 1.5.11 to 1.6.10
This closes #6406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-12 15:21:21 -05:00
exceptionfactory 158c5417bc
NIFI-9500 Added nifi.cmd for Windows; Switched to NiFi Home directory to run command actions
This closes #6370
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-12 14:13:02 -04:00
Peter Turcsanyi eaaff4ede9 NIFI-10364: Simplified connection/session handling in SmbjClientService
This closes #6307.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-12 16:06:22 +02:00
exceptionfactory dfa18b848f
NIFI-10477 Upgraded Apache Calcite from 1.31 to 1.32
This closes #6396

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-11 07:55:07 -04:00
mr1716 ccebf2b271
NIFI-10466 Updated questdb to 6.5.2-jdk8
This closes #6384

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:23:56 -04:00
exceptionfactory 1370295bd3
NIFI-10470 Upgraded SSHJ from 0.33.0 to 0.34.0
This closes #6387

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:19:22 -04:00
exceptionfactory 5b3601f50f
NIFI-10472 Upgraded SnakeYAML from 1.29 to 1.31
- Replaced module overrides with root managed dependency version

This closes #6389

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-09 20:38:01 -04:00
Joe Gresock de7793e69b
NIFI-9003 Added framework support for Parameter Providers
- Added Environment Variable and File Parameter Provider implementations
- Added Parameter Provider commands to CLI
- Added component search handling for Parameter Providers
- Added documentation for integrating Parameter Providers

This closes #5369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 13:04:56 -05:00
Peter Turcsanyi e81466d4f3
NIFI-10465: Fixed error message for invalid Controller Service type
This closes #6381

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:16:06 -05:00
Bence Simon a4a3bdbc98
NIFI-10451 Updated QuestDB Status History Rollover to work with version 6
This closes #6374

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:08:07 -05:00
UcanInfosec aca93ed3ce
NIFI-10464 Upgraded json-flattener from 0.13.0 to 0.14.0
This closes #6380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:03:31 -05:00
krisztina-zsihovszki b1b3a7057c
NIFI-10380 Added ListDropbox and DropboxCredentialService
This closes #6331

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 09:59:34 -05:00
Nandor Soma Abonyi eb68ffad70
NIFI-10411 Add record processing feature to PublishMQTT processor
This closes #6373.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-09 09:51:13 +02:00
mr1716 b12510e54a
NIFI-10443 Upgraded oauth2-oidc-sdk from 9.10 to 9.43
- Upgraded nimbus-jose-jwt to 9.11.2 to 9.24.3

This closes #6366

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 17:54:39 -05:00
Mark Payne a0c705715b
NIFI-10429: Added the ability to Replay latest provenance event for a given Processor.
This closes #6359

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 15:55:26 -05:00
ravinarayansingh 97b8f0e205
NIFI-10435 Masked sensitive arguments in ExecuteStreamCommand
This closes #6367

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-07 21:33:57 -05:00
Gabor Kulik 5b565679df NIFI-10230 added FetchSmb
This closes #6279.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-06 18:58:55 +02:00
krisztina-zsihovszki 822c4d473a NIFI-10404 TailFile processor persistent state not cleaned up
This closes #6349.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-06 10:52:38 +02:00
Matthew Hawkins 64acd8b1c5
NIFI-2827 Adding zstd-jni to the necessary pom.xml. It's already in the LICENSE.
NIFI-2827 Update CompressContent.java to use zstd compression format
NIFI-2827 Update test cases for CompressContent.java to include zstd format
NIFI-2827 Update JsonRecordSetWriter.java to enable zstd compression format

This closes #6294

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-04 15:02:41 -04:00
UcanInfosec 6ac7bfe0fa
NIFI-10433 Updated javassist
This closes #6363

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-03 21:03:33 -04:00
mr1716 60a6578a70
NIFI-10393 Update the lucene version
This closes #6333

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-03 18:09:14 -04:00
Mike Thomsen 09faec4866
NIFI-10432 Upgraded jsoup from 1.14.2 to 1.15.3
This closes #6362

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-03 09:23:23 -05:00
UcanInfosec 0a98ca3c09
NIFI-10424 Upgraded spring-integration from 5.5.9 to 5.5.14
This closes #6354

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-02 16:51:29 -05:00
Mark Payne 7a90137cef
NIFI-10431: Improved log messages and Exception messages to indicate which components they pertain to. Also added a toString() for StandardLabel to make it more clear which Label is being referenced
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6361.
2022-09-02 15:56:33 -04:00
exceptionfactory c19d6a0db1 NIFI-10407 Improved reliability of GetSmbFileTest
- Changed TestRunner.run() to avoid clearing internal cache between runs
- Updated Mockito usage with annotations

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6346.
2022-09-01 14:08:07 -04:00
exceptionfactory 6350829676 NIFI-10384 Upgraded Avatica to 1.22.0 for Hive 3
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6323.
2022-09-01 12:43:04 -04:00
UcanInfosec 5280762f58
NIFI-10417 Upgrade neo4j-java-driver to 1.7.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6353.
2022-09-01 12:08:20 +02:00
UcanInfosec a22f0b6bb4
NIFI-10399 Upgraded Jolt from 0.1.1 to 0.1.7
This closes #6339

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-31 15:40:59 -05:00
Nathan Gough 10d1fbe888
NIFI-10378 Added OIDC client secret to encrypted properties
This closes #6352

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 16:14:32 -05:00
Lehel e2d6df5afc
NIFI-10356 Created GetHubSpot processor
This closes #6301

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 15:50:51 -05:00
exceptionfactory 3a6d724b44 NIFI-10408 Added build user method to LdapUserGroupProvider
- Introduced blank user identity checking with improved error reporting for misconfigured mapping
- Simplified LDAP ThreadFactory configuration
- Replaced String.format() with placeholders for debug logging
- Replaced deprecated FormatUtils.getTimeDuration with getPreciseTimeDuration

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6351.
2022-08-30 16:26:58 -04:00
Lehel Boér 28fc030ef5
NIFI-10366: Make Default Run Duration configurable (#6310)
NIFI-10366: Make Default Run Duration configurable
2022-08-30 14:38:56 -04:00
Paul Grey bae659cb9e
NIFI-10409 Improved enrich-processors tests using MockedStatic
This closes #6348

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 11:35:00 -05:00
exceptionfactory 4f87cd770b
NIFI-10410 Added InputRequirement annotation to ExtractGrok
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6345.
2022-08-30 15:46:14 +02:00
Nandor Soma Abonyi 4d4a5ca4be
NIFI-10251 Add v5 protocol support for existing MQTT processors
This closes #6225.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-08-30 10:27:19 +02:00
Tamas Palfy 63905c5fc1
NIFI-10379 - In FetchGoogleDrive removed record-based input processing.
This closes #6327.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-08-29 17:01:34 +02:00
UcanInfosec 3be503668b
NIFI-10347 Upgraded metrics-graphite from 4.1.2 to 4.1.33
This closes #6291

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-26 14:54:54 -05:00
exceptionfactory b777978293 NIFI-10313 Removed Expiration Token on Authentication Errors
- Updated standard user interface error handler to clear the Access-Token-Expiration item from Session Storage when receiving an error with the WWW-Authenticate Header indicating a problem with the Bearer Token

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6334.
2022-08-25 13:12:01 -04:00
Emilio Setiadarma f5fee4dda3
NIFI-10344 Refactored Groovy tests in standard-processor to Java and JUnit 5
This closes #6321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 08:02:15 -05:00
Matthew Burgess d698e7af1a
NIFI-10306: Add logging to StandardProcessGroup.addConnection() with more details
This closes #6264

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 07:50:55 -05:00
Pierre Villard 71ba581fd8
NIFI-10392 - This closes #6330. ResizeImage - add option to maintain aspect ratio
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-08-25 08:34:19 +02:00
exceptionfactory 777238eb32 NIFI-10321 Send Session Expired message for Expired JWT errors
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6332.
2022-08-24 12:40:04 -04:00
mr1716 5303dd13aa
NIFI-10389 Upgrade AWS Kinesis to 1.14.8
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6328.
2022-08-24 11:46:32 +02:00
mr1716 4a2c0beb7f
NIFI-10388 Upgraded xmlunit-matchers from 2.6.3 to 2.9.0
This closes #6326

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-23 15:21:45 -05:00
Matt Burgess 6f0ca87304
NIFI-10387: Fixed negative logic bug in scripted components (#6325) 2022-08-23 13:53:12 -04:00
exceptionfactory 90aa778a6c NIFI-10348 Upgraded Tomcat Embed to 8.5.82 for Flume NAR
- Upgraded tomcat-embed-core from 8.5.46 to 8.5.82 for Flume components

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6292.
2022-08-23 12:39:08 -04:00
exceptionfactory fa85a05a2b
NIFI-9374 Added Deprecation Logger
- Added nifi-deprecation-log module with interface and implementation using SLF4J
- Updated standard logback.xml with nifi-deprecation.log appender
- Updated NiFiLegacyCipherProvider with deprecation logging
- Set Size, Time Policy, and Total Size Limit for Deprecation Log

This closes #6300
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-23 11:25:03 -04:00
exceptionfactory ca991a6805
NIFI-10382 Upgraded Flume dependencies from 1.10.0 to 1.10.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6320.
2022-08-23 17:15:10 +02:00
Mark Payne 9070cd0904
NIFI-10383: When importing/synching to a VersionedFlow, if the Versioned PropertyDescriptor indicates that a property references a Controller Service, treat it the same as if the PropertyDescriptor itself indicates that it references a service. This allows us to ensure that scripted components' property descriptors that reference controller services are properly mapped. Additionally updated StandardProcessorNode so that when we have this condition that we properly account for the Controller Service reference
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6322
2022-08-23 09:59:07 -04:00
Mark Payne cb275dd956
NIFI-10385: If script body is empty for AbstractScriptedControllerService or InvokeScriptedProcessor, do not attempt to load script
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6324
2022-08-22 22:34:29 -04:00
exceptionfactory 0a065538e2 NIFI-10368 Upgraded jQuery UI from 1.12.1 to 1.13.2
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6312.
2022-08-22 14:14:15 -04:00
mr1716 4b9f92f167
NIFI-10374 Upgraded Caffeine to 2.8.1 in nifi-asn1-services
This closes #6316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-22 08:11:34 -05:00
Mark Payne b012e9aad2
NIFI-10371: When a component is moved between groups, ensure that its versioned component id is unique within the destination group. Also ensure that when adding a connection to a PG with the VersionedComponentSynchronizer that we prefer obtaining source/destination by instance id instead of versioned id.
Fixed bug where ProcessGroup would inadvertently set the wrong component's Versioned Component ID to null when there was an ID conflict

This closes #6314

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-22 08:07:27 -05:00
Timea Barna 22e8901fce NIFI-8248 Modified PutAzureDataLakeStorage processor to use temp file instead of inline replacement
This closes #6159

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2022-08-19 17:10:32 +00:00
mr1716 1dd2bbb866
NIFI-10372 Upgrade Spring-Data-Redis to 2.7.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6315.
2022-08-19 12:18:25 +02:00
mr1716 bcc73a700d
NIFI-10367 Removed unused org.jeasy:easy-rules-mvel from rules-action-handler
This closes #6311

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-18 10:04:35 -05:00
Hsin-Ying Lee 2685856c62
NIFI-10052 Avoid obtaining any locks when creating/sending heartbeats (#6298) 2022-08-17 14:05:55 -04:00
exceptionfactory 5df6efa0f2
NIFI-10358 Updated CaptureChangeMySQL to use SSL JDBC properties
- Added Connection Properties Provider with implementation to translate SSL Mode and SSL Context Service configuration to MySQL Connector properties

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6306
2022-08-17 12:15:04 -04:00
Mark Payne 21503f6353
NIFI-10362: When asynchronous node disconnect is issued, do not send disconnect to node if the node becomes reconnected in the interim. Also, addressed the issue in which a disconnected node acts on a replicated request during the first phase by detect that it's the first phase if configured for cluster, not when only when connected to a cluster.
This closes #6308

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-17 11:09:47 -05:00
mr1716 99a0c05070
NIFI-10361 Upgraded commons-jexl3 from 3.1 to 3.2.1
This closes #6305

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-17 09:20:06 -05:00
exceptionfactory a89873f437
NIFI-9518 Upgraded mysql-binlog-connector-java from 0.20.1 to 0.26.1
- Changed from com.github.shyiko to com.zendesk dependency group for current library version

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6302.
2022-08-17 10:51:35 +02:00
Malthe Borch 1b4d66a726
NIFI-10343 Add error code to exception message
The error object may not have a description, but should have a code.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6288.
2022-08-16 09:49:58 +02:00
royalfork2 eb419b6e40
NIFI-10300 Added AzureEventHubRecordSink
This closes #6296

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-15 15:57:08 -05:00
Matt Burgess 0d0a119737
NIFI-1954: Add additionalDetails page to ExecuteScript (#6044)
* NIFI-1954: Add additionalDetails page to ExecuteScript

* NIFI-1954: Incorporated review comments
2022-08-15 11:44:30 -04:00
exceptionfactory 864036674e
NIFI-10244 Added nifi-web-client-api and implementation
- Added nifi-web-client implementation based on OkHttp
- Added WebClientServiceProvider Controller Service interface and implementation
- Corrected comments and added unmodifiableMap wrapper
- Added getHeaderNames() and corrected ProxyContext comments

This closes #6268
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-11 17:25:18 -04:00
UcanInfosec a3a7b2fcfd
NIFI-10334 Upgraded amqp-client from 5.8.0 to 5.15.0
This closes #6280

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-10 12:06:15 -05:00
Pierre Villard e7dc14a4e0
NIFI-10339 - Fix typo in QuerySalesforceObject
This closes #6286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-10 10:37:25 -05:00
exceptionfactory 8605d0a29f
NIFI-10336 Removed unnecessary lineage check from TestMonitorActivity
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6285.
2022-08-10 15:34:44 +02:00
exceptionfactory 24cea2a93b
NIFI-10183 Upgraded swagger-annotations to 1.6.6
- Added managed dependency in root Maven configuration
- Removed different versions from other Maven configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6284.
2022-08-10 15:32:30 +02:00
exceptionfactory 77033ec11a NIFI-10322 Corrected Cookie path when removing Bearer Token
- Appended root path to Cookie path attribute when removing Bearer Tokens as part of unauthorized response handling
- Updated Saml2AuthenticationSuccessHandler to follow standard Cookie path building strategy

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6278.
2022-08-09 16:09:41 -04:00
UcanInfosec 3341e789f0
NIFI-10329 Upgrade jasn1-compiler to 1.11.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6277.
2022-08-09 15:27:38 +02:00
Pierre Villard 0dc751981c
NIFI-10291 Updated Snowflake Driver from 3.13.14 to 3.13.21
This closes #6252

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:58:31 -05:00
UcanInfosec 415413fac2
NIFI-10327 Upgraded Apache Ivy from 2.4.0 to 2.5.0
This closes #6275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:44:12 -05:00
Emilio Setiadarma 5b9f096143
NIFI-10307 Refactored nifi-standard-processors tests to use JUnit 5
This closes #6272

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:35:19 -05:00
Timea Barna 26829e5c35 NIFI-10256 CSVRecordReader using RFC 4180 CSV format trimming starting and ending double quotes
NIFI-10256 Addresseng review comments, adding extra description, removing unneccessary static import, creating extra constructor

NIFI-10256 Refactoring CSVRecordReader

NIFI-10256 Addresseng review comments, adding validator

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6234
2022-08-08 17:13:48 +02:00
exceptionfactory fdf3925f81
NIFI-3964 Updated Grok Patterns to support TEXT and URL Resources
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6260.
2022-08-08 14:48:21 +02:00
UcanInfosec 0fd262efca NIFI-10319 - Update pom.xml
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6270.
2022-08-05 16:42:06 -04:00
Daniel Urban 387ae7d323
NIFI-10199: PublishKafka InFlightMessageTracker should not log batch level errors on each record
Currently, when a batch level error occurs (e.g. delivery timeout), the same error is logged for each record of the batch, needlessly flooding the logs.
InFlightMessageTracker now only logs an exception when a flow file encounters it for the first time.

This closes #6185
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-05 14:12:43 -04:00
Gabor Kulik 768f58da21 NIFI-10212 added ListSmb processor and SmbConnectionPoolService
This closes #6192.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-08-05 18:46:04 +02:00
exceptionfactory 5cc2790891
NIFI-10302 Streamlined TestMonitorActivity to improve reliability
- Removed TestRunner.run() loops
- Reduced usage of Thread.sleep()
- Upgraded TestMonitorActivity to JUnit 5

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6261.
2022-08-05 10:44:26 -04:00
exceptionfactory 2d73fd5631
NIFI-10318 Corrected HandleHttpRequest TLS client authentication
- Corrected setting of wantClientAuth instead of needClientAuth based on Client Authentication configuration

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6271.
2022-08-04 14:18:10 -04:00
Emilio Setiadarma df2c187761
NIFI-10298 Changed nifi-framework-cluster tests to use Java and JUnit 5
This closes #6262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-04 10:31:17 -05:00
Emilio Setiadarma b260c10ad4
NIFI-10293 Refactored tests in nifi-jolt-transform-json-ui to use JUnit 5
This closes #6258

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-01 10:49:27 -05:00
Joe Witt ded48269fe
Merge branch 'NIFI-10272-RC2' 2022-08-01 06:10:25 -07:00
Emilio Setiadarma 296f308cdc
NIFI-10048 Corrected StandardFlowDifference.hashCode() to avoid NPE
- Added tests to TestFlowController for JSON flow configuration

This closes #6227

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 13:44:26 -05:00
Emilio Setiadarma 67c463627c
NIFI-10292 Refactor nifi-framework-authorization-providers tests with Java and JUnit 5
This closes #6257

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 10:48:11 -05:00
exceptionfactory 4e49a55e93
NIFI-10295 Upgraded GRPC from 1.34.0 to 1.48.0
- Upgraded Protobuf from 3.14.0 to 3.21.4
- Removed netty-tcnative-boringssl-static as not necessary following NIFI-9897

This closes #6255.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-07-28 18:47:37 -04:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Nathan Gough c77f85aafb
NIFI-10070 Updated status merging for ControllerService and ReportingTask entities
- Corrected node identifier selection in multiple Mergers

This closes #6154

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-27 14:48:02 -05:00
Tamas Palfy 2fae3bb9a8
NIFI-10281 - Added FetchGoogleDrive processor. Consolidated record- and attribute output for ListGoogleDrive. (Record fields and flowfile attributes are now the same.)
This closes #6248.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-07-27 18:59:06 +02:00
exceptionfactory afa85a03ce
NIFI-10286 This closes #6251. Removed c2-client-api references from nifi-nar-utils
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-27 08:01:24 -07:00
exceptionfactory 9bb22fcb11
NIFI-10284 Corrected HTTP Request Authenticated User logging
- Moved RequestAuthenticationFilter before HeaderWriterFilter

This closes #6250
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-27 10:26:43 -04:00
exceptionfactory 02e37713b3
NIFI-10277 This closes #6245. Refactored ConnectionLoadBalanceServerTest
NIFI-10277 Changed failure test to throw SocketException
NIFI-10277 Increased timeout to 30 seconds and moved verify method

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 15:10:27 -07:00
emiliosetiadarma c6999ba9d8
NIFI-10278 - This closes #6247. repeat onTrigger of ConsumeTwitter until a FlowFile is received or timeout after 60 seconds
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 14:45:54 -07:00
Mark Payne 8a1249ee39
NIFI-10279: This closes #6246. Increased timeout in TestExecuteStateless, removed explicit timeouts on stateless system tests that were too aggressive so that the tests use the default 5 minute timeout defined in StatelessSystemIT
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 14:33:48 -07:00
Mark Payne 92750c2746
NIFI-10261: Ensure that when comparing Sensitive Parameters during flow sync we decrypt values for the comparison
This closes #6231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:52:46 -05:00
Mark Payne 0497907829
NIFI-10262: Ensure that when an Exception is thrown from a Controller Service's @OnEnabled method that we properly handle that Exception and continue enabling the other services in the given collection of services
This closes #6236

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:02:21 -05:00
exceptionfactory 7767a5b85d
NIFI-10265 Route to Failure on Connect Exceptions in PutDatabaseRecord
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6235
2022-07-25 09:36:54 -04:00
Eduardo Fontes c61efecbdc
NIFI-10252: Use correct field(s) for PutDatabaseRecord update keys
Not always UpdateKey comes in first position

Better readability

Include testUpdatePkNotFirst

Including usefull SQL log debug

Fix semicolon

NIFI-10252: Additional unit test for specified update keys
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6226
2022-07-25 08:48:06 -04:00
exceptionfactory 7244b9cfc4
NIFI-10271 This closes #6242. Upgraded Xerces from 2.12.1 to 2.12.2
- Suppressed false positive vulnerability report for CVE-2017-10355

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:59:33 -07:00
exceptionfactory 7d920b9bc6
NIFI-10270 This closes #6240. Upgraded AWS SDK from 1.12.182 to 1.12.267
- Upgraded MiNiFi AWS SDK references from 1.11.172 to 1.12.267

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:59:04 -07:00
patalwell 0cd438d9e9
NIFI-9817 Added Unit Validator to PutCloudWatchMetric
This closes #5905

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-23 10:18:27 -05:00
Nathan Gough 40d7d88bc0
NIFI-10232 Set write and idle timeouts in DistributedCacheClient
- Added OnShutdown annotation to Cache Server and Cache Client Service methods

This closes #6221

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 19:49:22 -05:00
exceptionfactory a661b035e8 NIFI-10259 Improved HTTP error handling for authentication failures
- Added Standard AuthenticationEntryPoint
- Configured AuthenticationEntryPoint for SecurityFilterChain and BearerTokenAuthenticationFilter

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6233.
2022-07-22 17:33:51 -04:00
Mark Payne d7ed66032e
NIFI-10050: When copying a process group and 1 CS references a higher-level CS, ensure that we don't drop that reference
This closes #6077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 16:25:58 -05:00
Mark Payne bc4e3e850b
NIFI-10246: When syncing Controller Services, wait until any DISABLING Controller Service has fully disabled before attempting to synchronize them. Also performed some minor refactoring/cleanup for System Tests in order to make writing a system test for this simpler
This closes #6219

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 13:31:06 -05:00
NissimShiman 74b25c7306
NIFI-10154 ReplaceText AdminYielding on long line (#6151)
* NIFI-10154 ReplaceText AdminYielding on long line

* NIFI-10154 code review changes

Signed-off-by: Otto Fowler <otto@apache.org>
2022-07-22 11:14:23 -04:00
Nandor Soma Abonyi 302bdbfb11
NIFI-10260 Changed display name and description of Validate DTD properties
- Set Allow DTD as display name in EvaluateXPath and EvaluateXQuery

This closes #6230

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-21 13:28:36 -05:00
Arpad Boda eab687ee50
NIFI-10255 Updated original relationship description on ExecuteStreamCommand
- Description of original relationship of ExecuteStreamCommand processor might be misleading

This closes #6229

Signed-off-by: David Handermann <exceptinofactory@apache.org>
2022-07-21 09:41:53 -05:00
Tamas Palfy ad781170e3
NIFI-10223 Created ListGoogleDrive processor.
This closes #6200.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-07-20 13:38:47 +02:00
Kevin Doran ccf3866261
NIFI-9812 Disabled Native Lib loading tests on ARM64
- Migrate tests in nifi-framework-mark-loading-utils to JUnit5
- Annotate tests that use x86_64 native binaries to be conditional on x86_64 os.arch

This closes #6215

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 11:38:26 -05:00
Kevin Doran 1a1037022f
NIFI-9813 Excluded Ranger modules on ARM64
This closes #6216

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 08:03:16 -05:00
Kevin Doran 97e7a3c030
NIFI-9809 Disabled Kudu tests on ARM64
This closes #6214

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 07:56:26 -05:00
Paul Grey 148834e71b
NIFI-10247 Corrected REST API documentation for empty-all-connection-requests
This closes #6220

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 07:51:32 -05:00
Lehel f8844440f5 NIFI-10019: SendTrapSNMP works without flowfile, upgraded to junit5
This closes #6046.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-18 16:15:15 +02:00
Pierre Villard 4d219689f1
NIFI-10193 Added SupportsSensitiveDynamicProperties to ExecuteStateless
This closes #6177

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-18 09:08:27 -05:00
Peter Turcsanyi 14a31c81dd
NIFI-10239 Upgraded Curator from 4.2.0 to 5.3.0 for Hive3
- Corrected NoSuchMethodError for ZooKeeper discovery mode with Hive3 JDBC and mismatch between Hadoop 3.3.3 and Curator 4.2.0

This closes #6210

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 12:43:05 -05:00
Emilio Setiadarma cb0753b03c
NIFI-9758 Added Dynamic Properties to PutEmail
This closes #6204

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 10:58:31 -05:00
exceptionfactory 047b3611bf NIFI-10233 Corrected Anonymous Authentication for HTTP Access
- Enabled Standard Anonymous Authentication Filter when unencrypted HTTP is enabled

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6209.
2022-07-14 23:27:54 -04:00
Matt Burgess d0db4c44bb
NIFI-10231: Change AbstractScriptedControllerService.OnConfigurationRestored to use ConfigurationContext (#6207) 2022-07-14 11:49:00 -04:00
exceptionfactory a9b5bebb15 NIFI-10216 Refactored NiFi Web API Security Configuration
- Removed extension of deprecated WebSecurityConfigurerAdapter
- Moved Filter bean configuration associated configuration classes
- Set default Spring Security log level to INFO
- Adjusted CSRF Token Repository to leverage simplified RequestUriBuilder for retrieving allowed context paths

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6195
2022-07-13 19:11:03 -04:00
exceptionfactory 0dea0ae364
NIFI-10196 Corrected Jolt UI CSRF Header Handling
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6198
2022-07-13 15:25:16 -04:00
Mark Payne 4c0555a476
NIFI-10203: Ensure that when a FlowFile is transferred and is not retried that we remove the retryCount.<uuid> attribute
This closes #6201
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 19:01:41 -04:00
exceptionfactory 51626d728b
NIFI-10215 This closes #6194. Upgraded Curator from 5.2.1 to 5.3.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-12 09:51:26 -07:00
Mark Payne 996d8faaf4
NIFI-10203: Fixed bug in which same FlowFile Builder was used repeatedly for multiple FlowFiles; this caused mingling of their attributes when a FlowFile is routed to a relationship that has more than 1 destination (i.e., many connections with the same Relationship)
This closes #6187
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 09:52:49 -04:00
Paul Grey 274e4feeaa
NIFI-10143 Adjusted UTF-8 auto-detection in FTP Processors
This closes #6172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 20:00:40 -05:00
Otto Fowler cf4eed0224 NIFI-10207: ensure allowableValues matches SUPPORTED_STATE in ProcessorRunStatusEntity
This closes #6188.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-11 21:34:27 +02:00
UcanInfosec 06db7968fa
NIFI-10201 Upgraded Prometheus simpleclient from 0.3.0 to 0.16.0
This closes #6180

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 12:57:27 -05:00
mr1716 291bd40013
NIFI-10195 Upgraded Testcontainers to 1.17.3
This closes #6179

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:37:39 -05:00
dependabot[bot] 3a31dff76b
NIFI-10214 Upgraded commons-configuration2 from 2.7 to 2.8.0
This closes #6181
This closes #6182
This closes #6183

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:27:17 -05:00
Peter Turcsanyi 1685204cc1
NIFI-10206: Restored flushBuffer() call in HandleHttpResponse to avoid HTTP 404
This closes #6186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-08 16:51:20 -05:00
Lehel 46bb7d153d NIFI-9558: ConnectWebSocket leaks connections and duplicates FlowFiles in incoming connection mode (new PR)
This closes #6176.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-06 10:30:47 +02:00
Lehel 328d38facb NIFI-10194: Simplified SendTrapSNMP error handling
This closes #6178.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-05 16:55:57 +02:00
Lehel 685088a59c NIFI-9916: ListenTrapSNMP USM parsing refactor.
This closes #6034.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-04 16:43:20 +02:00
Ferenc Erdei d78c667c19
NIFI-10166 Improved MiNiFi bootstrap test coverage
This closes #6160

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-01 14:45:31 -05:00
exceptionfactory ea0e1b446e
NIFI-10187 Upgraded FtpServer from 1.1.1 to 1.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6171.
2022-07-01 14:24:21 +02:00
Paul Grey 26a10d772f
NIFI-10186 Corrected PutFTP Remote Path Property EL
This closes #6173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 19:12:28 -05:00
exceptionfactory 1f18345929
NIFI-10163 Corrected StandardProcessSessionTest after NIFI-10167 2022-06-30 19:10:57 -05:00
exceptionfactory 943197c18b NIFI-10163
- Corrected StandardProcessSession.exportTo() byte counting
- Removed bytesWritten incrementing from exportTo methods

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6153.
2022-06-30 18:42:44 -04:00
Matthew Burgess 7eec507118
NIFI-10181: Upgrade Groovy to 3.0.9
This closes #6170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:47:00 -05:00
Kevin Doran 9cf5c170b1
NIFI-9810 Deprecated RocksDB repository and moved to NAR
- Bump version to 6.29.5 for arm64 compatibility
- Extract RocksDBFlowFileRepository and supporting code to its own module
- Mark RocksDBFlowFileRepository as deprecated, both in code and documentation
- Log deprecation warning at startup if RocksDBFlowFileRepository is used
- Move native RocksDB info logs to NiFi debug level logs

This closes #6155

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:23:10 -05:00
Mark Payne 5e83bda9e9
NIFI-10167: Added advanced timing metrics for processors, such as CPU Usage, time reading/writing content repo, process session commit time, etc. Exposed via nifi.sh diagnostics and made configurable via nifi.properties
This closes #6156

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 10:50:24 -05:00
timeabarna d5b626f0e4
NIFI-10108 Processor scheduling via parameter (#6115)
- NIFI-10108 Processor scheduling via parameter
- Refactoring component referencing check in AbstractComponentNode and StandardParameterReferenceManager classes.
2022-06-30 10:11:13 -04:00
exceptionfactory 0458b6432d NIFI-10158 Corrected ListFTP expression support for Hostname and Port
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6162.
2022-06-29 22:11:11 -04:00
exceptionfactory 7a47c8cfbd
NIFI-10162 Reorganized InvokeHTTP Properties
- Corrected handling of documentation for allowable values

NIFI-10162 Updated Multipart Form-Data Name description

This closes #6163.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-29 16:52:19 -04:00
exceptionfactory 6997f17bff
NIFI-10180 This closes #6168. Removed standard Maven repository definitions
- Upgraded Apache parent from 25 to 26
- Upgraded Apache Rat Plugin from 0.13 to 0.14
- Upgraded Maven Compiler Plugin from 3.9.0 to 3.10.1
- Removed Confluent repository from Confluent Registry Service module
- Removed MapR repository profile configuration
- Removed Hortonworks repository profile configuration

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:47 -07:00
exceptionfactory ee3dcc78bf
NIFI-10173 This closes #6164. Upgraded Flume from 1.6.0 to 1.10.0
- Removed unmaintained flume-dataset-sink and flume-ng-elasticsearch-sink dependencies
- Added dependency-check suppression configuration for false positives on Flume libraries

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:09 -07:00
Mark Payne 39c366eeef
NIFI-10169: When using the Insert Record Fields join strategy of JoinEnrichment, ensure that in order to combine schemas from the original record and the enrichment record we use incorporateSchema() so that even when the first enrichment record is null, we get the schema correct
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6157.
2022-06-29 17:28:15 +02:00
Emilio Setiadarma a098653d07
NIFI-10165 Increased NiFi bootstrap heap size to 48 MB
- Increased bootstrap heap size from 24 MB to 48 to avoid heap constraints when using HTTP notifications

This closes #6161

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 14:56:55 -05:00
exceptionfactory 0de83292de NIFI-9849 Refactored SAML Support with Spring Security 5
- Updated SAML Authentication Configuration with Spring Security SAML 2 components
- Updated Administration Guide with REST Resources
- Replaced SAMLAccessResource methods with applicable Spring Security Filters
- Removed IDP Credential Service and supporting components
- Removed message.logging.enabled, metadata.signing.enabled, and signature.digest.algorithm properties
- Added Access Token Expiration resource method
- Removed Saml2AccessResource and replaced with Access Token Expiration to avoid unnecessary conflicts with SAML login consumer
- Corrected Resource URI handling to support proxy server access

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6149.
2022-06-28 13:57:35 -04:00
Csaba Bejan 1465c2c629
NIFI-9908 C2 refactor and test coverage improvements
This closes #6149

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 12:02:31 -05:00
Nissim Shiman db11961026
NIFI-9440 Allow Controller Services to have configurable Bulletins
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6035
2022-06-28 10:44:45 -04:00
exceptionfactory b3b13a4ee0
NIFI-10145 Upgraded Hadoop from 3.3.2 to 3.3.3
- Excluded slf4j-reload4j implementation of Log4j 1
- Updated nifi-hive3-processors to leverage shared Hadoop version from 3.1.1
- Updated nifi-accumulo-bundle to leverage shared Hadoop version from 3.1.1
- Updated nifi-atlas-bundle to leverage shared Hadoop version from 3.3.2
- Updated nifi-spark-receiver to leverage shared Hadoop version from 3.3.2

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6139.
2022-06-28 16:19:38 +02:00
exceptionfactory c1c1d0da82
NIFI-10153 Refactored DocGeneratorTest and removed binary test files
This closes #6146

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-27 22:05:53 -04:00
Matthew Burgess 9d379121c4 NIFI-5005: Fix MergeRecord to honor writer's schema
This closes #6141.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-27 21:53:20 +02:00
exceptionfactory d8ebfb25d0
NIFI-10161 Added Gzip Content-Encoding to InvokeHTTP and ListenHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6150.
2022-06-26 22:23:32 +02:00
Tamas Palfy b6a32a9c5d
NIFI-10025 Removed in-project copy of com.hortonworks.registries.schemaregistry.client.SchemaRegistryClient, relying on original instead. Added basic auth support for HortonworksSchemaRegistry.
This closes #6055.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-06-24 22:22:35 +02:00
Mark Payne 1442dcef23
NIFI-10111: Added option to unpack NARs into an Uber Jar and updated stateless nifi to always use this.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6117
2022-06-24 13:12:14 -04:00
Mike Thomsen a3e8048b2d
NIFI-9981 Added support for Avro UUID types
This closes #6013

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-23 08:35:31 -05:00
Joe Gresock 3dda694fd6
NIFI-10139: Adding fields to RemoteProcessGroupStatus (#6137) 2022-06-22 12:24:23 -04:00
Tamas Palfy edd862bf55
NIFI-10013 For JASN1RecordReader added unit test for checking multi-record input.
This closes #6091.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-06-22 18:19:52 +02:00
Juldrixx bc84532a8b
NIFI-9983 Add output relation name attribute in QueryRecord processor (#6011)
* NIFI-9983 Add output relation name attribute
2022-06-21 17:55:07 -04:00
greyp9 f9beb507fd
NIFI-9996 - ListFile does not list root directory when Recurse Subdirectories is active and Path Filter is specified (#6110) 2022-06-21 17:23:49 -04:00
tpalfy c08996515b
NIFI-10106 Avoid NPE in LookupRecord.createLookupCoordinates (#6111) 2022-06-21 17:03:44 -04:00
exceptionfactory 5febd47c72
NIFI-10109 Changed HashMap to LinkedHashMap in JsonTreeRowRecordReader (#6112)
- Added unit test to confirm preservation of field ordering
2022-06-21 17:00:34 -04:00
exceptionfactory 47121614a2
NIFI-10146 Upgraded Apache Tika from 2.4.0 to 2.4.1
- Removed direct dependency on metadata-extractor to inherit newer transitive version

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6140.
2022-06-21 22:58:40 +02:00
Mark Payne ac8c1b0326
NIFI-10148: Fixed bug in SwappablePriorityQueue, in which the Active Queue Size could be decremented before the Unacknowledged Queue Size is incremented when FlowFiles are polled. This can result in the SwappablePrioriotyQueue incorrectly returning a value of true from the isEmpty() method. Additionally, updated the NiFiSystemIT so that if waiting for a particular queue size we periodically log size of all queues, which aids in debugging, and added necessary methods to FlowClient to make that happen.
This closes #6143

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-21 15:55:47 -05:00
Matt Burgess b60b9b8e29
NIFI-10141: Fix WriteJsonResult logging to show writer's schema (#6142)
* NIFI-10141: Fix WriteJsonResult logging to show writer's schema
2022-06-21 16:53:30 -04:00
Bryan Bende 1de9c72779
NIFI-10140 Handle deleted parameters in StandardVersionedComponentSynchronizer
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6138.
2022-06-21 10:43:38 -04:00
exceptionfactory eef4ea1fc6
NIFI-10138 Updated Atlas tests to use Jackson 2
- Replaced Jackson 1 dependencies with Jackson 2
- Removed commons-beanutils override that is no longer necessary with new Hadoop version

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6136.
2022-06-18 09:46:23 +02:00
exceptionfactory 4aee4546b9
NIFI-10135 Upgraded maven-surefire-plugin to 3.0.0-M7
- Removed duplicate plugin configuration in nifi-registry
- Removed maven-failsafe-plugin override in nifi-elasticsearch-client-service
- Removed failing test ResourceAuthorizationFilterSpec in nifi-registry-web-api

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6132.
2022-06-18 09:43:46 +02:00
Joe Gresock 5e01d3de06
NIFI-10117: Allowing remote group ports to be synchronized from Stand… (#6128)
NIFI-10117: Allowing remote group ports to be synchronized from StandardVersionedComponentSynchronizer
2022-06-17 14:28:14 -04:00
Matthew Burgess d89f98f5b4
NIFI-9666 Implemented MiNiFi C2 client and refactored bootstrap
- Implemented MiNiFi C2 client using OkHttp
- Refactored MiNiFi bootstrap command handling and socket communication
- Added C2 Client Service to nifi-framework-core

This closes #6075

Co-authored-by: Matthew Burgess <mattyb149@apache.org>
Co-authored-by: Csaba Bejan <bejan.csaba@gmail.com>
Co-authored-by: Ferenc Erdei <ferdei@cloudera.com>

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-17 09:23:52 -05:00
exceptionfactory bd45eb4995 NIFI-10100 Upgraded Jersey to 2.35
- Replaced individual version references with Jersey BOM dependency

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6106.
2022-06-16 23:09:22 -04:00
Emilio Setiadarma 2161d0fe9c
NIFI-10104 Refactored usage of PropertyEncryptor
This closes #6119

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-16 16:38:34 -05:00
exceptionfactory 07bbcb771e
NIFI-10087 Implemented UDPEventRecordSink
This closes #6099
Signed-off-by: Paul Grey <greyp@apache.org>
2022-06-15 17:58:17 -04:00
Mark Bean 0f5d8517b5
NIFI-5378 Prevent duplicate keys with different values in nifi.properties
This closes #6061

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 11:06:35 -05:00
exceptionfactory 554f648f00
NIFI-9654 Added Queue Logging to ListenTCP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6116.
2022-06-14 15:47:38 +02:00
exceptionfactory f91d877043
NIFI-10114 This closes #6122. Removed Single Refresh from ShellUserGroupProvider
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-13 14:38:19 -07:00
Mark Payne 00a96d79e0 NIFI-9347: Changed timeout for tests from 5 seconds to 60. It appears that the timeout was previously 50-60 seconds per test and was reduced in NIFI-9141 to 5 seconds, but 5 seconds causes problems in some environments 2022-06-10 10:57:53 -07:00
Nandor Soma Abonyi f99298f98e
NIFI-7535 add detailed error message when .nar file is not readable
This closes #6056
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-06-10 09:40:27 +02:00
exceptionfactory c51f70b6e6
NIFI-10096 Corrected nested inherited Parameter Context loading
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6114.
2022-06-09 21:10:44 -04:00
Lehel d925989811 NIFI-9963: Configure JsonTreeReader whether the schema applies to the Root Node or the Nested Node
This closes #6018.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-09 19:42:16 +02:00
Lehel Boér 2072e4ed2a NIFI-10105: FetchS3Object decodes Content-Disposition
This closes #6109.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-09 14:26:32 +02:00
exceptionfactory 54f1372b78
NIFI-10103 Upgraded Solr from 8.8.2 to 8.11.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6107.
2022-06-08 14:14:02 +01:00
exceptionfactory a5bed1391e
NIFI-10098 Upgraded Apache Tika from 2.3.0 to 2.4.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6104.
2022-06-07 17:53:58 +01:00
exceptionfactory e19efa6658
NIFI-10095 Use Allowable Value Display Name for Default Value when found
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6103.
2022-06-07 14:36:47 +01:00