Commit Graph

6724 Commits

Author SHA1 Message Date
Joe Gresock 77834c92df
NIFI-12263 Upgraded AWS Machine Learning processors to SDK 2
This closes #7953

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:05:22 -05:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 754baf0a37
NIFI-12308: Create Python Environment in background thread instead of during Processor creation
This closes #7971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 15:45:43 -05:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00
exceptionfactory 945d8b54bc
NIFI-12294 Standardized NAR Entry Loading (#7958)
- Consolidated duplicative NAR file entry normalization
2023-11-01 14:10:00 -04:00
Paul Grey 75c661bbbe
NIFI-12194 Added Yield on Exceptions in Kafka Processors
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers

This closes #7955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:08:44 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
Mark Payne 9b33d54f53
NIFI-12301 Corrected hasProperty() check when Migrating Properties
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties

This closes #7964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:41:51 -05:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-31 14:20:50 -05:00
dependabot[bot] 5c98b7cce0
NIFI-12295 Upgraded ActiveMQ Client from 5.18.2 to 5.18.3
This closes #7956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-30 17:34:59 -05:00
exceptionfactory 786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
nathluu 8e301cfdef
NIFI-12265 Fixed OpenPGP Hexadecimal Key Formatting with leading 0
- Replaced Long.toHexString() with String.format() using pattern with leading 0

This closes #7926

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 15:48:18 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-28 09:23:23 -07:00
Mark Bathori b2c4baf429
NIFI-12277 Added SSLContextService to Slack Processors
This closes #7936

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 20:51:50 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Mark Bean 5ecc12f405
NIFI-12285 Added py4j.url build property
The py4j.url property allows the URL for downloading py4j to be specified by a Maven command-line option

This closes #7946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:25:53 -05:00
Matt Burgess 880770f992
NIFI-12273 Fixed command.argument references in ExecuteStreamCommand docs
This closes #7941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:52:26 -05:00
Pierre Villard 1d125e9906
NIFI-11677 Removed non required yield in DeleteHDFS
This closes #7937

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:50:59 -05:00
Pierre Villard 1df9738f8f
NIFI-12281 Fix Go To in Parameter Providers to Provider Context
This closes #7939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 19:39:10 -05:00
Mark Bathori 4fa0299f8b NIFI-12130: Ability to configure snapshot properties via dynamic attributes in PutIceberg
Fix dynamic field expression language handling

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7849
2023-10-26 19:26:24 -04:00
lehelb a3e4f89fe3
NIFI-12271 Fix PutAzureBlobStorage_v12 rollback on failure with FileResourceService
This closes #7930

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 14:52:15 -05:00
Shane Ardell c4ff8de412
NIFI-12260: Remove templates from frontend (#7924)
* remove templates from frontend

* remove more references to removed files

* removing more template references

* remove unused css template styles
2023-10-26 15:16:14 -04:00
exceptionfactory 2eb5b79353
NIFI-12275 Disabled Keepalive in SFTP Tests
This closes #7932

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:28:02 +01:00
Mike Moser 9eb2038585
NIFI-12038 add UseCase documentation to PackageFlowFile
This closes #7896

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 20:00:55 +01:00
exceptionfactory f0593a0034
NIFI-12272 Added Formatter for Certificate Distinguished Names
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods

This closes #7931

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-25 19:54:27 +01:00
exceptionfactory bd4ba34339
NIFI-12266 Added Standard Shared NAR and BOM (#7925)
- Added nifi-standard-shared-nar with common dependencies
- Added nifi-standard-shared-bom with provided scope for parent module references
2023-10-25 13:22:26 -04:00
Mark Payne 19993783e1
NIFI-12203: Ensure that when inheriting cluster flow on startup, we remove any Controller Services, Reporting Tasks, Parameter Contexts, etc. that are not in the proposed flow. Also removed overly aggressive timeout from RunOnceIT and performed minor code cleanup
Resolves #7907

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-24 10:45:58 -05:00
Mark Payne a44b633252
NIFI-12220 Added ability to create Controller Services from migrateProperties
- Added ability to get raw property values from PropertyConfiguration instead of just effective values
- Updated TestRunner to allow for testing these migration methods
- Auto-enable newly created controller services if they are valid
- Eliminated Proxy properties in all AWS processors and instead just make use of the Proxy Configuration controller service
- Eliminated authentication properties from AWS processors and migrated all processors to using Controller Service or authentication

This closes #7874

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-24 09:14:19 -05:00
Mark Payne 1d5f2f626b NIFI-12245: Removed deprecations around flow registry clients
NIFI-12245: Removed null check that is no  longer necessary

NIFI-12245: Fixed checkstyle violation

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #7899
2023-10-24 14:08:03 +02:00
exceptionfactory dc5cd92aa8
NIFI-12264 Upgraded Apache Tika from 2.9.0 to 2.9.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7921.
2023-10-24 11:03:32 +02:00
dan-s1 4b95129f96
NIFI-11197 Added YamlTreeReader
- Adjusted JsonTreeReader implementation for sharing common Jackson components

This closes #7665

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-23 14:37:40 -05:00
dan-s1 7f7e3f0e7a
NIFI-12165 Changed the properties "Custom Transformation Class Name" and "Custom Module Directory" to depend on the "Jolt Transformation DSL" property when its value is "Custom"
This closes #7890

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-23 18:13:20 +01:00
exceptionfactory fc6677153f
NIFI-12259 Upgraded Apache Santuario from 2.3.3 to 2.3.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7916.
2023-10-23 10:28:57 +02:00
exceptionfactory f352857e42
NIFI-12243 Refactored encrypt-config using picocli
- Replaced Groovy implementation with Java classes
- Added StandardEncryptConfig and RegistryEncryptConfig command implementations
- Added FileTransformer interface with implementations for configuration files
- Changed -A to -u for output authorizers.xml when targeting Registry
- Removed --newFlowProvider option not used
- Removed --translateCli option
- Removed --decrypt option

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7901.
2023-10-22 04:54:45 -04:00
annanys23 6daf0abfd4
NIFI-5137 Fixed the path to Controller Service grid item's state
This closes #7833

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-21 20:05:10 -05:00
markobean 63a2503fc3
NIFI-11874 update Process Group configuration layout in the UI (#7591)
* NIFI-11874 update Process Group configuration layout in the UI

* NIFI-11874: relocate checkbox for recursive application of paramenter context

* NIFI-11874 remove comments tab from process group configuration

* NIFI-11874 minor cleanup of float CSS for process-group-parameter-context-combo

This closes #7591
2023-10-21 10:09:29 -04:00
exceptionfactory f9615414bd
NIFI-12258 Upgraded MINA SSHD from 2.10.0 to 2.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7915.
2023-10-20 18:22:07 +02:00
Mark Payne 40ac38dfe3 NIFI-12242: Added ability to route data that exceeds the configured threshold in ControlRate to be routed to 'rate exceeded' instead of just staying in the queue. Added Use Case documentation to ControlRate.
This closes #7895

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-20 15:19:04 +00:00
Bryan Bende fd2de5a151
NIFI-12198 Add API and CLI commands to import reporting task snapshots (#7875)
* NIFI-12198 Add API and CLI commands to import reporting task snapshots
2023-10-20 10:45:48 -04:00
Pierre Villard 184757fede
NIFI-12230 Add configurable Log Level for IP not found in GeoEnrichIP
NIFI-12253 Route to not found relationship instead of rolling back in GeoEnrichIPRecord

This closes #7909

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-20 08:58:07 -05:00
Chris Sampson 6c7d02e22e
NIFI-12254 clarify Bulk operation header documentation for PutElasticsearchRecord and PutElasticsearchJson processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7912.
2023-10-20 12:04:16 +02:00
Matt Gilman 9e5892780a
NIFI-12167:
- Renaming Usage to View Documentation.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7904.
2023-10-20 11:34:29 +02:00
exceptionfactory 15c3bdeac1
NIFI-12252 Removed Legacy FileAuthorizer
- Removed Legacy Authorized Users File property from FileUserGroupProvider
- Removed unused methods from FileAccessPolicyProvider and FileUserGroupProvider

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7910.
2023-10-20 10:31:48 +02:00
Matt Gilman 98eef74dd8
NIFI-12250: (#7908)
- Fixing issue where the registry configuration dialog was being initialized twice.
2023-10-19 15:53:07 -04:00
Mark Payne 015b721800
NIFI-7643 Removed absolute.path attribute from UnpackContent
- Do not include the absolute.path attribute from Zip/Tar files in UnpackContent; some code cleanup

This closes #7902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:51:27 -05:00
Mark Payne 8bfb6be5ba
NIFI-4172: Renamed ClusteSummaryEntity to ClusterSummaryEntity
This closes #7900

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:46:18 -05:00
Matt Gilman 97dfe2d812
NIFI-11909 Cleared Password field after login
- Clearing the password in the login form when login fails or unable to verify access once authentication succeeds.

This closes #11909

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-19 13:40:27 -05:00
Matt Gilman f2822a6bfb
NIFI-12247: (#7905)
- Reverting to the initial value if there is no selected parameter in the combo editor.
2023-10-19 14:25:06 -04:00
Matt Gilman dc76d3896d
NIFI-12248: (#7906)
- Fixing arrow alignment in combo editor.
2023-10-19 13:56:55 -04:00
Chris Sampson aac71c5aa1 NIFI-8135 allow CHOICE data types in conversion of Records to Java Maps
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7746
2023-10-19 13:13:58 -04:00
András Kovács d4014c71ee
NIFI-12099 Repurpose Template icon in top left bar (#7811)
This closes #7811
2023-10-19 12:16:34 -04:00
Pierre Villard 814e94b2ac
NIFI-12244 - UpdateRecord invalid because of migrateProperties (#7898) 2023-10-19 09:34:55 -04:00
Gabor Gyimesi 91e4b453b4
NIFI-12238 Fix SplitText endline trimming with max fragment size (#7892) 2023-10-18 12:40:52 -04:00
exceptionfactory 574c2b2168 NIFI-12234 Upgraded SSHJ from 0.35.0 to 0.37.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7886
2023-10-17 02:10:51 -04:00
Shane Ardell e2bbcac8e1 This closes #7810
NIFI-12088: recalculate hidden property fields when new service is created

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2023-10-16 16:52:45 -04:00
exceptionfactory 20283fd7ec
NIFI-12235 Upgraded Solr from 9.3.0 to 9.4.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7887.
2023-10-16 19:42:13 +02:00
Mark Payne cbdf32ab79
NIFI-12205: Moved loading of Python dependencies into background thread when processor created instead of during startup. Some code cleanup.
This closes #7863

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-14 15:05:17 -05:00
exceptionfactory 61c856a54c
NIFI-12122 Corrected test for Parameter Context updating
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-13 22:55:53 -05:00
Zackeus Bengtsson 0a47157640
NIFI-12122 Fixed persistence of Parameter Context descriptions
Fixed bug where parameter context descriptions were not loaded on NiFi startup and overwritten as empty

This closes: #7787

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-13 18:30:50 -05:00
Mark Payne 3ae0eedee6
NIFI-12124: This closes #7791. Added a new RenameRecordField processor. In testing, also noticed that the Descendant Wildcard operator (//*) and Descendant Field Path Operator (//name, for instance) did not properly account for array of records or map elements, so addressed those concerns.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 14:02:55 -07:00
Mark Payne f4ae292a45
NIFI-12221: This closes #7876. Be more lenient about which Disconnection Codes we allow a node to be reconnected to a cluster vs. when we notify the node to disconnect again. Also updated the timeout for OffloadIT because it occasionally times ou out while running properly.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 13:59:05 -07:00
Mark Payne 0eabbcdf19
NIFI-12228: This closes #7881. Fixed issue with FlowFile Concucrrency that can occasionally bring in more data than it should.
Code cleanup, fixing logback to avoid INFO-level stack trace from xodus

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 13:36:09 -07:00
Bryan Bende 96eb1d825a
NIFI-12222 Protect against missing parameter context when syncing a PG in component synchronizer (#7877) 2023-10-13 13:51:47 -04:00
exceptionfactory 22ad7d542d
NIFI-12206 Refactor Flow History using JetBrains Xodus (#7870)
* NIFI-12206 Refactored Flow History using JetBrains Xodus

- Replaced H2 Database Engine with JetBrains Xodus for persistent storage of FlowConfigurationHistory
- Added EntityStoreAuditService implementation using Xodus PersistentEntityStore
- Removed nifi.h2.url.append from properties
2023-10-12 14:50:25 -04:00
Mark Payne abfc49e212
NIFI-12139: Implemented migrateProperties, migrateRelationships for processors, as well as migrateProperties for ReportingTasks and Controller Services. Added system tests to verify behavior.
- Ensure that after restoring nars in the lib/ directory we restart NiFi so that they take effect. This is important if this test is not the last one to run

This closes #7837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-12 11:40:18 -05:00
exceptionfactory a849ca044c
NIFI-12218 Removed SensitiveValueEncoder and SecureHasher
- SensitiveValueEncoder and SecureHasher are no longer required following the removal of support for flow.xml.gz

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7873.
2023-10-12 17:39:43 +02:00
levilentz 1a0f509ffc
NIFI-12211: This closes #7868. add Validator.VALID to username/password on TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:38:02 -07:00
Chris Sampson 584b3fc165
NIFI-12214 This closes #7869. ConsumeElasticsearch Query Builder properties do not dependOn the Query Definition Style
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:37:40 -07:00
Mike Moser f2927525f3
NIFI-12213 This closes #7871. add nifi-utils dependency to NARs that do not use nifi-standard-services-api-nar as a parent
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:37:19 -07:00
Joe Gresock 9627c4c0e8
NIFI-12174 Upgraded AWS PutLambda Processor to SDK 2
This closes #7851

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 16:41:39 -05:00
Bence Simon 3f13604c36
NIFI-11772 Removed flow.xml.gz support
- Created NIFI-12203 to evaluate issues with flow comparison surfaced in JoinClusterWithDifferentFlow

This closes #7661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 13:53:01 -05:00
Mark Payne 0fd4ec50ad
NIFI-12144: Eliminated deprecation warnings by moving to newer Amazon SDK APIs. Eliminated several abstract classes that provided no value. Code cleanup. Refactored many of the integration tests to make use of Test Containers. Removed some tests that were incorrect
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7854.
2023-10-10 20:32:49 -04:00
Mark Payne ce2a156b9c NIFI-12140: Updated dependency to include nifi-property-utils in nifi-redis-utils module as a result of merging NIFI-12185 2023-10-10 16:08:26 -04:00
timeabarna d2aec89738
NIFI-12166 Add repo usage to the monitoring endpoint (#7836)
* NIFI-12166 Add repo usage to the monitoring endpoint
2023-10-10 14:55:33 -04:00
Bryan Bende 5a42d7245b
NIFI-12140 Add optional properties to RedisConnectionPoolService for Username and Sentinel Username (#7862) 2023-10-10 14:39:41 -04:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852)
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
2023-10-10 13:55:22 -04:00
Chris Sampson c091347795
NIFI-11985: Add ConsumeElasticsearch processor
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7671.
2023-10-10 06:00:52 -04:00
Nandor Soma Abonyi 87b8f230d2
NIFI-11940 Added SSLContextService to GetSplunk
- Included ClassLoader isolation to work around Splunk Service static configuration limitations

This closes #7668

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 15:59:27 -05:00
mkalavala 2b41b07489
NIFI-6240 Added Proxy Support for WebSocket Transport in Azure EventHubs
This closes #7740

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:19:24 -05:00
dan-s1 66b68140e2
NIFI-12116 Documented lack of NDJSON support in ValidateJson
This closes #7782

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:12:02 -05:00
Chris Sampson 099ceec7ed
NIFI-12153 Added Allow Comments and Max String Length to JSON Readers
This closes #7823

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 10:43:08 -05:00
Bryan Bende ae61ebb5ed
NIFI-12186 Add ability to export a versioned reporting task snapshot (#7853)
* NIFI-12186 Add ability to export a versioned reporting task snapshot
- Add CLI commands and optional query param to specify specific reporting task
2023-10-09 10:50:36 -04:00
exceptionfactory 457973d133
NIFI-12188 Upgraded Commons Net from 3.9.0 to 3.10.0
- Removed ProxyFTPClient extension of standard FTPClient no longer required following changes implemented in NET-650

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7855.
2023-10-09 12:21:23 +02:00
Joe Gresock a584251f0a
NIFI-12189: Upgrading PutCloudwatchMetric to use AWS SDK 2.x
This closes #7857

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-08 18:24:37 +01:00
mr1716 d2fb81d1d6
NIFI-12182 Upgraded AMQP from 5.18.0 to 5.19.0
This closes #7847

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:29 -05:00
mr1716 226bf273a1
NIFI-12179 Upgraded Accumulo from 2.1.1 to 2.1.2
This closes #7843

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:29 -05:00
mr1716 1e5c491433
NIFI-12184 Upgraded Iceberg from 1.3.1 to 1.4.0
This closes #7848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
mr1716 a8b56949d7
NIFI-12183 Upgraded zstd-jni from 1.5.5-5 to 1.5.5-6
This closes #7850

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
mr1716 db0407cda6
NIFI-12181 Upgraded HiveMQ MQTT Client from 1.3.1 to 1.3.3
This closes #7846

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:27 -05:00
Bryan Bende 551625f7bf
NIFI-12149 Create nifi-redis-utils and minor improvements to util methods
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7812.
2023-10-06 15:32:00 -04:00
mr1716 7ddcb91605
NIFI-12171 Upgraded excel-streaming-reader from 4.1.2 to 4.2.0
This closes #7841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:09:58 -05:00
Nissim Shiman 5afda79f28
NIFI-11782 Resolved NPE when moving snippet with label to process group
This closes #7838

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:05:40 -05:00
Lehel Boer 7e4ca9365f NIFI-12092 Add backoff parameters to JettyWebsocketClient reconnect
This closes #7761.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-10-04 18:22:15 +02:00
Mark Payne 711f2f1188
NIFI-12137: This closes #7808. Fixed name of Expression Language Scope from LIMITED to ENVIRONMENT, ; fixed issue in which flowfiles routed to failure by FlowFileTransform were also being routed to original; defined 'identifier' and 'logger' as member variables for FlowFileTransform and RecordTransform so that IDEs know about them
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-04 09:16:04 -07:00
Mark Payne 1d9ccb3857
NIFI-12161: This closes #7829. Ensuring framework threads use lightweight threads instead of a capped thread pool. This prevents framework threads from livelocking in the event enough framework threads are holding threads while those needing to run cannot get them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-04 08:48:12 -07:00
exceptionfactory da4c6f6e25
NIFI-12163 This closes #7835. Improved Syslog 5424 Line Handling
- Eliminated unused parseEvent method signatures from StrictSyslog5424Parser in favor of a single String line method
- Eliminated intermediate conversion from String to byte array and back to String for Syslog Parser

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:26:06 -07:00
exceptionfactory 6394912cce
NIFI-12115 This closes #7830. Added ListenOTLP to collect OpenTelemetry
- Added ListenOTLP Processor supporting OpenTelemetry OTLP 1.0.0 Specification with gRPC and HTTP
- Updated nifi-event-transport to support configurable SSLParameters for configurable Cipher Suites

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:21:15 -07:00
Matt Burgess 3f7b1de6b8
NIFI-11739 - Add ability to ignore missing fields in PutIceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7421.
2023-10-03 14:41:12 +03:00
Tamas Palfy 9c425d273c
NIFI-12131 Fixed potential NPE related to FlowAnalyzer
Revamped RuleViolationsManager and FlowAnalyzer handling to make sure no issue occurs when these are not set. Fix ResourceNotFoundException: When determining the subject permissions for a rule violation the type of the subject is now known, so we try to lookup all possible types. Non-matching tpyes throw a ResourceNotFoundException exception though. Going to ignore those.

This closes #7809

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-02 15:35:05 -05:00
exceptionfactory 19b4be40aa
NIFI-12157 This closes #7826. Removed nifi-logging-utils and NiFiLog
- Replaced NiFiLog references with direct references to SLF4J LoggerFactory

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-02 08:17:51 -07:00
Joe Gresock ff8f1ff686
NIFI-8531: This closes #7529. Upgrading Kinesis processors to AWS SDK 2.x
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 16:26:51 -07:00
levilentz 9228036e1d
NIFI-7355: This closes #7677. TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 11:17:58 -07:00
annanys23 9b9dd4bae3
NIFI-6721: This closes #7789. jms_expiration attribute problem fix
Originally authored in part by sjyang18 <ilsong02@hotmail.com>

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 11:11:56 -07:00
Mark Payne 342fb0d876
NIFI-12143: This closes #7820. Introduced a new nifi-calcite-utils module and refactored the nifi-sql-reporting-tasks to mamke use of it. This uses the newer calcite api instead of deprecated classes/methods
- Refactored QueryRecord / JoinEnrichment to use new nifi-calcite-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 13:28:03 -07:00
exceptionfactory 1561eb2506 NIFI-12155 Upgraded Apache Commons IO from 2.13.0 to 2.14.0
- Upgraded Apache POI from 5.2.3 to 5.2.4

This closes #7825

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-30 16:25:23 -04:00
Emilio Setiadarma a8c1bb1d9c
NIFI-10425 Corrected auto-reloading KeyStore files with symlinks
- Changed StoreScanner scanner instantiation to not report real paths

This closes #7821

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-30 12:28:54 -05:00
Peter Turcsanyi 8c5d85a28d
NIFI-12151 Fixed StandardPrivateKeyService fails due to missing BouncyCastleProvider
This closes #7817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-30 11:01:40 -05:00
Mike Moser e93586df11
NIFI-12038 This closes #7760. introduce PackageFlowFile processor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 08:51:46 -07:00
exceptionfactory c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:56:53 -07:00
exceptionfactory 75c3b19979
NIFI-12142 This closes #7822. Corrected Cluster Pool Size Method Reference
- Set getClusterNodeProtocolMaxPoolSize method reference in place of deprecated getClusterNodeProtocolThreads

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:54:13 -07:00
dan-s1 e9b532bd32 NIFI-12100 Removed the ConvertExcelToCSVProcessor
This closes #7802

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-29 14:09:00 -04:00
Bryan Bende a74c411079 NIFI-12104 Separate a non-atomic Redis DMC implementation from the existing one for use in Put/Fetch DMC when Redis is clustered
This closes #7796

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-29 10:54:16 -04:00
Joe Witt 476f30813d
NIFI-12132 change default content repo archive percentage and age to 90 percent and 3 hours to better align to default user needs (#7797) 2023-09-28 17:32:21 -04:00
Mark Payne 1046fdf79d
NIFI-11938: This closes #7673. Created ConsumeSlack Processor to consume conversation history message events from Slack
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:14:35 -07:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Arpad Boda dbcc223b40 NIFI-12134 - Disable Directory Listing property is duplicated on PutSFTP processor
Signed-off-by: Bejan Csaba <bejan.csaba@gmail.com>

This closes #7798.
2023-09-27 17:44:24 +02:00
Bryan Bende 1ac833654b NIFI-12127 Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath
This closes #7794

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-27 08:48:11 -04:00
Mark Payne 16c527271b
NIFI-11271: This closes #7795. Removed deprecated Kerberos-related properties and updated to make use of KerberosUserService; some code cleanup to bring up-to-date with Java 21 recommendations such as Stream.toList() instead of Stream.collect(Collectors.toList()) and using enhanced switch statements
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-26 10:51:59 -07:00
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
2023-09-26 13:01:13 +02:00
Joseph Witt 81dc36a473
NIFI-12128 updated cassandra, jgit, and netty
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7793.
2023-09-26 11:44:15 +02:00
Matt Burgess e7da2ab5b8
NIFI-11177: Add defensive code for null values for Iceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
2023-09-26 11:30:08 +02:00
Matt Burgess 3f5661232e
NIFI-12024: Add CSV Writer property to CSVRecordSetWriter and a FastCSV writer implementation
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7686.
2023-09-26 11:22:52 +02:00
Peter Turcsanyi 5644fdd725
NIFI-12126: Downgrade snowflake-jdbc to 3.13.33
snowflake-ingest-sdk:2.0.3 is not compatible with snowflake-jdbc:3.14.x

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7790.
2023-09-26 11:07:14 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
exceptionfactory bcc54953c4
NIFI-12120 This closes #7784. Removed Obsolete Framework Integration Tests
- Removed integration tests from org.apache.nifi.integration in nifi-framework-core

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-24 15:48:47 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-09-23 14:02:09 +01:00
Pierre Villard 4b9eb8361c
NIFI-12113 Replaced Validate.notNull() with Objects.requireNonNull()
This closes #7779

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-22 15:18:50 -05:00
Mark Payne 140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 10:47:47 -07:00
exceptionfactory d354c88f57
NIFI-12112 This closes #7778. Removed Unmaintained Components and Modules
- nifi-cybersecurity-bundle
- nifi-html-bundle
- nifi-hl7-bundle
- nifi-metrics-reporting-bundle
- nifi-riemann-bundle
- nifi-tcp-bundle
- nifi-rules-action-handler-bundle
- nifi-rules-engine-service-api

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 09:46:28 -07:00
Mark Payne 713be8b539
NIFI-12101: This closes #7768. Fixed bugs that caused StatelessBasicsIT.testChangeFlowVersion to fail. There were a couple of related issues. Firstly, for Stateless Groups we were not waiting for the group to fully stop before attempting to update the flow but were waiting only for child/descendant groups to stop. This was due to misleading naming in the ProcessGroupUpdateStrategy enum. Renamed enum values to more clearly convey what they mean. Additionally, renamed the enum to more clearly convey what how it is used, since it is used not only for updating groups but also for retrieving groups. Additionally, when waiting for stateless groups to stop, we inadvertently checked the Set of affectedComponents' IDs against Process Group IDs so addressed the logic there and also ensured that we were consistent in setting the AffectedComponentEntity's ProcessGroup (i.e., its ProcessGroupNameDTO) as we were inconsistently setting it across the codebase.
Fixed issue in logic of LocalComponentLifecycle, which was waiting for all PGs to reach desired stateless run schedule, even when the group itself was not stateless

Fixed JavaScript to specify correct value for recursivity when updating process group parameter context
2023-09-22 09:00:52 -07:00
Nandor Soma Abonyi 9ae6921272
NIFI-12095 This closes #7762. Increase default Xmx to 1g
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:48:34 -07:00
exceptionfactory a832b134b1
NIFI-12109 This closes #7774. Removed SpringContextProcessor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:41:52 -07:00
dan-s1 9b591a2fe3
NIFI-12041 Converted Groovy tests to Java in nifi-scripting-processors
This closes #7752

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:45:26 -05:00
Pierre Villard 5405a3b08b
NIFI-12102 Fixed deprecation warnings when instantiating primitive types
This closes #7769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:41:30 -05:00
Nandor Soma Abonyi badbc1aca6
NIFI-12022 Extract verification logic from JMSConnectionFactoryProvider
This closes #7667.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-21 19:24:41 +02:00
exceptionfactory ebe8b9a2e7
NIFI-12033 Added EncryptContentAge and DecryptContentAge Processors
This closes #7676
Signed-off-by: Paul Grey <greyp@apache.org>
2023-09-21 13:00:16 -04:00
Pierre Villard 9c19656f5b
NIFI-12097 Upgraded Snowflake ingest SDK to 2.0.3 and JDBC to 3.14.1
This closes #7764

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:46:19 -05:00
Joseph Witt 4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:38:22 -05:00
exceptionfactory 11d8519914
NIFI-12086 This closes #7757. Removed unused jgit dependency from framework-core
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 14:28:38 -07:00
exceptionfactory 2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 13:54:44 -07:00
Joseph Witt e5894cf943
NIFI-12053 Updated Minimum Build Version to Java 21
- Configured GitHub Workflows with Azul Zulu and Amazon Corretto
- Added bootstrap.conf option for reflective access supporting Hive 3

This closes #7744

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 22:59:59 -05:00
Joe Witt 017b16254b
NIFI-11903 disable if windows (#7566) 2023-09-19 16:22:49 -04:00
Peter Turcsanyi 520840d93b
NIFI-12076 Removed ComponentLog methods with Object[] and Throwable
This closes #7759

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 13:10:19 -05:00
Peter Turcsanyi ac80b9d900
NIFI-11595 StateProvider.replace() supports creating the initial state
- Extracted common logic from setState() and replace() into modifyState()
- Removed redundant code from createNode() because exceptions are handled on the caller side
- NodeExistsException and InterruptedException are handled in setState() and replace()
- Also used KeeperException's subclasses instead of KeeperException.code()

This closes #7324

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 10:06:38 -05:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
Joe Witt cbf5bb98f9
NIFI-12072 moved to StackWalker API elimnating usage of SecurityManager (#7742) 2023-09-16 17:05:22 -04:00
Joe Witt 019e16c728
NIFI-12069 removed nifi grpc bundle and build related config. Cleaned up brittle test check for command line text which varies. (#7739) 2023-09-15 18:15:02 -04:00
Joseph Witt c042a48c86
NIFI-12070 Removed nifi-easyrules-bundle
This closes #7738

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 16:41:06 -05:00
Joseph Witt bd2276260e
NIFI-12051 Upgraded Groovy from 3.0.19 to 4.0.15
- Adjusted Groovy Maven coordinates to org.apache.groovy
- Adjusted build configuration and tests for Groovy 4

This closes #7692

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:38:24 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
Chris Sampson 94bb8aec97
NIFI-12063 Clarified Elasticsearch Query Documentation
Clarify paginated Elasticsearch with SCROLL does not use query parameters from dynamic properties

This closes #7695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 20:01:50 -05:00
Joseph Witt a1fca9b44e
NIFI-12064 Upgraded Maven Plugin versions
This closes #7731

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 19:35:51 -05:00
exceptionfactory aee9f2c65d
NIFI-12034 This closes #7729. Upgraded Apache Commons Compress from 1.23.0 to 1.24.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 13:21:17 -07:00
exceptionfactory 98fa7d0290
NIFI-12060 This closes #7694. Removed Groovy Tests using Spock Framework
- Added org.spockframework to the list of banned dependencies
- Removed several other Groovy tests and associated build profiles

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 11:22:54 -07:00
Justin 7a79e8c01f
NIFI-12037 Update AzureUserGroupProvider to allow configuration of the graph endpoint and API scope to support regional clouds.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7675.
2023-09-14 19:39:03 +02:00
Matt Burgess a7a281c215
NIFI-12023: Add FastCSV parser to CSVReader
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7685.
2023-09-14 19:33:58 +02:00
Mark Payne f27ace1ccf
NIFI-12016: This closes #7662. Allow use of compatible NAR bundles when loading flow from cluster connection; when determining what bundles are compatible, consider not just any bundle if it's the only one but also any bundle whose version matches the framework version so that when NiFi is upgraded, it is handled more gracefully.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 10:29:23 -07:00
exceptionfactory 292b5d18a0
NIFI-12058 This closes #7693. Upgraded Apache Kudu from 1.16.0 to 1.17.0
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 09:57:37 -07:00
exceptionfactory 591c323f0a
NIFI-12057 Refactored Groovy tests to Java in nifi-lookup-services
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-14 08:39:00 -07:00
Mark Bathori ea4c2055d6
NIFI-12054: PutIceberg should produce a provenance send event
This closes #7690.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-14 16:53:32 +02:00
Joseph Witt 4d4c97d091
NIFI-12050 Upgraded Mockito from 4.11.0 to 5.5.0
This closes #7689

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 09:49:42 -05:00
exceptionfactory 6841aa6e99
NIFI-12047 Added HTTP/2 to Default Application Protocols
- Changed default value of nifi.web.https.application.protocols to include both h2 and http/1.1
- Changed default value of nifi.registry.web.https.application.protocols to include both h2 and http/1.1
- Updated HostHeaderHandler logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7684.
2023-09-14 13:50:01 +02:00
Matt Burgess 24736f6276
NIFI-12011 Added MIME Type to ExecuteStreamCommand and ExecuteProcess
This closes #7660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 16:39:41 -05:00
mr1716 8c68e5d8cc
NIFI-12046 Upgraded box-java-sdk from 4.2.0 to 4.4.0
This closes #7683

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 16:30:02 -05:00
dan-s1 09c1c8b2b3
NIFI-12042 Refactored Groovy test to Java in nifi-mock-record-utils
This closes #7681

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-12 09:03:51 -05:00
exceptionfactory f0b7775203
NIFI-12040 Upgraded Apache IoTDB from 1.1.2 to 1.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7680.
2023-09-12 10:41:43 +02:00
exceptionfactory 73a2d27b12
NIFI-12039 Upgraded Apache Commons DBCP from 2.9.0 to 2.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7679.
2023-09-12 10:39:07 +02:00
dan-s1 0280497c62
NIFI-11959 Corrected single-line comment handling for Jolt JSON
Added new lines back to the read in JSON spec to allow for single line comments to be parsed correctly and ignored.

This closes #7678

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 17:00:12 -05:00
Timea Barna c30fd9b66d
NIFI-12006 Removed Templates from Framework and UI
This closes #7658

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-11 14:52:41 -05:00
Pierre Villard 47f4c8ce2e NIFI-12028 - Add s3.region attribute to ListS3 generated flow files
This closes #7672

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-10 12:22:35 -04:00
Matt Burgess 932cfe22a3
NIFI-12010: Handle auto-commit and commit based on driver capabilities in SQL components
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #7663
2023-09-09 11:13:31 +02:00
Peter Turcsanyi 6cffc78ad2
NIFI-12025: Fixed duplicated bulletin messages (#7670) 2023-09-08 13:16:44 -04:00
krisztina-zsihovszki 75cfe21e4c
NIFI-12014 NullPointerException in PutSQL when adding error attributes
This closes #7666.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-05 11:38:14 +02:00
Freedom9339 2b330d9fee
NIFI-10904 Changed the font color for drop down menus to avoid the app… (#7502)
* NIFI-10904 Changed the font color for dropdown menus to avoid the appearance of menu items being disabled

* NIFI-10904 Changed the CSS tag used to set the color of the dropdown menu text

* NIFI-10904 Used a new css class to set the color of dropdown options

* nifi-10904 Changed the css class for create/reference drop down menu items.

Merged #7502 into main.
2023-08-31 09:41:08 -07:00
p-kimberley a9ac8fb707
NIFI-11945 Add Cache Entry Identifier property to DeduplicateRecord
This closes #7603

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-30 16:59:05 -05:00
exceptionfactory 5dc1ea27d3 NIFI-12001 Refactored CertificateUtils to separate modules
- Added nifi-security-cert for reusable components without dependencies
- Added nifi-security-cert-builder for certificate generation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7651
2023-08-30 15:08:46 -04:00
Tamas Palfy d4147ca442
NIFI-8650 Added Flow Analysis Rules
- Added new extensible Component Type: FlowAnalysisRule
- Added DisallowComponentType Rule implementation
- Flow Analysis Rules can be managed from the UI under Controller Settings -> Flow Analysis Rules
- Flow Analysis Rules can be set up with an enforcement policy of WARN or ENFORCE
- Flow Analysis Rules can evaluate an individual Component or a Process Group

This closes #7191

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-29 15:50:22 -05:00
dan-s1 8c045268ba
NIFI-11778 refactored Groovy tests in nifi-elasticsearch-restapi-processors to Java (and JUnit 5)
This closes #7537

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-29 05:56:15 +01:00
Emilio Setiadarma af365414e9
NIFI-11519 Fixed DBCPConnectionPool Sensitive Dynamic Properties
- Added handling for property names marked as sensitive but not having the SENSITIVE prefix for backward compatibility

This closes #7646

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:37:23 -05:00
mr1716 a5ca73b2da
NIFI-12005 Upgraded Apache Ant from 1.10.13 to 1.10.14
This closes #7656

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:16:28 -05:00
mr1716 88a5ac6f0d
NIFI-12003 Upgraded Solr from 9.2.1 to 9.3.0
This closes #7657

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:43 -05:00
mr1716 77ed641ee2
NIFI-12002 Upgraded javax.servlet.jsp-api from 2.3.1 to 2.3.3
This closes #7653

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:14:00 -05:00
mr1716 5d961eafce
NIFI-12000 Upgraded Hazelcast from 5.3.1 to 5.3.2
This closes #7649

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:13:18 -05:00
mr1716 49dd9ec03f
NIFI-11993 Upgraded Groovy from 3.0.18 to 3.0.19
This closes #7654

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-28 12:12:34 -05:00
mr1716 eb6a5a2f47
NIFI-11998 Update spring.data.redis.version to 2.7.15
This closes #7648

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-08-25 23:36:05 +02:00
Mark Bean d1b77018b2
NIFI-11934 Allow FlowFile filename to be sent in header for InvokeHTTP
This closes #7639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:21:28 -05:00
mr1716 bf3c9ed4cb
NIFI-11994 Upgraded socketbroker from 1.0.2 to 1.1.0
This closes #7645

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-24 17:15:12 -05:00
Peter Turcsanyi 68983cef42
NIFI-11987: Set read buffer size in PutAzureBlobStorage_v12
Increased the read buffer size in order to avoid OOME due to too many buffer allocations (exceeding vm.max_map_count on Linux).

This closes #7640

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-08-24 15:55:55 +02:00
Nandor Soma Abonyi e9b62f7b83
NIFI-11912 Added Proxy support to StandardOauth2AccessTokenProvider
This closes #7609

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 16:22:42 -05:00
Chris Sampson fb502cdf9a NIFI-11480 add option to group PutElasticsearchRecord errors by Elasticsearch _bulk error type
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7441
2023-08-23 16:00:28 -04:00
Tamas Palfy 1e12800912
NIFI-11978 Fix: NPE when trying to disable Management Controller Service
This closes #7637

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-23 13:58:58 -05:00
exceptionfactory c08560447f NIFI-11518 Upgraded Jetty from 9.4.51 to 10.0.15
- Updated Jetty WebSocket components using Jetty 10 components
- Upgraded Solr components from 8.11.2 to 9.2.1 to align with Jetty 10 dependencies

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7622
2023-08-23 14:42:59 -04:00
Paul Grey c0c1b386f6 NIFI-11981 - PublishGCPubSub failure / Record-based processing / AVRO
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7638
2023-08-23 14:29:19 -04:00
exceptionfactory 016834efaa NIFI-11976 Removed error log check in TestListenTCPRecord
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7635
2023-08-22 15:16:25 -04:00
dependabot[bot] 680acf89ed
NIFI-11980 Upgraded Apache Ivy from 2.5.1 to 2.5.2
This closes #7633
This closes #7632

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 11:52:48 -05:00
Mark Bean 9432f302c6
NIFI-11877 Added Comments field for Rules in UpdateAttribute
This closes #7541

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-22 09:49:19 -05:00
Bence Simon 7340bb8153
NIFI-11924 Closing FileSystem after using in HDFSExternalResourceProvider
This closes #7588.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-22 13:18:10 +02:00
Mark Payne baea7ffee9
NIFI-11971: Ensure that when creating a new content claim that we always treat an existing claim length of -1 as 0, to ensure that we never add -1 to our offset
This closes #7631

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 12:07:16 -05:00
Freedom9339 52cc831a2a
NIFI-11303 Added a go-to entry on the right click context menu for th… (#7461)
* NIFI-11303 Added a go-to entry on the right click context menu for the provenance lineage tree to take you to the specified component in the graph

* nifi-11303 Removed unused variable.

Merged #7461 into main.
2023-08-21 09:23:38 -07:00
Emilio Setiadarma 5d90c9c14b
NIFI-9164 Refactored tests in nifi-windows-event-log to JUnit 5
- Used LauncherInterceptor to handle custom class loading

This closes #7623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:12:29 -05:00
mr1716 96ae5252f5
NIFI-11970 Upgraded gRPC from 1.57.1 to 1.57.2
This closes #7628

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:04:11 -05:00
mr1716 83cba2c5ad
NIFI-11969 Upgraded excel-streaming-reader from 4.1.0 to 4.1.1
This closes #7627

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:03:37 -05:00
mr1716 e83fc230ac
NIFI-11968 Upgraded zstd-jni to 1.5.5-5 for compress-processors
This closes #7626

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 11:02:00 -05:00
Mark Payne 5e2a10c328
NIFI-11971: Ensure that if we do not write any bytes to a file after calling ProcessSession.write() that we set content claim's length to 0 when closing OutputStream; otherwise it remains -1, which causes issues, since the length will later be added to the offset to determine the position in the ste stream
This closes #7629

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-21 07:56:57 -05:00
mr1716 dcc2480cb5
NIFI-11956 Upgraded Frontend Maven Plugin from 1.12.1 to 1.13.4
This closes #7617

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-18 12:53:24 -05:00
mr1716 a9f29f209e NIFI-11928 Update gremlin.version to 3.7.0
This closes #7592

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-18 09:04:10 -04:00
Ferenc Kis 3aa02a022e
NIFI-11514 Flow JSON support and deprecating YAML format. Revised parameter generation. Generic refactors.
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #7344
2023-08-18 11:33:23 +02:00
mr1716 0d119f6f39
NIFI-11955 Upgraded maven-clean-plugin from 3.2.0 to 3.3.1
This closes #7616

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:05:01 -05:00
mr1716 46cdcf9dac
NIFI-11954 Upgraded license-maven-plugin from 2.0.0 to 2.2.0
This closes #7614

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:04:26 -05:00
mr1716 70c756ff78
NIFI-11953 Upgraded download-maven-plugin from 1.6.8 to 1.7.1
This closes #7613

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-16 21:03:41 -05:00
exceptionfactory 71abd77727 NIFI-11944 Removed validation warning from ExecuteStreamCommand
- Removed customValidate() which logged an incorrect warning every 5 seconds based on strategy string instance evaluation

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7607
2023-08-14 16:34:49 -04:00
mr1716 b55b712b38
NIFI-11949 Upgraded Spring Integration from 5.5.15 to 5.5.18
This closes #7605

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-14 12:20:58 -05:00
mr1716 12f736a6b0 NIFI-11943 Update activemq-client and broker to 5.18.2
This closes #7602

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 21:51:30 -04:00
mr1716 b78dc5ca57 NIFI-11942 Update zstd-jni to 1.5.5-5
This closes #7601

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:51:20 -04:00
mr1716 c0156e3429 NIFI-11936 Update msal4j.version to 1.13.10
This closes #7599

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:48:41 -04:00
mr1716 99a590ec0c NIFI-11935 Update Redis spring.data.redis.version to 2.7.14
This closes #7598

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:47:33 -04:00
mr1716 0c03521676 NIFI-11933 Update spring.integration.version For Email Bundle To 5.5.18
This closes #7597

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:46:06 -04:00
mr1716 53f64badbf NIFI-11931 Update iotdb.sdk.version to 1.1.2
This closes #7595

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:43:55 -04:00
mr1716 c878310e36 NIFI-11930 Update aws-kinesis-client-library-version to 1.15.0
This closes #7594

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-11 17:42:14 -04:00
Mark Bean 02653143d8
NIFI-11914 Support Expression Language for SegmentContent Size
This closes #7578

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 20:25:01 -05:00
Peter Turcsanyi 2e6eaaeb38
NIFI-11926: Added proxy handling in Azure Storage Credentials Services
Added Proxy Configuration Service property in AzureStorageCredentialsControllerService_v12 and ADLSCredentialsControllerService used by Service Principal and Managed Identity authentication modes.

This closes #7590

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:46:31 -05:00
Matt Burgess 88b6b587be
NIFI-11922: Honor catalog/schema field in UpdateDatabaseTable
This closes #7585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 17:30:20 -05:00
mr1716 0643e1db96
NIFI-11925 Upgraded smbj from 0.12.1 to 0.12.2
This closes #7589

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 14:46:17 -05:00
Mark Payne b3c620411a
NIFI-11556: Added ability to use a Process Group as a Stateless Flow
When shutting down FlowController, wait up to gracefulShutdownSeconds seconds for the components to stop before shutting down thread pools. This allows for asynchronous operations such as disableControllerServicesAsync to complete during shutdown. Updated StandardStatelessFlow so that on shutdown it catches more general Exception to ensure that shutdown succeeds

Ensure that Max Concurrent Tasks cannot be set less than 1 for stateless group; fixed typo in ProcessGroupDTO's docs; on shutdown, we may need to disable controller services asynchronously. At that point, the thread pool used to do so may already be shutdown. If so, catch this and create a new single-thread pool, disable the service, and immediately shutdown the pool. Also, if we fail to disable services on shutdown of a stateless flow, instead of throwing an Exception, just log it and move on - it doesn't make much sense for shutdown() to throw an Exception in that case.

Updated system tests so that when emptying a queue, we check the result and if the queue still has data (because a Processor hasn't acknowledged the data, for example) then continue issuing request until the queue fully becomes empty.

When shutting down input/output ports for stateless group, ensure that we wait for the ports' active threads to complete before returning

When stopping StatelessGroupNode, ensure that all the Processors, Controller Services (even those not executed by the Stateless Engine) are stopped/disabled before considering the Stateless Group to be fully STOPPED.

This closes #7253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 12:08:22 -05:00
exceptionfactory 84326ba4b2 NIFI-11920 Improved JDBC and JNDI JMS Connection URL Validation
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7586
2023-08-09 13:00:55 -04:00
Mike Thomsen cba6b00271
NIFI-11383 Updated Java documentation links from 8 to 17
This closes #7581

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-09 09:17:48 -05:00
exceptionfactory bbd8fb6f63
NIFI-11895 Removed deprecated Repository Encryption configuration
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7557.
2023-08-09 07:07:31 -04:00
krisztina-zsihovszki 0446990d54
NIFI-11916 Iceberg processor extensibility improvement
This closes #7583.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-08 22:31:52 +02:00
Peter Turcsanyi 2a3ce1cb69
NIFI-11918 Used java.security.cert in ListenGRPC
This closes #7580

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-08 10:04:52 -05:00
Mark Payne 964f56043c
NIFI-11910: Clarified some points in docs
This closes #7574

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-08-08 08:10:49 +01:00
exceptionfactory ff87060b16 NIFI-11915 Upgraded gRPC from 1.57.0 to 1.57.1
This closes #7577

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-08-07 17:22:47 -04:00
Pierre Villard 62487f575a
NIFI-11891 Added No Tracking listing strategy to ListGCS
This closes #7570

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 14:06:17 -05:00
Mike Thomsen 5cb15b484c
NIFI-11913 Added enum handling to StandardSchemaValidator
This closes #7576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-07 13:58:43 -05:00
Pierre Villard b056bf8f7b
NIFI-11823 - fix NUMERIC support in PutBigQuery
This closes #7489.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-05 23:21:48 +02:00
Mark Payne 485112e54f
NIFI-11911 Updated FetchGoogleDrive to support Export Types
- Export API support includes Google Docs, Presentations, Spreadsheets, Drawings, and AppScripts

This closes #7575

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 16:28:44 -05:00
Yolanda M. Davis f8e3b9ebac
NIFI-11899 Correct Bulletin Metrics Registry to return latest Bulletins
This closes #7567

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:20:00 -05:00
Pierre Villard 572e661d12
NIFI-11901 Added name and version subtitle in Processor Details view
This closes #7563

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-04 11:14:14 -05:00
exceptionfactory 5c577be946
NIFI-11889 Added Record-oriented Transmission to PutTCP
This closes #7554
Signed-off-by: Paul Grey <greyp@apache.org>
2023-08-04 11:25:23 -04:00
Matt Burgess 63c72bd7e2
NIFI-11898 Handle commit based on driver capabilities in PutDatabaseRecord
This closes #7561

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 16:18:45 -05:00
mr1716 1fda6bca7a
NIFI-11906 Updated nifi-resources description for consistency
This closes #7571

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-03 13:02:30 -05:00
mr1716 66fc11d7c5
NIFI-11905 Update snowflake-jdbc to 3.14.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7569.
2023-08-03 17:33:59 +02:00
exceptionfactory 04cd6c216e
NIFI-11896 Corrected QuestDB Status Repository Shutdown handling
- Updated QuestDB Status Repository shutdown method to cancel scheduled tasks before immediate shutdown of Scheduled Executor Service
- Updated QuestDB Scheduled Tasks to include initial delay to avoid unnecessary execution when starting
- Updated QuestDB test class to minimize logging for QuestDB 7
- Improved logging and exception messages

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7564.
2023-08-03 17:25:52 +02:00
Lehel Boer 6a8a8caa4c
NIFI-11902: Fix ListHDFS closes FileSystem in first run
This closes #7565.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-08-03 16:02:42 +02:00
Mike Thomsen 49a350a765
NIFI-11900 Catch RuntimeException in ResizeImage failures
This closes #7558

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-08-02 14:02:56 -05:00
mr1716 5a8519ebd1
NIFI-11888 Upgraded Saxon-HE from 12.2 to 12.3
This closes #7553

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 20:31:56 -05:00
mr1716 011986c431
NIFI-11885 Upgraded asn1bean from 1.13.0 to 1.14.0
This closes #7552

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:57:48 -05:00
mr1716 f081bcb311
NIFI-11887 Upgraded Iceberg from 1.3.0 to 1.3.1
This closes #7551

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:56:27 -05:00
mr1716 83ca3687ad
NIFI-11884 Upgraded snowflake-ingest-sdk from 2.0.1 to 2.0.2
This closes #7549

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:55:35 -05:00
mr1716 91d86513d1
NIFI-11876 Upgraded gRPC from 1.56.1 to 1.57.0
This closes #7540

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:50:00 -05:00
mr1716 87cd4b5817
NIFI-11868 Upgraded Cassandra Driver from 3.11.3 to 3.11.4
This closes #7535

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:45:39 -05:00
mr1716 225296435d
NIFI-11867 Upgraded Neo4j Driver from 4.4.11 to 4.4.12
This closes #7534

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:42:27 -05:00
mr1716 32c80ac294
NIFI-11866 Upgraded mvel2 from 2.4.15 to 2.5.0
This closes #7533

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-31 19:37:13 -05:00
exceptionfactory 118ee0d00e
NIFI-11864 Upgraded Calcite Core from 1.34.0 to 1.35.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7531.
2023-07-31 18:21:48 +02:00
Timea Barna 42910e80d1
NIFI-11658 Streamline using single Parameter Context for nested PGs
This closes #7353

Co-authored-by: Matt Gilman <mcgilman@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-27 15:02:54 -05:00
mr1716 a61add22c2
NIFI-11856 Upgraded MongoDB Driver from 4.9.1 to 4.10.2
This closes #7526

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-25 09:53:29 -05:00
mr1716 13d7850702
NIFI-11855 Upgraded mysql-binlog-connector-java from 0.28.0 to 0.28.1
This closes #7525

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-25 09:50:40 -05:00
exceptionfactory 3a078c0c31
NIFI-11780 Added Certificate SAN Attributes to HandleHttpRequest
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7521.
2023-07-25 16:09:25 +02:00
exceptionfactory 72618b1817
NIFI-11853 Changed Embedded QuestDB Tests to use JUnit5 TempDir
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7523.
2023-07-25 15:48:45 +02:00
Pierre Villard 319c974e7c
NIFI-11828 - Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID (#7495)
* NIFI-11828 - Confluent Schema Encoding Access Strategy - Schema ID versus Schema Version ID
* removed hard coded version 1
2023-07-25 09:42:50 -04:00
Matt Burgess d201119f0d
NIFI-11830 Added Transformation Strategy property to JSLTTransformJSON
This closes #7509

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 15:04:17 -05:00
Pierre Villard dbb2d6905f
NIFI-11842 - remove getTargetUri() and code cleanup
This closes #7511

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:53:17 -05:00
Paul Grey 5cad5838c5
NIFI-11840 Add Kafka Partition and Topic Attributes before handoff to RecordReader
This closes #7510

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:40:22 -05:00
Mark Payne c68f5ec9a2
NIFI-11793 Added Python debugging properties and documentation
Added documentation to indicate how to debug Python side of nifi framework, as well as debugging Python processors themselves using VSCode's Remote debugger.
This also provides the ability to launch the Controller process in such a way that it will listen to incoming remote debug connections.

This closes #7469

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:23:19 -05:00
Mark Payne 0eebf6b14e
NIFI-3065 When copying a PG, do not set the Log File Suffix if not already set
This closes #7522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 13:05:27 -05:00
Pierre Villard 969679e43b
NIFI-11846 - Change version should not show keep existing parameter context
This closes #7517

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-24 11:35:05 -05:00
Mark Payne c009b55762
NIFI-11813: Fixed a bug in nf-processor-configuration.js that caused the UI to ignore the Scheduling Period when using a Timer-Driven strategy; removed some additional remnants of event-driven strategy from the UI
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7518.
2023-07-24 17:24:26 +02:00
mr1716 ca2ee34bc2
NIFI-11843 Upgraded Box SDK from 4.1.0 to 4.2.0
This closes #7512

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:46 -05:00
exceptionfactory 8d5a6ce8d2
NIFI-11807 Reverted inadvertent changes to HandleHttpRequest
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-21 17:21:08 -05:00
Lehel 8a5f7f0092
NIFI-11827 Added AWS Glue Schema Registry Service
This closes #7492

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 14:07:25 -05:00
Mark Payne 8f5392dd11
NIFI-11837: When determining whether or not a queue should exit 'swap mode' we need to look at the updated size of the queue after migrating data from swapped queue to active queue. Previously, we were looking at the size variable that was obtained from before the migration happened.
This closes #7506

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 12:55:16 -05:00
Pierre Villard 20b19992d2
NIFI-11816 - Removed deprecated Primary Node Scheduling Strategy
This closes #7501

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:49:03 -05:00
mr1716 0a774f231a
NIFI-11835 Upgraded json-schema-validator from 1.0.84 to 1.0.86
This closes #7505

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-20 11:45:57 -05:00
Pierre Villard c06bb97e85
NIFI-11833 - remove deprecated classes in nifi-commons (#7503)
Signed-off-by: Otto Fowler <ottobackwards@gmail.com>
2023-07-20 11:58:51 -04:00
Mark Payne 323f148d27 NIFI-11783: Fixed a bug in which a FlowFile split into multiple and then removed did not properly handle retries when one of the outputs was retried.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7500
2023-07-19 15:51:21 -04:00
Mark Payne 7405dcb510
NIFI-11814 Optimized Cluster Replication Component status evaluation
When waiting for all controller services to reach the desired status in the ClusterReplicationComponentLifecycle component, return immediately if there are no services to wait for. Otherwise, request that referencing components not be included in the return value of the Controller Services

This closes #7493

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 14:19:11 -05:00
Paul Grey 7db956fea7
NIFI-11825 Fixed QueryRecord closing of resources
This closes #7496

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:48:15 -05:00
Matt Burgess f6a14bc475
NIFI-11807 Added ExtractRecordSchema Processor
This closes #7482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:32:59 -05:00
exceptionfactory 16c4004d58 NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7497
2023-07-18 18:29:20 -04:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
mr1716 779eea6453
NIFI-11824 Upgraded JAX-RS API from 2.1 to 2.1.1
This closes #7490

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 10:50:30 -05:00
Lehel a3fe9d121d NIFI-11817: Improve ListHDFS extensibility
Fix review items

This closes #7484
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-07-18 15:56:08 +02:00
mr1716 bdd2a2b24b
NIFI-11819 Update derby.version to 10.16.1.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7491.
2023-07-18 10:14:05 +02:00
EndzeitBegins 34a6d8a0a1
NIFI-8128 Added Sentinel Password to Redis Service
- Replaced embedded-redis and with Testcontainers for Redis integration tests

This closes #7481

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-15 19:53:24 -05:00
exceptionfactory 95bb23d403
NIFI-11781 Corrected OIDC Claim Identity Processing
- Added StandardOidcUserService supporting fallback claim names
- Updated StandardClientRegistrationProvider to use standard Subject claim
- Updated OIDC Security Configuration to use customized OidcUserService for claim handling

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7468.
2023-07-15 11:03:58 -04:00
Peter Turcsanyi 437995b75a
NIFI-11758: Added FileResourceService and used it in PutAzure*Storage processors for local file upload
- Renamed classes from DataUpload to ResourceTransfer and updated references
- Disabled testNonReadableFile() on Windows due to Posix permissions
- Replaced utility methods with functional handling of FileResource
- Corrected FlowFile InputStream access using Optional.orElseGet()

This closes: #7458

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-07-14 23:48:27 +02:00
mr1716 e5362c5eb7
NIFI-11798 Update smbj to 0.12.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7480.
2023-07-14 20:30:51 +02:00
Pierre Villard 8a61d5bdbf
NIFI-11794 - Fix NPE + configure max attempts for Redis State Provider (#7473)
Signed-off-by: Otto Fowler<ottobackwards@gmail.com>

This closes #7473.
2023-07-14 11:51:18 -04:00
exceptionfactory e812951c57
NIFI-11810 Removed unused JSTL and EL API libraries
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7479.
2023-07-14 10:30:27 +02:00
mr1716 65f9bcf0cf
NIFI-11804 Upgraded excel-streaming-reader from 4.0.5 to 4.1.0
This closes #7477

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:32:48 -05:00
mr1716 77b194303b
NIFI-11801 Upgraded RabbitMQ AMQP Client from 5.17.0 to 5.18.0
This closes #7475

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:30:08 -05:00
mr1716 3f72032112
NIFI-11800 Upgraded icu4j from 73.1 to 73.2
This closes #7474

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:29:24 -05:00
Matt Burgess 21e5ebc840
NIFI-7343: Add support for SchemaRegistryService to scripted components
This closes #7467

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-12 17:21:28 -05:00
Joe Witt d2c70d1d2f
NIFI-11434 added support for optionally allowing zip entries with dat… (#7462)
* NIFI-11434 added support for optionally allowing zip entries with data descriptors
* set default value and ensured all zip tests use various configs
2023-07-12 17:09:03 -04:00
Lehel 5bd4bc5190 NIFI-11178: Improve ListHDFS performance, incremental loading refactor. 2023-07-11 13:22:29 +02:00
Pierre Villard a04cbe7f07 NIFI-11779 - Override endpoint in PutBigQuery
review

use default from code instead of hardcoding

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7460
2023-07-10 12:15:24 -04:00
Emilio Setiadarma a85ef2c1f4
NIFI-11536 Corrected Keystore and Truststore auto-reloading
- Replaced Jetty KeyStoreScanner and custom TrustStoreScanner with shared StoreScanner
- New StoreScanner uses TLS Configuration to reload SSLContext instead of relying on Jetty SslContextFactory properties

This closes #7446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-10 11:07:04 -05:00
dan-s1 d24318cdb8
NIFI-11767 Refactored Groovy tests in nifi-web-error and nifi-web-security to Java
This closes #7457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-06 16:30:34 -05:00
Pierre Villard b3372900b3
NIFI-11774 Upgraded gRPC from 1.55.1 to 1.56.1
This closes #7456

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-05 17:01:49 -05:00
Matt Burgess f69b457757
NIFI-11770: Replace java-faker with Data Faker for GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7454.
2023-07-03 11:33:50 +02:00
Mark Bathori b1be71f918
NIFI-11334: Fixed PutIceberg processor instance interference due to same class loader usage
This closes #7449.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-30 20:36:33 +02:00
simonbence 5f4cc106f1
NIFI-11769 Adding details on Registry Clients and Registrty Client types on UI (#7453)
Co-authored-by: Shane Ardell <shane.m.ardell@gmail.com>

Merged #7453 into main.
2023-06-30 11:33:41 -07:00
Bence Simon cadf2fb6f2
NIFI-11706 Add option to create dedicated Parameter Contexts for Imported Flows
This closes #7401

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-30 12:56:27 -05:00
exceptionfactory 50b01ffd63
NIFI-11714 Added Error Handler to Jetty Server
- Configured Error Handler with Stack Traces disabled for NiFi and Registry

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7447.
2023-06-29 16:44:01 -04:00
exceptionfactory 3aba769cc3
NIFI-11762 Upgraded Hadoop dependencies from 3.3.5 to 3.3.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7445.
2023-06-28 19:35:38 +02:00
Matt Burgess 7b5853363f NIFI-11759: Remove Distributed Map Cache Client property from ListHDFS
This closes #7443

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-28 11:07:56 -04:00
exceptionfactory 12b7dd0243
NIFI-11760 Upgraded Riemann Client from 0.4.1 to 0.5.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7444.
2023-06-28 09:55:45 +02:00
dan-s1 2a7fa6d17b
NIFI-11754 Refactored Groovy test in nifi-jetty to Java (and JUnit 5)
This closes #7442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-27 14:39:08 -05:00
exceptionfactory 09e36f4d3e NIFI-11757 Upgraded Google Cloud Libraries from 26.15.0 to 26.17.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7439
2023-06-27 12:48:51 -04:00
Matt Burgess c90625a3e8
NIFI-11753: Remove deprecated JRuby and Luaj script engines
This closes #7436

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:35:57 -05:00
dan-s1 7748d9d1e5
NIFI-11747 Refactored Groovy tests in nifi-web-api to Java (and JUnit 5)
This closes #7434

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:18:48 -05:00
Chris Sampson 3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
This closes #6816

Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00
Bence Simon c5946b2e6c
NIFI-11745 Upgraded QuestDB from 6.7 to 7.2
This closes #7430

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:45:36 -05:00
exceptionfactory 1f1c5df5a3
NIFI-11673 Removed Legacy TLS Configuration Versions
This closes #7367

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-26 11:10:39 +02:00
timeabarna ba6797bb94
NIFI-3065 Per Process Group logging (#7315)
* NIFI-3065 Per Process Group logging
2023-06-23 21:14:34 -04:00
exceptionfactory 7d6af0dbb0 NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7428
2023-06-23 18:27:36 -04:00
exceptionfactory bdd7ef3671 NIFI-11744 Added Required Permission to Reference Remote Resources
- Applied Required Permission to components supporting URL Resource References

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7426
2023-06-23 18:07:16 -04:00
Timea Barna dceee57dfd
NIFI-11705 Append Operating System section in NiFi diagnostic tool
This closes #7388

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-23 16:36:51 -05:00
Bryan Bende 40014486a4
NIFI-11492 Allow authorization to proceed based on request groups even if user does not exist
This closes #7425

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 15:50:23 -05:00
Tanmaya Panda bd33f2c911
NIFI-8294 Added QueryAzureDataExplorer and StandardKustoQueryService
This closes #7122

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 15:26:47 -05:00
Mark Payne ce623632cf
NIFI-11243: Implemented Dependent Properties on the Python side
This closes #7323

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 13:03:43 -05:00
exceptionfactory 0f736e060a
NIFI-11735 Refactored Identity Provider Groups Handling (#7419)
- Removed H2 database approach in favor of passing groups in Application Bearer Token
2023-06-22 11:07:23 -04:00
exceptionfactory 3ddac48c6d NIFI-11734 Upgraded Apache Accumulo from 2.1.0 to 2.1.1
This closes #7418

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 15:42:05 -04:00
mr1716 f62e1eb1e9
NIFI-11732 Upgraded Saxon from 12.1 to 12.2
- Adjusted spacing in test HTML to match Saxon 12.2 serialization

This closes #7414

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-21 11:01:45 -05:00
dan-s1 5db06437a3 NIFI-11638 Refactored Groovy tests in nifi-cdc/nifi-cdc-mysql-bundle/nifi-cdc-mysql-processors to Java (and JUnit 5)
NIFI-11638 Removed groovy-json dependency

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7408
2023-06-21 10:25:17 -04:00
Matt Burgess 84fdb5e32f NIFI-7016: Fix Groovy File functions available for FlowFile in ExecuteGroovyScript
This closes #7016

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 06:23:59 -04:00
exceptionfactory 26d02fff49 NIFI-11729 Upgraded OWASP Dependency Check from 8.2.1 to 8.3.1
- Updated OWASP suppressions to exclude several JSON and Kafka false positives
- Excluded JUnit dependency from Hive 3 JDBC

This closes #7411

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 06:14:22 -04:00
mr1716 05322fa8ce
NIFI-11730 Upgraded UnboundID LDAP SDK from 6.0.8 to 6.0.9
This closes #7412

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-20 17:12:05 -05:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
exceptionfactory 7b6a51aa9f NIFI-11728 Removed RethinkDB Processors
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7410
2023-06-20 16:15:13 -04:00
mr1716 3ac1876ecb NIFI-11731 Update json-schema-validator to 1.0.84
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7413
2023-06-20 12:52:50 -04:00
Peter Turcsanyi 4082951506
NIFI-11708: Upgraded snowflake-ingest-sdk to 2.0.1 and snowflake-jdbc to 3.13.33
This closes #7393

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-20 18:12:34 +02:00
mr1716 a5ae155839
NIFI-11725 Upgraded Woodstox from 6.5.0 to 6.5.1
This closes #7407

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:05:01 -05:00
mr1716 b8c5bb661e
NIFI-11724 Upgraded parquet-avro from 1.13.0 to 1.13.1
This closes #7406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:04:15 -05:00
mr1716 69ef6c6971
NIFI-11723 Upgraded Jedis from 3.9.0 to 3.10.0
This closes #7405

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:03:32 -05:00
mr1716 d252ed5e1b
NIFI-11722 Upgraded Spring Data Redis from 2.7.10 to 2.7.13
This closes #7404

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:02:07 -05:00
mr1716 8be9b01677
NIFI-11720 Upgraded HBase from 2.5.3 to 2.5.5
This closes #7402

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:01:15 -05:00
exceptionfactory 0ed1efc50a
NIFI-11712 Removed java.net.preferIPv4Stack from bootstrap.conf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7392.
2023-06-19 10:22:31 +02:00
exceptionfactory b6b621bf9e
NIFI-11717 Updated Required Java Version to 17.0.6
- Added Groovy Plugin Repository for groovy-eclipse-compiler

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7397.
2023-06-19 10:19:55 +02:00
Matt Burgess 8a696c1dfa
NIFI-11715 Removed unused user-defined property support from PutDatabaseRecord and DistributedMapCacheLookupService
This closes #7395

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 16:23:43 -05:00
dan-s1 e4d1dab8f7
NIFI-11167 Added ExcelReader to nifi-poi-nar
- Moved shared schema inference components to nifi-record-serialization-services-shared

This closes #7194

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:50:08 -05:00
Matt Burgess bc6ac4b700
NIFI-11682 Correct Quoting for UPSERT and INSERT_IGNORE keys in PutDatabaseRecord
This closes #7385

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:05:03 -05:00
exceptionfactory ce019071a4 NIFI-11713 Removed Deprecated ECMAScript Support
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7394
2023-06-16 14:23:51 -04:00
Peter Turcsanyi b36570f2cd
NIFI-11699 Fixed dynamic properties in SnowflakeComputingConnectionPool
Also fixed driver class name handling (caused IT test failure).
Other test fixes to make IT tests work.

This closes #7387

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:40:57 -05:00
mr1716 7c7b7c026b
NIFI-11710 Corrected nifi-kafka-2-6-nar Description
This closes #7390

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:39:46 -05:00
exceptionfactory 6b19ab8eaa NIFI-11696 Upgraded Bouncy Castle from 1.71 to 1.74
- Adjusted nifi-repository-encryption to remove dependency on Bouncy Castle Provider
- Updated Google Cloud Provider dependencies to remove exclusions and dependencies on Bouncy Castle that no longer apply to current versions

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7384
2023-06-15 16:33:20 -04:00
exceptionfactory 4638d2e251
NIFI-11635 Upgraded IoTDB from 1.0.1 to 1.1.1
- Excluded transitive test dependencies to avoid SNAPSHOT versions

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7382.
2023-06-15 13:39:11 +02:00
Matt Burgess 760949922c
NIFI-11691 Support VARBINARY and LONGVARBINARY in PutDatabaseRecord
This closes #7380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 21:01:02 -05:00
Matthew Burgess 991e5e24de
NIFI-4957 Add Resource File Support for Jolt Specifications
This closes #4044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 16:01:02 -05:00
mr1716 17efd87bae
NIFI-11687 Upgraded Hazelcast from 5.3.0 to 5.3.1
This closes #7375

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:45 -05:00
mr1716 8cd1b4b76c
NIFI-11685 Upgraded zstd-jni from 1.5.5-3 to 1.5.5-4
This closes #7376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:07 -05:00
mr1716 4b6209ed20
NIFI-11684 Upgraded Brotli4j from 1.11.0 to 1.12.0
This closes #7377

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:27:26 -05:00
Jeyassri Balchandran 8382b0a7a3
NIFI-11540 Removed legacy segment attributes from MergeContent
This closes #7305

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 18:37:48 -05:00
exceptionfactory ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
2023-06-13 15:36:23 -04:00
Emilio Setiadarma 31e1c17d44
NIFI-11642 Updated PutSNS using AWS SDK 2
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 13:50:22 -05:00
Paul Grey 336b857442
NIFI-11553 Add Record handling and more Properties for GCP PubSub
- Added Message Derivation Strategy to PublishGCPubSub with FlowFile and Record options
- Added API Endpoint property to PublishGCPPubSub and ConsumeGCPubSub
- Added Batch configuration properties

This closes #7274

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 11:00:51 -05:00
exceptionfactory 9c2f15cc18
NIFI-11680 Corrected Buffer Size Calculation for Connection Balancing (#7370)
- Resolved BufferOverflowException in PeerChannel with Bouncy Castle Provider
- Changed prepareForWrite() to use Destination Buffer remaining instead of Application Buffer Size
- Changed encrypt() to Packet Buffer Size instead of Application Buffer Size
2023-06-13 11:01:27 -04:00
Mark Payne 787e0d8261
NIFI-11681: Terminate Process Sessions before interrupting processor threads
This closes #7371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 08:24:03 -05:00
Paul Grey 45e8226f89
NIFI-11672 Adjusted ListSFTP to handle incomplete File Types
- Modified file handling to include both REGULAR and UNKNOWN File Types returned from an SFTP server

This closes #7365

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 11:25:22 -05:00
Mark Payne 702c635034
NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile
Rather than creating many FlowFiles with the same Content Claim, refactored content repos' OutputStreams and ClaimWriteCache so that a new ContentClaim is created for each FlowFile. This ensures that we have a content claim offset of 0. The poor performance was due to having to use StreamUtils.skip() in conjunction with the CipherInputStream, which would only skip a max of 511 bytes at a time. By using a separate Content Claim per FlowFile, we no longer need to seek after creating the CipherInputStream

This closes #7363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 09:47:44 -05:00
exceptionfactory 7485687d4b
NIFI-11657 Removed Deprecated PutBigQueryBatch and PutBigQueryStreaming
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7351.
2023-06-11 15:49:42 +02:00
exceptionfactory 9374039312
NIFI-11674 Upgraded Apache Iceberg from 1.2.1 to 1.3.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7364.
2023-06-11 15:43:58 +02:00
mr1716 054df20aed
NIFI-11665 Upgraded oauth2-oidc-sdk from 9.43.1 to 9.43.3
This closes #7358

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
Matt Burgess 5e6f3abdd2
NIFI-11655 Fixed float and double handling in GenerateRecord
This closes #7356

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
exceptionfactory 4509f5de80 NIFI-11666 Added Exception to Error Log for ModifyCompression
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7360
2023-06-08 11:19:05 -04:00
Matt Burgess f3e8651522 NIFI-11647: Support UUID type in DataTypeUtils.getSQLTypeValue
This closes #7355

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-08 11:13:07 -04:00
Nandor Soma Abonyi 10a2815527
NIFI-11659 Removed unnecessary Jackson 1 dependencies
This closes #7354

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-07 15:04:43 -05:00
exceptionfactory 9195b586e5
NIFI-11656 Removed deprecated Azure Queue Storage Processors
- Removed AzureStorageCredentialsControllerService and related implementations
- Removed com.micrsoft.azure:azure-storage dependencies

This closes #7350

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-07 16:19:38 +02:00
siddr dd2486d3e0 NIFI-11587: Update questdb to 6.7
This closes #7319
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-06-07 09:39:44 +02:00
siddr e72ca689c2
NIFI-11643 Upgraded geoip2 from 2.16.1 to 4.0.1
This closes #7341

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 15:31:39 -05:00
exceptionfactory 4faf3ea598
NIFI-11653 This closes #7349. Added Connection URL Validation for Database Services
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-06 09:29:48 -07:00
mr1716 d956ede743
NIFI-11649 Upgraded icu4j from 72.1 to 73.1
This closes #7346

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:42:17 -05:00
mr1716 e6c2c7c7ee
NIFI-11652 Upgraded Jolt from 0.1.7 to 0.1.8
This closes #7348

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:30:36 -05:00
exceptionfactory c5c711c91d
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
- Added selective overrides to upgrade transitive dependencies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
Emilio Setiadarma b11373af7b
NIFI-11549 Added AzureQueueStorage_v12 Processors
- Deprecated GetAzureQueueStorage and PutAzureQueueStorage

This closes #7269

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 16:26:02 -05:00
Shane Ardell 7a7f6f6229
NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:36:49 -07:00
dependabot[bot] 88d7b3905b
NIFI-11644 Upgraded Hazelcast from 4.2.7 to 5.3.0
This closes #7282

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 14:49:22 -05:00
Matt Burgess d200186096
NIFI-11567: Auto-reload database file in GeoEnrichIP processors (#7266)
NIFI-11567: Auto-reload database file in GeoEnrichIP processors
2023-06-05 13:54:17 -04:00
Bryan Bende ce50ffbe0e
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:11:33 -04:00
Peter Turcsanyi 963518d943
NIFI-11586 Added AzureStorageCredentialsControllerServiceLookup_v12
Also added client caching in blob v_12 processors which was needed to support multiple credentials provided by the new lookup service

This closes #7300

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-05 13:07:02 +02:00
Peter Turcsanyi 803868935a
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 14:59:07 -05:00
Mark Payne df9f8ddcfb NIFI-11636: Do not buffer Parquet content into memory unnecessarily
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7334
2023-06-02 15:35:10 -04:00
exceptionfactory ec525b0437
NIFI-11629 This closes #7327. Added Socket Write Timeout to InvokeHTTP
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-02 08:04:25 -07:00
Joe Gresock 3ef4439879
NIFI-8287 Upgraded SQS Processors to use AWS SDK 2
This closes #7211

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 21:53:33 -05:00
Scott Aslan 7a10ba6165
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:13:08 -04:00
Matthew Burgess 3ebe8f2983
NIFI-11538: This closes #7239. Fix primitive type conversion for PutIceberg 2023-06-01 12:29:38 -07:00
Mark Payne 50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
exceptionfactory b042eb01e8
NIFI-11614 Improved Validation for JndiJmsConnectionFactoryProvider
This closes #7313.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-01 19:53:18 +02:00
Pierre Villard d4f301f473
NIFI-11620 Upgraded Google libraries-bom from 26.12.0 to 26.15.0
This closes #7321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:44 -05:00
Pierre Villard 06b49cbc32
NIFI-11619 Upgraded Azure BOM from 1.2.11 to 1.2.13
This closes #7320

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:04 -05:00
Mark Payne 4b7e20740e
NIFI-11591: Added additional logging for DynamicallyModifyClasspath system test
This closes #7312

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:23:07 -05:00
Mark Payne ac810671c5 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7322
2023-05-31 17:07:39 -04:00
Steven Matison 645618a609
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery
This closes #7316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 14:32:01 -05:00
Bence Simon 007bf3bcec
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 11:02:48 -05:00
siddr b6802ffed8
NIFI-11598 Upgrade gremlin.version from 3.6.2 to 3.6.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7311.
2023-05-31 15:06:39 +02:00
Peter Turcsanyi 02374798d2
NIFI-11615: Logging fixes in AMQP bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7314.
2023-05-31 13:03:41 +02:00
Michael Moser eca4f5d68f
NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232)
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:06 -04:00
Peter Turcsanyi 3bd4b49abe NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 16:25:28 +02:00
mr1716 bfa4b178ee NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10
This closes #7307

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 14:07:44 -04:00
Mark Bathori cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
Peter Turcsanyi de62c6261f Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
This reverts commit 4e304ac586.
2023-05-26 11:07:45 +02:00
Mark Bathori 4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
dan-s1 d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
Mike Moser a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
mr1716 4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
mr1716 8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
Peter Turcsanyi e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
mr1716 40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
This closes #7290

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
NissimShiman a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273)
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
Mark Payne ca2a829d47
NIFI-11584 Improved MergeContent stream handling
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
Matthew Burgess adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:40:48 +02:00
Matthew Burgess df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
2023-05-24 10:43:30 +02:00
exceptionfactory 3833b51764
NIFI-11583 Removed GetIgniteCache and PutIgniteCache Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7285.
2023-05-24 09:49:34 +02:00
Mark Payne a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7265
2023-05-23 14:29:29 -04:00
Bence Simon ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:14:39 -05:00
exceptionfactory c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7264.
2023-05-21 07:17:52 -04:00
Pierre Villard a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4
This closes #7277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:58 -05:00
Pierre Villard 0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
mr1716 141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
Mike Thomsen c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor.
NIFI-11221 Style check fixes

NIFI-11221 Removed dead code.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7213
2023-05-19 10:53:28 -04:00
Joe Gresock 28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:24:13 -04:00
Lehel Boér 6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7263
2023-05-18 15:54:08 -04:00
Lehel 1a38bf003e
NIFI-11547 Fixed DBCPConnectionPool verification
- Added unit test for AbstractDBCPConnectionPool

This closes #7249

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 10:51:29 -05:00
siddr 607b53504b
NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3
This closes #7252

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-16 15:48:57 -05:00
exceptionfactory bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations (#7222)
* NIFI-11513 Removed deprecated NarProvider and implementations

- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
Lehel 335365874a
NIFI-11535: Transfer ConnectWebsocket connection configuration FlowFile to relationships
Also moved dto and util packages under org.apache.nifi.websocket.jetty

This closes #7246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 15:26:35 +02:00
Matthew Burgess 78fd7fadcd
NIFI-11380: Refactor CaptureChangeMySQL with improvements
This closes #7116

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-16 12:12:18 +02:00
exceptionfactory 8ebecdc3ab
NIFI-11554 Upgraded OpenSAML from 3.4.6 to 4.3.0
- Added Shibboleth repository for OpenSAML
- Replaced deprecated OpenSAML 3 Spring Security components with OpenSAML 4

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7251.
2023-05-16 10:34:23 +02:00
krisztina-zsihovszki 3051b69a6c
NIFI-11544 Fixed REL_FAILURE usage in AbstractIcebergProcessor
This closes #7241.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 09:43:47 +02:00
exceptionfactory bec6ceda1f
NIFI-11548 Upgraded Apache Tika from 2.7.0 to 2.8.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7247.
2023-05-15 20:41:22 +02:00
Ryan Van Den Bos 658f2547d8
NIFI-11430 - PaginatedJsonQueryElasticsearch processors should not output empty FlowFile if hits have been found; PaginatedJsonQueryElasticsearch processors should be able to use _source and _meta only result formats when grouping by query
This closes #7163

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-05-13 19:35:20 +01:00
exceptionfactory f7e36a07ac
NIFI-11228 Removed deprecated Azure Blob Storage Processors
This closes #7234

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-12 17:33:28 +02:00
Nissim Shiman fd2138b8cf NIFI-10756 Generate error message when processor and/or controller
service is unable to transition to start and/or enabled state

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-05-12 14:40:47 +00:00
M Tien 09cef4ff99
NIFI-11287: detect dependent properties when the property it depends on references a parameter (UI) (#7117)
* NIFI-11287: detect dependent properties when the property it depends on references a parameter

* address review feedback

* address more review comments

* - loadProperties checks type before getting the parameter context
- retrieve the parameter context with ajax call from inside the class

* add type parameter to all places calling loadProperties

* get reference parameters by invoking provided callbacks from the client

* check for user permissions before requesting for referenced parameters

* address review feedback

This closes #7117
2023-05-11 17:00:57 -04:00
Nandor Soma Abonyi 2049d5068b
NIFI-11524 Improved ExecuteStreamCommand documentation and configuration
This closes #7228

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-11 14:52:21 -05:00
exceptionfactory e302f2aff7
NIFI-10976 Added Previous Cluster State Provider configuration (#7235)
- Added methods to enumerate Stored Component Identifiers on State Provider interface and implementations
- Added nifi.state.management.provider.cluster.previous to nifi.properties
- Updated State Manager Provider to restore Cluster State from Previous Cluster Provider
- Updated Configuring State Providers documentation for new property
2023-05-10 16:22:05 -04:00
Timea Barna 5811a9c579
NIFI-11385 Added JMX Metrics REST Resource for Diagnostics
This closes #7124

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-08 08:11:20 -05:00
Emilio Setiadarma 340b5fcb00
NIFI-11526 Refactored DatabaseRecordSinkTest to Java from Groovy
This closes #7229

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-05 08:53:00 -05:00
Lehel Boér 265b132e73
NIFI-11493: Defaulted dynamically modified classpath fix
This closes #7201.

Co-authored-by: Peter Turcsanyi <turcsanyi@apache.org>
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-04 15:20:56 +02:00
Bence Simon 4e9675475c NIFI-11523 Refining schema handling for ScriptedTransfromRecord
This closes #7226

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:34:28 -04:00
mr1716 d754d952c2 NIFI-11522 Upgrade cassandra.sdk.version to 3.11.3
This closes #7225

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-03 19:29:35 -04:00
mkalavala aad7b40bd9
NIFI-11360 Added Client-Side Encryption for Azure Blob v12 Processors
This closes #7182

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-02 20:37:33 -05:00
dan-s1 e4cdb90a75 [NIFI-11509] Added configuration to allow for parsing comments in JSON.
This closes #7220

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:18:47 -04:00
dan-s1 71c7d38c75 [NIFI-11511] Added Provenance route events for all the relationships.
This closes #7221

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 08:03:49 -04:00
Pierre Villard 9f3284393a NIFI-11510 - Upgrade Box SDK to 4.1.0
This closes #7219

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-02 07:50:40 -04:00