Commit Graph

9062 Commits

Author SHA1 Message Date
Ferenc Erdei 4430effe00 NIFI-12335 Fix MiNiFi startup issue
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #7998.
2023-11-08 17:17:10 +01:00
exceptionfactory 3dcfc919bb
NIFI-12261 Added Schema Reference Reader and Writer Services (#7991)
- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
2023-11-08 08:55:58 -05:00
markap14 8b0abd45df
NIFI-12330: When synchronizing flow, pause component scheduling until after property migration has completed (#7994) 2023-11-07 16:46:27 -05:00
Malthe Borch 0fe9d2b56f
NIFI-9972 Added CopyAzureBlobStorage_v12 Processor
This closes #6941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 13:13:25 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:07:59 -06:00
Bryan Bende 940c9276c5
NIFI-12323 Removed String Length Limits from JSON Flow Configuration
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow

This closes #7985

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:03:13 -06:00
exceptionfactory a89fb17f9f
NIFI-12328 Updated OpenPGP test Key Generator Settings
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7992.
2023-11-07 13:03:07 +01:00
mr1716 50e2fff05c
NIFI-12325 Upgraded Commons CLI from 1.5.0 to 1.6.0
This closes #7988

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 20:55:27 -06:00
mr1716 7cc6c2ee8a
NIFI-12324 Upgraded swagger-annotations from 1.6.11 to 1.6.12
This closes #7987

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 20:54:47 -06:00
exceptionfactory b50557b854
NIFI-12321 Avoid Exceptions when removing Python Processors (#7984)
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
2023-11-06 16:17:41 -05:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 12:01:49 -06:00
mr1716 f650c2078a
NIFI-12320 Upgraded Jackson BOM from 2.15.2 to 2.15.3
This closes #7983

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 11:53:10 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
exceptionfactory ccd2f0677d
NIFI-12316 Upgraded MySQL Connector J from 8.1.0 to 8.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7979.
2023-11-03 23:54:19 -07:00
lehelb 21387316e3
NIFI-10222 Added Apicurio Schema Registry Service
This closes #7913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 15:30:08 -05:00
exceptionfactory 309061ca2d
NIFI-12310 Validate Python Component Type for Processes (#7972)
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
2023-11-03 14:42:08 -04:00
annanys23 dcc4b8590f
NIFI-8673 Documented Active Threads versus Cluster Summary details
Documented difference between Active Threads in Status bar versus as shown by Node in Cluster Summary

This closes #7978

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:36:34 -05:00
lehelb 514c8d8a6a
NIFI-12314 Fix EL for SQL Query Property in QueryNiFiReportingTask
This closes #7976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:34:01 -05:00
Nissim Shiman ed9b23ef3f
NIFI-12315 Resolved issue preventing PG from being imported from
Registry

- Corrected component property reference in sorting of response objects

This closes #7977

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:33:10 -05:00
Joe Gresock 77834c92df
NIFI-12263 Upgraded AWS Machine Learning processors to SDK 2
This closes #7953

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:05:22 -05:00
exceptionfactory c706877147
NIFI-12297 Standardized File Path resolution in Persistence Providers (#7975) 2023-11-03 12:26:11 -04:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 754baf0a37
NIFI-12308: Create Python Environment in background thread instead of during Processor creation
This closes #7971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 15:45:43 -05:00
exceptionfactory f1a34a58fa
NIFI-12307 Upgraded Commons Text from 1.10.0 to 1.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7969.
2023-11-02 09:54:22 -07:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00
exceptionfactory 945d8b54bc
NIFI-12294 Standardized NAR Entry Loading (#7958)
- Consolidated duplicative NAR file entry normalization
2023-11-01 14:10:00 -04:00
Chris Sampson df3f5b4638
NIFI-12299 Run integration-tests when assemblies are updated
This closes #7962

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:24:46 -05:00
Paul Grey 75c661bbbe
NIFI-12194 Added Yield on Exceptions in Kafka Processors
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers

This closes #7955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:08:44 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
Mark Payne 9b33d54f53
NIFI-12301 Corrected hasProperty() check when Migrating Properties
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties

This closes #7964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:41:51 -05:00
Zackeus Bengtsson 33c8029d65
NIFI-12298 add swagger annotations for createExtensionBundleVersion form fields
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7961.
2023-10-31 16:52:57 -07:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-31 14:20:50 -05:00
dependabot[bot] 5c98b7cce0
NIFI-12295 Upgraded ActiveMQ Client from 5.18.2 to 5.18.3
This closes #7956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-30 17:34:59 -05:00
exceptionfactory 786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
nathluu 8e301cfdef
NIFI-12265 Fixed OpenPGP Hexadecimal Key Formatting with leading 0
- Replaced Long.toHexString() with String.format() using pattern with leading 0

This closes #7926

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 15:48:18 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-28 09:23:23 -07:00
exceptionfactory 211a3aa7c4
NIFI-12279 Added nifi-standard-shared-nar to Kafka Connector Tests
- Corrected integration-tests workflow failures

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 08:32:31 -05:00
exceptionfactory 6b265e2120
NIFI-12282 Moved Hadoop and other NARs to Optional Profiles
- Moved Hadoop and Parquet NARs to include-hadoop
- Moved HBase NARs to include-hbase
- Moved Kudu NAR to include-kudu
- Moved Solr NAR to include-solr

This closes #7942.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2023-10-27 21:24:01 -07:00
dependabot[bot] a71cc4bee3
NIFI-12289 Upgraded browserify-sign from 4.2.1 to 4.2.2
This closes #7949

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 21:15:25 -05:00
Mark Bathori b2c4baf429
NIFI-12277 Added SSLContextService to Slack Processors
This closes #7936

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 20:51:50 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Mark Bean 5ecc12f405
NIFI-12285 Added py4j.url build property
The py4j.url property allows the URL for downloading py4j to be specified by a Maven command-line option

This closes #7946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:25:53 -05:00
Mark Bean 94e746dc47
NIFI-12283 Added include-swagger-ui profile with activation by default
Deactivating prevents attempt to download swagger asset from the Internet allowing for offline builds.

This closes #7945

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:24:21 -05:00
exceptionfactory c421172ee2
NIFI-12286 Removed nifi-example-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7944.
2023-10-27 13:44:32 -07:00
exceptionfactory 46b5d8fdc0
NIFI-12284 Upgraded Frontend Maven Plugin from 1.14.0 to 1.14.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7943.
2023-10-27 10:47:19 -07:00