Commit Graph

9078 Commits

Author SHA1 Message Date
mr1716 703ea34c66
NIFI-12348 Update jetty.version to 10.0.18
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8010.
2023-11-13 09:50:55 +01:00
Joe Gresock ec884ac091
NIFI-12212 Upgraded DynamoDB Processors to AWS SDK 2
This closes #7911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:30:30 -06:00
mr1716 582c3ac7cc
NIFI-12347 Upgraded AWS Kinesis from 2.5.2 to 2.5.3
This closes #8007

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:28:11 -06:00
mr1716 246ffe4ee9
NIFI-12346 Upgraded Apache Calcite from 1.35.0 to 1.36.0
This closes #8009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:27:07 -06:00
mr1716 4a4eb2c109
NIFI-12345 Upgraded Commons DBCP from 2.10.0 to 2.11.0
This closes #8006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-11 23:25:57 -06:00
Umar Hussain 4f4e99085d
NIFI-11995 Added Header Format configuration to ConsumeAMQP
This closes #7652

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:32:13 -06:00
Pierre Villard eb7d49cdff
NIFI-12344 PutKudu Operation should accept Debezium Types
This closes #8004

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 12:02:55 -06:00
Pierre Villard 279084ddfe
NIFI-12233 Added Parameter Provider for 1Password
This closes #7884

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 11:57:16 -06:00
David Handermann 57ed9ad675
NIFI-12332 Removed nifi-toolkit-flowfile-repo Module (#7996) 2023-11-10 12:28:00 -05:00
David Handermann dabdf94bf1
NIFI-12339 Fixed Property Decryption for Migrated Components (#8002)
- Updated StandardVersionedComponentSynchronizer to decrypt properties when creating extension references for subsequent migration
2023-11-10 11:50:03 -05:00
Mike Moser 832d4455c1
NIFI-12121 Added Transform Result Filter to JSLTTransformJSON
This closes #7922

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 10:37:17 -06:00
Ferenc Erdei 61bb01560d
NIFI-12333 MiNiFi property override through env and system variables
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #7997.
2023-11-10 16:20:41 +01:00
Mark Payne aff4e5fd1b
NIFI-12340: Only call PythonBridge.onProcessorRemoved for python based processors, not all processors. Do so in a background virtual thread. Also specified explicit versions for openai dependencies to ensure correctness, since the newly released 1.x is not yet compatible with the latest langchain
This closes #8001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 08:41:53 -06:00
Mark Payne 3b6c482db3 NIFI-12341: Fixed typo in expression language guide 2023-11-09 09:52:34 -05:00
mr1716 2c89e3a21d
NIFI-12336 Upgraded Mockito from 5.5.0 to 5.7.0
This closes #8000

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-08 16:14:25 -06:00
exceptionfactory 5554bab516
NIFI-12192 Added Codecov Reporting with JaCoCo
- Added report-code-coverage profile to nifi-assembly for aggregation
- Added Codecov reporting to Ubuntu Linux Job in ci-workflow
- Added Codecov badge to README.md

This closes #7995

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-11-08 19:49:51 +00:00
Ferenc Erdei 4430effe00 NIFI-12335 Fix MiNiFi startup issue
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #7998.
2023-11-08 17:17:10 +01:00
exceptionfactory 3dcfc919bb
NIFI-12261 Added Schema Reference Reader and Writer Services (#7991)
- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
2023-11-08 08:55:58 -05:00
markap14 8b0abd45df
NIFI-12330: When synchronizing flow, pause component scheduling until after property migration has completed (#7994) 2023-11-07 16:46:27 -05:00
Malthe Borch 0fe9d2b56f
NIFI-9972 Added CopyAzureBlobStorage_v12 Processor
This closes #6941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 13:13:25 -06:00
Nissim Shiman 013ca6da7d
NIFI-11463 Added Config Strategy to IdentifyMimeType
This closes #7781

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:39:48 -06:00
Mark Payne a978406c83
NIFI-12326: When a Python Processor is created, it attempts to download dependencies in the background and then load the processor code. If that fails, it previously gave up; now it will log the exception and keep trying
This closes #7990

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:07:59 -06:00
Bryan Bende 940c9276c5
NIFI-12323 Removed String Length Limits from JSON Flow Configuration
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow

This closes #7985

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-07 09:03:13 -06:00
exceptionfactory a89fb17f9f
NIFI-12328 Updated OpenPGP test Key Generator Settings
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7992.
2023-11-07 13:03:07 +01:00
mr1716 50e2fff05c
NIFI-12325 Upgraded Commons CLI from 1.5.0 to 1.6.0
This closes #7988

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 20:55:27 -06:00
mr1716 7cc6c2ee8a
NIFI-12324 Upgraded swagger-annotations from 1.6.11 to 1.6.12
This closes #7987

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 20:54:47 -06:00
exceptionfactory b50557b854
NIFI-12321 Avoid Exceptions when removing Python Processors (#7984)
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
2023-11-06 16:17:41 -05:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 12:01:49 -06:00
mr1716 f650c2078a
NIFI-12320 Upgraded Jackson BOM from 2.15.2 to 2.15.3
This closes #7983

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 11:53:10 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
exceptionfactory ccd2f0677d
NIFI-12316 Upgraded MySQL Connector J from 8.1.0 to 8.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7979.
2023-11-03 23:54:19 -07:00
lehelb 21387316e3
NIFI-10222 Added Apicurio Schema Registry Service
This closes #7913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 15:30:08 -05:00
exceptionfactory 309061ca2d
NIFI-12310 Validate Python Component Type for Processes (#7972)
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
2023-11-03 14:42:08 -04:00
annanys23 dcc4b8590f
NIFI-8673 Documented Active Threads versus Cluster Summary details
Documented difference between Active Threads in Status bar versus as shown by Node in Cluster Summary

This closes #7978

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:36:34 -05:00
lehelb 514c8d8a6a
NIFI-12314 Fix EL for SQL Query Property in QueryNiFiReportingTask
This closes #7976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:34:01 -05:00
Nissim Shiman ed9b23ef3f
NIFI-12315 Resolved issue preventing PG from being imported from
Registry

- Corrected component property reference in sorting of response objects

This closes #7977

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:33:10 -05:00
Joe Gresock 77834c92df
NIFI-12263 Upgraded AWS Machine Learning processors to SDK 2
This closes #7953

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:05:22 -05:00
exceptionfactory c706877147
NIFI-12297 Standardized File Path resolution in Persistence Providers (#7975) 2023-11-03 12:26:11 -04:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 754baf0a37
NIFI-12308: Create Python Environment in background thread instead of during Processor creation
This closes #7971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 15:45:43 -05:00
exceptionfactory f1a34a58fa
NIFI-12307 Upgraded Commons Text from 1.10.0 to 1.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7969.
2023-11-02 09:54:22 -07:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00
exceptionfactory 945d8b54bc
NIFI-12294 Standardized NAR Entry Loading (#7958)
- Consolidated duplicative NAR file entry normalization
2023-11-01 14:10:00 -04:00
Chris Sampson df3f5b4638
NIFI-12299 Run integration-tests when assemblies are updated
This closes #7962

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:24:46 -05:00
Paul Grey 75c661bbbe
NIFI-12194 Added Yield on Exceptions in Kafka Processors
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers

This closes #7955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:08:44 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
Mark Payne 9b33d54f53
NIFI-12301 Corrected hasProperty() check when Migrating Properties
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties

This closes #7964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:41:51 -05:00
Zackeus Bengtsson 33c8029d65
NIFI-12298 add swagger annotations for createExtensionBundleVersion form fields
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7961.
2023-10-31 16:52:57 -07:00