Commit Graph

21 Commits

Author SHA1 Message Date
exceptionfactory 7f536117b1
NIFI-13219 Corrected phase for python-extensions-bundle plugins
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-13 16:58:50 -05:00
Mark Bathori b608e5a2f0
NIFI-12831: Add PutOpenSearchVector and QueryOpenSearchVector processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8441.
2024-05-02 21:03:52 +02:00
exceptionfactory 49c8d1b490
NIFI-13097 Set project.version in Python Extension Processors
- Enabled resource filtering for Python Extension modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8700.
2024-05-02 20:07:22 +02:00
Zoltan Kornel Torok 99d8433b7d
NIFI-13118: Add LANGUAGE to property_descriptor list
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8720.
2024-04-30 18:39:09 -04:00
dependabot[bot] ac6c9c6ca4
NIFI-12869 - Bump langchain from 0.1.2 to 0.1.11
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.1.2 to 0.1.11.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.1.2...v0.1.11)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8479.
2024-03-06 22:47:56 +01:00
Alex Ethier 4b4ca30fc0
NIFI-12791 Added pillow-heif to ParseDocument Processor
- Set explicit dependency versions for ParseDocument Processor

This closes #8411

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 19:30:25 -06:00
Pierre Villard 3afeac6341
NIFI-12636 - Upgrade dependencies for Pinecone, ChromaDB and OpenAI processors
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8293.
2024-02-08 16:05:45 -05:00
exceptionfactory dff7ea3535
NIFI-12646 Set Python Processor versions to 2.0.0-SNAPSHOT 2024-01-29 08:12:42 -06:00
exceptionfactory 5ca7b0df81 NIFI-12646-RC4 prepare for next development iteration 2024-01-25 18:11:30 -06:00
exceptionfactory 640b7bdfbb NIFI-12646-RC4 prepare release nifi-2.0.0-M2-RC4 2024-01-25 18:11:28 -06:00
exceptionfactory 38fc0a4e8d
NIFI-12646 Set Python Processor version to 2.0.0-M2
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-25 17:54:32 -06:00
Pierre Villard 89836f32d0
NIFI-12660 Added missing Filter property to QueryPinecone
This closes #8292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-23 11:11:14 -06:00
Pierre Villard f402970132
NIFI-12629 - adding metadata filtering to QueryPinecone (#8264)
* NIFI-12629 - adding metadata filtering to QueryPinecone
2024-01-19 13:03:38 -05:00
Mark Payne 2acc1038c9
NIFI-12616 Added Processor Documentation Support for Python
- Added some Use Case docs for Python processors and updated Runtime Manifests to include Python based processors as well as Use Case/MultiProcessorUseCase documentation elements. Refactored/cleaned up some of the Python code and added unit tests.

- Added python-unit-tests profile and enabled on Ubuntu and macOS GitHub workflows

This closes #8253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-18 19:12:05 -06:00
Pierre Villard 6e9da11be9
NIFI-12619 Fixed Python dependencies in ParseDocument
This closes #8255

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-17 14:28:34 -06:00
Mark Payne 2897618635
NIFI-12536: This closes #8178. Used proper method for converting byte array to String
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-21 10:45:15 -07:00
krisztina-zsihovszki 2d82cdc0f5
NIFI-12366 Add HuggingFace support to Pinecone processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8026.
2023-11-29 11:33:30 +01:00
exceptionfactory 00fd7d7cca NIFI-12361-RC6 prepare for next development iteration 2023-11-22 18:35:27 -06:00
exceptionfactory 49fa0d8674 NIFI-12361-RC6 prepare release nifi-2.0.0-M1-RC6 2023-11-22 18:35:26 -06:00
Mark Payne aff4e5fd1b
NIFI-12340: Only call PythonBridge.onProcessorRemoved for python based processors, not all processors. Do so in a background virtual thread. Also specified explicit versions for openai dependencies to ensure correctness, since the newly released 1.x is not yet compatible with the latest langchain
This closes #8001

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-10 08:41:53 -06:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00