- Removed the non-applicable maxFileSize from TimeBasedRollingPolicy configurations in default logback.xml files to avoid warnings on shutdown
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#8033.
NIFI-4550 New Processor not required based on improvements to IdentifyMimeType
- Added mime.charset FlowFile attribute when not null for text MIME types
This closes#8011
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Moved EventLoopGroup from CacheClientChannelPoolFactory to DistributedCacheClient to enable closing the EventLoopGroup after closing the ChannelPool
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#8027.
NIFI-11788 Standardized Logback maximum settings
- Set MiNiFi maxHistory to 10 and totalSizeCap to 10MB
- Set NiFi maxHistory to 30 and totalSizeCap to 3GB except for deprecation log
- Set Stateless maxHistory to 30 and totalSizeCap to 3GB
- Set Registry maxHistory to 30 and totalSizeCap to 3GB
NIFI-11788 Increased MiNiFi maxFileSize to 10MB and cap to 100MB
This closes#7465. Coauthored by David Handermann and Mike Thomsen
Signed-off-by: Joseph Witt <joewitt@apache.org>
- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow
This closes#7985
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#7992.
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes#7967
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
Registry
- Corrected component property reference in sorting of response objects
This closes#7977
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes
This closes#7973
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.
Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install
- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone
NIFI-12195 Added support for requirements.txt to define Python dependencies
This closes#7894
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers
This closes#7955
Signed-off-by: David Handermann <exceptionfactory@apache.org>
Ferenc Gerlits
Bryan Bende
Mark Payne
Matt Burgess
exceptionfactory
EndzeitBegins
mr1716
Mike Thomsen
Paulette Hines-Cross pliszle
Joe Gresock
Umar Hussain
Pierre Villard
Mike Moser
Malthe Borch
Nissim Shiman
lehelb
Peter Turcsanyi
Paul Grey