- Refactored Confluent Encoded handling to Schema Reference Reader and Schema Reference Writer implementations
- Removed Schema Protocol Version from Schema Registry Service associated with Hortonworks Schema Registry
- Configured StreamReadConstraints on the ObjectMapper used by StandardDataFlow
This closes#7985
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Updated DSA Key Size from 1024 to 2048
- Updated Content Signer Algorithm from SHA-1 to SHA-256
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#7992.
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes#7967
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
Registry
- Corrected component property reference in sorting of response objects
This closes#7977
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes
This closes#7973
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.
Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install
- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone
NIFI-12195 Added support for requirements.txt to define Python dependencies
This closes#7894
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers
This closes#7955
Signed-off-by: David Handermann <exceptionfactory@apache.org>
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties
This closes#7964
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files
This closes#7951
Signed-off-by: Mike Moser <mosermw@apache.org>
- Replaced Long.toHexString() with String.format() using pattern with leading 0
This closes#7926
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Set fetch.failure.reason to relationship name when routing to failure relationships
This closes#7929
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors
Signed-off-by: Joseph Witt <joewitt@apache.org>
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#7948.
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#7947.
The py4j.url property allows the URL for downloading py4j to be specified by a Maven command-line option
This closes#7946
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Added standard implementation for formatting Subject and Issuer using RFC 1779
- Replaced direct method references to maintain compatibility with historical getSubjectDN and getIssuerDN methods
This closes#7931
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
- Added ability to get raw property values from PropertyConfiguration instead of just effective values
- Updated TestRunner to allow for testing these migration methods
- Auto-enable newly created controller services if they are valid
- Eliminated Proxy properties in all AWS processors and instead just make use of the Proxy Configuration controller service
- Eliminated authentication properties from AWS processors and migrated all processors to using Controller Service or authentication
This closes#7874
Signed-off-by: David Handermann <exceptionfactory@apache.org>
NIFI-12245: Removed null check that is no longer necessary
NIFI-12245: Fixed checkstyle violation
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes#7899
- Adjusted JsonTreeReader implementation for sharing common Jackson components
This closes#7665
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Replaced Groovy implementation with Java classes
- Added StandardEncryptConfig and RegistryEncryptConfig command implementations
- Added FileTransformer interface with implementations for configuration files
- Changed -A to -u for output authorizers.xml when targeting Registry
- Removed --newFlowProvider option not used
- Removed --translateCli option
- Removed --decrypt option
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes#7901.
* NIFI-11874 update Process Group configuration layout in the UI
* NIFI-11874: relocate checkbox for recursive application of paramenter context
* NIFI-11874 remove comments tab from process group configuration
* NIFI-11874 minor cleanup of float CSS for process-group-parameter-context-combo
This closes#7591
NIFI-12253 Route to not found relationship instead of rolling back in GeoEnrichIPRecord
This closes#7909
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Removed Legacy Authorized Users File property from FileUserGroupProvider
- Removed unused methods from FileAccessPolicyProvider and FileUserGroupProvider
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#7910.
- Do not include the absolute.path attribute from Zip/Tar files in UnpackContent; some code cleanup
This closes#7902
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Clearing the password in the login form when login fails or unable to verify access once authentication succeeds.
This closes#11909
Signed-off-by: David Handermann <exceptionfactory@apache.org>
Fixed bug where parameter context descriptions were not loaded on NiFi startup and overwritten as empty
This closes: #7787
Signed-off-by: David Handermann <exceptionfactory@apache.org>
* NIFI-12206 Refactored Flow History using JetBrains Xodus
- Replaced H2 Database Engine with JetBrains Xodus for persistent storage of FlowConfigurationHistory
- Added EntityStoreAuditService implementation using Xodus PersistentEntityStore
- Removed nifi.h2.url.append from properties
- Ensure that after restoring nars in the lib/ directory we restart NiFi so that they take effect. This is important if this test is not the last one to run
This closes#7837
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- SensitiveValueEncoder and SecureHasher are no longer required following the removal of support for flow.xml.gz
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#7873.
- Created NIFI-12203 to evaluate issues with flow comparison surfaced in JoinClusterWithDifferentFlow
This closes#7661
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
- Included ClassLoader isolation to work around Splunk Service static configuration limitations
This closes#7668
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Removed ProxyFTPClient extension of standard FTPClient no longer required following changes implemented in NET-650
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes#7855.
- Eliminated unused parseEvent method signatures from StrictSyslog5424Parser in favor of a single String line method
- Eliminated intermediate conversion from String to byte array and back to String for Syslog Parser
Signed-off-by: Joseph Witt <joewitt@apache.org>
- Added ListenOTLP Processor supporting OpenTelemetry OTLP 1.0.0 Specification with gRPC and HTTP
- Updated nifi-event-transport to support configurable SSLParameters for configurable Cipher Suites
Signed-off-by: Joseph Witt <joewitt@apache.org>
Revamped RuleViolationsManager and FlowAnalyzer handling to make sure no issue occurs when these are not set. Fix ResourceNotFoundException: When determining the subject permissions for a rule violation the type of the subject is now known, so we try to lookup all possible types. Non-matching tpyes throw a ResourceNotFoundException exception though. Going to ignore those.
This closes#7809
Signed-off-by: David Handermann <exceptionfactory@apache.org>
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS
Signed-off-by: Joseph Witt <joewitt@apache.org>
- Set getClusterNodeProtocolMaxPoolSize method reference in place of deprecated getClusterNodeProtocolThreads
Signed-off-by: Joseph Witt <joewitt@apache.org>
Umar Hussain
Pierre Villard
David Handermann
Mike Moser
Mark Payne
Malthe Borch
Nissim Shiman
Bryan Bende
lehelb
Joe Gresock
Peter Turcsanyi
Paul Grey
dependabot[bot]
nathluu
annanys23
Mark Bathori
Mark Bean
Matt Burgess
Shane Ardell
dan-s1
Chris Sampson
Matt Gilman
András Kovács
Gabor Gyimesi
Shane Ardell
Zackeus Bengtsson
levilentz
Bence Simon
timeabarna
Nandor Soma Abonyi
mkalavala
mr1716
Lehel Boer
Tamas Palfy
Emilio Setiadarma
Joe Witt
Arpad Boda