Commit Graph

9052 Commits

Author SHA1 Message Date
exceptionfactory b50557b854
NIFI-12321 Avoid Exceptions when removing Python Processors (#7984)
- Updated StandardPythonBridge.onProcessorRemoved to avoid throwing exceptions when called with a Processor Type and Version that is not registered
- Updated system-tests workflow to run on changes in the nifi-py4j-bundle
2023-11-06 16:17:41 -05:00
Pierre Villard b24249c850
NIFI-12322 Added resource usage note in ES Client CS documentation
This closes #7986

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 12:01:49 -06:00
mr1716 f650c2078a
NIFI-12320 Upgraded Jackson BOM from 2.15.2 to 2.15.3
This closes #7983

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-06 11:53:10 -06:00
exceptionfactory 9b29fffbc6 NIFI-12305 Optimized Regular Expression patterns
- Updated SampleRecord range validation to split on comma and validate individual ranges
- Updated AccessPolicyEndpointMerger to restrict the set of characters matched

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7967
2023-11-05 19:26:04 -05:00
exceptionfactory ccd2f0677d
NIFI-12316 Upgraded MySQL Connector J from 8.1.0 to 8.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7979.
2023-11-03 23:54:19 -07:00
lehelb 21387316e3
NIFI-10222 Added Apicurio Schema Registry Service
This closes #7913

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 15:30:08 -05:00
exceptionfactory 309061ca2d
NIFI-12310 Validate Python Component Type for Processes (#7972)
* NIFI-12310 Validated Python Component Type for Processes
- Updated StandardPythonBridge to validate requested Component Type and Version against available Python Processors
2023-11-03 14:42:08 -04:00
annanys23 dcc4b8590f
NIFI-8673 Documented Active Threads versus Cluster Summary details
Documented difference between Active Threads in Status bar versus as shown by Node in Cluster Summary

This closes #7978

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:36:34 -05:00
lehelb 514c8d8a6a
NIFI-12314 Fix EL for SQL Query Property in QueryNiFiReportingTask
This closes #7976

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:34:01 -05:00
Nissim Shiman ed9b23ef3f
NIFI-12315 Resolved issue preventing PG from being imported from
Registry

- Corrected component property reference in sorting of response objects

This closes #7977

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:33:10 -05:00
Joe Gresock 77834c92df
NIFI-12263 Upgraded AWS Machine Learning processors to SDK 2
This closes #7953

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-03 13:05:22 -05:00
exceptionfactory c706877147
NIFI-12297 Standardized File Path resolution in Persistence Providers (#7975) 2023-11-03 12:26:11 -04:00
exceptionfactory 97dd543c6a
NIFI-12293 Standardized HTTP error response messages (#7957)
- Updated ExceptionFilter and AuthenticationFilter with standard messages

This closes #7957
2023-11-03 10:09:47 -04:00
exceptionfactory 168b3e205a
NIFI-12311 Removed Custom Module Support from Jolt UI (#7973)
- Removed custom ClassLoader creation support from the JoltTransformJSON Advanced user interface to avoid issues with loading external classes

This closes #7973
2023-11-03 08:24:19 -04:00
Mark Payne 754baf0a37
NIFI-12308: Create Python Environment in background thread instead of during Processor creation
This closes #7971

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 15:45:43 -05:00
exceptionfactory f1a34a58fa
NIFI-12307 Upgraded Commons Text from 1.10.0 to 1.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7969.
2023-11-02 09:54:22 -07:00
Peter Turcsanyi 3e8db53f88
NIFI-12306 ConsumeAzureEventHub logs partition ownership changes at info level
This closes #7970

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-02 08:01:06 -05:00
Mark Payne 5bcad9eef3
NIFI-12240 Added Python Processors for Docs, ChatGPT, Chroma, and Pinecone
Created new python processors for text embeddings, inserting into Chroma, querying Chroma, querying ChatGPT, inserting into and querying Pinecone. Fixed some bugs in the Python framework. Added Python extensions to assembly. Also added ability to load dependencies from a requirements.txt as that was important for making the different vectorstore implementations play more nicely together.

Excluded nifi-python-extensions-bundle from GitHub build because it requires Maven to use unpack-resources goal, which will not work in GitHub because it uses mvn compile instead of mvn install

- ParseDocument
- ChunkDocument
- PromptChatGPT
- PutChroma
- PutPinecone
- QueryChroma
- QueryPinecone

NIFI-12195 Added support for requirements.txt to define Python dependencies

This closes #7894

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 16:17:36 -05:00
exceptionfactory 945d8b54bc
NIFI-12294 Standardized NAR Entry Loading (#7958)
- Consolidated duplicative NAR file entry normalization
2023-11-01 14:10:00 -04:00
Chris Sampson df3f5b4638
NIFI-12299 Run integration-tests when assemblies are updated
This closes #7962

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:24:46 -05:00
Paul Grey 75c661bbbe
NIFI-12194 Added Yield on Exceptions in Kafka Processors
- Catching KafkaException and yielding for publisher lease requests improves behavior when the Processor is unable to connect to Kafka Brokers

This closes #7955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 11:08:44 -05:00
Peter Turcsanyi 2c0ff6f624
NIFI-12303 Removed deprecated Consumer Hostname property from ConsumeAzureEventHub
This closes #7966

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:44:56 -05:00
Mark Payne 9b33d54f53
NIFI-12301 Corrected hasProperty() check when Migrating Properties
When calling migrateProperties, provide the properties that were configured in the VersionedComponent, rather than creating a new property map based on the component's new properties

This closes #7964

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-11-01 10:41:51 -05:00
Zackeus Bengtsson 33c8029d65
NIFI-12298 add swagger annotations for createExtensionBundleVersion form fields
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7961.
2023-10-31 16:52:57 -07:00
Mark Payne 960498f76b
NIFI-12291: Added additional Use Case Docs
This closes #7954

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-31 14:20:50 -05:00
dependabot[bot] 5c98b7cce0
NIFI-12295 Upgraded ActiveMQ Client from 5.18.2 to 5.18.3
This closes #7956

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-30 17:34:59 -05:00
exceptionfactory 786784ef62 NIFI-12290 Migrated from Quartz to Spring for Cron Expressions
- Removed support for Year field in Cron Expressions
- Changed numeric Day of Week field from starting with 1 to starting with 0
- Removed Quartz and C3P0 from Notice files

This closes #7951

Signed-off-by: Mike Moser <mosermw@apache.org>
2023-10-30 18:47:02 +00:00
nathluu 8e301cfdef
NIFI-12265 Fixed OpenPGP Hexadecimal Key Formatting with leading 0
- Replaced Long.toHexString() with String.format() using pattern with leading 0

This closes #7926

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 15:48:18 -05:00
annanys23 90498a352d
NIFI-12249 FetchFTP and FetchSFTP set fetch.failure.reason on failures
- Set fetch.failure.reason to relationship name when routing to failure relationships

This closes #7929

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 13:01:50 -05:00
exceptionfactory ae14738dea
NIFI-12288 This closes #7950. Improved Long and Integer handling in Utilities
- Added explicit round in FormatUtils.makeWholeNumberTime()
- Removed unnecessary boxing in component descriptors
- Maintained long number tracking for releasable counts in Wait and Notify Processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-28 09:23:23 -07:00
exceptionfactory 211a3aa7c4
NIFI-12279 Added nifi-standard-shared-nar to Kafka Connector Tests
- Corrected integration-tests workflow failures

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-28 08:32:31 -05:00
exceptionfactory 6b265e2120
NIFI-12282 Moved Hadoop and other NARs to Optional Profiles
- Moved Hadoop and Parquet NARs to include-hadoop
- Moved HBase NARs to include-hbase
- Moved Kudu NAR to include-kudu
- Moved Solr NAR to include-solr

This closes #7942.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2023-10-27 21:24:01 -07:00
dependabot[bot] a71cc4bee3
NIFI-12289 Upgraded browserify-sign from 4.2.1 to 4.2.2
This closes #7949

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 21:15:25 -05:00
Mark Bathori b2c4baf429
NIFI-12277 Added SSLContextService to Slack Processors
This closes #7936

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 20:51:50 -05:00
exceptionfactory 0e1ae2bd6f
NIFI-12276 Addressed Dependency Check Findings
- Added dependency-check GitHub workflow
- Upgraded Janino Commons Compiler from 3.1.9 to 3.1.10
- Upgraded Azure SDK BOM from 1.2.16 to 1.2.17
- Upgraded GCP SDK BOM from 26.17.0 to 26.25.0
- Upgraded AWS SDK from 1.12.550 to 1.12.573
- Upgraded Hazelcast from 5.3.2 to 5.3.5
- Upgraded Jersey from 2.40 to 2.41
- Upgraded Camel Salesforce from 3.14.5 to 3.14.9
- Unified ZooKeeper versioning on 3.9.1
- Applied Groovy 2.4.21 to Hive 3 and Iceberg components
- Applied gRPC version 1.59.0 to Asana components
- Applied Jettison 1.5.4 to Atlas and Hive 3 components
- Managed JUnit 4 version to 4.13.2 for MockWebServer
- Excluded HBase libraries from Hive 3 following Iceberg approach
- Excluded Htrace from HBase components
- Upgraded OWASP Dependency Check from 8.4.0 to 8.4.2
- Removed non-applicable dependency check suppressions
- Added dependency check suppressions for non-applicable findings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7948.
2023-10-27 16:21:38 -07:00
exceptionfactory 2366132e92
NIFI-12287 Standardized skipping Source and Javadoc for NAR modules
- Added nar-packaging and war-packaging profiles to root Maven configuration
- Removed individual properties from NAR module configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7947.
2023-10-27 16:18:42 -07:00
Mark Bean 5ecc12f405
NIFI-12285 Added py4j.url build property
The py4j.url property allows the URL for downloading py4j to be specified by a Maven command-line option

This closes #7946

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:25:53 -05:00
Mark Bean 94e746dc47
NIFI-12283 Added include-swagger-ui profile with activation by default
Deactivating prevents attempt to download swagger asset from the Internet allowing for offline builds.

This closes #7945

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 16:24:21 -05:00
exceptionfactory c421172ee2
NIFI-12286 Removed nifi-example-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7944.
2023-10-27 13:44:32 -07:00
exceptionfactory 46b5d8fdc0
NIFI-12284 Upgraded Frontend Maven Plugin from 1.14.0 to 1.14.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7943.
2023-10-27 10:47:19 -07:00
Matt Burgess 880770f992
NIFI-12273 Fixed command.argument references in ExecuteStreamCommand docs
This closes #7941

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:52:26 -05:00
Pierre Villard 1d125e9906
NIFI-11677 Removed non required yield in DeleteHDFS
This closes #7937

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-27 08:50:59 -05:00
Pierre Villard 1df9738f8f
NIFI-12281 Fix Go To in Parameter Providers to Provider Context
This closes #7939

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 19:39:10 -05:00
Mark Bathori 4fa0299f8b NIFI-12130: Ability to configure snapshot properties via dynamic attributes in PutIceberg
Fix dynamic field expression language handling

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7849
2023-10-26 19:26:24 -04:00
exceptionfactory 67bf4434ad
NIFI-12280 Upgraded Commons IO from 2.14.0 to 2.15.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7938.
2023-10-26 15:03:09 -07:00
Chris Sampson 2e8d0214c0
NIFI-12177 Added integration tests for MiNiFi and C2 Docker
This closes #7919

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 15:35:04 -05:00
lehelb a3e4f89fe3
NIFI-12271 Fix PutAzureBlobStorage_v12 rollback on failure with FileResourceService
This closes #7930

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-26 14:52:15 -05:00
Shane Ardell c4ff8de412
NIFI-12260: Remove templates from frontend (#7924)
* remove templates from frontend

* remove more references to removed files

* removing more template references

* remove unused css template styles
2023-10-26 15:16:14 -04:00
exceptionfactory 361e31fb19
NIFI-12279 Added nifi-standard-shared-nar to System Tests
- Corrected system test failures for PythonProcessorIT and Stateless CreateFlowFileIT

This closes #7935

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-26 19:35:51 +01:00
exceptionfactory 39898d1ee2
NIFI-12278 Added CodeQL to Static Analysis Job
This closes #7934

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-26 19:30:04 +01:00