Commit Graph

282 Commits

Author SHA1 Message Date
timeabarna ba6797bb94
NIFI-3065 Per Process Group logging (#7315)
* NIFI-3065 Per Process Group logging
2023-06-23 21:14:34 -04:00
exceptionfactory 7b6a51aa9f NIFI-11728 Removed RethinkDB Processors
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7410
2023-06-20 16:15:13 -04:00
Matthew Burgess 0e93dfae83
NIFI-11466 Added ModifyCompression Processor
- Added nifi-compress-bundle with nifi-compress-nar

This closes #7180

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-29 21:06:29 -05:00
Matthew Burgess 3d60e4a4f6 NIFI-11034: Restore image viewer to nifi-assembly
This closes #7209

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-04-29 18:20:53 -04:00
Mark Payne 7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
exceptionfactory 512155ba2f
NIFI-10975 Add Kubernetes Leader Election and State Provider (#6779)
* NIFI-10975 Added Kubernetes Leader Election and State Provider
- Added Kubernetes Leader Election Manager based on Kubernetes Leases
- Added Kubernetes State Provider based on Kubernetes ConfigMaps
- Added nifi-kubernetes-client for generalized access to Fabric8 Kubernetes Client
- Added nifi.cluster.leader.election.implementation Property defaulting to CuratorLeaderElectionManager
- Refactored LeaderElectionManager to nifi-framework-api for Extension Discovering Manager
- Refactored shared ZooKeeper configuration to nifi-framework-cluster-zookeeper

* NIFI-10975 Updated Kubernetes Client and StateMap
- Upgraded Kubernetes Client from 6.2.0 to 6.3.0
- Added getStateVersion to StateMap and deprecated getVersion
- Updated Docker start.sh with additional properties

* NIFI-10975 Corrected MockStateManager.assertStateSet()
* NIFI-10975 Upgraded Kubernetes Client from 6.3.0 to 6.3.1
* NIFI-10975 Corrected unregister leader and disabled release on cancel

* NIFI-10975 Corrected findLeader handling of Lease expiration
- Changed LeaderElectionManager.getLeader() return to Optional String

* NIFI-10975 Corrected StandardNiFiServiceFacade handling of Optional Leader
* NIFI-10975 Changed getLeader() to call findLeader() to avoid stale cached values
* NIFI-10975 Updated LeaderElectionCommand to run LeaderElector in loop
* NIFI-10975 Rebased on project version 2.0.0-SNAPSHOT

* NIFI-10975 Corrected Gson and AspectJ versions
- Updated versions to match current main branch and avoid reverting
2023-03-07 14:14:24 -05:00
Nandor Soma Abonyi a8cd33a243
NIFI-11248 Removed Kafka 2_0 Components
This closes #7010

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-06 09:35:31 -06:00
exceptionfactory b7df6b9716
NIFI-11235 Removed ExtractCCDAAttributes and ccda-bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7000.
2023-03-03 18:39:45 +01:00
exceptionfactory c8b5c0ce7b
NIFI-11220 Removed nifi-bootstrap-utils
- Replaced OSUtils.getProcessId() with java.lang.Process.pid() available on Java 9 and following

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6989.
2023-02-27 13:51:14 +01:00
exceptionfactory 85f2162021 NIFI-11201 Added include-iotdb Maven build profile
This closes #6975

- Corrected Fetch Size property evaluation in QueryIoTDBRecord for FlowFile attributes

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:53:23 -05:00
exceptionfactory a0ef378a42 NIFI-11207 Removed HBase 1.1.2 Services
This closes #6979

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-02-21 19:51:02 -05:00
exceptionfactory 0fa1060297
NIFI-11208 Removed Hortonworks Schema Registry
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6980
2023-02-21 16:48:45 -05:00
Pierre Villard b56b1da842
NIFI-11180 Removed Ambari Reporting Task
- Updated TestRuntimeManifest to reference Prometheus Reporting Task

This closes #6952

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-15 08:25:22 -06:00
Pierre Villard aae6bafc6c
NIFI-11183 Removed Hive 1.x components
This closes #6957

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 22:39:16 -06:00
Pierre Villard 46f89e3226
NIFI-11182 Removed Kafka 1.x components
This closes #6955

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-14 18:38:42 -06:00
exceptionfactory 1156f4cbc5
NIFI-11165 This closes #6944. Removed optional jigsaw build profiles
- Removed jigsaw build profiles
- Removed Java 11 directories from assemblies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-02-13 13:01:58 -05:00
Chris Sampson 7393ce294e
NIFI-11168 Removed deprecated Elasticsearch Processors and properties
This closes #6942

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-02-13 10:41:53 -06:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
exceptionfactory 0c676b9633
NIFI-11022 Added DecryptContent Compatibility Processors
- Added nifi-cipher-bundle with nifi-cipher-nar for new Processors
- Added DecryptContentCompatibilityMode Processor supporting PKCS5 and PKCS12 Password-Based Encryption Schemes
- Added DecryptContentEncoded Processor supporting NiFi Key Derivation Functions and associated formatting
- Added nifi-security-crypt-key module with Key Derivation Functions and Parameter Readers
- Added Additional Details documentation for Processors

This closes #6821
Signed-off-by: Paul Grey <greyp@apache.org>
2023-01-26 17:56:02 -05:00
exceptionfactory 972667461b
NIFI-10580 This closes #6867. Upgraded SLF4J from 1.7.36 to 2.0.6
- Upgraded Logback from 1.2.11 to 1.3.5
- Updated Logback DelayingShutdownHook to DefaultShutdownHook
- Disabled Spring Boot Logging System in favor of standard Logback initialization
- Excluded logback-classic from ZooKeeper and other dependencies to avoid conflicts when running tests
- Excluded spring-boot-starter-logging to avoid failures related to Logback 1.2 and Spring Boot 2.7
- Removed ZooKeeperMigratorTest.groovy based on Apache Curator test server usage of Logback 1.2

NIFI-10580 Added logback-core as explicit dependency

- Set logback-core as provided in root configuration
- Added logback-core as compile dependency in assembly configurations

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 11:38:10 -07:00
Pierre Villard 2b8475a6f8 NIFI-10992 - Option to build all include-x profiles
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6797
2023-01-20 12:59:34 +00:00
Rajmund Takacs 1c40738997
NIFI-10618: Add Asana connector
This closes #6504.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-12-16 00:14:26 +01:00
Bryan Bende 334c9db9c3
NIFI-10915 Add additionalDetails content to runtime manifest
- Update manifests assembly to include the additionaDetails.html files
- Update C2 ExtensionDefinition to add a new field for additional details content
- Update manifest generation to read the additional details and pass through to C2 runtime manifest
- Switch to boolean to indicate presence of additional details, instead of including content

Add additionalDetails files to nifi-runtime-manifest artifact, organized by group/artifact/version/type

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6767
2022-12-08 11:02:56 -05:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
Robert Kalmar 89426d167b
NIFI-10370 Create PutSnowflake processor using Snowpipe ingest
This closes #6584.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-11-18 16:19:03 +01:00
exceptionfactory 9f2ad260bd NIFI-10667 Added Private Key Service interface and implementation
- Defined PrivateKeyService in nifi-key-service-api
- Implemented StandardPrivateKeyService using Bouncy Castle library

NIFI-10667 Improved custom validation to avoid repetitive reads

NIFI-10667 Added onPropertyModified() to clear Key Reference for validation

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6553.
2022-10-20 18:08:18 -04:00
Matthew Burgess dfbc7dfc21
NIFI-8111: Add JSLTTransformJSON Processor
This closes #4797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-17 16:14:18 -05:00
Mark Bathori e87bced147
NIFI-10442: Create PutIceberg processor
This closes #6368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-11 21:51:18 +02:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Lehel da05ba0165 NIFI-10213: Create GetShopify processor
This closes #6303.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-29 16:12:53 +02:00
exceptionfactory 6461061e8f
NIFI-10381 Refactored Azure Event Hubs components with current SDK
- Upgraded Azure Event Hubs components from legacy version 3 to current version 5
- Refactored Azure dependencies using azure-sdk-bom
- Merged nifi-azure-record-sink-nar with nifi-azure-nar
- Refactored PutAzureCosmosDBRecordTest to use Jackson instead of Gson

This closes #6319.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-28 18:22:01 +02:00
Ferenc Kis 0fa923159f
NIFI-10460 GetZendesk processor
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6411
2022-09-26 20:47:17 +02:00
simonbence 94fdc794b0
NIFI-10497 Making RegistryClient an extension point (#6433)
- NIFI-10497 Mae FlowRegistryClient an extension point
2022-09-26 12:16:21 -04:00
Tamas Palfy dd9739a28c
NIFI-10427 - Added ListBoxFile and FetchBoxFile processors
This closes #6355.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 19:46:56 +02:00
Ferenc Erdei 903a487cf8
NIFI-10455 Added GetWorkdayReport Processor
This closes #6376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 12:56:03 -05:00
Joe Gresock 3987d39cdc
NIFI-9401 Added HashiCorpVaultParameterProvider
- Refactored nifi-vault-utils to nifi-hashicorp-vault-api and nifi-hashcorp-vault modules
- Added HashiCorpVaultClientService and Standard implementation

This closes #6304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-14 19:46:09 -05:00
Robert Kalmar 4b0568e6fe
NIFI-10242 Create QueryAirtableTable processor
This closes #6350.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-14 20:31:34 +02:00
krisztina-zsihovszki b1b3a7057c
NIFI-10380 Added ListDropbox and DropboxCredentialService
This closes #6331

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 09:59:34 -05:00
Lehel e2d6df5afc
NIFI-10356 Created GetHubSpot processor
This closes #6301

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 15:50:51 -05:00
royalfork2 eb419b6e40
NIFI-10300 Added AzureEventHubRecordSink
This closes #6296

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-15 15:57:08 -05:00
exceptionfactory 864036674e
NIFI-10244 Added nifi-web-client-api and implementation
- Added nifi-web-client implementation based on OkHttp
- Added WebClientServiceProvider Controller Service interface and implementation
- Corrected comments and added unmodifiableMap wrapper
- Added getHeaderNames() and corrected ProxyContext comments

This closes #6268
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-11 17:25:18 -04:00
Gabor Kulik 768f58da21 NIFI-10212 added ListSmb processor and SmbConnectionPoolService
This closes #6192.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-08-05 18:46:04 +02:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Ferenc Erdei f05d0f10f3
NIFI-10211 Add dependencies for running minifi on java11
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6191
2022-07-14 09:16:07 -04:00
Nathan Gough 62eb565daf
NIFI-5402 - Added more assembly options for different modules. Assemblies should build a zip by default, or a tar.gz with the -Ptargz profile
This closes #5694
Signed-off-by: Paul Grey <greyp@apache.org>
2022-06-23 13:52:41 -04:00
exceptionfactory 459daf6600
NIFI-10101 Moved nifi-hive-nar to optional include-hive profile
- Added nifi-hive-services-api-nar to include-hive3 and include-hive1_1 profiles

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6113.
2022-06-14 15:54:58 +02:00
Lehel 73ee1a9a1e
NIFI-9720 Added QuerySalesforceObject Processor
This closes #5802

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-20 13:59:21 -05:00