Commit Graph

7698 Commits

Author SHA1 Message Date
exceptionfactory 013d01a9fc
NIFI-10558 This closes #6456. Updated Ranger modules to skip tests on AArch64
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-28 13:54:42 -07:00
Joe Witt 1a99b9611c
NIFI-10559 Clarified remote path can come from flowfile attributes and made inherited prop descriptors more obvious
This closes #6457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-28 15:52:32 -05:00
exceptionfactory 6461061e8f
NIFI-10381 Refactored Azure Event Hubs components with current SDK
- Upgraded Azure Event Hubs components from legacy version 3 to current version 5
- Refactored Azure dependencies using azure-sdk-bom
- Merged nifi-azure-record-sink-nar with nifi-azure-nar
- Refactored PutAzureCosmosDBRecordTest to use Jackson instead of Gson

This closes #6319.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-28 18:22:01 +02:00
joewitt fdd94009b3 NIFI-10521 updating docker refs 2022-09-27 13:51:13 -07:00
Zoltan Kornel Torok b28a211bf3
NIFI-10552 This closes #6453. Fix ranger credential builder NoClassDefFoundError
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-27 10:58:07 -07:00
Lehel Boér 63aac1a31d NIFI-10513: Added capture non-record fields to JsonTreeRowRecordReader, added pagination to QuerySalesforceObject
This closes #6444.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-27 19:53:10 +02:00
Tamas Palfy 1d9e119084
NIFI-10523 - Improved Google Drive processor documentations.
This closes #6430.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 19:42:26 +02:00
Lehel Boér f14f940389
NIFI-10551: Improve GetHubSpot documentation
This closes #6452.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 16:50:49 +02:00
M Tien 34084d083a
NIFI-10542: set sensitivity for new parameters in a synced parameter context (#6446)
* NIFI-10542: set sensitivity for new parameters in a synced parameter context

* show removed or missing but referenced parameters with tooltip in the selectable parameters table
- remove default parameter value

* address review feedback
- fix showing a referencing icon for a missing but removed parameter

* fix discovering new parameters

This closes #6446
2022-09-26 19:32:00 -04:00
Eduardo Fontes 9bc63920aa
NIFI-10289 This closes #6256. Change getConflictColumnsClause
NIFI-10289 Test upsert to catch this issue

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-26 15:38:42 -07:00
Joe Witt 9e6ee656b5
NIFI-10532 ensuring client gets reset if any of the key values host/port/user/pw change on a per ff basis (#6445) 2022-09-26 17:00:23 -04:00
simonbence e5059e0514
NIFI-10550 Fixing SSH Context Service validation for NifiRegistryFlowRegistryClient (#6451) 2022-09-26 16:28:00 -04:00
Shane Ardell 17084a1f09
NIFI-10538: UI updates for making RegistryClient an extension point (#6437)
* init commit

* remove test string

* display only class name for types combo

* remove commented code

* add UI support for dynamic properties

* add support for controller services

* address review feedback:

* fix syntax error
* remove console logs
* move contents of editRegistry into callback
* add name and description fields back to edit dialog

* add referencing component logic for registry clients

* implement reload logic

* more review findings
* increase size of description textarea in config
* remove location column from registry table
* remove commented out code

* post-rebase tweaks
* change if condition from assignment to evaluation
* add missing semicolons
* refactor new registry initialization into function

* more feedback addressed
* fix rebase error around controller service reference
* render registry references in their own list
* remove duplicate updateValidationError function
* remove TODO comment

* expose reload through nfSettings public variable

* show add registry dialog only after available types returns

* fix css class name

This closes #6437
2022-09-26 16:03:51 -04:00
Lehel 5d2bd1e47b
NIFI-10463: Fix GetHubSpot incremental loading
This closes #6379.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 21:33:22 +02:00
Ferenc Kis 0fa923159f
NIFI-10460 GetZendesk processor
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6411
2022-09-26 20:47:17 +02:00
Matt Burgess 363e798107
NIFI-10549: Remove group name wildcard from assembly for nifi-ranger-resources (#6448) 2022-09-26 13:22:49 -04:00
simonbence 94fdc794b0
NIFI-10497 Making RegistryClient an extension point (#6433)
- NIFI-10497 Mae FlowRegistryClient an extension point
2022-09-26 12:16:21 -04:00
Nandor Soma Abonyi 320aed024f
NIFI-10152 Storage client caching in Azure ADLS processors
This closes #6158.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 08:26:44 +02:00
M Tien d82ce18f88
NIFI-9514 NIFI-9515: Add UI support for Parameter Providers in Controller Services (#5671)
* NIFI-9514 - Add UI support for Parameter Providers in Controller Services

* - Fix a dialog closing issue

* - Hide fetch parameters button if there are config errors

* - Update Fetch Parameters dialog with new UX
- Implement checkbox logic for Selectable Parameters table

* - add createNewParameterContext property to track if group will be created as a new parameter context
- update fetch parameters dialog views for editing and after applying changes
- show affected referencing components after applying changes
- disable apply button if no parameter contexts will be updated
- refactor showing and hiding fetched parameters and selectable parameters tables logic
- add tooltip for parameter context icon

* - update parameter contexts view for provided contexts

* - add affected referencing components after applying fetched parameters
- add referencing parameter contexts to the provider settings tab
- update checkbox style in the selectable parameters table
- fix updating the referencing components border
- fix lint errors

* - fix selectable parameters table checkbox styles

* - fix hasParameterContextChanged checks
- checkbox style tweaks

* - add status bar to fetch parameters dialog

* - more style tweaks and remove unnecessary code

* - fix the selectable parameters table not saving and loading correctly

* - add tooltips
- fix styles

* - link from the parameter context to the associated parameter provider

* 9514: support navigating to the controller service created in parameter providers

* fix bulletins format in status bar

* address review feedback
- manage permissions for parameter providers
- disable/enable Fetch Parameters dialog Apply button

* manage authorizations to access parameter providers and parameter contexts

* fix lint errors

* fix and refactor hasGroupsChanged to determine the Apply button state

* new parameter context name input cannot be empty in Fetch Parameters dialog

* address review feedback

* fix duplicate code

* more fixes

* update fetch parameters checkbox states

* replace slickgrid checkbox selection plugin with custom implementation for different selection types
- check for affected parameters using the parameter status

* fixed showing the correct referencing components when switching groups

* fixed selectable parameters table shifting contents on row selection

* leverage slickgrid onClick to set user-selected parameter sensitivities in the selectable parameters table

* fix statusbar bulletins in processor details
- fix updating borders for referencing components
- update referencing parameter icon
- update table title in fetch parameters dialog

* address review feedback

* populate controller services referencing components of a referenced provider
- update controller services tab name

* showing parameter providers in CS controller service

* update tooltip messages in fetch parameters dialog
- fix dialog height to make room for the status bar

* reload the parameter providers table after a referenced parameter provider change in controller services
- fix conditions for enabling/disabling fetch parameters dialog Apply button
- add affected components no permissions message in the dialog

* fix always reloading the parameter providers table
- fix disableApplyButton checks
- add dialog message for a missing new parameter context name

* remove extra reload

* more fixes for disableApplyButton
- fixed styles for dialog message

* add a check in disableApplyButton for changed parameter values that are not referenced
- add changed value icon for parameters that are not referenced
- fix border on the referencing affected components container

* removed unnused plugins

This closes #5671
2022-09-24 08:43:27 -04:00
Nathan Gough a52974780d
NIFI-10525 - Upgraded hadoop.version to 3.3.4.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6431.
2022-09-24 10:33:18 +04:00
Bryan Bende 8d04ba5427
NIFI-10529 Add DynamicProperties to AvroSchemaRegistry
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6436.
2022-09-24 10:31:15 +04:00
Joe Gresock ece83709f4
NIFI-10473: Removing referencing components check on param provider f… (#6388)
* NIFI-10473: Removing referencing components check on param provider fetch

* NIFI-10473: Adding parameter status DTO to ParameterProviderDTO

* Allowing parameterStatus to be populated even when no parameters were updated

* Adding ParameterStatus enum for parameter fetching

* Adding MISSING_BUT_REFERENCED ParameterStatus

This closes #6388
2022-09-23 13:44:52 -04:00
Bryan Bende 27e3ee1915 NIFI-10528 Create nifi-json-record-utils and updated Salesforce NAR dependencies to use it
This closes #6435.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-23 17:11:13 +02:00
Emilio Setiadarma f586f8f4cf NIFI-9451 - Add 'Input Character Set' property for PutEmail and additional tests
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6313.
2022-09-23 00:20:23 -04:00
mr1716 91ad4548a8 NIFI-10534 - Update pom.xml for spring.version from 5.3.22 to 5.3.23.
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6442.
2022-09-22 23:22:37 -04:00
Ferenc Kis 1b1d388ef7
NIFI-10530 MiNiFi: Add option to compress c2 requests
This closes #6439

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-09-22 16:23:28 +02:00
mr1716 cfb1597e10
NIFI-10520: Upgrade Hazelcast version to 4.2.5
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6429
2022-09-21 10:47:12 -04:00
kulikg cea924bc6b
NIFI-10507 removed absolute.path from ListSmb (#6422) 2022-09-19 16:49:20 -04:00
Tamas Palfy dd9739a28c
NIFI-10427 - Added ListBoxFile and FetchBoxFile processors
This closes #6355.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 19:46:56 +02:00
Joe Gresock 43931b1504
NIFI-10518: Adding intended state to ScheduledStateChangeListener (#6428)
- NIFI-10518: Adding intended state to ScheduledStateChangeListener
- Notifying of scheduled state change when transitionComponentState is called
- Notifying scheduled state change when reporting task state is changed
- Notifying scheduledState changes for remote group port start/stop components calls
2022-09-19 10:38:00 -04:00
Csaba Bejan 35fb66f50f
NIFI-10403 Add processor supporting the new BigQuery Write API
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6344
2022-09-19 14:32:11 +02:00
krisztina-zsihovszki 111c7ac0a4
NIFI-10444 FetchDropbox processor
NIFI-10444 Add ProxyConfiguration to ListDropbox and FetchDropbox processors

This closes #6401.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 13:08:49 +02:00
Mark Payne ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6421
2022-09-16 17:58:19 -04:00
UcanInfosec 860d550435
NIFI-10504 Upgraded OpenCSV from 5.4 to 5.7.0 for nifi-toolkit-cli
This closes #6419

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 16:52:11 -05:00
dependabot[bot] e8dd601e53
NIFI-10519 Upgraded JavaScript terser library from 4.8.0 to 4.8.1
This closes #6232

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 16:37:17 -05:00
Mark Payne eaa275a5e4
NIFI-10515: If propopsed controller service is disabled, ensure that we don't re-enable the service and references when synchronize(ControllerServiceNode...) is called
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6425.
2022-09-16 16:36:55 -04:00
exceptionfactory abbd7a89c8
NIFI-10455 Removed unused import from GetWorkdayReport
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 13:49:38 -05:00
Ferenc Erdei 903a487cf8
NIFI-10455 Added GetWorkdayReport Processor
This closes #6376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 12:56:03 -05:00
mr1716 62811f5afe NIFI-10492 - Update pom.xml for graphics2d from 0.32 to 0.40
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6412.
2022-09-16 12:45:46 -04:00
exceptionfactory 6398c2deb7
NIFI-10505 Removed unused HttpClient dependency from nifi-web-api
- Removing org.apache.httpcomponents:httpclient from nifi-web-api avoids Linkage Errors with Sensitive Property Providers

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6423.
2022-09-16 10:19:28 +02:00
exceptionfactory cb6fd91e24
NIFI-10509 Upgraded SnakeYAML from 1.31 to 1.32
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6424.
2022-09-16 10:12:27 +02:00
Mark Payne 3f0ef9e977
NIFI-10406: Updated Maven assemblies to ensure that we always use at least two of the GAVC parameters for includes and excludes. Updated Maven assembly plugin to version 3.4.2. Removed some includes and excludes from dependencies that previously were not matching and were generating Maven WARNING messages.
This closes #6415

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-15 11:02:08 -05:00
Joe Gresock 51d01f874e
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer (#6341)
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer
2022-09-15 09:15:44 -04:00
Joe Gresock 3987d39cdc
NIFI-9401 Added HashiCorpVaultParameterProvider
- Refactored nifi-vault-utils to nifi-hashicorp-vault-api and nifi-hashcorp-vault modules
- Added HashiCorpVaultClientService and Standard implementation

This closes #6304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-14 19:46:09 -05:00
Peter Turcsanyi 5303aadda3
NIFI-10500: Improved property ordering in MQTT processors
Signed-off-by: Arpad Boda <aboda@apache.org>
2022-09-14 21:13:01 +02:00
Robert Kalmar 4b0568e6fe
NIFI-10242 Create QueryAirtableTable processor
This closes #6350.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-14 20:31:34 +02:00
UcanInfosec a9013a61ec
NIFI-10494 Upgrade Camel-Salesforce to 3.14.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6413.
2022-09-14 16:48:16 +02:00
exceptionfactory 04c0df1723
NIFI-10471 Documented and applied standard deprecation logging
- Updated Admin Guide with section on Logging Configuration and Deprecation Logging
- Updated Developer Guide with section on Deprecating Components and Features
- Added Deprecation Logging when adding components marked with DeprecationNotice to the Flow Configuration
- Added Deprecation Logging on deprecated methods in standard Controller Service implementations
- Removed integration tests for deprecated PersistentProvenanceRepository
- Updated logging and added documentation on minor upgrade steps
- Updated logging for HDFSNarProvider and RocksDB Repository

This closes #6390
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-13 19:40:03 -04:00
Csaba Bejan e26aa233d7 NIFI-10458 Add support for the DESCRIBE/MANIFEST Operation
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #6375
2022-09-13 19:22:35 +02:00
Nandor Soma Abonyi 398af783c2
NIFI-10488 Fix NullPointerException on updating empty ParameterContext property with NiFi Toolkit (#6408)
NIFI-10488 Fix NullPointerException on updating empty ParameterContext property
2022-09-13 12:54:43 -04:00