Commit Graph

5484 Commits

Author SHA1 Message Date
Joe Witt 1a99b9611c
NIFI-10559 Clarified remote path can come from flowfile attributes and made inherited prop descriptors more obvious
This closes #6457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-28 15:52:32 -05:00
exceptionfactory 6461061e8f
NIFI-10381 Refactored Azure Event Hubs components with current SDK
- Upgraded Azure Event Hubs components from legacy version 3 to current version 5
- Refactored Azure dependencies using azure-sdk-bom
- Merged nifi-azure-record-sink-nar with nifi-azure-nar
- Refactored PutAzureCosmosDBRecordTest to use Jackson instead of Gson

This closes #6319.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-28 18:22:01 +02:00
Zoltan Kornel Torok b28a211bf3
NIFI-10552 This closes #6453. Fix ranger credential builder NoClassDefFoundError
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-27 10:58:07 -07:00
Lehel Boér 63aac1a31d NIFI-10513: Added capture non-record fields to JsonTreeRowRecordReader, added pagination to QuerySalesforceObject
This closes #6444.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-27 19:53:10 +02:00
Tamas Palfy 1d9e119084
NIFI-10523 - Improved Google Drive processor documentations.
This closes #6430.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 19:42:26 +02:00
Lehel Boér f14f940389
NIFI-10551: Improve GetHubSpot documentation
This closes #6452.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-27 16:50:49 +02:00
M Tien 34084d083a
NIFI-10542: set sensitivity for new parameters in a synced parameter context (#6446)
* NIFI-10542: set sensitivity for new parameters in a synced parameter context

* show removed or missing but referenced parameters with tooltip in the selectable parameters table
- remove default parameter value

* address review feedback
- fix showing a referencing icon for a missing but removed parameter

* fix discovering new parameters

This closes #6446
2022-09-26 19:32:00 -04:00
Eduardo Fontes 9bc63920aa
NIFI-10289 This closes #6256. Change getConflictColumnsClause
NIFI-10289 Test upsert to catch this issue

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-09-26 15:38:42 -07:00
Joe Witt 9e6ee656b5
NIFI-10532 ensuring client gets reset if any of the key values host/port/user/pw change on a per ff basis (#6445) 2022-09-26 17:00:23 -04:00
simonbence e5059e0514
NIFI-10550 Fixing SSH Context Service validation for NifiRegistryFlowRegistryClient (#6451) 2022-09-26 16:28:00 -04:00
Shane Ardell 17084a1f09
NIFI-10538: UI updates for making RegistryClient an extension point (#6437)
* init commit

* remove test string

* display only class name for types combo

* remove commented code

* add UI support for dynamic properties

* add support for controller services

* address review feedback:

* fix syntax error
* remove console logs
* move contents of editRegistry into callback
* add name and description fields back to edit dialog

* add referencing component logic for registry clients

* implement reload logic

* more review findings
* increase size of description textarea in config
* remove location column from registry table
* remove commented out code

* post-rebase tweaks
* change if condition from assignment to evaluation
* add missing semicolons
* refactor new registry initialization into function

* more feedback addressed
* fix rebase error around controller service reference
* render registry references in their own list
* remove duplicate updateValidationError function
* remove TODO comment

* expose reload through nfSettings public variable

* show add registry dialog only after available types returns

* fix css class name

This closes #6437
2022-09-26 16:03:51 -04:00
Lehel 5d2bd1e47b
NIFI-10463: Fix GetHubSpot incremental loading
This closes #6379.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 21:33:22 +02:00
Ferenc Kis 0fa923159f
NIFI-10460 GetZendesk processor
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6411
2022-09-26 20:47:17 +02:00
simonbence 94fdc794b0
NIFI-10497 Making RegistryClient an extension point (#6433)
- NIFI-10497 Mae FlowRegistryClient an extension point
2022-09-26 12:16:21 -04:00
Nandor Soma Abonyi 320aed024f
NIFI-10152 Storage client caching in Azure ADLS processors
This closes #6158.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-26 08:26:44 +02:00
M Tien d82ce18f88
NIFI-9514 NIFI-9515: Add UI support for Parameter Providers in Controller Services (#5671)
* NIFI-9514 - Add UI support for Parameter Providers in Controller Services

* - Fix a dialog closing issue

* - Hide fetch parameters button if there are config errors

* - Update Fetch Parameters dialog with new UX
- Implement checkbox logic for Selectable Parameters table

* - add createNewParameterContext property to track if group will be created as a new parameter context
- update fetch parameters dialog views for editing and after applying changes
- show affected referencing components after applying changes
- disable apply button if no parameter contexts will be updated
- refactor showing and hiding fetched parameters and selectable parameters tables logic
- add tooltip for parameter context icon

* - update parameter contexts view for provided contexts

* - add affected referencing components after applying fetched parameters
- add referencing parameter contexts to the provider settings tab
- update checkbox style in the selectable parameters table
- fix updating the referencing components border
- fix lint errors

* - fix selectable parameters table checkbox styles

* - fix hasParameterContextChanged checks
- checkbox style tweaks

* - add status bar to fetch parameters dialog

* - more style tweaks and remove unnecessary code

* - fix the selectable parameters table not saving and loading correctly

* - add tooltips
- fix styles

* - link from the parameter context to the associated parameter provider

* 9514: support navigating to the controller service created in parameter providers

* fix bulletins format in status bar

* address review feedback
- manage permissions for parameter providers
- disable/enable Fetch Parameters dialog Apply button

* manage authorizations to access parameter providers and parameter contexts

* fix lint errors

* fix and refactor hasGroupsChanged to determine the Apply button state

* new parameter context name input cannot be empty in Fetch Parameters dialog

* address review feedback

* fix duplicate code

* more fixes

* update fetch parameters checkbox states

* replace slickgrid checkbox selection plugin with custom implementation for different selection types
- check for affected parameters using the parameter status

* fixed showing the correct referencing components when switching groups

* fixed selectable parameters table shifting contents on row selection

* leverage slickgrid onClick to set user-selected parameter sensitivities in the selectable parameters table

* fix statusbar bulletins in processor details
- fix updating borders for referencing components
- update referencing parameter icon
- update table title in fetch parameters dialog

* address review feedback

* populate controller services referencing components of a referenced provider
- update controller services tab name

* showing parameter providers in CS controller service

* update tooltip messages in fetch parameters dialog
- fix dialog height to make room for the status bar

* reload the parameter providers table after a referenced parameter provider change in controller services
- fix conditions for enabling/disabling fetch parameters dialog Apply button
- add affected components no permissions message in the dialog

* fix always reloading the parameter providers table
- fix disableApplyButton checks
- add dialog message for a missing new parameter context name

* remove extra reload

* more fixes for disableApplyButton
- fixed styles for dialog message

* add a check in disableApplyButton for changed parameter values that are not referenced
- add changed value icon for parameters that are not referenced
- fix border on the referencing affected components container

* removed unnused plugins

This closes #5671
2022-09-24 08:43:27 -04:00
Nathan Gough a52974780d
NIFI-10525 - Upgraded hadoop.version to 3.3.4.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6431.
2022-09-24 10:33:18 +04:00
Bryan Bende 8d04ba5427
NIFI-10529 Add DynamicProperties to AvroSchemaRegistry
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6436.
2022-09-24 10:31:15 +04:00
Joe Gresock ece83709f4
NIFI-10473: Removing referencing components check on param provider f… (#6388)
* NIFI-10473: Removing referencing components check on param provider fetch

* NIFI-10473: Adding parameter status DTO to ParameterProviderDTO

* Allowing parameterStatus to be populated even when no parameters were updated

* Adding ParameterStatus enum for parameter fetching

* Adding MISSING_BUT_REFERENCED ParameterStatus

This closes #6388
2022-09-23 13:44:52 -04:00
Bryan Bende 27e3ee1915 NIFI-10528 Create nifi-json-record-utils and updated Salesforce NAR dependencies to use it
This closes #6435.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-23 17:11:13 +02:00
Emilio Setiadarma f586f8f4cf NIFI-9451 - Add 'Input Character Set' property for PutEmail and additional tests
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6313.
2022-09-23 00:20:23 -04:00
Ferenc Kis 1b1d388ef7
NIFI-10530 MiNiFi: Add option to compress c2 requests
This closes #6439

Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>
2022-09-22 16:23:28 +02:00
mr1716 cfb1597e10
NIFI-10520: Upgrade Hazelcast version to 4.2.5
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6429
2022-09-21 10:47:12 -04:00
kulikg cea924bc6b
NIFI-10507 removed absolute.path from ListSmb (#6422) 2022-09-19 16:49:20 -04:00
Tamas Palfy dd9739a28c
NIFI-10427 - Added ListBoxFile and FetchBoxFile processors
This closes #6355.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 19:46:56 +02:00
Joe Gresock 43931b1504
NIFI-10518: Adding intended state to ScheduledStateChangeListener (#6428)
- NIFI-10518: Adding intended state to ScheduledStateChangeListener
- Notifying of scheduled state change when transitionComponentState is called
- Notifying scheduled state change when reporting task state is changed
- Notifying scheduledState changes for remote group port start/stop components calls
2022-09-19 10:38:00 -04:00
Csaba Bejan 35fb66f50f
NIFI-10403 Add processor supporting the new BigQuery Write API
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6344
2022-09-19 14:32:11 +02:00
krisztina-zsihovszki 111c7ac0a4
NIFI-10444 FetchDropbox processor
NIFI-10444 Add ProxyConfiguration to ListDropbox and FetchDropbox processors

This closes #6401.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-19 13:08:49 +02:00
Mark Payne ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6421
2022-09-16 17:58:19 -04:00
Mark Payne eaa275a5e4
NIFI-10515: If propopsed controller service is disabled, ensure that we don't re-enable the service and references when synchronize(ControllerServiceNode...) is called
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6425.
2022-09-16 16:36:55 -04:00
exceptionfactory abbd7a89c8
NIFI-10455 Removed unused import from GetWorkdayReport
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 13:49:38 -05:00
Ferenc Erdei 903a487cf8
NIFI-10455 Added GetWorkdayReport Processor
This closes #6376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-16 12:56:03 -05:00
mr1716 62811f5afe NIFI-10492 - Update pom.xml for graphics2d from 0.32 to 0.40
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6412.
2022-09-16 12:45:46 -04:00
exceptionfactory 6398c2deb7
NIFI-10505 Removed unused HttpClient dependency from nifi-web-api
- Removing org.apache.httpcomponents:httpclient from nifi-web-api avoids Linkage Errors with Sensitive Property Providers

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6423.
2022-09-16 10:19:28 +02:00
Mark Payne 3f0ef9e977
NIFI-10406: Updated Maven assemblies to ensure that we always use at least two of the GAVC parameters for includes and excludes. Updated Maven assembly plugin to version 3.4.2. Removed some includes and excludes from dependencies that previously were not matching and were generating Maven WARNING messages.
This closes #6415

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-15 11:02:08 -05:00
Joe Gresock 51d01f874e
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer (#6341)
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer
2022-09-15 09:15:44 -04:00
Joe Gresock 3987d39cdc
NIFI-9401 Added HashiCorpVaultParameterProvider
- Refactored nifi-vault-utils to nifi-hashicorp-vault-api and nifi-hashcorp-vault modules
- Added HashiCorpVaultClientService and Standard implementation

This closes #6304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-14 19:46:09 -05:00
Peter Turcsanyi 5303aadda3
NIFI-10500: Improved property ordering in MQTT processors
Signed-off-by: Arpad Boda <aboda@apache.org>
2022-09-14 21:13:01 +02:00
Robert Kalmar 4b0568e6fe
NIFI-10242 Create QueryAirtableTable processor
This closes #6350.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-14 20:31:34 +02:00
UcanInfosec a9013a61ec
NIFI-10494 Upgrade Camel-Salesforce to 3.14.5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6413.
2022-09-14 16:48:16 +02:00
exceptionfactory 04c0df1723
NIFI-10471 Documented and applied standard deprecation logging
- Updated Admin Guide with section on Logging Configuration and Deprecation Logging
- Updated Developer Guide with section on Deprecating Components and Features
- Added Deprecation Logging when adding components marked with DeprecationNotice to the Flow Configuration
- Added Deprecation Logging on deprecated methods in standard Controller Service implementations
- Removed integration tests for deprecated PersistentProvenanceRepository
- Updated logging and added documentation on minor upgrade steps
- Updated logging for HDFSNarProvider and RocksDB Repository

This closes #6390
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-13 19:40:03 -04:00
Csaba Bejan e26aa233d7 NIFI-10458 Add support for the DESCRIBE/MANIFEST Operation
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #6375
2022-09-13 19:22:35 +02:00
UcanInfosec 5fbd3ac7a9
NIFI-10490 Upgrade influxdb-java to 2.23
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6410.
2022-09-13 15:08:21 +02:00
exceptionfactory ae14ef2d1f
NIFI-10373 Set managed version for AWS 1 and 2 SDK
- Replaced individual AWS SDK versions with root managed dependency version
- Set AWS SDK 1 version to 1.12.299
- Set AWS SDK 2 version to 2.17.270
- Suppressed false positive dependency vulnerability for aws-sdk-swf-libraries

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6405.
2022-09-13 15:06:42 +02:00
exceptionfactory a91928e0e3
NIFI-10489 Upgraded zip4j from 2.10.0 to 2.11.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6409.
2022-09-13 15:03:54 +02:00
mr1716 d351f92104
NIFI-10486 Upgraded greenmail from 1.5.11 to 1.6.10
This closes #6406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-12 15:21:21 -05:00
exceptionfactory 158c5417bc
NIFI-9500 Added nifi.cmd for Windows; Switched to NiFi Home directory to run command actions
This closes #6370
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-12 14:13:02 -04:00
Peter Turcsanyi eaaff4ede9 NIFI-10364: Simplified connection/session handling in SmbjClientService
This closes #6307.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-12 16:06:22 +02:00
exceptionfactory dfa18b848f
NIFI-10477 Upgraded Apache Calcite from 1.31 to 1.32
This closes #6396

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-11 07:55:07 -04:00
mr1716 ccebf2b271
NIFI-10466 Updated questdb to 6.5.2-jdk8
This closes #6384

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:23:56 -04:00
exceptionfactory 1370295bd3
NIFI-10470 Upgraded SSHJ from 0.33.0 to 0.34.0
This closes #6387

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:19:22 -04:00
exceptionfactory 5b3601f50f
NIFI-10472 Upgraded SnakeYAML from 1.29 to 1.31
- Replaced module overrides with root managed dependency version

This closes #6389

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-09 20:38:01 -04:00
Joe Gresock de7793e69b
NIFI-9003 Added framework support for Parameter Providers
- Added Environment Variable and File Parameter Provider implementations
- Added Parameter Provider commands to CLI
- Added component search handling for Parameter Providers
- Added documentation for integrating Parameter Providers

This closes #5369

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 13:04:56 -05:00
Peter Turcsanyi e81466d4f3
NIFI-10465: Fixed error message for invalid Controller Service type
This closes #6381

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:16:06 -05:00
Bence Simon a4a3bdbc98
NIFI-10451 Updated QuestDB Status History Rollover to work with version 6
This closes #6374

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:08:07 -05:00
UcanInfosec aca93ed3ce
NIFI-10464 Upgraded json-flattener from 0.13.0 to 0.14.0
This closes #6380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:03:31 -05:00
krisztina-zsihovszki b1b3a7057c
NIFI-10380 Added ListDropbox and DropboxCredentialService
This closes #6331

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 09:59:34 -05:00
Nandor Soma Abonyi eb68ffad70
NIFI-10411 Add record processing feature to PublishMQTT processor
This closes #6373.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-09 09:51:13 +02:00
mr1716 b12510e54a
NIFI-10443 Upgraded oauth2-oidc-sdk from 9.10 to 9.43
- Upgraded nimbus-jose-jwt to 9.11.2 to 9.24.3

This closes #6366

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 17:54:39 -05:00
Mark Payne a0c705715b
NIFI-10429: Added the ability to Replay latest provenance event for a given Processor.
This closes #6359

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 15:55:26 -05:00
ravinarayansingh 97b8f0e205
NIFI-10435 Masked sensitive arguments in ExecuteStreamCommand
This closes #6367

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-07 21:33:57 -05:00
Gabor Kulik 5b565679df NIFI-10230 added FetchSmb
This closes #6279.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-06 18:58:55 +02:00
krisztina-zsihovszki 822c4d473a NIFI-10404 TailFile processor persistent state not cleaned up
This closes #6349.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-06 10:52:38 +02:00
Matthew Hawkins 64acd8b1c5
NIFI-2827 Adding zstd-jni to the necessary pom.xml. It's already in the LICENSE.
NIFI-2827 Update CompressContent.java to use zstd compression format
NIFI-2827 Update test cases for CompressContent.java to include zstd format
NIFI-2827 Update JsonRecordSetWriter.java to enable zstd compression format

This closes #6294

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-04 15:02:41 -04:00
UcanInfosec 6ac7bfe0fa
NIFI-10433 Updated javassist
This closes #6363

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-03 21:03:33 -04:00
mr1716 60a6578a70
NIFI-10393 Update the lucene version
This closes #6333

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-03 18:09:14 -04:00
Mike Thomsen 09faec4866
NIFI-10432 Upgraded jsoup from 1.14.2 to 1.15.3
This closes #6362

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-03 09:23:23 -05:00
UcanInfosec 0a98ca3c09
NIFI-10424 Upgraded spring-integration from 5.5.9 to 5.5.14
This closes #6354

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-02 16:51:29 -05:00
Mark Payne 7a90137cef
NIFI-10431: Improved log messages and Exception messages to indicate which components they pertain to. Also added a toString() for StandardLabel to make it more clear which Label is being referenced
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6361.
2022-09-02 15:56:33 -04:00
exceptionfactory c19d6a0db1 NIFI-10407 Improved reliability of GetSmbFileTest
- Changed TestRunner.run() to avoid clearing internal cache between runs
- Updated Mockito usage with annotations

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6346.
2022-09-01 14:08:07 -04:00
exceptionfactory 6350829676 NIFI-10384 Upgraded Avatica to 1.22.0 for Hive 3
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6323.
2022-09-01 12:43:04 -04:00
UcanInfosec 5280762f58
NIFI-10417 Upgrade neo4j-java-driver to 1.7.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6353.
2022-09-01 12:08:20 +02:00
UcanInfosec a22f0b6bb4
NIFI-10399 Upgraded Jolt from 0.1.1 to 0.1.7
This closes #6339

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-31 15:40:59 -05:00
Nathan Gough 10d1fbe888
NIFI-10378 Added OIDC client secret to encrypted properties
This closes #6352

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 16:14:32 -05:00
Lehel e2d6df5afc
NIFI-10356 Created GetHubSpot processor
This closes #6301

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 15:50:51 -05:00
exceptionfactory 3a6d724b44 NIFI-10408 Added build user method to LdapUserGroupProvider
- Introduced blank user identity checking with improved error reporting for misconfigured mapping
- Simplified LDAP ThreadFactory configuration
- Replaced String.format() with placeholders for debug logging
- Replaced deprecated FormatUtils.getTimeDuration with getPreciseTimeDuration

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6351.
2022-08-30 16:26:58 -04:00
Lehel Boér 28fc030ef5
NIFI-10366: Make Default Run Duration configurable (#6310)
NIFI-10366: Make Default Run Duration configurable
2022-08-30 14:38:56 -04:00
Paul Grey bae659cb9e
NIFI-10409 Improved enrich-processors tests using MockedStatic
This closes #6348

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 11:35:00 -05:00
exceptionfactory 4f87cd770b
NIFI-10410 Added InputRequirement annotation to ExtractGrok
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6345.
2022-08-30 15:46:14 +02:00
Nandor Soma Abonyi 4d4a5ca4be
NIFI-10251 Add v5 protocol support for existing MQTT processors
This closes #6225.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-08-30 10:27:19 +02:00
Tamas Palfy 63905c5fc1
NIFI-10379 - In FetchGoogleDrive removed record-based input processing.
This closes #6327.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-08-29 17:01:34 +02:00
UcanInfosec 3be503668b
NIFI-10347 Upgraded metrics-graphite from 4.1.2 to 4.1.33
This closes #6291

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-26 14:54:54 -05:00
exceptionfactory b777978293 NIFI-10313 Removed Expiration Token on Authentication Errors
- Updated standard user interface error handler to clear the Access-Token-Expiration item from Session Storage when receiving an error with the WWW-Authenticate Header indicating a problem with the Bearer Token

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6334.
2022-08-25 13:12:01 -04:00
Emilio Setiadarma f5fee4dda3
NIFI-10344 Refactored Groovy tests in standard-processor to Java and JUnit 5
This closes #6321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 08:02:15 -05:00
Matthew Burgess d698e7af1a
NIFI-10306: Add logging to StandardProcessGroup.addConnection() with more details
This closes #6264

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 07:50:55 -05:00
Pierre Villard 71ba581fd8
NIFI-10392 - This closes #6330. ResizeImage - add option to maintain aspect ratio
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-08-25 08:34:19 +02:00
exceptionfactory 777238eb32 NIFI-10321 Send Session Expired message for Expired JWT errors
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6332.
2022-08-24 12:40:04 -04:00
mr1716 5303dd13aa
NIFI-10389 Upgrade AWS Kinesis to 1.14.8
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6328.
2022-08-24 11:46:32 +02:00
mr1716 4a2c0beb7f
NIFI-10388 Upgraded xmlunit-matchers from 2.6.3 to 2.9.0
This closes #6326

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-23 15:21:45 -05:00
Matt Burgess 6f0ca87304
NIFI-10387: Fixed negative logic bug in scripted components (#6325) 2022-08-23 13:53:12 -04:00
exceptionfactory 90aa778a6c NIFI-10348 Upgraded Tomcat Embed to 8.5.82 for Flume NAR
- Upgraded tomcat-embed-core from 8.5.46 to 8.5.82 for Flume components

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6292.
2022-08-23 12:39:08 -04:00
exceptionfactory fa85a05a2b
NIFI-9374 Added Deprecation Logger
- Added nifi-deprecation-log module with interface and implementation using SLF4J
- Updated standard logback.xml with nifi-deprecation.log appender
- Updated NiFiLegacyCipherProvider with deprecation logging
- Set Size, Time Policy, and Total Size Limit for Deprecation Log

This closes #6300
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-23 11:25:03 -04:00
exceptionfactory ca991a6805
NIFI-10382 Upgraded Flume dependencies from 1.10.0 to 1.10.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6320.
2022-08-23 17:15:10 +02:00
Mark Payne 9070cd0904
NIFI-10383: When importing/synching to a VersionedFlow, if the Versioned PropertyDescriptor indicates that a property references a Controller Service, treat it the same as if the PropertyDescriptor itself indicates that it references a service. This allows us to ensure that scripted components' property descriptors that reference controller services are properly mapped. Additionally updated StandardProcessorNode so that when we have this condition that we properly account for the Controller Service reference
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6322
2022-08-23 09:59:07 -04:00
Mark Payne cb275dd956
NIFI-10385: If script body is empty for AbstractScriptedControllerService or InvokeScriptedProcessor, do not attempt to load script
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6324
2022-08-22 22:34:29 -04:00
exceptionfactory 0a065538e2 NIFI-10368 Upgraded jQuery UI from 1.12.1 to 1.13.2
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6312.
2022-08-22 14:14:15 -04:00
mr1716 4b9f92f167
NIFI-10374 Upgraded Caffeine to 2.8.1 in nifi-asn1-services
This closes #6316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-22 08:11:34 -05:00
Mark Payne b012e9aad2
NIFI-10371: When a component is moved between groups, ensure that its versioned component id is unique within the destination group. Also ensure that when adding a connection to a PG with the VersionedComponentSynchronizer that we prefer obtaining source/destination by instance id instead of versioned id.
Fixed bug where ProcessGroup would inadvertently set the wrong component's Versioned Component ID to null when there was an ID conflict

This closes #6314

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-22 08:07:27 -05:00
Timea Barna 22e8901fce NIFI-8248 Modified PutAzureDataLakeStorage processor to use temp file instead of inline replacement
This closes #6159

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2022-08-19 17:10:32 +00:00
mr1716 1dd2bbb866
NIFI-10372 Upgrade Spring-Data-Redis to 2.7.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6315.
2022-08-19 12:18:25 +02:00
mr1716 bcc73a700d
NIFI-10367 Removed unused org.jeasy:easy-rules-mvel from rules-action-handler
This closes #6311

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-18 10:04:35 -05:00
Hsin-Ying Lee 2685856c62
NIFI-10052 Avoid obtaining any locks when creating/sending heartbeats (#6298) 2022-08-17 14:05:55 -04:00
exceptionfactory 5df6efa0f2
NIFI-10358 Updated CaptureChangeMySQL to use SSL JDBC properties
- Added Connection Properties Provider with implementation to translate SSL Mode and SSL Context Service configuration to MySQL Connector properties

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6306
2022-08-17 12:15:04 -04:00
Mark Payne 21503f6353
NIFI-10362: When asynchronous node disconnect is issued, do not send disconnect to node if the node becomes reconnected in the interim. Also, addressed the issue in which a disconnected node acts on a replicated request during the first phase by detect that it's the first phase if configured for cluster, not when only when connected to a cluster.
This closes #6308

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-17 11:09:47 -05:00
mr1716 99a0c05070
NIFI-10361 Upgraded commons-jexl3 from 3.1 to 3.2.1
This closes #6305

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-17 09:20:06 -05:00
exceptionfactory a89873f437
NIFI-9518 Upgraded mysql-binlog-connector-java from 0.20.1 to 0.26.1
- Changed from com.github.shyiko to com.zendesk dependency group for current library version

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6302.
2022-08-17 10:51:35 +02:00
Malthe Borch 1b4d66a726
NIFI-10343 Add error code to exception message
The error object may not have a description, but should have a code.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6288.
2022-08-16 09:49:58 +02:00
royalfork2 eb419b6e40
NIFI-10300 Added AzureEventHubRecordSink
This closes #6296

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-15 15:57:08 -05:00
Matt Burgess 0d0a119737
NIFI-1954: Add additionalDetails page to ExecuteScript (#6044)
* NIFI-1954: Add additionalDetails page to ExecuteScript

* NIFI-1954: Incorporated review comments
2022-08-15 11:44:30 -04:00
exceptionfactory 864036674e
NIFI-10244 Added nifi-web-client-api and implementation
- Added nifi-web-client implementation based on OkHttp
- Added WebClientServiceProvider Controller Service interface and implementation
- Corrected comments and added unmodifiableMap wrapper
- Added getHeaderNames() and corrected ProxyContext comments

This closes #6268
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-11 17:25:18 -04:00
UcanInfosec a3a7b2fcfd
NIFI-10334 Upgraded amqp-client from 5.8.0 to 5.15.0
This closes #6280

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-10 12:06:15 -05:00
Pierre Villard e7dc14a4e0
NIFI-10339 - Fix typo in QuerySalesforceObject
This closes #6286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-10 10:37:25 -05:00
exceptionfactory 8605d0a29f
NIFI-10336 Removed unnecessary lineage check from TestMonitorActivity
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6285.
2022-08-10 15:34:44 +02:00
exceptionfactory 24cea2a93b
NIFI-10183 Upgraded swagger-annotations to 1.6.6
- Added managed dependency in root Maven configuration
- Removed different versions from other Maven configurations

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6284.
2022-08-10 15:32:30 +02:00
exceptionfactory 77033ec11a NIFI-10322 Corrected Cookie path when removing Bearer Token
- Appended root path to Cookie path attribute when removing Bearer Tokens as part of unauthorized response handling
- Updated Saml2AuthenticationSuccessHandler to follow standard Cookie path building strategy

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6278.
2022-08-09 16:09:41 -04:00
UcanInfosec 3341e789f0
NIFI-10329 Upgrade jasn1-compiler to 1.11.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6277.
2022-08-09 15:27:38 +02:00
Pierre Villard 0dc751981c
NIFI-10291 Updated Snowflake Driver from 3.13.14 to 3.13.21
This closes #6252

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:58:31 -05:00
UcanInfosec 415413fac2
NIFI-10327 Upgraded Apache Ivy from 2.4.0 to 2.5.0
This closes #6275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:44:12 -05:00
Emilio Setiadarma 5b9f096143
NIFI-10307 Refactored nifi-standard-processors tests to use JUnit 5
This closes #6272

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:35:19 -05:00
Timea Barna 26829e5c35 NIFI-10256 CSVRecordReader using RFC 4180 CSV format trimming starting and ending double quotes
NIFI-10256 Addresseng review comments, adding extra description, removing unneccessary static import, creating extra constructor

NIFI-10256 Refactoring CSVRecordReader

NIFI-10256 Addresseng review comments, adding validator

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6234
2022-08-08 17:13:48 +02:00
exceptionfactory fdf3925f81
NIFI-3964 Updated Grok Patterns to support TEXT and URL Resources
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6260.
2022-08-08 14:48:21 +02:00
UcanInfosec 0fd262efca NIFI-10319 - Update pom.xml
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6270.
2022-08-05 16:42:06 -04:00
Daniel Urban 387ae7d323
NIFI-10199: PublishKafka InFlightMessageTracker should not log batch level errors on each record
Currently, when a batch level error occurs (e.g. delivery timeout), the same error is logged for each record of the batch, needlessly flooding the logs.
InFlightMessageTracker now only logs an exception when a flow file encounters it for the first time.

This closes #6185
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-05 14:12:43 -04:00
Gabor Kulik 768f58da21 NIFI-10212 added ListSmb processor and SmbConnectionPoolService
This closes #6192.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-08-05 18:46:04 +02:00
exceptionfactory 5cc2790891
NIFI-10302 Streamlined TestMonitorActivity to improve reliability
- Removed TestRunner.run() loops
- Reduced usage of Thread.sleep()
- Upgraded TestMonitorActivity to JUnit 5

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6261.
2022-08-05 10:44:26 -04:00
exceptionfactory 2d73fd5631
NIFI-10318 Corrected HandleHttpRequest TLS client authentication
- Corrected setting of wantClientAuth instead of needClientAuth based on Client Authentication configuration

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #6271.
2022-08-04 14:18:10 -04:00
Emilio Setiadarma df2c187761
NIFI-10298 Changed nifi-framework-cluster tests to use Java and JUnit 5
This closes #6262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-04 10:31:17 -05:00
Emilio Setiadarma b260c10ad4
NIFI-10293 Refactored tests in nifi-jolt-transform-json-ui to use JUnit 5
This closes #6258

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-01 10:49:27 -05:00
Joe Witt ded48269fe
Merge branch 'NIFI-10272-RC2' 2022-08-01 06:10:25 -07:00
Emilio Setiadarma 296f308cdc
NIFI-10048 Corrected StandardFlowDifference.hashCode() to avoid NPE
- Added tests to TestFlowController for JSON flow configuration

This closes #6227

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 13:44:26 -05:00
Emilio Setiadarma 67c463627c
NIFI-10292 Refactor nifi-framework-authorization-providers tests with Java and JUnit 5
This closes #6257

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 10:48:11 -05:00
exceptionfactory 4e49a55e93
NIFI-10295 Upgraded GRPC from 1.34.0 to 1.48.0
- Upgraded Protobuf from 3.14.0 to 3.21.4
- Removed netty-tcnative-boringssl-static as not necessary following NIFI-9897

This closes #6255.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-07-28 18:47:37 -04:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Nathan Gough c77f85aafb
NIFI-10070 Updated status merging for ControllerService and ReportingTask entities
- Corrected node identifier selection in multiple Mergers

This closes #6154

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-27 14:48:02 -05:00
Tamas Palfy 2fae3bb9a8
NIFI-10281 - Added FetchGoogleDrive processor. Consolidated record- and attribute output for ListGoogleDrive. (Record fields and flowfile attributes are now the same.)
This closes #6248.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-07-27 18:59:06 +02:00
exceptionfactory afa85a03ce
NIFI-10286 This closes #6251. Removed c2-client-api references from nifi-nar-utils
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-27 08:01:24 -07:00
exceptionfactory 9bb22fcb11
NIFI-10284 Corrected HTTP Request Authenticated User logging
- Moved RequestAuthenticationFilter before HeaderWriterFilter

This closes #6250
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-27 10:26:43 -04:00
exceptionfactory 02e37713b3
NIFI-10277 This closes #6245. Refactored ConnectionLoadBalanceServerTest
NIFI-10277 Changed failure test to throw SocketException
NIFI-10277 Increased timeout to 30 seconds and moved verify method

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 15:10:27 -07:00
emiliosetiadarma c6999ba9d8
NIFI-10278 - This closes #6247. repeat onTrigger of ConsumeTwitter until a FlowFile is received or timeout after 60 seconds
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 14:45:54 -07:00
Mark Payne 8a1249ee39
NIFI-10279: This closes #6246. Increased timeout in TestExecuteStateless, removed explicit timeouts on stateless system tests that were too aggressive so that the tests use the default 5 minute timeout defined in StatelessSystemIT
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 14:33:48 -07:00
Mark Payne 92750c2746
NIFI-10261: Ensure that when comparing Sensitive Parameters during flow sync we decrypt values for the comparison
This closes #6231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:52:46 -05:00
Mark Payne 0497907829
NIFI-10262: Ensure that when an Exception is thrown from a Controller Service's @OnEnabled method that we properly handle that Exception and continue enabling the other services in the given collection of services
This closes #6236

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:02:21 -05:00
exceptionfactory 7767a5b85d
NIFI-10265 Route to Failure on Connect Exceptions in PutDatabaseRecord
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6235
2022-07-25 09:36:54 -04:00
Eduardo Fontes c61efecbdc
NIFI-10252: Use correct field(s) for PutDatabaseRecord update keys
Not always UpdateKey comes in first position

Better readability

Include testUpdatePkNotFirst

Including usefull SQL log debug

Fix semicolon

NIFI-10252: Additional unit test for specified update keys
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6226
2022-07-25 08:48:06 -04:00
exceptionfactory 7244b9cfc4
NIFI-10271 This closes #6242. Upgraded Xerces from 2.12.1 to 2.12.2
- Suppressed false positive vulnerability report for CVE-2017-10355

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:59:33 -07:00
exceptionfactory 7d920b9bc6
NIFI-10270 This closes #6240. Upgraded AWS SDK from 1.12.182 to 1.12.267
- Upgraded MiNiFi AWS SDK references from 1.11.172 to 1.12.267

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:59:04 -07:00
patalwell 0cd438d9e9
NIFI-9817 Added Unit Validator to PutCloudWatchMetric
This closes #5905

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-23 10:18:27 -05:00
Nathan Gough 40d7d88bc0
NIFI-10232 Set write and idle timeouts in DistributedCacheClient
- Added OnShutdown annotation to Cache Server and Cache Client Service methods

This closes #6221

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 19:49:22 -05:00
exceptionfactory a661b035e8 NIFI-10259 Improved HTTP error handling for authentication failures
- Added Standard AuthenticationEntryPoint
- Configured AuthenticationEntryPoint for SecurityFilterChain and BearerTokenAuthenticationFilter

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6233.
2022-07-22 17:33:51 -04:00
Mark Payne d7ed66032e
NIFI-10050: When copying a process group and 1 CS references a higher-level CS, ensure that we don't drop that reference
This closes #6077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 16:25:58 -05:00
Mark Payne bc4e3e850b
NIFI-10246: When syncing Controller Services, wait until any DISABLING Controller Service has fully disabled before attempting to synchronize them. Also performed some minor refactoring/cleanup for System Tests in order to make writing a system test for this simpler
This closes #6219

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 13:31:06 -05:00
NissimShiman 74b25c7306
NIFI-10154 ReplaceText AdminYielding on long line (#6151)
* NIFI-10154 ReplaceText AdminYielding on long line

* NIFI-10154 code review changes

Signed-off-by: Otto Fowler <otto@apache.org>
2022-07-22 11:14:23 -04:00
Nandor Soma Abonyi 302bdbfb11
NIFI-10260 Changed display name and description of Validate DTD properties
- Set Allow DTD as display name in EvaluateXPath and EvaluateXQuery

This closes #6230

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-21 13:28:36 -05:00
Arpad Boda eab687ee50
NIFI-10255 Updated original relationship description on ExecuteStreamCommand
- Description of original relationship of ExecuteStreamCommand processor might be misleading

This closes #6229

Signed-off-by: David Handermann <exceptinofactory@apache.org>
2022-07-21 09:41:53 -05:00
Tamas Palfy ad781170e3
NIFI-10223 Created ListGoogleDrive processor.
This closes #6200.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-07-20 13:38:47 +02:00
Kevin Doran ccf3866261
NIFI-9812 Disabled Native Lib loading tests on ARM64
- Migrate tests in nifi-framework-mark-loading-utils to JUnit5
- Annotate tests that use x86_64 native binaries to be conditional on x86_64 os.arch

This closes #6215

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 11:38:26 -05:00
Kevin Doran 1a1037022f
NIFI-9813 Excluded Ranger modules on ARM64
This closes #6216

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 08:03:16 -05:00
Kevin Doran 97e7a3c030
NIFI-9809 Disabled Kudu tests on ARM64
This closes #6214

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 07:56:26 -05:00
Paul Grey 148834e71b
NIFI-10247 Corrected REST API documentation for empty-all-connection-requests
This closes #6220

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 07:51:32 -05:00
Lehel f8844440f5 NIFI-10019: SendTrapSNMP works without flowfile, upgraded to junit5
This closes #6046.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-18 16:15:15 +02:00
Pierre Villard 4d219689f1
NIFI-10193 Added SupportsSensitiveDynamicProperties to ExecuteStateless
This closes #6177

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-18 09:08:27 -05:00
Peter Turcsanyi 14a31c81dd
NIFI-10239 Upgraded Curator from 4.2.0 to 5.3.0 for Hive3
- Corrected NoSuchMethodError for ZooKeeper discovery mode with Hive3 JDBC and mismatch between Hadoop 3.3.3 and Curator 4.2.0

This closes #6210

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 12:43:05 -05:00
Emilio Setiadarma cb0753b03c
NIFI-9758 Added Dynamic Properties to PutEmail
This closes #6204

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 10:58:31 -05:00
exceptionfactory 047b3611bf NIFI-10233 Corrected Anonymous Authentication for HTTP Access
- Enabled Standard Anonymous Authentication Filter when unencrypted HTTP is enabled

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6209.
2022-07-14 23:27:54 -04:00
Matt Burgess d0db4c44bb
NIFI-10231: Change AbstractScriptedControllerService.OnConfigurationRestored to use ConfigurationContext (#6207) 2022-07-14 11:49:00 -04:00
exceptionfactory a9b5bebb15 NIFI-10216 Refactored NiFi Web API Security Configuration
- Removed extension of deprecated WebSecurityConfigurerAdapter
- Moved Filter bean configuration associated configuration classes
- Set default Spring Security log level to INFO
- Adjusted CSRF Token Repository to leverage simplified RequestUriBuilder for retrieving allowed context paths

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6195
2022-07-13 19:11:03 -04:00
exceptionfactory 0dea0ae364
NIFI-10196 Corrected Jolt UI CSRF Header Handling
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6198
2022-07-13 15:25:16 -04:00
Mark Payne 4c0555a476
NIFI-10203: Ensure that when a FlowFile is transferred and is not retried that we remove the retryCount.<uuid> attribute
This closes #6201
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 19:01:41 -04:00
exceptionfactory 51626d728b
NIFI-10215 This closes #6194. Upgraded Curator from 5.2.1 to 5.3.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-12 09:51:26 -07:00
Mark Payne 996d8faaf4
NIFI-10203: Fixed bug in which same FlowFile Builder was used repeatedly for multiple FlowFiles; this caused mingling of their attributes when a FlowFile is routed to a relationship that has more than 1 destination (i.e., many connections with the same Relationship)
This closes #6187
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 09:52:49 -04:00
Paul Grey 274e4feeaa
NIFI-10143 Adjusted UTF-8 auto-detection in FTP Processors
This closes #6172

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 20:00:40 -05:00
Otto Fowler cf4eed0224 NIFI-10207: ensure allowableValues matches SUPPORTED_STATE in ProcessorRunStatusEntity
This closes #6188.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-11 21:34:27 +02:00
UcanInfosec 06db7968fa
NIFI-10201 Upgraded Prometheus simpleclient from 0.3.0 to 0.16.0
This closes #6180

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 12:57:27 -05:00
mr1716 291bd40013
NIFI-10195 Upgraded Testcontainers to 1.17.3
This closes #6179

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:37:39 -05:00
dependabot[bot] 3a31dff76b
NIFI-10214 Upgraded commons-configuration2 from 2.7 to 2.8.0
This closes #6181
This closes #6182
This closes #6183

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:27:17 -05:00
Peter Turcsanyi 1685204cc1
NIFI-10206: Restored flushBuffer() call in HandleHttpResponse to avoid HTTP 404
This closes #6186

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-08 16:51:20 -05:00
Lehel 46bb7d153d NIFI-9558: ConnectWebSocket leaks connections and duplicates FlowFiles in incoming connection mode (new PR)
This closes #6176.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-06 10:30:47 +02:00
Lehel 328d38facb NIFI-10194: Simplified SendTrapSNMP error handling
This closes #6178.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-05 16:55:57 +02:00
Lehel 685088a59c NIFI-9916: ListenTrapSNMP USM parsing refactor.
This closes #6034.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-04 16:43:20 +02:00
Ferenc Erdei d78c667c19
NIFI-10166 Improved MiNiFi bootstrap test coverage
This closes #6160

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-01 14:45:31 -05:00
exceptionfactory ea0e1b446e
NIFI-10187 Upgraded FtpServer from 1.1.1 to 1.2.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6171.
2022-07-01 14:24:21 +02:00
Paul Grey 26a10d772f
NIFI-10186 Corrected PutFTP Remote Path Property EL
This closes #6173

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 19:12:28 -05:00
exceptionfactory 1f18345929
NIFI-10163 Corrected StandardProcessSessionTest after NIFI-10167 2022-06-30 19:10:57 -05:00
exceptionfactory 943197c18b NIFI-10163
- Corrected StandardProcessSession.exportTo() byte counting
- Removed bytesWritten incrementing from exportTo methods

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6153.
2022-06-30 18:42:44 -04:00
Matthew Burgess 7eec507118
NIFI-10181: Upgrade Groovy to 3.0.9
This closes #6170

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:47:00 -05:00
Kevin Doran 9cf5c170b1
NIFI-9810 Deprecated RocksDB repository and moved to NAR
- Bump version to 6.29.5 for arm64 compatibility
- Extract RocksDBFlowFileRepository and supporting code to its own module
- Mark RocksDBFlowFileRepository as deprecated, both in code and documentation
- Log deprecation warning at startup if RocksDBFlowFileRepository is used
- Move native RocksDB info logs to NiFi debug level logs

This closes #6155

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:23:10 -05:00
Mark Payne 5e83bda9e9
NIFI-10167: Added advanced timing metrics for processors, such as CPU Usage, time reading/writing content repo, process session commit time, etc. Exposed via nifi.sh diagnostics and made configurable via nifi.properties
This closes #6156

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 10:50:24 -05:00
timeabarna d5b626f0e4
NIFI-10108 Processor scheduling via parameter (#6115)
- NIFI-10108 Processor scheduling via parameter
- Refactoring component referencing check in AbstractComponentNode and StandardParameterReferenceManager classes.
2022-06-30 10:11:13 -04:00
exceptionfactory 0458b6432d NIFI-10158 Corrected ListFTP expression support for Hostname and Port
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6162.
2022-06-29 22:11:11 -04:00
exceptionfactory 7a47c8cfbd
NIFI-10162 Reorganized InvokeHTTP Properties
- Corrected handling of documentation for allowable values

NIFI-10162 Updated Multipart Form-Data Name description

This closes #6163.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-29 16:52:19 -04:00
exceptionfactory 6997f17bff
NIFI-10180 This closes #6168. Removed standard Maven repository definitions
- Upgraded Apache parent from 25 to 26
- Upgraded Apache Rat Plugin from 0.13 to 0.14
- Upgraded Maven Compiler Plugin from 3.9.0 to 3.10.1
- Removed Confluent repository from Confluent Registry Service module
- Removed MapR repository profile configuration
- Removed Hortonworks repository profile configuration

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:47 -07:00
exceptionfactory ee3dcc78bf
NIFI-10173 This closes #6164. Upgraded Flume from 1.6.0 to 1.10.0
- Removed unmaintained flume-dataset-sink and flume-ng-elasticsearch-sink dependencies
- Added dependency-check suppression configuration for false positives on Flume libraries

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:09 -07:00
Mark Payne 39c366eeef
NIFI-10169: When using the Insert Record Fields join strategy of JoinEnrichment, ensure that in order to combine schemas from the original record and the enrichment record we use incorporateSchema() so that even when the first enrichment record is null, we get the schema correct
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6157.
2022-06-29 17:28:15 +02:00
Emilio Setiadarma a098653d07
NIFI-10165 Increased NiFi bootstrap heap size to 48 MB
- Increased bootstrap heap size from 24 MB to 48 to avoid heap constraints when using HTTP notifications

This closes #6161

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 14:56:55 -05:00
exceptionfactory 0de83292de NIFI-9849 Refactored SAML Support with Spring Security 5
- Updated SAML Authentication Configuration with Spring Security SAML 2 components
- Updated Administration Guide with REST Resources
- Replaced SAMLAccessResource methods with applicable Spring Security Filters
- Removed IDP Credential Service and supporting components
- Removed message.logging.enabled, metadata.signing.enabled, and signature.digest.algorithm properties
- Added Access Token Expiration resource method
- Removed Saml2AccessResource and replaced with Access Token Expiration to avoid unnecessary conflicts with SAML login consumer
- Corrected Resource URI handling to support proxy server access

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6149.
2022-06-28 13:57:35 -04:00
Csaba Bejan 1465c2c629
NIFI-9908 C2 refactor and test coverage improvements
This closes #6149

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 12:02:31 -05:00
Nissim Shiman db11961026
NIFI-9440 Allow Controller Services to have configurable Bulletins
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6035
2022-06-28 10:44:45 -04:00
exceptionfactory b3b13a4ee0
NIFI-10145 Upgraded Hadoop from 3.3.2 to 3.3.3
- Excluded slf4j-reload4j implementation of Log4j 1
- Updated nifi-hive3-processors to leverage shared Hadoop version from 3.1.1
- Updated nifi-accumulo-bundle to leverage shared Hadoop version from 3.1.1
- Updated nifi-atlas-bundle to leverage shared Hadoop version from 3.3.2
- Updated nifi-spark-receiver to leverage shared Hadoop version from 3.3.2

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6139.
2022-06-28 16:19:38 +02:00
exceptionfactory c1c1d0da82
NIFI-10153 Refactored DocGeneratorTest and removed binary test files
This closes #6146

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-27 22:05:53 -04:00