Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-02-08 02:58:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
druid/docs/development/extensions-core/azure.md
zachjsh 720f1e834a
Add support for AzureDNSZone enabled storage accounts used for deep storage (#16016) 
* Add support for AzureDNSZone enabled storage accounts used for deep storage

Added a new config to AzureAccountConfig

`storageAccountEndpointSuffix`

which allows the user to specify a storage account endpoint suffix where the underlying
storage account is enabled for AzureDNSZone. The previous config `endpointSuffix`, did not allow
support for such accounts. The previous config has been deprecated in favor of this new config. Also
fixed an issue where `managedIdentityClientId` was not being set properly

* * address review comments

* * add back azure government link and docs
2024-03-04 16:13:28 -05:00

3.3 KiB
Raw Blame History

id title
azure Microsoft Azure

To use this Apache Druid extension, include druid-azure-extensions in the extensions load list.

Deep Storage

Microsoft Azure Storage is another option for deep storage. This requires some additional Druid configuration.

Property Description Possible Values Default
druid.storage.type azure Must be set.
druid.azure.account Azure Storage account name. Must be set.
druid.azure.key Azure Storage account key. Optional. Set one of key, sharedAccessStorageToken or useAzureCredentialsChain.
druid.azure.sharedAccessStorageToken Azure Shared Storage access token Optional. Set one of key, sharedAccessStorageToken or useAzureCredentialsChain..
druid.azure.useAzureCredentialsChain Use DefaultAzureCredential for authentication Optional. Set one of key, sharedAccessStorageToken or useAzureCredentialsChain. False
druid.azure.managedIdentityClientId If you want to use managed identity authentication in the DefaultAzureCredential, useAzureCredentialsChain must be true. Optional.
druid.azure.container Azure Storage container name. Must be set.
druid.azure.prefix A prefix string that will be prepended to the blob names for the segments published to Azure deep storage ""
druid.azure.protocol the protocol to use http or https https
druid.azure.maxTries Number of tries before canceling an Azure operation. 3
druid.azure.maxListingLength maximum number of input files matching a given prefix to retrieve at a time 1024
druid.azure.storageAccountEndpointSuffix The endpoint suffix to use. Use this config instead of druid.azure.endpointSuffix. Override the default value to connect to Azure Government. This config supports storage accounts enabled for AzureDNSZone. Note: do not include the storage account name prefix in this config value. Examples: ABCD1234.blob.storage.azure.net, blob.core.usgovcloudapi.net blob.core.windows.net
See Azure Services for more information.