Commit Graph

209 Commits

Author SHA1 Message Date
Andrew Gaul 152ca564b5 JCLOUDS-1337: Azure putBlob portable storage tiers 2017-10-12 11:15:14 -07:00
Andrew Gaul fc147dc0c5 JCLOUDS-1335: Azure Blob object access tiers 2017-09-21 20:31:34 -07:00
Andrew Gaul 5facb65a7e JCLOUDS-1335: Upgrade to Azure Blob API 2017-04-17 2017-09-20 21:07:32 -07:00
Andrew Gaul 05f64f52b2 JCLOUDS-1109: update Azure signed URL expect tests 2017-04-22 12:07:26 -07:00
Andrew Gaul 1e04eafbab JCLOUDS-255: JCLOUDS-1109: Azure signed URLs expiration
This commit also changes signed URLs from header-based to query
parameter-based.
2017-04-22 10:59:15 -07:00
Andrew Gaul 2e7de9f850 JCLOUDS-1271: Deprecate signRemoveBlob
URL signing should always use authentication parameters instead of
headers yet no provider supports DELETEs with the former.
2017-04-19 18:08:52 -07:00
Andrew Gaul 46d3645111 Set ListBlobsOptions.datasets in setter 2017-04-12 13:18:41 -07:00
Andrew Gaul 87eda15085 Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 20:35:24 -08:00
Andrew Gaul 87a6f2a615 JCLOUDS-1228: Include PublicAccess in responses
REST API version 2016-05-31 includes PublicAccess in List Containers
and Get Container Properties APIs.
2017-01-20 12:02:18 -08:00
Andrew Gaul f8025790bf JCLOUDS-1223: Use larger block blobs for Azure
This raises the maximum multipart size from 195 GB to 4.77 TB.
Reference:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:21 -08:00
Andrew Gaul a5ec80a275 JCLOUDS-1123: Azure REST API version 2016-05-31
This enables larger block blobs:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:05 -08:00
Ignasi Barrera d290705419 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:12:59 +01:00
Ignasi Barrera 6a3a37f4e0 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:30:45 +01:00
Andrew Gaul 3c9f66b8e9 Avoid lower-case l literal suffix
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
2016-10-23 14:24:35 -07:00
Andrew Gaul 8117574c83 Avoid C-style array declarations
Found via error-prone.
2016-10-23 13:51:59 -07:00
Andrew Gaul 50e6d44433 JCLOUDS-945: fix local blobstore marker handling
Previously using prefix markers would not correctly find the next key.
Add test for this behavior.
2016-10-12 22:22:28 -07:00
Zack Shoylev 05c05e3de2 Allows users to download large files efficiently and directly to disk. 2016-09-02 14:05:26 -05:00
Andrew Gaul de04c69141 Consistently name test container names
Previously jclouds allocated the initial container pool as
$USERNAME-blobstore-1, 2, etc. and subsequent containers with
$USERNAME-blobstore-$RANDOM.  Use only the former instead.
2016-06-22 22:50:22 -07:00
Andrew Gaul 0bd2959410 JCLOUDS-1125: portable list multipart uploads
Only Azure, B2, and S3 support this operation.  Some MultipartUpload
fields become nullable.
2016-06-13 16:26:43 -07:00
Andrew Gaul 61ab28cc50 JCLOUDS-1125: Azure list other blobs
Some BlobProperties fields become nullable due to these new blob types.
2016-06-13 16:26:43 -07:00
Andrew Gaul 41bdd9c5a9 Skip unimplemented signed URL tests in S3 provider
jclouds aws-s3 provider supports these but s3 does not.  Also expect
failure in atmos and azureblob.  Follow on to
a4c40e15cd.
2016-05-12 12:12:52 -07:00
Andrew Gaul a4c40e15cd Handle unimplemented signed URL tests in providers
This commit makes it evident in source code which providers do not
support this feature.
2016-05-06 10:31:37 -07:00
Andrew Gaul 467f3483bc JCLOUDS-651: Azure support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul 293d3f864e Convert CopyOptions into an AutoValue
This commit requires an interface change since AutoValue lacks support
for Optional and uses Nullable annotations instead.
2016-02-16 16:29:54 -08:00
Andrew Gaul 0cf13c61ef Do not remove during Azure abortMultipartUpload
Explicitly removing the blob removes any previously existing blob with
the same name.
2016-02-03 23:34:37 -08:00
Andrew Gaul e50bd79f01 Map PublicAccess.CONTAINER to PUBLIC_READ
This better matches the semantics of other providers and allows
clients to list a publicly readable container.
2016-01-31 18:14:25 -08:00
Andrew Gaul 6360023f09 Remove unnecessary static imports
Found via error-prone.
2016-01-29 09:14:55 -08:00
Andrew Gaul b2c0786fc0 Enable range tests for azureblob 2016-01-23 12:38:50 -08:00
Andrew Gaul 01e10bba66 JCLOUDS-948: Azure Cache-Control support
References JCLOUDS-185.
2016-01-15 04:41:01 -08:00
Rita Zhang a12ce5a8b7 Add support for AzureBlobStore.getBlobAccess and RegionScopedSwiftBlobStore.getBlobAccess.
They are currently throwing UnsupportedOperationException exception.
2016-01-05 15:33:50 -08:00
Andrew Gaul f926944949 JCLOUDS-844: Azure putBlob ACLs 2015-12-22 00:46:34 -08:00
Andrew Gaul 13701bf7ab Do not test marker contents
Some providers like Azure have opaque markers.
2015-12-19 15:24:12 -08:00
Andrew Gaul b64d05abb9 Allow setting content metadata during copyBlob
Also remove unneeded call to setBlobMetadata which copy sets.
2015-12-13 22:33:08 -08:00
Andrew Gaul 85bc4a6b7e Fix Azure setBlobProperties
Also backfill test.
2015-12-13 22:24:53 -08:00
Andrew Gaul 0634da98a7 Return ETag from AzureBlobClient.copyBlob
This avoids a call to getBlobProperties in AzureBlobStore.copyBlob.
2015-12-13 18:12:57 -08:00
Timur Alperovich 4bc4564900 Skip broken Azure test. 2015-09-11 14:27:24 -07:00
Timur Alperovich cdabc59ad8 JCLOUDS-217: Azure: Handle blobs with % correctly.
When constructing a URI path for a blob in the listing results, the
Azure provider should re-encode any "bad" characters. Azure provider
also should not call trim() on the blob name, as that will remove any
leading or trailing space characters (which the provider supports). In
fact, the trim() call is only required because of the fact that when
parsing the XML document in the Azure tests, the white space between
the tags was also included in the values. Changing when the character
array is reset eliminates the need to do so.
2015-09-08 15:19:02 -07:00
Oliver Gondža edde721937 JCLOUDS-962: Make all @Provider methods final 2015-09-02 23:54:44 +02:00
Timur Alperovich 04ba8905f8 JCLOUDS-992: Handle directories as blobs in Azure. 2015-08-20 12:42:11 -07:00
Andrew Gaul d86a6c9ee1 Correct Checkstyle violations 2015-07-31 15:28:25 -07:00
Andrew Gaul 86f47394bf Correct FindBugs violations 2015-07-31 14:53:58 -07:00
Timur Alperovich 2c1ca89e1a JCLOUDS-929: Add delimiter support to Azure.
Plumb the delimiter option to the Azure blob store.
2015-07-13 14:35:00 -07:00
Timur Alperovich a29d75a5d1 JCLOUDS-929: Implement generic delimiter support.
The patch adds delimiter option support in the generic blob store
interface. A live integration test is added to verify that jclouds
correctly lists objects separated by a delimiter.
2015-07-13 14:34:58 -07:00
Timur Alperovich 841a184898 Azure Blob: do not filter out prefixes.
We should not filter out prefixes when listing containers, similarly
to the way swift behaves. This makes the marker blobs apparently to
the user.
2015-07-07 16:33:44 -07:00
Timur Alperovich 497a013c8a JCLOUDS-930: Plumb prefix support down to Azure.
Plumbs support for the prefix query option in the Azure provider. This
option is not compatible with the "directory" list option and an
exception is thrown if both are set.
2015-06-29 17:31:56 -07:00
Timur Alperovich 7c7d2e2df6 JCLOUDS-930: Add the prefix option.
Add a prefix option to the ListContainerOptions class.
2015-06-29 17:31:55 -07:00
Andrew Gaul 794b385c98 JCLOUDS-894: Add portable multipart upload for Azure 2015-06-06 16:32:16 -07:00
Andrew Gaul 4e3776a099 JCLOUDS-894: Expose Azure multipart operations 2015-05-01 13:32:29 -07:00
Andrew Gaul 09b54eb03f List both committed and uncommitted Azure blocks 2015-05-01 13:32:28 -07:00
Andrew Gaul a761f4cfa1 JCLOUDS-651: Azure copy object content metadata 2015-04-08 17:58:46 -07:00