176 Commits

Author SHA1 Message Date
Andrew Gaul
05f64f52b2 JCLOUDS-1109: update Azure signed URL expect tests 2017-04-22 12:07:26 -07:00
Andrew Gaul
1e04eafbab JCLOUDS-255: JCLOUDS-1109: Azure signed URLs expiration
This commit also changes signed URLs from header-based to query
parameter-based.
2017-04-22 10:59:15 -07:00
Andrew Gaul
2e7de9f850 JCLOUDS-1271: Deprecate signRemoveBlob
URL signing should always use authentication parameters instead of
headers yet no provider supports DELETEs with the former.
2017-04-19 18:08:52 -07:00
Andrew Gaul
46d3645111 Set ListBlobsOptions.datasets in setter 2017-04-12 13:18:41 -07:00
Andrew Gaul
87eda15085 Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 20:35:24 -08:00
Andrew Gaul
87a6f2a615 JCLOUDS-1228: Include PublicAccess in responses
REST API version 2016-05-31 includes PublicAccess in List Containers
and Get Container Properties APIs.
2017-01-20 12:02:18 -08:00
Andrew Gaul
f8025790bf JCLOUDS-1223: Use larger block blobs for Azure
This raises the maximum multipart size from 195 GB to 4.77 TB.
Reference:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:21 -08:00
Andrew Gaul
a5ec80a275 JCLOUDS-1123: Azure REST API version 2016-05-31
This enables larger block blobs:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:05 -08:00
Andrew Gaul
3c9f66b8e9 Avoid lower-case l literal suffix
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
2016-10-23 14:24:35 -07:00
Andrew Gaul
8117574c83 Avoid C-style array declarations
Found via error-prone.
2016-10-23 13:51:59 -07:00
Andrew Gaul
50e6d44433 JCLOUDS-945: fix local blobstore marker handling
Previously using prefix markers would not correctly find the next key.
Add test for this behavior.
2016-10-12 22:22:28 -07:00
Zack Shoylev
05c05e3de2 Allows users to download large files efficiently and directly to disk. 2016-09-02 14:05:26 -05:00
Andrew Gaul
de04c69141 Consistently name test container names
Previously jclouds allocated the initial container pool as
$USERNAME-blobstore-1, 2, etc. and subsequent containers with
$USERNAME-blobstore-$RANDOM.  Use only the former instead.
2016-06-22 22:50:22 -07:00
Andrew Gaul
0bd2959410 JCLOUDS-1125: portable list multipart uploads
Only Azure, B2, and S3 support this operation.  Some MultipartUpload
fields become nullable.
2016-06-13 16:26:43 -07:00
Andrew Gaul
61ab28cc50 JCLOUDS-1125: Azure list other blobs
Some BlobProperties fields become nullable due to these new blob types.
2016-06-13 16:26:43 -07:00
Andrew Gaul
41bdd9c5a9 Skip unimplemented signed URL tests in S3 provider
jclouds aws-s3 provider supports these but s3 does not.  Also expect
failure in atmos and azureblob.  Follow on to
a4c40e15cdddda30a9683d12bf022d94025567c8.
2016-05-12 12:12:52 -07:00
Andrew Gaul
a4c40e15cd Handle unimplemented signed URL tests in providers
This commit makes it evident in source code which providers do not
support this feature.
2016-05-06 10:31:37 -07:00
Andrew Gaul
467f3483bc JCLOUDS-651: Azure support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul
293d3f864e Convert CopyOptions into an AutoValue
This commit requires an interface change since AutoValue lacks support
for Optional and uses Nullable annotations instead.
2016-02-16 16:29:54 -08:00
Andrew Gaul
0cf13c61ef Do not remove during Azure abortMultipartUpload
Explicitly removing the blob removes any previously existing blob with
the same name.
2016-02-03 23:34:37 -08:00
Andrew Gaul
e50bd79f01 Map PublicAccess.CONTAINER to PUBLIC_READ
This better matches the semantics of other providers and allows
clients to list a publicly readable container.
2016-01-31 18:14:25 -08:00
Andrew Gaul
6360023f09 Remove unnecessary static imports
Found via error-prone.
2016-01-29 09:14:55 -08:00
Andrew Gaul
b2c0786fc0 Enable range tests for azureblob 2016-01-23 12:38:50 -08:00
Andrew Gaul
01e10bba66 JCLOUDS-948: Azure Cache-Control support
References JCLOUDS-185.
2016-01-15 04:41:01 -08:00
Rita Zhang
a12ce5a8b7 Add support for AzureBlobStore.getBlobAccess and RegionScopedSwiftBlobStore.getBlobAccess.
They are currently throwing UnsupportedOperationException exception.
2016-01-05 15:33:50 -08:00
Andrew Gaul
f926944949 JCLOUDS-844: Azure putBlob ACLs 2015-12-22 00:46:34 -08:00
Andrew Gaul
13701bf7ab Do not test marker contents
Some providers like Azure have opaque markers.
2015-12-19 15:24:12 -08:00
Andrew Gaul
b64d05abb9 Allow setting content metadata during copyBlob
Also remove unneeded call to setBlobMetadata which copy sets.
2015-12-13 22:33:08 -08:00
Andrew Gaul
85bc4a6b7e Fix Azure setBlobProperties
Also backfill test.
2015-12-13 22:24:53 -08:00
Andrew Gaul
0634da98a7 Return ETag from AzureBlobClient.copyBlob
This avoids a call to getBlobProperties in AzureBlobStore.copyBlob.
2015-12-13 18:12:57 -08:00
Timur Alperovich
4bc4564900 Skip broken Azure test. 2015-09-11 14:27:24 -07:00
Timur Alperovich
cdabc59ad8 JCLOUDS-217: Azure: Handle blobs with % correctly.
When constructing a URI path for a blob in the listing results, the
Azure provider should re-encode any "bad" characters. Azure provider
also should not call trim() on the blob name, as that will remove any
leading or trailing space characters (which the provider supports). In
fact, the trim() call is only required because of the fact that when
parsing the XML document in the Azure tests, the white space between
the tags was also included in the values. Changing when the character
array is reset eliminates the need to do so.
2015-09-08 15:19:02 -07:00
Oliver Gondža
edde721937 JCLOUDS-962: Make all @Provider methods final 2015-09-02 23:54:44 +02:00
Timur Alperovich
04ba8905f8 JCLOUDS-992: Handle directories as blobs in Azure. 2015-08-20 12:42:11 -07:00
Andrew Gaul
d86a6c9ee1 Correct Checkstyle violations 2015-07-31 15:28:25 -07:00
Andrew Gaul
86f47394bf Correct FindBugs violations 2015-07-31 14:53:58 -07:00
Timur Alperovich
2c1ca89e1a JCLOUDS-929: Add delimiter support to Azure.
Plumb the delimiter option to the Azure blob store.
2015-07-13 14:35:00 -07:00
Timur Alperovich
a29d75a5d1 JCLOUDS-929: Implement generic delimiter support.
The patch adds delimiter option support in the generic blob store
interface. A live integration test is added to verify that jclouds
correctly lists objects separated by a delimiter.
2015-07-13 14:34:58 -07:00
Timur Alperovich
841a184898 Azure Blob: do not filter out prefixes.
We should not filter out prefixes when listing containers, similarly
to the way swift behaves. This makes the marker blobs apparently to
the user.
2015-07-07 16:33:44 -07:00
Timur Alperovich
497a013c8a JCLOUDS-930: Plumb prefix support down to Azure.
Plumbs support for the prefix query option in the Azure provider. This
option is not compatible with the "directory" list option and an
exception is thrown if both are set.
2015-06-29 17:31:56 -07:00
Timur Alperovich
7c7d2e2df6 JCLOUDS-930: Add the prefix option.
Add a prefix option to the ListContainerOptions class.
2015-06-29 17:31:55 -07:00
Andrew Gaul
794b385c98 JCLOUDS-894: Add portable multipart upload for Azure 2015-06-06 16:32:16 -07:00
Andrew Gaul
4e3776a099 JCLOUDS-894: Expose Azure multipart operations 2015-05-01 13:32:29 -07:00
Andrew Gaul
09b54eb03f List both committed and uncommitted Azure blocks 2015-05-01 13:32:28 -07:00
Andrew Gaul
a761f4cfa1 JCLOUDS-651: Azure copy object content metadata 2015-04-08 17:58:46 -07:00
Andrew Gaul
31369ae590 JCLOUDS-651: Add Azure server-side copyBlob 2015-04-02 15:36:53 -07:00
Andrew Gaul
f57ccadce8 JCLOUDS-871: Azure Copy Blob support
API reference:

http://msdn.microsoft.com/en-us/library/dd894037.aspx
2015-03-31 11:13:16 -07:00
Andrew Gaul
967f08a8f2 Return ETag from Azure setBlobMetadata
Also fix up live tests.
2015-03-31 11:03:04 -07:00
Andrew Gaul
9cf97f3117 JCLOUDS-867: Azure support for Content-Disposition
Enabled by Azure API version 2013-08-15.
2015-03-31 10:53:32 -07:00
Andrew Gaul
8617c75b7e JCLOUDS-867: Use Azure API version 2013-08-15
This changes the format of EnumerationResults.
2015-03-31 10:53:32 -07:00