Apache
/
jclouds
mirror of https://github.com/apache/jclouds.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
9,980 Commits 22 Branches 130 Tags 97 MiB
Commit Graph

692 Commits

Author SHA1 Message Date
Andrew Gaul 992e60d82d JCLOUDS-1368: Fix off-by-one in slicing algorithm 2018-02-08 22:38:53 -08:00
Andrew Gaul 382c9201e3 JCLOUDS-1368: Correct use of slicing algorithm 
MultipartUploadSlicingAlgorithm creates multiple equal-sized parts and
a remaining amount.  BaseBlobStore.putMultipartBlob used this
interface incorrectly, which could create more parts than intended
since the remaining size could be larger than the part size.  This
manifested with Google Cloud Storage which only allows 32 parts.
 2018-01-09 12:58:18 -08:00
Ignasi Barrera 4327e658ba Next development version 2.0.4-SNAPSHOT 2017-11-25 22:33:58 +01:00
Ignasi Barrera 0f889d8159 Apache jclouds 2.0.3-rc1 release 2017-11-25 22:28:20 +01:00
Andrew Gaul 6d1b385bb0 Include trailing slash in prefix test 2017-11-24 21:42:49 -08:00
Andrew Gaul 9a302453e0 JCLOUDS-1358: Fix zero byte InputStream test input 
Do not use ByteSource.empty() since it is backed by a
ByteArrayInputStream which supports reset.
 2017-11-24 20:15:25 -08:00
Andrew Gaul c61e8bc28b Implement partial prefix support for Atmos 
Atmos only supports listing by directories while other blobstores
allow listing via arbitrary prefixes.  Allow requests which list
directories via both prefix and delimiter = "/" to succeed instead of
failing all requests.  Also change a test which specified recursive to
instead be delimiter = "/".  Fixes gaul/s3proxy#244.
 2017-11-24 19:25:35 -08:00
Chaithanya Ganta 5e9743a226 JCLOUDS-1327: Add tests for zero-length blobs 2017-08-06 13:51:51 -07:00
Timur Alperovich 8ab58f075f Handle empty delimiter/prefix in FS store. 
When delimiter/prefix is an empty string, jclouds filesystem blobstore
should treat them as not being set.
 2017-08-03 14:38:08 -07:00
Ignasi Barrera 3b5fe0b02f Next development version 2.0.3-SNAPSHOT 2017-06-29 12:24:45 +02:00
Ignasi Barrera 574c7fc3c1 Apache jclouds 2.0.2-rc1 release 2017-06-29 12:21:59 +02:00
Andrew Gaul acb84bc5e1 JCLOUDS-1299: Handle % in names during Swift list 
uriBuilder.appendPath assumes an encoded path.
 2017-05-17 10:38:10 -07:00
Andrew Gaul d89d6b5d05 Return more metadata from listMultipartUpload 
Include Content-Length and Last-Modified.
 2017-03-08 20:38:22 -08:00
Ignasi Barrera cbc750cb8b Next development version 2.0.2-SNAPSHOT 2017-02-22 10:32:50 +01:00
Ignasi Barrera bafa52be97 Apache jclouds 2.0.1-rc2 release 2017-02-22 10:28:10 +01:00
Andrew Gaul d993501309 Include part size in listMultipartUpload result 
Clients use this during completeMultipartUpload.
 2016-11-15 20:30:37 -08:00
Ignasi Barrera 970f521bcd Next development version 2.0.1-SNAPSHOT 2016-11-15 01:17:08 +01:00
Ignasi Barrera 6a3a37f4e0 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:30:45 +01:00
Andrew Gaul 69aa5d6426 JCLOUDS-1065: Deprecate fake directory support 
Superseded by prefix and delimiter support.
 2016-10-26 21:30:52 -07:00
Andrew Gaul 3c9f66b8e9 Avoid lower-case l literal suffix 
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
 2016-10-23 14:24:35 -07:00
Shri Javadekar 7826d22d30 JCLOUDS-1161: Make AWSS3BlobRequestSignerV4 the default signer. 
Added new live tests and fixed some unit tests accordingly.
 2016-10-18 20:06:34 -07:00
Andrew Gaul 50e6d44433 JCLOUDS-945: fix local blobstore marker handling 
Previously using prefix markers would not correctly find the next key.
Add test for this behavior.
 2016-10-12 22:22:28 -07:00
Andrew Gaul 3b42bafe25 Add streaming methods to ForwardingBlobStore 
Follow on to 05c05e3de2.
 2016-09-04 22:16:40 -07:00
Zack Shoylev 05c05e3de2 Allows users to download large files efficiently and directly to disk. 2016-09-02 14:05:26 -05:00
Zack Shoylev 42079e1392 Parallel upload for BaseBlobStore 2016-07-15 04:15:17 -05:00
Andrew Gaul 4874a1eb18 JCLOUDS-1137: Handle TOCTOU during blobMetadata 
A similar issue exists when getting a blob payload when a caller
simultaneously removes the blob.
 2016-07-11 22:02:15 -07:00
Zack Shoylev 6bff97b6d3 Changes the upload behavior to parallel, a TODO 2016-07-01 11:26:56 -05:00
Andrew Gaul 984b6ae8fb Handle null ETag in copyBlob and conditional get 
Mac OS X and Docker aufs do not support xattr and thus have null
ETags.  Fixes andrewgaul/s3proxy#143.
 2016-06-28 09:55:53 -07:00
Andrew Gaul 6df0472ab5 JCLOUDS-1125: local blobstore list MPUs 2016-06-23 21:45:04 -07:00
Andrew Gaul a845471b88 Create Payload per thread in testPutBlobParallel 
Fixes a regression from 45bcc3ce22.
 2016-06-23 05:26:21 -07:00
Andrew Gaul 45bcc3ce22 Use in-memory payload for testPutBlobParallel 
Also simplify parts of the test.
 2016-06-22 22:50:22 -07:00
Andrew Gaul de04c69141 Consistently name test container names 
Previously jclouds allocated the initial container pool as
$USERNAME-blobstore-1, 2, etc. and subsequent containers with
$USERNAME-blobstore-$RANDOM.  Use only the former instead.
 2016-06-22 22:50:22 -07:00
Andrew Gaul 7a1c3a7b06 Remove listed multipart parts in abort 
Previously we unconditionally removed all possible part names.
 2016-06-21 10:01:00 -07:00
Andrew Gaul 04c2394a10 Annotate @BeforeSuite with groups as @AfterSuite 
Previously this caused unexpected failures in the B2 integration
tests.
 2016-06-16 12:57:38 -07:00
Andrew Gaul 52de3b5766 JCLOUDS-1125: Upload two parts in list MPU test 
This allows B2 to call complete multipart upload.
 2016-06-13 17:00:50 -07:00
Andrew Gaul 0bd2959410 JCLOUDS-1125: portable list multipart uploads 
Only Azure, B2, and S3 support this operation.  Some MultipartUpload
fields become nullable.
 2016-06-13 16:26:43 -07:00
Andrew Gaul ed7ff648e8 Ensure MPU input size meets minimum for test 2016-06-02 11:27:21 -07:00
Andrew Gaul d983d8d0a7 Revert "Handle when total length is less than part length" 
This reverts commit bc1f12b7bd.
 2016-06-02 07:21:48 -07:00
Andrew Gaul bc1f12b7bd Handle when total length is less than part length 2016-06-01 22:01:38 -07:00
Andrew Gaul 63bfc2f6e8 Use prefix option in prefix test 
Directory is deprecated.
 2016-06-01 17:44:43 -07:00
Andrew Gaul 421764dfd1 Remove disposition checks from testFileGetParallel 
Some providers like B2 do not support Content-Disposition and other
tests exercise this functionality.
 2016-06-01 16:15:47 -07:00
Andrew Gaul 5a85f5b5f9 Use provided minimum part size in MPU tests 2016-06-01 16:15:15 -07:00
Andrew Gaul 1ac73d3093 Ensure MPU has a minimum size 2016-06-01 16:14:58 -07:00
Andrew Gaul 209152e30a Abort multipart upload on putMultipartBlob error 
This avoids dangling incomplete MPU.
 2016-06-01 13:34:53 -07:00
Andrew Gaul bf7d864c41 Allow null ETag in MultipartPart 
Some storage backends, notably filesystem provider using either
Mac OS X or NFS, do not support extended attributes and cannot store
the ETag.  References andrewgaul/s3proxy#135.
 2016-06-01 12:47:02 -07:00
Andrew Gaul fb186d82de Consistently compare quoted ETags in CopyBlob 2016-05-28 12:17:28 -07:00
Andrew Gaul 00a36c3e45 JCLOUDS-654: Add size to BlobMetadata constructor 
Follow on to fae097e144.
 2016-05-27 17:27:06 -07:00
Andrew Gaul cd50ad905d Avoid NPE in BaseBlobStore.copyBlob 
Resolves copyBlob failures in Atmos.
 2016-05-12 12:48:07 -07:00
Andrew Gaul 62410d31ae Handle missing containers in LocalBlobStore.list 
Also fix FilesystemStorageStrategyImpl.getContainerMetadata to return
null on missing container as jdbc and transient already do.
 2016-05-06 21:36:28 -07:00
Andrew Gaul a4c40e15cd Handle unimplemented signed URL tests in providers 
This commit makes it evident in source code which providers do not
support this feature.
 2016-05-06 10:31:37 -07:00