124 Commits

Author SHA1 Message Date
filecatalyst
bbb41b4590 JCLOUDS-1464: Update Google Cloud Storage regions
Added missing regions.  For reference:
https://cloud.google.com/storage/docs/bucket-locations
2018-10-30 11:18:08 -07:00
Andrew Gaul
cc65957997 Error-prone 2.3.2 fixes 2018-10-12 23:28:00 -07:00
smedavaram75
17cf6fec9e JCLOUDS-1419: Add missing REGIONAL storage class 2018-09-13 13:28:19 -07:00
Andrew Gaul
f7b4534132 JCLOUDS-1389: add GCS MPU multiregional test 2018-04-21 13:25:00 -07:00
Jim Sermersheim
def6db4864 JCLOUDS-1389: When composing, set destination.storageClass from object
This aligns that the destination's storageClass with that of the sub-object(s) being composed
2018-04-20 12:05:58 -06:00
Andrew Gaul
7db5eb5cd0 JCLOUDS-1400: Honor GCS signed URL content type
Also add GetOptions headers instead of replacing all headers.
2018-04-12 22:43:43 -07:00
Felipe L. de Souza
b04d2df661 JCLOUDS-1404: Added new Google Storage locations 2018-04-08 21:57:51 -07:00
Andrew Gaul
90fac3b683 JCLOUDS-1271: Remove BlobStore.signRemoveBlob
Most providers never supported this functionality and the portable
abstraction should not have included it.
2018-03-09 20:52:12 -08:00
Alin Dreghiciu
f6d95d0fda JCLOUDS-1390: Use FULL projection for list blobs
This avoids a per-object call during detailed listings.
2018-03-07 21:47:44 -08:00
Andrew Gaul
88c84af878 JCLOUDS-912: Use simpleUpload in GCS BlobStore MPU
This works around a regression with InputStream payloads that I cannot
track down.  Using simpleUpload instead of multipartUpload is more
optimal since the former avoids creating a multipart form request.
2018-02-10 18:42:36 -08:00
Andrew Gaul
46759f8bda Fix a few Coverity defects 2017-11-05 20:12:47 -08:00
Andrew Gaul
14c41ea133 JCLOUDS-1337: GCS putBlob portable storage tiers 2017-10-12 11:15:14 -07:00
Andrew Gaul
1937e200e3 JCLOUDS-1336: GCS object-level storage class 2017-09-01 14:26:44 -07:00
Andrew Gaul
2817b27725 Correct InsertObjectOptions.Builder return type 2017-09-01 12:37:32 -07:00
Andrew Gaul
a22ea352f6 Add md5Hash and crc32c accessors to ObjectTemplate 2017-09-01 12:37:30 -07:00
Andrew Gaul
517323fbd5 JCLOUDS-1225: Address Guava 18 MoreExecutors changes
Fixed with:

find -name \*.java | xargs sed -i 's/sameThreadExecutor/newDirectExecutorService/g'
2017-08-22 17:14:22 -07:00
Andrew Gaul
a493e2ca2f JCLOUDS-1225: Address Guava 18 Objects changes
Fixed with:

find -name \*.java | xargs sed -i 's/Objects.[Tt]oStringHelper/More&/g'
find -name \*.java | xargs sed -i 's/Objects.firstNonNull/More&/g'
find -name \*.java | xargs sed -i 's/^\(import com.google.common.base.\)\(Objects.*\)/\1More\2\n\1\2/g'
find -name \*.java | xargs java -jar google-java-format-1.3-all-deps.jar -i --fix-imports-only --skip-sorting-imports
2017-08-22 17:12:53 -07:00
Andrew Gaul
5bcf7c4757 Add missing import
Fixes regression from 3d508d2d165f319eb3b5e8e8179b0e209e61edf7.
2017-08-07 00:57:39 -07:00
Andrew Gaul
3d508d2d16 Handle HTTP 429 in google-cloud-storage
This addresses rateLimitExceeded errors encountered during integration
tests.  Also increase retry timeout.
2017-08-06 23:43:54 -07:00
Andrew Gaul
5cbefccf96 JCLOUDS-902: Enable GCS access integration tests
Enabled by request signing.
2017-08-06 16:21:44 -07:00
Andrew Gaul
9e73bbec16 JCLOUDS-1327: Do not try GCS MPU if length is zero
References JCLOUDS-912.
2017-08-06 13:51:08 -07:00
Andrew Gaul
d36812e5a6 Correct misplaced AutoValue parameters
Found via error-prone 2.0.21.
2017-07-04 11:15:21 -07:00
Geoff Macartney
5b2aca103e Fix CRLF on google-cloud-storage logback.xml 2017-05-09 16:46:41 +01:00
Andrew Gaul
b671d2c0d2 JCLOUDS-902: Google Cloud Storage signed URLs 2017-04-20 01:14:07 -07:00
Andrew Gaul
a1af4f7fec Use a random UUID for fake upload ID
This matches the Azure provider.
2017-04-13 13:00:50 -07:00
Andrew Gaul
ca75641fc0 JCLOUDS-1259: Add GCS multi-regional and coldline 2017-03-20 18:42:32 -07:00
Andrew Gaul
8e50fe69ad Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 22:15:41 -08:00
Ignasi Barrera
a600a1221d Do not leave open streams when loading test mock files 2016-10-26 15:57:28 +02:00
Andrew Gaul
89787b4c97 Avoid lower-case l literal suffix
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
2016-10-23 14:15:09 -07:00
Andrew Gaul
11c636b6b3 JCLOUDS-945: ignore marker prefix test on GCS 2016-10-04 23:03:03 -07:00
Andrew Gaul
230448a454 JCLOUDS-1028: Configure idempotent methods
Enable for GCS.
2016-06-15 16:38:53 -07:00
Andrew Gaul
5baa49d9b8 JCLOUDS-1125: GCS list multipart uploads
Not supported.
2016-06-13 17:11:39 -07:00
Andrew Gaul
ae1f6d0c3f JCLOUDS-866: Reduce GCS multipart limit to 32 2016-06-04 00:23:40 -07:00
Andrew Gaul
ed262f7bd6 Delete GCS composite object components
Previously we left dangling subobjects.  The composite object retains
a reference to the components data.
2016-06-04 00:23:22 -07:00
Andrew Gaul
c2a22bc32c JCLOUDS-912: GCS upload InputStream work around 2016-06-03 12:38:43 -07:00
Andrew Gaul
5d437312bf JCLOUDS-912: Remove GCS simpleUpload UploadBinder
This is not necessary; jclouds binds the Payload automatically;
jclouds binds the Payload automatically.
2016-06-02 22:35:54 -07:00
Andrew Gaul
2b02db4f22 Add ObjectTemplate.toString 2016-06-02 16:24:13 -07:00
Andrew Gaul
f6210d58d3 Handle unimplemented signed URL tests in providers
This commit makes it evident in source code which providers do not
support this feature.
2016-05-06 14:38:57 -07:00
Ignasi Barrera
a780cdad59 Depend on OAuth test jar for tests 2016-04-07 11:56:45 +02:00
Andrew Gaul
28f10f90b8 Use correct payload length in GCS test
This avoids MWS unexpected end of stream errors.  Regression from
b9322c583d6aa0cae91d2c5724dfa528a0168385.
2016-03-23 19:35:41 -04:00
Andrew Gaul
2499cb0ac2 GCS support for conditional copies 2016-02-12 20:44:18 -08:00
Andrew Gaul
165e9afd9f Convert CopyOptions into an AutoValue
This commit requires an interface change since AutoValue lacks support
for Optional and uses Nullable annotations instead.
2016-02-12 19:29:38 -08:00
Andrew Gaul
9c05604e99 Skip ACL tests on GCS
These tests use request signing which GCS does not currently support.
2016-01-22 21:09:54 -08:00
Andrew Gaul
57d162c646 JCLOUDS-844: GCS putBlob ACLs 2015-12-21 23:25:00 -08:00
Andrew Gaul
639e96d5e7 Remove @Nullable from methods returning primitives
Found via error-prone.
2015-12-12 08:22:27 +08:00
Timur Alperovich
2385ba901e JCLOUDS-1008: Use @Encoded with GCS.
Google cloud storage should use the @Encoded annotation with the
object names to make sure that the object is percent-encoded prior to
being submitted in the path of the request. This was previously broken
because the default path encoding ignores "/" and encodes the entire
string. The @Encoded annotation instructs jclouds annotation processor
to not encode the parameters to which it is attached and not to encode
the entire request path. Parameters that are not annotated with
@Encoded are URL encoded prior to being add to the path.
2015-10-21 10:40:04 +02:00
Timur Alperovich
06125793d2 GCS delimiter test should not be special cased.
GCS delimiter implementation now works similarly to the other
providers (fixed in a prior commit) and we do not need to special case
the test.
2015-09-29 21:29:08 -07:00
Andrew Gaul
2e1e109a0c JCLOUDS-894: Add portable multipart upload for GCS 2015-08-26 14:08:10 -07:00
Timur Alperovich
e222567821 Update comment for the failing test. 2015-08-20 17:55:55 -07:00
Timur Alperovich
25cb06c9fe Simplify list handling. 2015-08-20 17:55:55 -07:00