Commit Graph

8181 Commits

Author SHA1 Message Date
Andrew Gaul 3ad6b275d4 Run some filesystem integration tests
Previously no integration tests ran, now we see:

Tests run: 43, Failures: 0, Errors: 0, Skipped: 8
2013-09-04 13:26:46 -07:00
Andrew Gaul e27ae6117c Reduce testPutFileParallel input size to ~160 KB
Previously this test uploaded ~10 MB in 30 seconds which failed on
slower connections, causing spurious test failures.  The larger input
size provides no benefit.
2013-09-02 19:33:15 -07:00
Andrew Gaul b80bb48be3 Add trailing slash to Atmos listDirectories
This is more consistent with examples in the Atmos programmer's guide
and allows this operation to succeed when used with ViPR.
2013-08-30 09:07:12 -07:00
Andrew Bayer de8ab57072 Cleanup of Client->Api getters for vcloud 2013-08-29 15:03:43 -07:00
Andrew Bayer a61ad06cbf JCLOUDS-166, JCLOUDS-167 - Removing async from vcloud and Terremark APIs/providers 2013-08-29 11:29:14 -07:00
Andrew Gaul 5261f760b7 Support Integer.MAX_VALUE size PUTs
Previously jclouds enforced Integer.MAX_VALUE - 1 size.  Tested
against Atmos Online.
2013-08-28 13:52:06 -07:00
Andrew Gaul 607b178c6b Simplify testPutFileParallel
Create only one temporary file and use explicit delete instead
finalization to remove it.
2013-08-27 23:06:18 -07:00
Andrew Gaul 4ca531aa98 Allocate new container name using prefix
Before we used the previous container name, which kept appending and
hit S3 limits during integration tests like:

Caused by: java.lang.IllegalArgumentException: Object 'gaul-blobstore27-4348532805015069992-1155797412711190448-1465016400636204031' doesn't match S3 bucket virtual host naming convention. Reason: Can't be null or empty. Length must be 3 to 63 symbols.. For more info, please refer to http://docs.amazonwebservices.com/AmazonS3/latest/index.html?BucketRestrictions.html
2013-08-27 23:02:55 -07:00
Andrew Gaul 15d9abead0 Skip testDirectory on S3
This test cannot succeed due to the way directories are implemented as
prefix pseudo-files in S3.
2013-08-27 23:01:04 -07:00
Diwaker Gupta 12f29fd8a9 JCLOUDS-217: Only decode strings that are actually encoded.
* Update HttpRequestTests to account for change in urlDecode.
* Related to JCLOUDS-200
2013-08-27 22:03:48 -04:00
Andrew Bayer e6765cc5db JCLOUDS-150. De-async SQS. 2013-08-27 12:16:30 -07:00
Andrew Bayer 91d6736c22 JCLOUDS-150. De-async CloudWatch. 2013-08-27 12:16:30 -07:00
Zack Shoylev 100afba1d8 Skips tests for time signed URLs 2013-08-26 20:35:16 -05:00
Andrew Gaul d387a25113 Enforce a non-negative content length 2013-08-26 20:20:49 -04:00
Andrew Gaul 1a003ee731 Handle large putBlob with filesystem blobstore
Previously large putBlob caused an OutOfMemoryError even with
repeatable Payloads.  Fixes JCLOUDS-248.
2013-08-26 20:17:46 -04:00
Francis Devereux d60d2681d1 JCLOUDS-251: Swift: Delete chunks when deleting a multipart blob
Also:
- Make SwiftBlobIntegrationLiveTest.testMultipartChunkedFileStream more realistic by uploading a file large enough to be split into parts.
- JavaDoc fixes for SwiftBlobStore: don't reference nonexistent methods.
2013-08-25 10:20:22 -05:00
Francis Devereux d05e77b8b6 Fix JCLOUDS-250 for the common case where blob names do not contain / 2013-08-25 10:17:14 -05:00
Francis Devereux c11614400f Handle quoted ETags for OpenStack objects to fix JCLOUDS-247
This avoids a 'java.io.IOException: Unrecognized character: "' when a quoted ETag is encountered (which happens when getting a multipart blob from Rackspace Cloud).
2013-08-24 21:03:47 -05:00
Diwaker Gupta 622aec5566 Modify Strings2.urlDecode to input a string.
This is consistent with urlEncode.  Also consistently use urlDecoder in
DecodingMultimap for values.
2013-08-22 20:43:32 -04:00
Andrew Bayer eabdfe2d92 JCLOUDS-242. Fixing AWSEC2SecurityGroupExtension based on JCLOUDS-242 fix. 2013-08-18 13:53:15 -04:00
Andrew Bayer f7dd08a2a5 JCLOUDS-242. Fix security group creation on aws-ec2
Contributed by Richard Downer.
2013-08-14 11:07:59 -07:00
einsdo 97c3a203f4 JCLOUDS-241. Added type, page, and pagesize to ListUsageRecordsOptions
and corresponding test cases. These are optional parameters for
listUsageRecords
http://cloudstack.apache.org/docs/api/apidocs-4.1/root_admin/listUsageRecords.html

Removed null check on usage id because this can be null.
2013-08-12 14:28:49 -07:00
Andrew Bayer e0ea017a56 JCLOUDS-235. Add support for datadisks to CloudStackTemplateOptions
Also adds support for the new options to
CloudStackComputeServiceAdapter, unsurprisingly. Also got rid of the
in fact wrong mutual exclusivity of dataDiskSize and diskOfferingId in
DeployVirtualMachineOptions - that's a misleading bit from the
CloudStack API docs.
2013-08-08 13:50:34 -07:00
Everett Toews bf2138089d Support IAD region for Rackspace providers. 2013-08-06 20:54:23 -05:00
Ignasi Barrera d8fe0c9c21 Added method to generate the AuthorizationException with only a message 2013-08-07 00:09:04 +02:00
Andrew Gaul bc0abbaa07 Disable timed temporary signed URLs for AWS-S3
This functionality uncovered subtleties in URL parameter encoding
which result in random failures integration tests.  References
JCLOUDS-200.
2013-08-06 14:17:00 -07:00
Andrew Gaul 435103eb35 Add live test for JCLOUDS-233 2013-08-06 11:53:48 -07:00
Tom Manville 19f79145fc Handle multiple of MAX_BLOCK_SIZE for Azure MPU
Currently files are not properly uploaded if they are a multiple of
MAX_BLOCK_SIZE.  Fixes JCLOUDS-233.
2013-08-06 11:46:53 -07:00
Diwaker Gupta 96c326d0cd Enable time-bound signed URL tests for HPCS.
HP does, in fact, support configurable temporary signed URLs:
http://docs.hpcloud.com/api/object-storage#temp_url

References JCLOUDS-231
2013-08-05 21:36:42 -07:00
Andrew Gaul b2bf75f8ef Revert "A 401 error should result in re-authenticating for a new token"
This reverts commit 833f046a5c.

References JCLOUDS-231
2013-08-05 21:36:42 -07:00
Andrew Phillips f3df06aff0 Removing pre-ASF release profile configuration 2013-08-05 17:30:45 -04:00
Andrew Bayer 29a5360d71 Fixing API casting for cloudsigma-zrh live test. 2013-08-02 09:55:51 -07:00
Andrew Bayer a14c03ba0b Remove async from glesys 2013-08-02 07:57:42 -07:00
Andrew Bayer d4bf51128e Remove async from gogrid 2013-08-02 07:57:42 -07:00
Andrew Bayer a2af31c419 Removed async from elasticstack 2013-08-02 07:57:41 -07:00
Andrew Bayer 1a6071ab92 Removed async from cloudsigma 2013-08-02 07:57:41 -07:00
Zack Shoylev a9cb3cf068 When creating a server, allow attaching server to custom network
https://issues.apache.org/jira/browse/JCLOUDS-202
2013-08-01 21:46:24 -05:00
Andrew Bayer dae2c67d79 Remove async from softlayer 2013-08-01 18:13:48 -07:00
Andrew Bayer 82fe701c77 JCLOUDS-221. Add availabilityZone to spot price history. 2013-08-01 17:56:16 -07:00
Andrew Bayer 2fcd90c394 JCLOUDS-220. Adding projectId to a bunch of CloudStack API options 2013-08-01 17:17:24 -07:00
Andrew Phillips 375cb2075d JCLOUDS-155: Making header handling in OpenStack case-insensitive
Submitted by Rodney Beede
2013-08-01 19:09:48 -04:00
Everett Toews bf723a8649 Support Disk Configuration Extension in NovaTemplateOptions 2013-08-01 16:40:00 -05:00
Andrew Gaul f1673194ad Update URL for commons-logging-1.1.1-bin.tar.gz
This allows testCopyUrl to succeed against blobstore integration
tests.
2013-08-01 10:35:26 -07:00
Everett Toews e6b6e4edb2 Support Disk Configuration Extension 2013-07-31 23:10:35 -05:00
Diwaker Gupta 675c649cb6 URL encode string to sign.
As recommended at
http://s3.amazonaws.com/doc/s3-developer-guide/RESTAuthentication.html:

"You can also send a signature as a URL-encoded query-string parameter
in the URL for the request."

Also deals with some of the craziness of URL encoding/decoding in
jclouds.

References JCLOUDS-200
2013-07-31 16:32:53 -07:00
Andrew Bayer 70af0ea5ab Fixing bad package for StubSecurityGroupExtensionIntegrationTest 2013-07-31 16:16:37 -07:00
Andrew Phillips f6b5b67b5b JCLOUDS-200: Consolidate all feature-specific in the AWS provider
Follow-up to c64c7423
2013-07-26 15:03:12 -04:00
Diwaker Gupta 2409ac1a37 Preserve blob metadata for AWS-S3 MPU
Specifically preserve content-type and content-disposition for
multi-part uploads.

Fixes JCLOUDS-204
2013-07-25 10:31:47 -07:00
Ignasi Barrera 4621176516 Generalized the Arg0ToPagedIterable to propagate all args
Generalized the Arg0ToPagedIterable to allow to propagating
all arguments. This will help building PagedIterables for
api methods that require more than one argument to be invoked.
2013-07-25 10:31:09 +02:00
Diwaker Gupta c64c7423cd AWS-S3 configurable temporary signed URL support
Introduces AWSS3BlobRequestSigner, which reuses the
RequestAuthorizeSignature filter for most of the heavy lifting.
Other implementation details based on [1].

Tested with AWSS3BlobSignerLiveTest, in particular,
testSign(Get|Put)UrlWithTime.

Closes JCLOUDS-200

[1] http://s3.amazonaws.com/doc/s3-developer-guide/RESTAuthentication.html
2013-07-24 15:22:45 -07:00