Commit Graph

8174 Commits

Author SHA1 Message Date
Andrew Gaul 4ca531aa98 Allocate new container name using prefix
Before we used the previous container name, which kept appending and
hit S3 limits during integration tests like:

Caused by: java.lang.IllegalArgumentException: Object 'gaul-blobstore27-4348532805015069992-1155797412711190448-1465016400636204031' doesn't match S3 bucket virtual host naming convention. Reason: Can't be null or empty. Length must be 3 to 63 symbols.. For more info, please refer to http://docs.amazonwebservices.com/AmazonS3/latest/index.html?BucketRestrictions.html
2013-08-27 23:02:55 -07:00
Andrew Gaul 15d9abead0 Skip testDirectory on S3
This test cannot succeed due to the way directories are implemented as
prefix pseudo-files in S3.
2013-08-27 23:01:04 -07:00
Diwaker Gupta 12f29fd8a9 JCLOUDS-217: Only decode strings that are actually encoded.
* Update HttpRequestTests to account for change in urlDecode.
* Related to JCLOUDS-200
2013-08-27 22:03:48 -04:00
Andrew Bayer e6765cc5db JCLOUDS-150. De-async SQS. 2013-08-27 12:16:30 -07:00
Andrew Bayer 91d6736c22 JCLOUDS-150. De-async CloudWatch. 2013-08-27 12:16:30 -07:00
Zack Shoylev 100afba1d8 Skips tests for time signed URLs 2013-08-26 20:35:16 -05:00
Andrew Gaul d387a25113 Enforce a non-negative content length 2013-08-26 20:20:49 -04:00
Andrew Gaul 1a003ee731 Handle large putBlob with filesystem blobstore
Previously large putBlob caused an OutOfMemoryError even with
repeatable Payloads.  Fixes JCLOUDS-248.
2013-08-26 20:17:46 -04:00
Francis Devereux d60d2681d1 JCLOUDS-251: Swift: Delete chunks when deleting a multipart blob
Also:
- Make SwiftBlobIntegrationLiveTest.testMultipartChunkedFileStream more realistic by uploading a file large enough to be split into parts.
- JavaDoc fixes for SwiftBlobStore: don't reference nonexistent methods.
2013-08-25 10:20:22 -05:00
Francis Devereux d05e77b8b6 Fix JCLOUDS-250 for the common case where blob names do not contain / 2013-08-25 10:17:14 -05:00
Francis Devereux c11614400f Handle quoted ETags for OpenStack objects to fix JCLOUDS-247
This avoids a 'java.io.IOException: Unrecognized character: "' when a quoted ETag is encountered (which happens when getting a multipart blob from Rackspace Cloud).
2013-08-24 21:03:47 -05:00
Diwaker Gupta 622aec5566 Modify Strings2.urlDecode to input a string.
This is consistent with urlEncode.  Also consistently use urlDecoder in
DecodingMultimap for values.
2013-08-22 20:43:32 -04:00
Andrew Bayer eabdfe2d92 JCLOUDS-242. Fixing AWSEC2SecurityGroupExtension based on JCLOUDS-242 fix. 2013-08-18 13:53:15 -04:00
Andrew Bayer f7dd08a2a5 JCLOUDS-242. Fix security group creation on aws-ec2
Contributed by Richard Downer.
2013-08-14 11:07:59 -07:00
einsdo 97c3a203f4 JCLOUDS-241. Added type, page, and pagesize to ListUsageRecordsOptions
and corresponding test cases. These are optional parameters for
listUsageRecords
http://cloudstack.apache.org/docs/api/apidocs-4.1/root_admin/listUsageRecords.html

Removed null check on usage id because this can be null.
2013-08-12 14:28:49 -07:00
Andrew Bayer e0ea017a56 JCLOUDS-235. Add support for datadisks to CloudStackTemplateOptions
Also adds support for the new options to
CloudStackComputeServiceAdapter, unsurprisingly. Also got rid of the
in fact wrong mutual exclusivity of dataDiskSize and diskOfferingId in
DeployVirtualMachineOptions - that's a misleading bit from the
CloudStack API docs.
2013-08-08 13:50:34 -07:00
Everett Toews bf2138089d Support IAD region for Rackspace providers. 2013-08-06 20:54:23 -05:00
Ignasi Barrera d8fe0c9c21 Added method to generate the AuthorizationException with only a message 2013-08-07 00:09:04 +02:00
Andrew Gaul bc0abbaa07 Disable timed temporary signed URLs for AWS-S3
This functionality uncovered subtleties in URL parameter encoding
which result in random failures integration tests.  References
JCLOUDS-200.
2013-08-06 14:17:00 -07:00
Andrew Gaul 435103eb35 Add live test for JCLOUDS-233 2013-08-06 11:53:48 -07:00
Tom Manville 19f79145fc Handle multiple of MAX_BLOCK_SIZE for Azure MPU
Currently files are not properly uploaded if they are a multiple of
MAX_BLOCK_SIZE.  Fixes JCLOUDS-233.
2013-08-06 11:46:53 -07:00
Diwaker Gupta 96c326d0cd Enable time-bound signed URL tests for HPCS.
HP does, in fact, support configurable temporary signed URLs:
http://docs.hpcloud.com/api/object-storage#temp_url

References JCLOUDS-231
2013-08-05 21:36:42 -07:00
Andrew Gaul b2bf75f8ef Revert "A 401 error should result in re-authenticating for a new token"
This reverts commit 833f046a5c.

References JCLOUDS-231
2013-08-05 21:36:42 -07:00
Andrew Phillips f3df06aff0 Removing pre-ASF release profile configuration 2013-08-05 17:30:45 -04:00
Andrew Bayer 29a5360d71 Fixing API casting for cloudsigma-zrh live test. 2013-08-02 09:55:51 -07:00
Andrew Bayer a14c03ba0b Remove async from glesys 2013-08-02 07:57:42 -07:00
Andrew Bayer d4bf51128e Remove async from gogrid 2013-08-02 07:57:42 -07:00
Andrew Bayer a2af31c419 Removed async from elasticstack 2013-08-02 07:57:41 -07:00
Andrew Bayer 1a6071ab92 Removed async from cloudsigma 2013-08-02 07:57:41 -07:00
Zack Shoylev a9cb3cf068 When creating a server, allow attaching server to custom network
https://issues.apache.org/jira/browse/JCLOUDS-202
2013-08-01 21:46:24 -05:00
Andrew Bayer dae2c67d79 Remove async from softlayer 2013-08-01 18:13:48 -07:00
Andrew Bayer 82fe701c77 JCLOUDS-221. Add availabilityZone to spot price history. 2013-08-01 17:56:16 -07:00
Andrew Bayer 2fcd90c394 JCLOUDS-220. Adding projectId to a bunch of CloudStack API options 2013-08-01 17:17:24 -07:00
Andrew Phillips 375cb2075d JCLOUDS-155: Making header handling in OpenStack case-insensitive
Submitted by Rodney Beede
2013-08-01 19:09:48 -04:00
Everett Toews bf723a8649 Support Disk Configuration Extension in NovaTemplateOptions 2013-08-01 16:40:00 -05:00
Andrew Gaul f1673194ad Update URL for commons-logging-1.1.1-bin.tar.gz
This allows testCopyUrl to succeed against blobstore integration
tests.
2013-08-01 10:35:26 -07:00
Everett Toews e6b6e4edb2 Support Disk Configuration Extension 2013-07-31 23:10:35 -05:00
Diwaker Gupta 675c649cb6 URL encode string to sign.
As recommended at
http://s3.amazonaws.com/doc/s3-developer-guide/RESTAuthentication.html:

"You can also send a signature as a URL-encoded query-string parameter
in the URL for the request."

Also deals with some of the craziness of URL encoding/decoding in
jclouds.

References JCLOUDS-200
2013-07-31 16:32:53 -07:00
Andrew Bayer 70af0ea5ab Fixing bad package for StubSecurityGroupExtensionIntegrationTest 2013-07-31 16:16:37 -07:00
Andrew Phillips f6b5b67b5b JCLOUDS-200: Consolidate all feature-specific in the AWS provider
Follow-up to c64c7423
2013-07-26 15:03:12 -04:00
Diwaker Gupta 2409ac1a37 Preserve blob metadata for AWS-S3 MPU
Specifically preserve content-type and content-disposition for
multi-part uploads.

Fixes JCLOUDS-204
2013-07-25 10:31:47 -07:00
Ignasi Barrera 4621176516 Generalized the Arg0ToPagedIterable to propagate all args
Generalized the Arg0ToPagedIterable to allow to propagating
all arguments. This will help building PagedIterables for
api methods that require more than one argument to be invoked.
2013-07-25 10:31:09 +02:00
Diwaker Gupta c64c7423cd AWS-S3 configurable temporary signed URL support
Introduces AWSS3BlobRequestSigner, which reuses the
RequestAuthorizeSignature filter for most of the heavy lifting.
Other implementation details based on [1].

Tested with AWSS3BlobSignerLiveTest, in particular,
testSign(Get|Put)UrlWithTime.

Closes JCLOUDS-200

[1] http://s3.amazonaws.com/doc/s3-developer-guide/RESTAuthentication.html
2013-07-24 15:22:45 -07:00
Andrew Bayer 48b499c636 JCLOUDS-199. CloudStack live tests against ACS 4.2 simulator cleanup.
- ACS 4.x doesn't like taking SSH pub keys from the filesystem, so
generate them on the fly.
- vm.getDisplayName() can be null now.
- Add new possible resource limit types.
- Default to looking template=osFamily=CENTOS, since that's the only
template guaranteed to be there in the simulator.
- Use adminJobComplete instead of jobComplete in admin tests
- Accept capacity/usage/etc of 0.
- Premium configuration category not present in ACS.
- Sleep a bit between deleting a domain and verifying it's not there
any more. Also expect an IllegalStateException.
- Given that there are issues deleting zones at the moment (through
the UI, too), use a different zone for pod and zone tests.

Still failing tests:
- pretty much everything that creates a VM and expects to log into it,
but that's simulator-specific.
- Zone deletion, due to a bug in ACS, apparently.
- Registering and creating templates
- creating volumes from snapshots, and attaching volumes
2013-07-22 12:34:59 -07:00
Andrew Bayer 2c6d8b2479 JCLOUDS-195. Add egress firewall rules for CloudStack 2013-07-21 13:38:57 -07:00
Andrew Bayer 5ec05fed70 Allow skipping duplicate-finder-plugin by setting skipDuplicateFinder property to true 2013-07-17 12:42:40 -07:00
Andrew Phillips c6facc13d6 Follow-up to Azureblob cleanup
See discussion at https://github.com/jclouds/jclouds/pull/66
2013-07-17 10:32:05 -07:00
Andrew Gaul e14e23be52 Revert "Add Atmos-specific MD5 checksum header"
This reverts commit 98230e60a4.

This succeeded in my tests but integration tests fail.
2013-07-17 10:29:42 -07:00
John Kew 865b910637 Cleanup of Azureblob code; as per pull request review. Additional items
not covered here are assigned specific bug ids.
2013-07-16 18:08:49 -07:00
Andrew Gaul fcdc3d6138 Expect exception from FilePayload.getInput
Previously the constructor threw this.  Fixes regression from ac58a70.
2013-07-16 08:26:50 -07:00