Apache
/
jclouds
mirror of https://github.com/apache/jclouds.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,452 Commits 22 Branches 130 Tags 97 MiB
Commit Graph

2687 Commits

Author SHA1 Message Date
Andrew Gaul 6446627aad Correct equals with incompatible types 
Found via error-prone.
 2016-04-24 23:28:55 -07:00
Andrew Gaul 66cda12b50 Avoid eager evaluation of Preconditions messages 
Found via error-prone.
 2016-04-24 23:28:55 -07:00
Andrew Donald Kennedy 49f7bc37af Make DockerTemplateOptions values null safe 2016-04-19 17:01:18 +02:00
Andrew Gaul 3cf4e3d79c JCLOUDS-1101: Correct generics wildcard errors 
Always incorrect but previously broken on Java 9.  Reference:

https://bugs.openjdk.java.net/browse/JDK-8075793
 2016-04-18 09:49:58 -07:00
Ignasi Barrera 819141a608 Fixed OAuth authentication flow injections 2016-04-07 10:10:10 +02:00
Andrew Donald Kennedy 047595c7bb Added volumesFrom to Docker template options 2016-04-05 10:22:56 +02:00
Jim Spring 0420741690 Add support for Azure AD authentication using Service Principal and Password 2016-04-01 14:50:09 +02:00
Oleg 74a2a2683f JCLOUDS-1102: Fix. Rackspace returns a new structure for volume types. 2016-04-01 14:48:12 +02:00
Fernando Ribeiro 80beb9b397 JCLOUDS-1098: Fix OpenStack Marconi Unit Tests 2016-03-23 16:28:34 +01:00
Fernando Ribeiro 92e6319cd7 JCLOUDS-1095: Update OpenStack KeyStone Support for Zaqar 2016-03-23 10:29:07 +01:00
Zack Shoylev 760995a46e Use non-privileged mode for compute 2016-03-21 12:49:07 -05:00
Andrew Gaul 6e7801ad58 JCLOUDS-766: Fix issues with chunked upload signer 
Previously we created a new builder instead of using the one the
method modified and did not preserve content encoding.  Addresses
AWSS3BlobIntegrationLiveTest.testPutInputStream test failures.
 2016-03-20 16:06:51 -07:00
Andrew Gaul 8053abb530 JCLOUDS-766: Check metadata and headers for MD5 
Addresses AWSS3ClientLiveTest.testMultipartSynchronously test
failures.
 2016-03-18 22:56:54 -07:00
Andrew Gaul 35c5d7ffc0 JCLOUDS-766: Include Content-MD5 in v4 signature 
Addresses AWSS3BlobIntegrationLiveTest.deleteMultipleObjects test
failures.
 2016-03-18 16:58:03 -07:00
Andrew Gaul feae011c4d JCLOUDS-766: URL encode path for v4 signatures 
Addresses AWSS3BlobIntegrationLiveTest.deleteObject test failures.
 2016-03-18 15:05:05 -07:00
IgnacioCalvo 7d2f1e8b4d JCLOUDS-1080: Force JSON format for requests 
Also make all fields optional.
 2016-03-17 20:40:51 -07:00
Josef Cacek f3ee898c13 [JCLOUDS-1089] Add image history support to Docker ImageApi 2016-03-08 23:06:21 +01:00
Josef Cacek 831cdc67c3 [JCLOUDS-1002] provide access to Docker container Config object in the Node template options 2016-03-08 23:01:52 +01:00
Zack Shoylev f8ebbfdf8a Fixes an intermittently failing swift live test. 2016-03-08 12:38:13 -06:00
Andrew Gaul c18371a793 JCLOUDS-766: Add eu-central-1 to AWS S3 regions 
Also clean up some missing and duplicated properties.
 2016-03-07 21:21:08 -08:00
Andrew Gaul dd670f3f78 JCLOUDS-1064: More helpful error for null length 2016-03-06 19:08:26 -08:00
Zack Shoylev 243afed278 Add alias fallback info to keystone and nova extensions. 2016-02-24 11:22:10 -06:00
Josef Cacek 3f1fe271ed [JCLOUDS-1084] Docker live tests fixed and made more robust 2016-02-22 17:16:40 +01:00
Josef Cacek e0ab5d848a [JCLOUDS-1079] Make Floating IPs public in the NodeMetadata in openstack-nova provider 2016-02-19 11:59:52 +01:00
Zack Shoylev 8bbcfed312 Ensures the Swift container list call requests JSON as per spec 2016-02-18 18:48:55 -06:00
Zack Shoylev 738121d934 Renames extension resolver 2016-02-16 22:50:41 -06:00
Andrew Gaul e0a7ea7fdf Only quote ETag if it does not already have quotes 2016-02-16 16:29:54 -08:00
Andrew Gaul 7eb46cce36 JCLOUDS-651: Swift support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul 6cdb1216a7 JCLOUDS-651: S3 support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul cc8af838e8 JCLOUDS-651: Atmos support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul 293d3f864e Convert CopyOptions into an AutoValue 
This commit requires an interface change since AutoValue lacks support
for Optional and uses Nullable annotations instead.
 2016-02-16 16:29:54 -08:00
Zack Shoylev c8bbb44f37 Enhance the way openstack extensions are resolved. Needed for new openstack versions. 2016-02-16 15:18:39 -06:00
rongallagher 27b3a844f8 JCLOUDS-1072: Add support for environment-specific run lists to Role 2016-02-10 12:09:19 +01:00
Andrew Gaul 2bd0550110 Add support for Swift conditional copy 2016-02-09 16:34:48 -08:00
Zack Shoylev 288235f2d5 Adds more information about the neutron extensions. Name can already be used for automatic resolution. Needed because namespace is being deprecated. Alias should also be added at some point. 2016-02-09 08:28:58 -06:00
Reijhanniel Jearl Campos 01ca3425cc JCLOUDS-691: Remove 404 fallbacks of PUT and POST calls from OpenStack APIs 2016-02-06 08:02:16 +08:00
Andrew Gaul 6371235568 Null out tmpFile to avoid remove after rename 2016-02-05 12:35:27 -08:00
Andrew Gaul 6cefc99cf0 Always delete tmpFile in filesystem putBlob 
Previously we would only do this on the exceptional path.  Also throw
IOException on failed rename for consistency.
 2016-02-05 00:52:37 -08:00
Andrew Gaul 9feeee8347 Set xattr before rename to make blob create atomic 
Previously concurrent operations could expose an object before put had
completed.  Note that the temporary file is still exposed to the
client.
 2016-02-04 23:14:54 -08:00
Andrew Gaul be96b9f270 Suppress spurious ignored return value errors 
Found with Guava 20.
 2016-02-04 14:57:46 -08:00
Reijhanniel Jearl Campos d83282ca53 JCLOUDS-691: Remove 404 fallbacks of PUT and POST calls from OpenStack APIs 2016-02-04 12:10:06 +01:00
Andrew Gaul de333e8b3c Check Content-Length in local blobstore putBlob 2016-02-03 22:03:48 -08:00
Andrew Gaul 19b3a41c90 Remove unnecessary static imports 
Found via error-prone.
 2016-01-29 09:23:54 -08:00
Andrew Gaul 6360023f09 Remove unnecessary static imports 
Found via error-prone.
 2016-01-29 09:14:55 -08:00
Andrew Gaul 86e947dded Revert "Always return ETag from filesystem object store" 
This reverts commit 496e27f1af.  This
commit imposed too much computational overhead when listing blobs.
 2016-01-28 23:04:12 -08:00
Andrew Gaul a8f5401f6c Enable filesystem service tests 2016-01-28 22:42:05 -08:00
Ignasi Barrera 773aa30c64 JCLOUDS-1067: Fix cookbook grouping mapping in Chef metadata 2016-01-28 15:12:29 +01:00
Andrew Gaul 02b2e80b27 Delete single- and multi-part objects in Swift 
Due to Swift's wonky MPU implementation we must try the multi-part
delete first followed by a single-part delete if it fails.  Previously
delete would leave orphan subobjects.  Fixes andrewgaul/s3proxy#92.
 2016-01-26 21:22:54 -08:00
Andrew Gaul 68ff250c38 Return response from StaticLargeObjectApi.delete 2016-01-25 13:26:03 -08:00
Andrew Gaul 3a65df1e2e JCLOUDS-988: Subclass StaticLargeObjectApiLiveTest in Cloudfiles providers 
This allows tests to run.
 2016-01-22 14:01:49 -08:00
Ignasi Barrera ef7b85130e JCLOUDS-1056: Configure OSGi packaging 2016-01-22 11:34:07 +01:00
Andrea Turli a4a255fa4a improve roll-back strategy when floating-ip are not available 
- improve destroyNodes to clean up securityGroups and keyPair created explicitly for that node
- refactor clean up server in one place
 2016-01-22 11:02:44 +01:00
Andrew Gaul 100d1dac6c Do not override S3 provider methods 
Fixes Guice 4.0 support.
 2016-01-21 10:12:19 -08:00
Andrew Gaul 7b3a300d51 Skip testBlobAccess on filesytem 
Follow on to 52dc1a3ccf.
 2016-01-20 23:47:06 -08:00
Andrew Gaul 52dc1a3ccf Add BaseBlobIntegrationTest.testSetBlobAccess 
Similar to BaseContainerIntegrationTest.testSetContainerAccess.
 2016-01-19 14:40:55 -08:00
Ignasi Barrera 40f31786c5 JCLOUDS-512: Implement the ImageCache 
This commit refactors the ImageCacheSupplier to act as a
proper cache. It is used by the ImageExtesion and all operations
on the images are propagated to the cache.

A method has also been added to the TemplateBuilder to let users
force a cache refresh. There have been several requests to provide a way
to disable image caching in the compute abstraction, and this new method
should fix that.
 2016-01-19 11:25:09 +01:00
Andrew Gaul 6bc2ff7e00 JCLOUDS-1042: Remove unused bucketAcls 2016-01-17 17:35:12 -08:00
Andrew Gaul 68e6539192 JCLOUDS-1042: Remove unneeded ACL swizzling 
Follow on to 750c5d5316.
 2016-01-17 17:30:06 -08:00
Andrew Gaul b63f74a6eb JCLOUDS-948: Swift Cache-Control support 
Not supported.
 2016-01-15 13:22:15 -08:00
Andrew Gaul f292408af4 JCLOUDS-948: S3 Cache-Control support 
Deprecate older S3-specific Cache-Control mechanism.
 2016-01-15 13:22:14 -08:00
Andrew Gaul 82ad05e98e JCLOUDS-948: Filesystem Cache-Control support 2016-01-15 04:43:39 -08:00
Andrew Gaul 77d3db0058 JCLOUDS-948: Atmos Cache-Control support 
Not supported.
 2016-01-15 04:41:01 -08:00
Zhao Jin 8bddbb496a JCLOUDS-480: AWS S3 v4 signature 
This includes support for chunked uploads.
 2016-01-13 15:08:18 -08:00
Andrew Gaul c20fcb8cda Do not compare MPU ETag contents 
AWS S3 MPU ETag are hashes of the part ETag headers but some
implementations, specifically S3Proxy with the filesystem provider,
represent multi-part objects as a single object.  Remove these checks
since they add nothing.
 2016-01-12 15:36:37 -08:00
Rita Zhang a12ce5a8b7 Add support for AzureBlobStore.getBlobAccess and RegionScopedSwiftBlobStore.getBlobAccess. 
They are currently throwing UnsupportedOperationException exception.
 2016-01-05 15:33:50 -08:00
Andrew Gaul 91b202f4ea JCLOUDS-844: Swift putBlob ACLs 2015-12-22 00:46:34 -08:00
Andrew Gaul 85951e2af9 JCLOUDS-844: S3 putBlob ACLs 2015-12-22 00:46:34 -08:00
Andrew Gaul cc0d0d40c5 JCLOUDS-844: Atmos putBlob ACLs 2015-12-22 00:46:33 -08:00
Andrew Gaul 86491bc607 JCLOUDS-844: Portable putBlob ACLs 2015-12-22 00:46:33 -08:00
Andrew Gaul 37f307ecd0 Skip testSetContainerAccess for local blobstores 
These lack a public HTTP endpoint needed for this test.
 2015-12-20 01:14:33 -08:00
Andrew Gaul ffa7c5c587 Update via canned ACLs instead of XML ACLs for S3 
These are simpler than the full XML API and better supported by
non-AWS S3 implementations, e.g., Ceph, S3Proxy.  Further this makes
the provider more consistent when creating a bucket or object which
only supports setting canned ACLs.
 2015-12-19 19:28:03 -08:00
Andrew Gaul c2ba0bef32 Allow updating S3 canned ACLs 
These are simpler than the full XML API and better supported by
non-AWS S3 implementations, e.g., Ceph, S3Proxy.
 2015-12-19 19:28:03 -08:00
Andrew Gaul 4c8f758e3a Loosen restrictions for S3 bucket naming 
US Standard and most S3 clones allow more bucket names than DNS
allows.
 2015-12-19 15:10:01 -08:00
Andrew Gaul 750c5d5316 JCLOUDS-1042: Remove unneeded ACL swizzling 
The previous commit shows that we do not need this.
 2015-12-18 23:28:39 -08:00
Andrew Gaul e59039a109 Update namespaceAliasBinder reference 
Regression from 415a8a6600.
 2015-12-18 21:56:25 -08:00
Zack Shoylev 7d73a0392a Adds nova extension names and an example test 2015-12-16 11:35:09 -06:00
Ignasi Barrera 962de83e86 JCLOUDS-1050: Fix BootstrapConfig deserialization in Chef 2015-12-16 16:05:09 +01:00
Zack Shoylev 415a8a6600 Allows extensions to fall back on using an optional name in keystone/openstack 2015-12-14 10:24:59 -06:00
Andrew Gaul b6e20822d8 Remove @Nullable from methods returning primitives 
Found via error-prone.
 2015-12-12 10:20:34 +08:00
Andrew Gaul b47c50b7a5 Correct malformed format strings 
Found via error-prone.
 2015-12-12 08:53:08 +08:00
Andrew Gaul 06e379d7a5 Remove @Nullable from methods returning primitives 
Found via error-prone.
 2015-12-12 08:53:07 +08:00
Graeme-Miller 75e2c6999c Instead of setting up static NAT for all networks, we setup static NAT for default network only 2015-12-11 16:39:20 +01:00
Andrew Gaul 4abd5dd16f Revert "Delete parts when removing Swift multipart objects" 
This reverts commit 3c1588527d.
 2015-12-08 10:08:22 +08:00
Josef Cacek 0fb1b459a6 JCLOUDS-1044 fix handling NULL JsonTokens in adapters under NullFilteringTypeAdapterFactories class 2015-12-05 22:45:24 +01:00
Ignasi Barrera 90423d7b9b Fix filesystem api in OSX 2015-11-24 15:38:10 +01:00
Ignasi Barrera 86dadc3a75 JCLOUDS-1038: Fix date deserialization in EC2 apis 2015-11-24 14:53:18 +01:00
Zack Shoylev 02b79106c3 Fixes tenantId when using the keystone admin extension 2015-11-23 16:03:02 -06:00
Zack Shoylev ab25fc7259 putblob fails when file exists 2015-11-23 16:01:46 -06:00
Ignasi Barrera 29a8474ba0 JCLOUDS-1041: Fix NPE when deserializing Port in Docker 1.9.1 2015-11-23 22:31:01 +01:00
Ka-Hing Cheung ca70d44143 don't remove directory if it's a blob 
the filesystem blob store was always removing a/ when a/b was
removed, even if the client explicitly created a/. this patch
fixes that
 2015-11-20 17:27:19 -08:00
Andrew Gaul f706d9c13a JCLOUDS-835: Atomically put filesystem blobs 
Write to a temporary file and rename to the desired destination to
better match object store semantics.
 2015-11-20 14:44:02 -08:00
Zack Shoylev 2efcb2c5a9 Fixes a windows locale bug with the "Everyone" principal 2015-11-19 11:50:15 -06:00
Andrew Gaul 3c1588527d Delete parts when removing Swift multipart objects 
Swift implements multi-part upload with user-visible parts and an
explicit manifest.  When deleting an MPU blob it can delete only the
manifest or both the manifest and parts.  For consistency with other
providers, we now do the latter in the portable abstraction.  Swift
ignores the multipart-manifest=delete parameter for single-part
objects.  Fixes andrewgaul/s3proxy#92.
 2015-11-17 23:06:33 -08:00
Andrew Gaul 721a0dbd3c Add support for standard_ia storage class 
This enables storage with lower at-rest prices, higher request prices,
and lower availability.  Also rework existing reduced redundancy
parsing into a more generic storage class.  More background on
standard_ia:

https://aws.amazon.com/blogs/aws/aws-storage-update-new-lower-cost-s3-storage-option-glacier-price-reduction/
 2015-11-16 14:04:51 -08:00
Andrew Gaul 22c789da9e JCLOUDS-894: Use prefix when listing MPU on Swift 
Previously we only used the blob name and not the blob
name/slo/timestamp/part size cookie which yield extra parts when
listing an MPU with parts from a previous MPU.  Listing using the
stricter prefix gives the expected results.
Fixes andrewgaul/s3proxy#91.
 2015-11-13 12:15:29 -08:00
Andrea Turli 33522b8945 add docker NetworkAPI 
- bump api version to 1.21
- use `alpine/3.2` image for liveTests
- use `kwart/alpine-ext:3.2-ssh` image as ssh-able image
- assert request bodies created correctly in NetworkApiMockTest
 2015-11-13 16:47:01 +01:00
Zack Shoylev 41ce90ec36 Fixes tests failing on windows filesystems Makes windows behavior more consistent, especially for deletes 2015-11-11 21:01:13 -06:00
Ignasi Barrera 9df30c5a09 JCLOUDS-717: Join Enterprise and OpenSource Chef 2015-10-30 01:02:53 +01:00
Ignasi Barrera 985d45122b JCLOUDS-987: Create security groups in AWS if subnetId is specified 2015-10-29 01:54:03 +01:00
Ignasi Barrera 0e7283e191 Convert logback.xml to unix format 2015-10-28 23:15:28 +01:00
Andrew Gaul 592a4e7cce JCLOUDS-786: Remove legacy swift provider 
The modern openstack-swift provider obsoletes this.
 2015-10-25 20:39:39 -07:00
Stuart Hendren ada17d3e47 [elasticstack] fix for incorrect logging message 
Was logging when it was present rather than when it had failed to find it.
 2015-10-24 21:39:40 -07:00
Josef Cacek 746038e8b2 [JCLOUDS-1021] Add JavaDoc to cover behavior of repoTags() method in org.jclouds.docker.domain.Image 2015-10-21 17:16:27 +02:00
Josef Cacek 3260fa5803 Add LiveTest to cover loginPort (SSH) customization in Docker. 2015-10-21 16:10:29 +02:00
Josef Cacek f0fc31e299 [JCLOUDS-1020] fix query parameter name in Docker's BuildOptions 2015-10-21 16:10:25 +02:00
Josef Cacek 3342e88f80 [JCLOUDS-1017] add tagImage() method to ImageApi 2015-10-21 16:10:21 +02:00
Josef Cacek 9271c11b67 [JCLOUDS-1010] use a lightweight image as a base for Docker build test 2015-10-21 16:10:18 +02:00
Ignasi Barrera 01d43f503b JCLOUDS-1014: Make the login port lookup function configurable 2015-10-19 16:14:05 +02:00
Andrew Gaul 4829bbbd2c JCLOUDS-964: S3 multipart copy 2015-10-14 23:17:40 -07:00
John McDonnell ef816119b1 AS per JCLOUDS-1012 project and projectId parameters are not supported. This commits adds the 2 parameters to the usage response. 2015-10-13 10:35:13 +02:00
John McDonnell c73b82b58b As in JCLOUDS-991 it appears size is missing as a UsageResponse parameter, particularily for Volume usages. This commit adds it into the UsageRecord class. 2015-10-07 20:42:47 +02:00
googlielmo 8ca3a326c8 Fix dnsSearch type 
- dnsSearch declared as String, corrected to List<String>
 2015-10-05 12:36:43 +02:00
Josef Cacek f6ad2cc380 [JCLOUDS-1007] Implemented Docker Exec support in MiscApi 2015-10-02 16:29:50 +02:00
Josef Cacek d7b3f5d98f [JCLOUDS-1011] force closing HTTP client connection after using Docker build REST API method 2015-10-02 15:58:42 +02:00
Josef Cacek 288d387610 Format code of DockerUntrustedSSLContextSupplier to fit jclouds code conventions and checkstyle settings 2015-09-28 11:20:30 +02:00
Josef Cacek 4e308868bd [JCLOUDS-1006] Fix DockerUntrustedSSLContextSupplier to allow tests runs against endpoints without TLS configured 2015-09-28 11:19:02 +02:00
Josef Cacek e21767dbde JCLOUDS-997 Allow nullable docker configuration - the null has another meaning than empty list/map (e.g. CMD: null=default, emptyList=no-command) 2015-09-18 10:28:37 +02:00
Timur Alperovich 2c2b498066 JCLOUDS-217: Old Swift should encode blob names. 
When constructing the URI from the blob names, the deprecated Swift
provider should encode the blob names.
 2015-09-17 13:08:44 -07:00
Timur Alperovich 7151a3875b JCLOUDS-217: Cloudstack: avoid encoded strings. 
jclouds should not use encoded strings in tests for Cloudstack.
 2015-09-17 13:08:44 -07:00
Andrew Kennedy 3901403379 Added ExtraHosts option to template 2015-09-17 14:48:30 +02:00
Josef Cacek 15651822be JCLOUDS-996 fix location of NetworkMode parameter from Docker Remote API and make it configurable from DockerTemplateOptions 2015-09-17 12:01:34 +02:00
Timur Alperovich 85357cf92a JCLOUDS-217: Filesystem: avoid trailing spaces. 
On Windows, we need to avoid trailing spaces, as the test fails to
create the required blob. Specifically, we should not test blobs named
" " and "%20 ".
 2015-09-08 15:19:03 -07:00
Timur Alperovich f7370d2b12 JCLOUDS-217: Nova: do encode form parameters. 
OpenStack Nova tests should not pre-encode parameters before passing
them to generate the HTTP requests, as they end up encoded twice.
 2015-09-08 15:19:03 -07:00
Timur Alperovich 9b15fdfde8 JCLOUDS-217: SQS: Do not encode parameters. 
SQS API tests should not encode parameters when constructing the
expected HTTP requests.
 2015-09-08 15:19:03 -07:00
Timur Alperovich d70127f126 JCLOUDS-217: EC2: Do not encode form parameters. 
EC2 tests should not pre-encode form parameters when constructing the
expected HTTP responses.
 2015-09-08 15:19:03 -07:00
Timur Alperovich b87ca1b33a JCLOUDS-217: CloudStack do not encode parameters. 
Parameters when creating an HTTP request should not be encoded in the
CloudStack tests, as they end up being doubly encoded.
 2015-09-08 15:19:03 -07:00
Timur Alperovich 6df2233867 JCLOUDS-217: Do not encode strings in STS tests. 
When constructing the expected HTTP requests in STS tests, STS API
should not pre-encode the strings. The form parameters are already
encoded and are otherwise encoded twice.
 2015-09-08 15:19:02 -07:00
Timur Alperovich a0b95ea7a3 JCLOUDS-217: Fix encoding handling in S3. 
When constructing the query path, S3 does not properly handle encoded
paths. For example, if a blob named %20 is to be placed into the blob
store, S3 would end up placing blob named " " (what %20 represents).
This occurs because the S3 provider examines the URI's path portion
(which is presented in a decoded fasion to the caller). After
examining the path, it is not encoded again. Instead, we should call
getRawPath() to avoid this issue.

There are two issues on the decoding path:
1. Given a blob named " ", S3 API will throw a RuntimeException due to
a NULL check -- the key that it uses is NULL to represent the XML
content " " corresponding to the blob name.
2. Given a blob named "%20 ", S3 API will generate a URI for a blob
named "%20%20", which is also incorrect. The correct URI would be
"%2520%20" (escaping the first "%" and " " characters).

The first issue is due to the currentOrNull() helper, which calls
trim() on the string and then compares the string to an empty string.
This means that a blob named " " will be parsed as "" and then
converted to NULL as the result of that method. Passing "null" as the
key then fails in a number of places (notably, appendPath()).

The second issue is due to the appendPath() method in the jclouds Uris
class. The issue here is that appendPath() calls urlDecode() and
passes the result to path(). The path() method, in turn, also calls
urlDecode(). After these transformations, a properly encoded blob of
the form %2520%20 turns into "%20 " and then "  " (two spaces). After
these transformations the path is encoded again, resulting in "%20%20"
(which is wrong).
 2015-09-08 15:19:02 -07:00
Irmo Manie 9be7339c32 JCLOUDS-993 - Add missing parameters to `VirtualMachineApi` 
- `serviceOfferingId` at `#changeServiceForVirtualMachine`
- `options` of type `UpdateVirtualMachineOptions` at
  `#updateVirtualMachine`
 2015-09-06 23:59:15 +02:00
Irmo Manie 89f81840d2 JCLOUDS-995 - Add `userData` property to `CloudStackTemplateOptions` and map it in the underlying adapter. 2015-09-06 23:58:21 +02:00
Oliver Gondža edde721937 JCLOUDS-962: Make all @Provider methods final 2015-09-02 23:54:44 +02:00
Nate Rosenblum 496e27f1af Always return ETag from filesystem object store 
If the Content-MD5 extended attribute is missing for an object,
recompute it and return as the ETag. Primarily affects OS X.
 2015-08-20 14:46:17 -07:00
Timur Alperovich 238cc525f9 JCLOUDS-992: Old Swift: treat directories as blobs 2015-08-20 12:42:11 -07:00
Timur Alperovich a2d8dfcb27 JCLOUDS-992: Handle directories as blobs in S3. 2015-08-20 12:42:11 -07:00
Timur Alperovich 2c417c83a6 JCLOUDS-992: Handle directories as blobs in Swift. 2015-08-20 12:42:10 -07:00
Josef Cacek 644541a2f4 JCLOUDS-990: fix condition DockerTemplateOptions.copyTo() method 2015-08-19 14:15:25 +02:00
Zack Shoylev 92ccea8c4f Adds a mock test for a much longer token format for Rackspace identity 2015-08-17 18:01:28 -05:00
Ignasi Barrera 586e31805a [JCLOUDS-898] Allow insecure connection in Docker. 
Original author was @andreaturli and the original patch was #172.
 2015-08-14 10:56:07 +02:00
Andrew Gaul e2b6950462 JCLOUDS-872: Swift copy object and append metadata 
The existing method replaces metadata.
 2015-08-11 13:26:56 -07:00
Andrew Gaul 4f32e863ad JCLOUDS-883: Replace metadata during Swift copy 
Previously Swift copy would append metadata instead of replacing it.
 2015-08-06 11:26:45 -07:00
Adrian Bravo eafdeb5266 JCLOUDS-967: Chef Client Model update with public key attribute 
JCLOUDS-967: Made PubKey nullable and added tests to verify serialization works with and without it
 2015-08-05 09:40:28 +02:00
Andrew Gaul d86a6c9ee1 Correct Checkstyle violations 2015-07-31 15:28:25 -07:00
Andrew Gaul 86f47394bf Correct FindBugs violations 2015-07-31 14:53:58 -07:00
Andrew Gaul 98b3105669 Address error-prone errors 
Mostly of the form, Collection.size() >= 0.
 2015-07-30 15:40:03 -07:00
Arvind Nadendla ba55ab4b12 Fix bug where password information is printed in logs in case of exceptions 2015-07-30 12:16:16 -05:00
Ignasi Barrera 5d30f859aa Fix AWS and EC2 TemplateBuilder live tests 2015-07-29 11:58:19 +02:00
Zack Shoylev 632e0c3f66 Fixes an error caused by not using an assert by @CheckReturnValue. Also see jsr305 2015-07-28 12:01:57 -05:00
Marcus Wanner 35b71c5728 Add awareness of Manila and SHARED_FILESYSTEM openstack projects to keystone 2015-07-27 07:22:43 -05:00
Arvind Nadendla d7c4867752 add os-hypervisors extension for openstack-nova 2015-07-27 07:05:06 -05:00
Csaba Palfi 55a7d8ce3c [docker] upgrade to docker 1.7 and refactor TLS support 2015-07-22 10:22:36 +02:00
Ka-Hing Cheung 2c578d7bcb marker should be null when there are no more items 2015-07-21 15:46:58 -07:00
Ignasi Barrera ed1149141d Added missing virtualization types after rebasing on top of 1fe90b0 2015-07-20 18:23:11 +02:00
Alex Heneveld a6aff306e7 add deprecated flag to Hardware and prefer non-deprecated hardware types 
deprecated hardware types in EC2 are flagged using this, according to latest AWS advice,
to fix situations where deprecated hardware types would be chosen when a non-deprecated alternative exists.
we also deprecate T2 because it requires a VPC.

also fixes semantics of ImagesToRegionAndIdMap to match the logic used in the TemplateBuilderImpl;
RegionAndName should contain the ID not the ProviderID.  this is only really used in tests so no external impact.
(previously the cache only worked if provider ID matched the non-location segment of the image ID.)
however this does now assert that image id's are in the right format for AWS, as suggested by @nacx.
 2015-07-20 17:40:07 +02:00
Alex Heneveld 04a4095ca6 indicate virtualization type for all ec2 instance types 2015-07-20 17:40:06 +02:00
Arvind Nadendla a38ee21207 Split availability Zone API to return Basic Info and Detailed info 2015-07-16 13:11:52 -05:00
Zack Shoylev ca3c2622ff Adds missing floating-ip-pool expect test 
Fixes broken namespace for the ip pool extension
 2015-07-15 16:25:01 +02:00
Zack Shoylev dcba6fe51a Fixes missing @Deprecated annotation 2015-07-15 16:11:12 +02:00
Ka-Hing Cheung ad38e48205 range get of manifest object has no etag 2015-07-14 17:20:14 -07:00
Arvind Nadendla 537f411ebd Adding missing "hosts" field to OpenStack Nova AvailabilityZone 2015-07-14 18:54:40 -05:00
Timur Alperovich e4161a59bb Move tests to test the file system API. 
Move the prefix and delimiter tests from BaseContainerLiveTest to
BaseContainerIntegrationTest, as that class is subclassed in
Filesystem integration tests. This will make sure the file system blob
store will not regress.

The ListContainerTest is updated to _not_ use a file separator
character, as that leads to a possible creation of directories.
Instead, "-" is used as the delimiter for the delimiter option tests.
 2015-07-14 14:11:34 -07:00
Timur Alperovich fe13b07233 JCLOUDS-929: Implement delimiter support in S3. 
Plumb the delimiter option to the S3 API.
 2015-07-13 14:34:59 -07:00
Timur Alperovich 6ec11fd6ec JCLOUDS-929: Implement delimiter support in Swift. 
The patch adds the delimiter support in the openstack-swift API. As
part of the change, the subdirectory support in results is introduced.
This occurs when a prefix and delimiter options are set and there are
subdirectories present in the listing (i.e. multiple objects under the
same prefix/delimiter). In this case, Swift will return a list of
"subdir" objects (similar to CommonPrefixes in S3), which need to be
treated differently.
 2015-07-13 14:34:59 -07:00
Timur Alperovich a29d75a5d1 JCLOUDS-929: Implement generic delimiter support. 
The patch adds delimiter option support in the generic blob store
interface. A live integration test is added to verify that jclouds
correctly lists objects separated by a delimiter.
 2015-07-13 14:34:58 -07:00
Andrew Bayer 1fe90b03c9 JCLOUDS-961 - Add d2, m4, t2 instance types for EC2 2015-07-13 16:10:58 +02:00
Zack Shoylev 65b7bdf282 Removes CopyObjectException in favor of jclouds-standard blobstore exceptions 2015-07-09 18:28:14 -05:00
Zack Shoylev 6945b04243 Fixes a small test bug on windows 2015-07-08 20:19:33 -05:00
Timur Alperovich 86af0753bf Swift: do not assume only 1 container in tests. 
Openstack Swift ContainerApiLiveTest testListWithOptions assumes that
there are no other containers and that ContainerApiLiveTest container
will _always_ be the first container.

The patch changes the behavior of the test to instead pull out the
container from the returned list.
 2015-07-07 18:05:20 -07:00
Timur Alperovich 5383148d9e Filesystem: disable directory integration test. 
There is no notion of marker blobs in the file system blob store,
which means that when listing results after issuing the
"createDirectory" request, the marker blob will not be in the result
set.
 2015-07-07 18:00:32 -07:00
Timur Alperovich 6d27fbb18a JCLOUDS-930: Handle subdir entries correctly. 
When listing blobs, Swift returns an array of "subdir" entries for
every common prefix. The openstack-swift provider needs to process
such entries and add them to the result set. The subdir array is an
array of strings, so additional metadata needs to be added to the
objects (bogus ETag, bogus LastModifiedDate, and so on).

When directory marker blobs are used, this means that potential _two_
entries are generated for every directory if:
1. the delimiter is set and matches the directory blob (e.g. dir/ and
   delimiter /)
2. there are objects under the directory name (e.g. dir/blob), which
   will result in results that include common prefixes (subdir)

In the above example, we should expect two results: "dir" and "dir/"
representing the directory marker blob and the common prefix,
respectively.

This is caught in the testDirectory integration test.

The patch changes the behavior of the Swift provider to correctly
handle the results in the subdir stanza and changes the test to expect
the directory marker to be returned in the list.
 2015-07-07 17:55:50 -07:00
Andrea Turli 82da165fdd [JCLOUDS-956] synchronizing allocateFloatingIPForNode helps 2015-07-03 13:29:54 +02:00
Andrew Gaul 41d598b03f JCLOUDS-894: Skip multipart tests on Atmos 2015-07-02 22:28:42 -07:00
Andrea Turli 289cce042a add FWaaS extension to openstack-neutron 2015-07-02 15:00:36 -05:00
Timur Alperovich 8c9344b501 JCLOUDS-930: Regression in a File System test. 
Fix a regression in the file system blob store, where a test does not
expect the trailing delimiter character.
 2015-06-29 21:41:33 -07:00
Andrew Gaul 1dcd4500ea JCLOUDS-930: disable testListDirectoryBlobsS3FS 
Regression from 8677ffcb21.
 2015-06-29 19:36:20 -07:00
Timur Alperovich 1cb0822972 JCLOUDS-930: Add prefix option to OpenStack Swift. 
Plumbs the prefix option to the openstack-swift provider. In the
process, the support for the recursive option is modified to avoid
setting the _path_ parameter, but rather use the delimiter if required
(setting the delimiter is sufficient for a non-recursive listing).
 2015-06-29 17:31:56 -07:00
Timur Alperovich c409c19ff3 JCLOUDS-930: Plumb prefix support down to S3. 
Plumbs the ListContainerOptions.prefix setting down to the S3 API.
 2015-06-29 17:31:56 -07:00
Timur Alperovich 7c7d2e2df6 JCLOUDS-930: Add the prefix option. 
Add a prefix option to the ListContainerOptions class.
 2015-06-29 17:31:55 -07:00
Andrew Kennedy 4edaf18226 Minor fixes for the Docker provider 
- Tidy up DockerTemplateOptions and add tests for new options
- Make Dns a list of strings in HostConfig
- Change template option builder to remove use of optionals
- Update tests to verify HostConfig.Dns as list
 2015-06-29 11:17:53 +02:00
Andrea Turli 61b06329d8 create java-xmlbuilder.version property for maven 
add java-xmlbuilder to dependencyManagement so downstream project don't need to specify the version
 2015-06-29 08:47:54 +02:00
Andrea Turli aa64e0d3e2 [NOVA] change some access modifiers to simplify the downstream provider impl 
modify the BasicAuthenticator in Keystone
destroy node if creation timeouts
 2015-06-26 15:05:06 +02:00
Zack Shoylev 87b885306b Remove old cloudfiles providers 2015-06-26 02:32:16 -05:00
Andrew Gaul 46493ed3b5 Avoid using internal testng methods 2015-06-25 11:43:17 -07:00
Ka-Hing Cheung 8b325d585e object stores typically sort the list of containers 2015-06-24 15:08:23 -07:00
Ka-Hing Cheung e0bafd4c10 list MPU parts with prefix listing instead of marker 
we now use segment conventions that allow us to do more
efficient listing
 2015-06-23 20:06:10 -07:00
Andrew Gaul 38fa41d056 JCLOUDS-941: Ignore metadata tests on Mac OS X 
Also make testOverwriteBlobMetadata consistent with other tests.
 2015-06-22 11:50:20 -07:00
Iván López 37a014ae00 JCLOUDS-941: Auto-detect filesystem Content-Type 
When a filesystem blob does not have content metadata and when users
set jclouds.filesystem.auto-detect-content-type to tru, probe the file
type to return to clients.  This is useful when using jclouds to serve
an existing filesystem.
 2015-06-21 22:55:57 -07:00
Ka-Hing Cheung b8b20c16f5 use segment names similar to those created by python-swiftclient 
Currently swift creates blob-1, blob-2... blob-n for multipart
upload segments, which are very common names that can easily
collide with normal objects. This changes the naming convention
to that of python-swiftclient (the `swift' command line).

python-swiftclient also uses a different segment container by
default, that's not implemented by this patch
 2015-06-19 17:34:40 -07:00
Andrew Gaul 1f7f8c8c86 Refine HTTP 416 into IllegalArgumentException 
Providers yield different messages so remove parsing from test.  Also
narrow exception handling scope.TTP 416 into IllegalArgumentException

Providers yield different messages so remove parsing from test.  Also
narrow exception handling scope.
 2015-06-16 21:47:30 -07:00
Andrew Gaul b0dfae1092 Use a configurable timeout for awaitConsistency 
This allows setting to zero for strongly-consistency implementations
of s3 and swift stores.
 2015-06-15 15:45:17 -07:00
Ka-Hing Cheung 320742c6b5 send HEAD instead of GET for blobMetadata 2015-06-11 17:33:51 -07:00
Ka-Hing Cheung 6ed95d8968 fix range get for manifest object 
swift doesn't return the etag if the client is doing a range
get of a manifest (SLO or DLO), this fixes SwiftObject so
etag is optional
 2015-06-10 13:38:55 -07:00
Zack Shoylev 25ec655d74 Adds support for the orchestration type. 2015-06-10 12:39:10 -05:00
Andrew Gaul 454a30a484 Set Atmos object size to content metadata size 2015-06-08 14:28:42 -07:00
Andrew Gaul 4f6af13329 JCLOUDS-894: Swift portable MPU improvements 2015-06-08 11:20:09 -07:00
Andrew Gaul 04c4d5c916 JCLOUDS-894: Odds and ends for other providers 2015-06-06 16:32:16 -07:00
Andrew Gaul 9a02157a7f JCLOUDS-894: Add portable multipart upload for Swift 2015-06-06 16:32:16 -07:00
Andrew Gaul ae157991ba JCLOUDS-894: Add portable multipart upload for S3 2015-06-06 16:32:16 -07:00
Andrew Gaul 00734ee755 JCLOUDS-894: Move MultipartUploadSlicingAlgorithm to core 2015-06-06 16:32:16 -07:00
Ignasi Barrera 97c160879e Propagate an AuthorizationException on OAuth client errors 2015-06-05 14:32:49 +02:00
Andrew Gaul 5095590d60 JCLOUDS-894: Do not add unnecessary ETag quotes 
Previously
AWSS3BlobIntegrationLiveTest.testMultipartUploadMultipleParts failed.
 2015-05-26 11:19:58 -07:00
Ignasi Barrera 7053a7870d JCLOUDS-897: Remove the Rocoto dependency 2015-05-21 00:26:57 +02:00
Zack Shoylev f397bebeb2 JCLOUDS-894 Multipart upload code fixes for swift 2015-05-12 19:13:15 -05:00
Zack Shoylev 83b104d9a0 Remove deprecated neutron code 2015-05-12 15:51:20 -05:00
Karel Vervaeke 2c53ef38a5 JCLOUDS-901 Moved CloudStack javadocs around 
During the rename from *Client to *Api the javadocs were shuffled
around. This commit moves them back to the correct methods.
 2015-05-07 15:18:39 +02:00
Stuart Hendren 31749cba5d JCLOUDS-207: Key Pair and Security Groups created by jclouds are not removed when the node is destroyed 
The names created do not match those searched for.

They are created in FormatSharedNamesAndAppendUniqueStringToThoseWhichRepeat.java
and have are of this form jclouds#I-0#e96.

But for example jclouds#I-0#us-east-1#* is used as the search term.
 2015-05-07 10:50:14 +02:00
Jakub Bartecek be6ce141b6 Options use boolean primitive instead of object 
The Boolean object makes passing null value possible, which would cause NPE.
 2015-05-05 10:55:39 +02:00
Jakub Bartecek 867b7f52e4 Add option to remove a volume, when removing docker container 2015-05-05 10:55:38 +02:00
Andrea Turli 26d925c2de add ConnectionSpec.CLEARTEXT for DockerEngine running w/t TLS 2015-05-04 09:08:44 +02:00
Ignasi Barrera 4863bb83a9 Remove the deprecated methods in Chef 2015-05-03 22:22:44 +02:00
Andrew Gaul deeebe46f7 JCLOUDS-894: Expose Swift multipart operations 2015-05-01 13:32:36 -07:00
Andrew Gaul 9128ae515f JCLOUDS-894: Expose S3 multipart operations 2015-05-01 13:32:35 -07:00
Andrew Gaul ca543f3cdd Add S3 list multipart parts 
TODO: pagination, etc.?
 2015-05-01 13:32:35 -07:00
Andrew Gaul df3c91ef4a JCLOUDS-894: Expose legacy Swift multipart operations 
Not yet implemented
 2015-05-01 13:32:35 -07:00
Andrew Gaul 66516106a2 JCLOUDS-894: Expose Atmos multipart operations 
Atmos does not support multipart uploads
 2015-05-01 13:32:28 -07:00
Zack Shoylev 786e5d8e25 Adds windows ACL code for file permissions, fixes build. 2015-04-28 14:35:58 -05:00
Ignasi Barrera 2b855809a4 JCLOUDS-890: Prevent NPE when generating the Chef attributes file 2015-04-23 23:21:14 +02:00
Ignasi Barrera ba93170813 Amended OAuth API pom.xml 2015-04-15 11:03:26 +02:00
Ignasi Barrera 1c8b7764f6 Promote the OAuth v2 API 2015-04-15 10:56:55 +02:00
Andrew Gaul 21a422bc71 Fix testCopyIfModifiedSince for AWS S3 2015-04-10 23:11:21 -07:00
Andrea Turli e4477e579a DockerTemplateOptions: use the correct return type 2015-04-10 15:36:43 +02:00
Zack Shoylev a6ca5a363a Update cloudfiles poms 2015-04-09 14:20:28 -05:00
Andrew Gaul 0c6052f803 JCLOUDS-651: Swift copy object content metadata 2015-04-08 22:51:49 -07:00
Andrew Gaul a43dcece16 JCLOUDS-651: S3 copy object content metadata 2015-04-08 18:07:28 -07:00
Andrew Kennedy 1685758f0d Updates for new Docker port mapping option based on review comments 
- Change to portBindings and Map intead of List
- Tidy up formatting for DockerTemplateOptions
- Remove superfluous checkNotNull calls
- Document the Map contents for portBindings option
- Remove unused import to fix Checkstyle
 2015-04-08 21:38:00 +02:00
Andrew Kennedy 0cea1efd2f Add template option to specify direct (unmapped) ports 2015-04-08 21:38:00 +02:00
Zack Shoylev a3b7f3ab80 Merge remote-tracking branch 'promote-jclouds-labs-openstack-local/promote-rackspace-cloudfiles-moved' 2015-04-07 16:24:43 -05:00
Andrew Gaul d8f48c48b4 JCLOUDS-651: Copy Swift system metadata 2015-04-06 15:35:59 -07:00
Zack Shoylev 576005a335 Adds live test. 2015-04-06 15:35:59 -07:00
Zack Shoylev a1cbec1092 Allows copying an object and modifying metadata (user and object) 2015-04-06 15:35:58 -07:00
Zack Shoylev 0128e91dc0 Enables live tests for neutron security groups. Makes tests more robust. 2015-04-03 13:53:14 -05:00
Andrew Gaul 67d731f054 JCLOUDS-651: Add Swift server-side copyBlob 
This has some limitations as discussed in JCLOUDS-872.
 2015-04-02 15:36:54 -07:00
Andrew Gaul b85068ca7f JCLOUDS-651: Add S3 server-side copyBlob 2015-04-02 15:36:53 -07:00
Zack Shoylev 44c5053e09 Neutron port ranges only compared when present. 2015-04-02 17:33:56 -05:00
Andrew Gaul 6a7a52642a Convert Windows to Unix line endings 
Converted with:

mvn checkstyle:checkstyle --quiet -Dcheckstyle.output.file=/dev/stdout -Dcheckstyle.output.format=plain | grep warn | cut -f1 -d: | uniq | xargs -n 1 dos2unix
 2015-03-31 18:25:54 -07:00
Andrew Gaul fadbbad8ac JCLOUDS-732: Filesystem portable object ACLs 2015-03-31 15:33:34 -07:00
Andrew Gaul deff8d8413 JCLOUDS-660: Filesystem portable container ACLs 2015-03-31 15:33:33 -07:00
Andrew Gaul 4f566d3b6e Address and suppress FindBugs warnings 2015-03-30 20:40:10 -07:00
Andrew Gaul df8407a1e8 Fix error-prone StringEquality 2015-03-30 19:06:48 -07:00
Andrew Gaul db5acb8588 Fix error-prone DepAnn 2015-03-30 19:06:48 -07:00
Andrew Gaul 866ac3fabb Fix error-prone PreconditionsCheckNotNullPrimitive 2015-03-30 19:06:48 -07:00
Ignasi Barrera 2a12587bf2 Next development version 2.0.0-SNAPSHOT 2015-03-24 11:07:27 +01:00
Ignasi Barrera 225c45fd4f Apache jclouds 1.9.0 release 2015-03-24 11:06:18 +01:00
Ignasi Barrera 565a102c15 Next development version 2.0.0-SNAPSHOT 2015-03-24 11:02:39 +01:00
Ignasi Barrera 70a409f8cb Next development version 2.0.0-SNAPSHOT 2015-03-24 11:02:39 +01:00
Ignasi Barrera ce3eeefd85 Apache jclouds 1.9.0 release 2015-03-24 10:59:36 +01:00
Ignasi Barrera 550c3e3a85 Apache jclouds 1.9.0 release 2015-03-24 10:59:36 +01:00
Ignasi Barrera 944f14c687 Next development version 2.0.0-SNAPSHOT 2015-03-24 10:56:30 +01:00
Ignasi Barrera 08fae12ef4 Apache jclouds 1.9.0 release 2015-03-24 10:54:19 +01:00
Ignasi Barrera f469cf8b51 Next development version 2.0.0-SNAPSHOT 2015-03-24 10:52:01 +01:00
Ignasi Barrera bb41ed4341 Apache jclouds 1.9.0 release 2015-03-24 10:35:42 +01:00