Commit Graph

1771 Commits

Author SHA1 Message Date
Andrew Bayer 6451098f72 JCLOUDS-602 - Add support for volumeType, iops and encrypted to EBS.
Adds CreateVolumeOptions for volume creation, adds support for the
above EBS configs in Image, Volume, BlockDeviceMapping, etc.
2014-06-20 12:27:17 -07:00
Jeremy Daggett da50cd6cbe JCLOUDS-455: Add get() method to KeyPairApi 2014-06-20 11:11:30 -07:00
Ignasi Barrera b0250cfb4f JCLOUDS-588: Register discovered images in the image cache
Images were cached in memory using a memoized supplier. To allow growing
this cache with the discovered images, the ImageCacheSupplier class has
been created. It provides an in-memory cache with all discovered images
and acts as a view over the image cache that also provides access to
them.

The in-memory cache for the discovered images expires with the session,
just as the image cache does.

The default memoized image supplier has been changed to the
ImageCacheSupplier, to make sure all providers get injected the right
instance, and the old supplier has been qualified with the 'imageCache'
name, in case a provider needs the basic image cache.
2014-06-20 12:35:18 +02:00
Jeremy Daggett 1982626cd6 Fix replaceAll regex to handle spaces correctly 2014-06-18 10:21:01 -07:00
Jeremy Daggett 235092e517 JCLOUDS-471: Adds pool field to FloatingIP and updated related tests. 2014-06-17 11:43:10 -07:00
Chris Custine 8c8fe83f3e JCLOUDS-582: Enhancements to availability zones api 2014-06-17 11:31:06 -07:00
Andrew Gaul e799a7409c JCLOUDS-597: HashCode methods for Content-MD5
This works more naturally with Guava Hashing methods and immutability
provides better safety guarantees.  Also deprecate existing byte[]
methods.
2014-06-12 15:29:17 -07:00
Jeremy Daggett a6c89d9150 Pretty formatted json test resources 2014-06-11 15:37:02 -04:00
Andrew Phillips 9b50754c24 Cleaning up Checkstyle violations from b1c1636 and 39f77ad 2014-06-09 23:17:37 -04:00
Andrew Phillips b1c163636d Adding a test to check for JCLOUDS-278
Contributed by Bill Branan.
2014-06-09 15:15:17 -04:00
Andrew Gaul 9cdd53b0b7 JCLOUDS-546: Remove Javadoc @author annotations
Annotations removed with:

find -name \*.java | xargs sed -i /@author/d

Empty Javadoc removed with multiple iterations of:

find -name \*.java | xargs sed -i -z 's/ \*\n \*\// \*\//'
find -name \*.java | xargs sed -i -z 's/ \* \n \*\// \*\//'
find -name \*.java | xargs sed -i -z 's/\/\*\*\n \*\/\n//'
2014-06-07 21:44:54 -07:00
Ignasi Barrera 39f77ad3f8 JCLOUDS-570: Fallback to the GetImageStrategy
If the TemplateBuilderImpl is given an imageId but the image can not be
found in the image cache, fallback to the GetImageStrategy to perform a
call to the provider to try to get it.

We've seen that in some cases images are not returned in the image list
but they actually exist in the provider. This fix won't make them
available when filtering by other properties such as the operating system,
etc, but at least will make them available if their id is known.
2014-06-06 12:40:27 +02:00
Ignasi Barrera a7e342422c JCLOUDS-517: New ElasticHosts images and regions
Added the new ElasticHosts regions.

Updated the ElasticStack api to get the list of standard
drives using an API call. All providers except ServerLove
support the new API call, so the old logic in the ElasticStack
api has been moved to that provider. The rest of providers will now
extract all the OperatingSystem information by parsing the name of the
StandardDrive.

A unit test has been added to the ElasticStack api with all the images
that were hardcoded, to make sure all names are still parsed as expected
and all information in the existing providers is kept.

Modified the default template for all ElasticHosts providers to
match newer Ubuntu images and updated the Template*Live tests
accordingly.

Also refactored the WellKnownImage map to a supplier to lazy load it
when needed and avoid unexpected errors when building the Guice injector
if there are authentication errors or similar.
2014-06-02 16:57:44 +02:00
Andrew Gaul 186f052022 Remove BlobBuilder and Payloads.calculateMD5
Callers should instead explicitly set contentMD5, usually with the
results from Guava Hashing.md5(). This narrows the API and removes a
strange IOException from callers.  Further it removes a dangerous
rebuffering of arbitrarily-large non-repeatable Payloads.
2014-05-28 12:54:18 -07:00
Andrew Gaul 0d2c7ed6ff Use HashingInputStream to avoid buffering Payload 2014-05-27 15:53:06 -07:00
Andrew Phillips 5239e0fea1 Updating EC2 test mocks to match changes in 79c289d 2014-05-18 14:18:35 -04:00
Andrew Gaul 79c289da9d Replace deprecated calls to LoadingCache.apply 2014-05-17 17:39:42 -07:00
Andrew Gaul baddf8fe80 Replace InputSupplierMap with Map<K, ByteSource>
A future version of Guava will remove InputSupplier.
2014-05-16 18:10:52 -07:00
Andrew Gaul 70cf3e1f7c Make constants final classes instead of interfaces
This commit prohibits implementation of the empty interface and
instantiation of the class.  Refer to _Effective Java_ item 19 for
more background.
2014-05-16 09:45:52 -07:00
Jeremy Daggett 94459ba6e3 Update openstack-keystone RetryOnRenew to handle 408 errors with a BackoffLimitedRetryHandler 2014-05-15 08:43:34 -07:00
Andrew Gaul 8d51ad6f87 Prefer Guava HttpHeaders over JAX-RS
jclouds code contains more instances of the former and Guava has
additional constants like CONTENT_MD5.
2014-05-15 01:55:51 -07:00
Zack Shoylev 44aea81972 Fixes an issue where the number of retries was always set to 1. 2014-05-14 19:11:52 -05:00
Jeremy Daggett a53438159a Fix Accept header and removed Content-Type from common headers 2014-05-14 11:58:37 -07:00
Andrew Gaul 84440e5dc1 Update pre-ASF copyright notices 2014-05-12 13:30:28 -07:00
Andrew Bayer d15144cf45 JCLOUDS-564. Add ephemeral disks for m3.xlarge and m3.2xlarge sizes 2014-05-12 09:20:01 -07:00
Andrew Gaul 67c2b5f6b9 Enable whitespace around Checkstyle rule 2014-05-08 18:31:47 -07:00
Andrew Gaul 2d88f5164e Enforce that all commas have trailing whitespace 2014-05-08 18:28:08 -07:00
Andrew Gaul 24a7c4d195 Address Checkstyle violations 2014-05-07 16:30:19 -07:00
Andrew Gaul a45124c51a JCLOUDS-505: Remove unused ObjectMD5
The only users of this seem to be
org.jclouds.atmos.blobstore.strategy.FindMD5InUserMetadata and
org.jclouds.azureblob.blobstore.strategy.FindMD5InBlobProperties which
are themselves unused.
2014-05-07 10:16:18 +02:00
Jeremy Daggett b112e8069e Updated service types for OpenStack/Rackspace services 2014-05-01 13:54:53 -07:00
Everett Toews f1a0370bd0 ServerPredicates to make waiting easier. 2014-04-29 14:58:27 -05:00
jasdeep-hundal b2be149946 JCLOUDS-526: Removing Nova QuotaClassApi
The quota-classes API in Nova has been removed (and apparently never worked)
2014-04-19 09:00:50 -04:00
Andrew Gaul 5fabd87685 Mark Swift blobstores as eventually consistent
This allows tests to retry correctly.  Most blobstores, including
Swift[1], offer eventual consistency, although Azure[2] and the
jclouds test blobstores offer strong consistency.

[1] https://lists.launchpad.net/openstack/msg06788.html
[2] http://blogs.msdn.com/b/windowsazure/archive/2011/11/21/windows-azure-storage-a-highly-available-cloud-storage-service-with-strong-consistency.aspx
2014-04-14 19:50:45 -07:00
Andrew Gaul d0bd30cc15 Address several Guava InputSupplier deprecations
Many remain due to Payload implementing InputSupplier<InputStream>.  Guava 18
will remove InputSupplier.
2014-04-12 12:02:26 -07:00
Andrew Gaul 7af18d4843 JCLOUDS-534: Address Guava 17 compatibility issues
Corrected with:

find -name \*.java | xargs sed -i 's/new Stopwatch();/Stopwatch.createUnstarted();/'
find -name \*.java | xargs sed -i 's/new Stopwatch().start();/Stopwatch.createStarted();/'
2014-04-11 14:24:12 -07:00
Everett Toews 84e0b91179 JCLOUDS-317: Fix NPE when ComputeService.listNodes()
Follow-up to 222779b
2014-04-09 14:22:08 -04:00
Andrew Phillips 244e194c72 Correcting 4-space indent in openstack/nova/v2_0/domain/Server.java
Follow-up to 222779b
2014-04-05 16:22:14 -04:00
Jacob Mourelos 222779bbc4 JCLOUDS-317: Add missing states to Nova v2 Server
- Deprecated state: STOPPED
- Add states:   MIGRATING, SHUTOFF, RESCUE, SOFT_DELETED,
                SHELVED, SHELVED_OFFLOADED
2014-04-03 18:06:27 -05:00
Jeremy Daggett e195a5a2bb Add deprecation warnings and provide links to new APIs 2014-04-03 17:51:39 -05:00
jasdeep-hundal b92892094b JCLOUDS-515: Don't require availability zone when creating volumes in cinder 2014-03-31 14:11:43 -05:00
Hugo Trippaers 0401959157 JCLOUDS-347: Implement a poor-mans rollback if CloudStack static NAT creation fails 2014-03-27 13:01:40 +01:00
Joel Friedly b93cfa42e1 Remove Nova instance metadata limit
Rackspace cloud limits instance metadata to 5 key-value pairs, but
upstream Nova only sets the limit at 128 by default.  This patch removes
the limit entirely; the official python clients don't check it and the
server is responsible for enforcing it anyway.

Fixes:  https://issues.apache.org/jira/browse/JCLOUDS-507
2014-03-21 19:03:07 -05:00
Zack Shoylev 7588d2fba4 Fixes potentially deleting a null server id. 2014-03-21 15:13:44 -05:00
Jasdeep Hundal 22a8b9d04c Fix Keystone response for testing to not include Glance version 2014-03-19 23:28:51 +01:00
Andrew Gaul a7fa3b9c62 Retry on S3 HTTP 504 Gateway Timeout status codes
RiakCS using the S3 interface occasionally surfaces these status
codes.
2014-03-14 12:15:55 -07:00
Jeremy Daggett 33f244dbab JCLOUDS-489 - Adds support to Cloud Files for the iOS Streaming URI 2014-03-14 13:31:52 -05:00
Pedro Navarro Pérez b68f1b6e1a JCLOUDS-453. Add OpenStack Keystone v2.0 OS-KSADM Admin Extension support for Keystone. 2014-03-14 09:54:38 +01:00
Andrew Gaul e7fccd6528 Address Checkstyle violations 2014-03-13 14:06:38 -07:00
Roman C. Coedo 8dafeacfed Fixing a couple of typos 2014-03-12 14:41:23 -07:00
Zack Shoylev d99ad1b94a JCLOUDS-486 This will allow booting up nova servers with fixed IPs and ports. 2014-03-11 14:58:22 -05:00
Andrew Gaul 04e6620fb9 Address Checkstyle violation 2014-03-04 11:59:30 -08:00
Zack Shoylev eef83ed3cc Better documentation and a bugfix for cloud-init 2014-03-03 17:14:27 -06:00
Andrew Gaul d7e0b3b10c Remove WriteTo
Guava helpers capture this functionality in a more idiomatic way.
2014-02-21 17:13:31 -08:00
Andrew Gaul 9965fbcadb Address error-prone warning 2014-02-21 16:59:30 -08:00
Andrew Gaul 266d7f847b Prefer ByteSource over deprecated InputSupplier 2014-02-18 22:35:10 -08:00
Andrew Gaul 076e31b076 Address Checkstyle violations 2014-02-18 22:33:56 -08:00
Andrew Bayer a656c7292f JCLOUDS-467. Properly iterate over node names for EC2 instance creation. 2014-02-14 14:54:09 -08:00
Andrew Gaul 8c495ddee4 JCLOUDS-137: Retry on HTTP 500 AtmosError 1040 2014-02-11 12:12:54 -08:00
Andrew Gaul 53134dfa4e Improve use of Splitter in Atmos code 2014-02-10 09:39:44 -08:00
Andrew Bayer e1c8c88cf5 JCLOUDS-450. Adding support for EC2 MaxCount option.
Note - no live test for this, because it's very hard to guarantee a
situation where it would be relevant.
2014-02-07 15:03:43 -08:00
Ioannis Canellos 52f25fd284 [JCLOUDS-439] Fix osgi metadata on jclouds-sts. 2014-01-29 15:46:34 +02:00
Andrew Gaul 0098751f42 JCLOUDS-438: Map S3 code BucketAlreadyExists
Mapping to ResourceAlreadyExistsException allows external callers to
handle this situation specifically.
2014-01-28 21:21:46 -08:00
Ignasi Barrera 0625c087fa JCLOUDS-431: Added m3.medium and m3.large instance types to EC2 2014-01-24 16:32:08 +01:00
Zack Shoylev d76a9d921e The metadata needs to be ordered for this implementation. 2014-01-20 23:03:26 -06:00
Jeremy Daggett 55aadf858a JCLOUDS-423: Update Service Type for Cloud Files CDN 2014-01-20 11:53:56 -06:00
Andrew Gaul 9416416ff4 Address Checkstyle violations 2014-01-19 20:51:51 -08:00
Audrius Butkevicius 05c2986d08 JCLOUDS-426. Update Elasticstack vnc password key 2014-01-17 12:50:24 +01:00
Zack Shoylev 6ab1f6ccce Adds support for networks in the NovaComputeServiceAdapter Related to https://issues.apache.org/jira/browse/JCLOUDS-416 2014-01-14 12:53:54 -06:00
Ignasi Barrera 09a430744a Added OkHttp driver to support modern HTTP verbs 2014-01-13 10:47:39 +01:00
Andrew Bayer 35ecf794cf Cleaning up nodeNames/networks copy-paste mixup in EC2TemplateOptions as well 2014-01-08 15:44:15 -08:00
Andrew Bayer 031b75c31a Cleaning up nodeNames/networks copy-paste mixup in CloudSigmaTemplateOptions 2014-01-08 15:25:02 -08:00
Andrew Bayer e2cd6d8322 JCLOUDS-416. Add TemplateOptions#networks.
- Adds networks field/methods to TemplateOptions.
- Adds them to children as well for legacy reasons.
- Deprecates CloudStackTemplateOptions#networkIds methods in favor of #networks.
- TODO: Modify compute abstraction layer for provisioning for nova,
    EC2, et al to take advantage of this.
2014-01-07 16:15:48 -08:00
Andrew Gaul b27658eccd Propagate status in deleteAndVerifyContainerGone
Consuming the result of deleteContainerIfEmpty avoids an eventual
issue with Swift containers.  Also backfill some tests for
deleteContainerIfEmpty.  Fixes JCLOUDS-420.
2014-01-06 11:41:45 -08:00
Andrew Gaul c7b0f66544 Replace calls to Closeables.closeQuietly
Guava 16 removes this API.  Replace with Closeables2.closeQuietly.
References JCLOUDS-413 and JCLOUDS-415.
2013-12-21 12:30:59 -08:00
Andrew Gaul f9e98681b6 Address miscellaneous Guava deprecations
References JCLOUDS-415.
2013-12-20 14:05:44 -08:00
Andrew Bayer fcca1fd525 JCLOUDS-412. Add the new i2.* instance sizes 2013-12-20 10:05:33 -05:00
Andrew Bayer c1ee11d9bd Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00
Andrew Gaul 05ec994f9e Address Checkstyle violations 2013-12-16 13:09:02 -08:00
Hyeonu Jeong 6d9784c4b5 Fix CloudStack EgressFirewall request parameter name
createEgressFirewall needs networkid instead of ipaddressid:
    http://download.cloud.com/releases/3.0.6/api_3.0.6/root_admin/createEgressFirewallRule.html
2013-12-16 12:58:50 -08:00
Everett Toews 5ba527ec33 Ensure the accessIPv4 value gets into NodeMetadata. 2013-12-16 14:54:06 -06:00
Andrew Gaul 0398276be3 Remove redundant imports
Also enforce no new ones via Checkstyle
2013-12-12 18:23:43 -08:00
Zack Shoylev 6de84cb003 Moving trove to jclouds from jclouds-openstack-labs https://issues.apache.org/jira/browse/JCLOUDS-102 2013-12-12 17:13:38 -06:00
Andrew Gaul 828d8790c2 Enforce no unused imports via Checkstyle
Removed with:

mvn checkstyle:checkstyle --quiet -Dcheckstyle.output.file=/dev/stdout -Dcheckstyle.output.format=plain | tac | while read i; do echo $i | sed -n 's/\([^:]*\):\([^:]*\):.*/sed -i \2d \1/p' | bash; done
2013-12-11 17:27:43 -08:00
Andrew Gaul 3321506c84 JCLOUDS-403. Add support for Swift object expiry 2013-12-11 14:20:32 -08:00
Ignacio Mulas 7e99ddef5c [JCLOUDS-263] Usage of internalURL services' endpoints 2013-12-11 11:28:37 -06:00
Eric Evans 15a3c04fb7 JCLOUDS-356 multipart uploads with InputStream payloads
This changeset introduces an alternative to PayloadSlicer,
IterablePayloadSlicer, with a method for returning a Payload iterator.

...swift.blobstore.strategy.internal.SequentialMultipartUploadStrategy
has been updated to to use a payload iterator.
2013-12-11 16:34:19 +01:00
Zack Shoylev 83e77d2309 Adds some easy-of-use for openstack mock tests 2013-12-10 12:55:22 -06:00
Adrian Cole acde2beff1 JCLOUDS-32: Using less magic in route53 signature 2013-12-09 19:04:21 -05:00
Andrew Gaul 4cef85d1cd Address Checkstyle violations in tests 2013-12-09 14:40:07 -08:00
Andrew Bayer b351406fc9 JCLOUDS-394. Add note to ec2 README in re: live tests and new accounts 2013-12-08 18:45:16 -08:00
Andrew Gaul 1043d851a7 Correct jcloud -> jclouds typos 2013-12-01 11:36:08 -08:00
Andrew Gaul cb98a47173 Correct jcloud -> jclouds typos
Corrected with:

find -name pom.xml | xargs sed -i 's/jcloud\>/jclouds/'
2013-12-01 11:21:26 -08:00
Zack Shoylev 6e663be20a Fixes filesystem tests sometimes failing on Windows. 2013-11-26 16:12:46 -06:00
Andrew Bayer 8b94ee589b JCLOUDS-218. List templates in all known projects for CloudStack. 2013-11-26 10:00:09 -08:00
Andrew Bayer 23e43b2c8d JCLOUDS-381. Allow explicit naming of nodes via TemplateOptions. 2013-11-21 10:15:25 -08:00
Alex Heneveld 3ecbf90847 remove addl whitespace pointed out in JCLOUDS-331 2013-11-19 17:37:02 -05:00
Alex Heneveld 9a7336bb0e applies tidies for imageChooser (JCLOUDS-331) as suggested in pull #202 2013-11-18 10:31:34 -05:00
Andrew Bayer 0d3f6441c7 JCLOUDS-383. Adding c3 instance sizes. 2013-11-15 12:59:54 -08:00
Everett Toews ab4473561e Style fixes and corrections. 2013-11-15 10:46:49 -06:00
Andrew Bayer 2077da2879 JCLOUDS-361. Add support for filtering Describe* methods in EC2 2013-11-14 11:53:31 -08:00