Commit Graph

1543 Commits

Author SHA1 Message Date
Zack Shoylev 05c05e3de2 Allows users to download large files efficiently and directly to disk. 2016-09-02 14:05:26 -05:00
Iván Lomba 557a115694 JCLOUDS-482: Fix ProfitBricksComputeServiceLiveTest custom hardware assert 2016-08-16 23:12:42 +02:00
Iván Lomba aac9b5fd5d JCLOUDS-482: Add support for ProfitBricks 2016-08-16 02:44:13 +02:00
Iván Lomba 79e95c5a4c JCLOUDS-482: Add support for arbitrary CPU and RAM
This is a combination of 16 commits:

* First approach to ArbitraryCpuRamTemplateBuilderImpl
* Several fixes: refactoring some names, format, identation problems, some missing license headers and generateId method
* Refactored parse utility
* Added GoogleComputeEngineArbitraryCpuRamTemplateBuilderImpl to support GCE custom machine URI
* extracted hardware creation to automaticHardwareForCpuAndRam method
* Fixed ide automatic asterisk imports
* correcting WIP base case PR according to comments
* added machineTypeUriToHardware to set custom hardware in nodes
* fix checkstyle violations and other PR comments
* Set the providerId to custom machineType URI and fix adding node log
* Arbitrary hardware tests added to BaseTemplateBuilderLiveTest and GoogleComputeEngineTemplateBuilderLiveTest
* Added two more tests to BaseTemplateBuilderLiveTest
* Move repeated constants to TestUtils to reuse code
* Fix full path in the Hardware id and URI
* Add custom hardware tests to BaseComputeServiceLiveTest and GCEServiceLiveTest
* Change customHardware test to use buildTemplate and fix identation
2016-08-16 02:44:04 +02:00
Ignasi Barrera 1e4d0beae2 JCLOUDS-1145: Fix DigitalOceanImageExtension and live tests 2016-08-16 00:18:05 +02:00
Andrea Turli 93028b7529 GCE: fix tags order 2016-08-02 20:12:45 +02:00
Andrea Turli deeedd55e8 add support for security groups 2016-08-02 16:46:04 +02:00
Andrea Turli a515ce2f22 Change line endings on files recursively 2016-07-14 00:02:13 +02:00
Andrew Gaul de04c69141 Consistently name test container names
Previously jclouds allocated the initial container pool as
$USERNAME-blobstore-1, 2, etc. and subsequent containers with
$USERNAME-blobstore-$RANDOM.  Use only the former instead.
2016-06-22 22:50:22 -07:00
Ignasi Barrera bde70457d0 JCLOUDS-1105: Do not create the default security group if custom groups are specified 2016-06-17 22:18:35 +02:00
Ignasi Barrera 179ed3b2f6 Properly set the permissions in the ~/.ssh folder
When writing the ~/.ssh/authorized_keys file in a script that is being
run as sudo, the file is created with the root owner, instead of the
user defined by the node credentials. File ownership should be enforced
to make sure the right owner is alwaays set.
2016-06-17 22:16:19 +02:00
Andrew Gaul 5fec2346a6 JCLOUDS-1028: Configure idempotent methods
Enable POST for Atmos, S3, and Swift.
2016-06-15 16:35:22 -07:00
Valentin Aitken f98116ec83 GCE ResetWindowsPassword
- Function which tells to GCE to reset Windows password

- InstanceApiLiveTest for windows

- Unit test for decrypting windows password

- fixed compile errors
2016-06-15 12:31:48 +02:00
Andrew Gaul 0bd2959410 JCLOUDS-1125: portable list multipart uploads
Only Azure, B2, and S3 support this operation.  Some MultipartUpload
fields become nullable.
2016-06-13 16:26:43 -07:00
Andrew Gaul 61ab28cc50 JCLOUDS-1125: Azure list other blobs
Some BlobProperties fields become nullable due to these new blob types.
2016-06-13 16:26:43 -07:00
Zack Shoylev c1ce819f61 updateTemporaryUrlKey test 2016-06-07 17:37:39 -05:00
Zack Shoylev de88a72e7a Change the template to use CentOS instead. Avoids some openjdk-6 problems. 2016-06-07 17:37:33 -05:00
Andrew Gaul a67ae3f27b Make inner classes static where possible
Found via error-prone.
2016-06-01 20:03:54 -07:00
Sergey Torgashov ccd1ef2b4d JCLOUDS-1114: Adding support for "Placement.Tenancy" and "Placement.HostId" AWS EC2 parameters 2016-05-20 00:07:47 +02:00
Andrew Gaul 41bdd9c5a9 Skip unimplemented signed URL tests in S3 provider
jclouds aws-s3 provider supports these but s3 does not.  Also expect
failure in atmos and azureblob.  Follow on to
a4c40e15cd.
2016-05-12 12:12:52 -07:00
Andrew Gaul a4c40e15cd Handle unimplemented signed URL tests in providers
This commit makes it evident in source code which providers do not
support this feature.
2016-05-06 10:31:37 -07:00
Andrew Gaul da386ad0e2 Correct FindBugs warnings 2016-04-27 20:28:37 -07:00
Andrew Gaul 66cda12b50 Avoid eager evaluation of Preconditions messages
Found via error-prone.
2016-04-24 23:28:55 -07:00
Andrew Gaul 3cf4e3d79c JCLOUDS-1101: Correct generics wildcard errors
Always incorrect but previously broken on Java 9.  Reference:

https://bugs.openjdk.java.net/browse/JDK-8075793
2016-04-18 09:49:58 -07:00
Ignasi Barrera cf07407c2d JCLOUDS-1077: Fix ProjectApiLiveTest in Google Compute Engine 2016-04-16 02:05:29 +02:00
Ignasi Barrera 819141a608 Fixed OAuth authentication flow injections 2016-04-07 10:10:10 +02:00
Andrew Gaul 0f77386c77 JCLOUDS-766: JCLOUDS-1090: Use AWS v4 signature
Previous commits added support for v4 but did not default to it.  URL
signing continues to use v2 signatures due to a conflict between PUT
requests and v4 content signing.  Addresses
AWSS3ServiceIntegrationLiveTest.testAllLocations test failures.
2016-03-27 16:27:30 -07:00
Andrew Gaul fdec2fa99f JCLOUDS-766: Do not resign already-signed requests
Previously jclouds would add both a V2 and V4 signature to some
requests which Amazon rejects.  Addresses AWSS3BlobSignerLiveTest test
failures with time-limited requests.
2016-03-27 16:24:12 -07:00
Andrew Gaul 6964ef6c8f Actually send RRS in putBlobWithReducedRedundancy
Regression from 0f6ab3944f.
2016-03-27 14:25:56 -07:00
Andrew Gaul 2501122a20 JCLOUDS-766: Add eu-central-1 to test expectations
Addresses AWSS3ServiceIntegrationLiveTest.testGetAssignableLocations
test failures.  Follow-on to c18371a793.
2016-03-17 23:48:07 -07:00
Alex Heneveld d649c90d98 fix for issue if SL machine has multiple credentials registered
now just pick the best one. it matters only when we are going to log in to a machine.
the only time the problem has been observed has been with pre-existing machines set up
outwith jclouds with multiple password.
2016-03-08 14:59:20 +01:00
Andrew Gaul c18371a793 JCLOUDS-766: Add eu-central-1 to AWS S3 regions
Also clean up some missing and duplicated properties.
2016-03-07 21:21:08 -08:00
Ignasi Barrera 72f2652dca Properly handler ProfitBricks service errors 2016-03-02 14:51:29 +01:00
Ignasi Barrera 59a88ff898 Fix ProfitBricks TemplateBuilderLiveTests 2016-02-24 22:56:40 +01:00
Reijhanniel Jearl Campos 9a8b4d074b Move html responses to a subfolder for cleaner rat plugin exclude 2016-02-23 19:30:03 +08:00
Reijhanniel Jearl Campos d5b74179a4 Update profitbricks readme to reflect previous refactoring changes 2016-02-20 01:33:26 +08:00
Reijhanniel Jearl Campos d05cecc39c Update pom details for ProfitBricks 2016-02-19 23:02:29 +08:00
Reijhanniel Jearl Campos 1af52159c9 Merge remote-tracking branch 'jclouds-labs-profitbricks-local/promote-profitbricks-moved' into promoted-profitbricks 2016-02-19 22:04:55 +08:00
Ignasi Barrera 7202e0557f Refactored locations to not rely on existing DataCenters 2016-02-18 10:48:00 +01:00
Andrew Gaul 6cdb1216a7 JCLOUDS-651: S3 support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul 467f3483bc JCLOUDS-651: Azure support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul 293d3f864e Convert CopyOptions into an AutoValue
This commit requires an interface change since AutoValue lacks support
for Optional and uses Nullable annotations instead.
2016-02-16 16:29:54 -08:00
Andrew Gaul 0cf13c61ef Do not remove during Azure abortMultipartUpload
Explicitly removing the blob removes any previously existing blob with
the same name.
2016-02-03 23:34:37 -08:00
Andrew Gaul e50bd79f01 Map PublicAccess.CONTAINER to PUBLIC_READ
This better matches the semantics of other providers and allows
clients to list a publicly readable container.
2016-01-31 18:14:25 -08:00
Andrew Gaul 6360023f09 Remove unnecessary static imports
Found via error-prone.
2016-01-29 09:14:55 -08:00
Andrew Gaul 4be8a2eb72 Add missing hashCode methods
Found via error-prone.
2016-01-29 08:37:46 -08:00
Andrew Gaul b2c0786fc0 Enable range tests for azureblob 2016-01-23 12:38:50 -08:00
Andrew Gaul 3a65df1e2e JCLOUDS-988: Subclass StaticLargeObjectApiLiveTest in Cloudfiles providers
This allows tests to run.
2016-01-22 14:01:49 -08:00
Ignasi Barrera ef7b85130e JCLOUDS-1056: Configure OSGi packaging 2016-01-22 11:34:07 +01:00
Ignasi Barrera edacad2b6e Amend poms after promoting DigitalOcean v2 2016-01-21 01:02:58 +01:00
Ignasi Barrera 886aa156b4 Promote DigitalOcean v2 2016-01-20 23:57:03 +01:00
Ignasi Barrera c188570444 Improved DigitalOcean image extension
Do not block when waiting for the images to become available.
2016-01-20 12:24:46 +01:00
Reijhanniel Jearl Campos 235b4b98d4 JCLOUDS-1047: Fix ProfitBricks compute service live tests 2016-01-19 15:29:57 +01:00
Ignasi Barrera 40f31786c5 JCLOUDS-512: Implement the ImageCache
This commit refactors the ImageCacheSupplier to act as a
proper cache. It is used by the ImageExtesion and all operations
on the images are propagated to the cache.

A method has also been added to the TemplateBuilder to let users
force a cache refresh. There have been several requests to provide a way
to disable image caching in the compute abstraction, and this new method
should fix that.
2016-01-19 11:25:09 +01:00
Ignasi Barrera 62f1c0bc9a Remove unnecessary code to register the compute extensions 2016-01-19 11:17:21 +01:00
Andrew Gaul 0f6ab3944f JCLOUDS-1042: Remove unused bucketAcls
Follow-on to 6bc2ff7e00.
2016-01-17 23:05:08 -08:00
Andrew Gaul 01e10bba66 JCLOUDS-948: Azure Cache-Control support
References JCLOUDS-185.
2016-01-15 04:41:01 -08:00
Zhao Jin 8bddbb496a JCLOUDS-480: AWS S3 v4 signature
This includes support for chunked uploads.
2016-01-13 15:08:18 -08:00
Rita Zhang a12ce5a8b7 Add support for AzureBlobStore.getBlobAccess and RegionScopedSwiftBlobStore.getBlobAccess.
They are currently throwing UnsupportedOperationException exception.
2016-01-05 15:33:50 -08:00
Ignasi Barrera 1ac6fa8426 JCLOUDS-1052: Fix DigitalOcean2 deleteImage 2015-12-22 23:12:59 +01:00
Andrew Gaul f926944949 JCLOUDS-844: Azure putBlob ACLs 2015-12-22 00:46:34 -08:00
Andrew Gaul 13701bf7ab Do not test marker contents
Some providers like Azure have opaque markers.
2015-12-19 15:24:12 -08:00
Zack Shoylev 415a8a6600 Allows extensions to fall back on using an optional name in keystone/openstack 2015-12-14 10:24:59 -06:00
Andrew Gaul b64d05abb9 Allow setting content metadata during copyBlob
Also remove unneeded call to setBlobMetadata which copy sets.
2015-12-13 22:33:08 -08:00
Andrew Gaul 85bc4a6b7e Fix Azure setBlobProperties
Also backfill test.
2015-12-13 22:24:53 -08:00
Andrew Gaul 0634da98a7 Return ETag from AzureBlobClient.copyBlob
This avoids a call to getBlobProperties in AzureBlobStore.copyBlob.
2015-12-13 18:12:57 -08:00
Andrew Gaul bc41e96c49 Use correct package name for CloudFiles tests
Found via error-prone.
2015-12-13 04:27:40 -08:00
Andrew Gaul b47c50b7a5 Correct malformed format strings
Found via error-prone.
2015-12-12 08:53:08 +08:00
Andrew Gaul 28d090139d Make inner classes static when possible
Found via error-prone.
2015-12-12 08:53:07 +08:00
Andrew Gaul 06e379d7a5 Remove @Nullable from methods returning primitives
Found via error-prone.
2015-12-12 08:53:07 +08:00
Ignasi Barrera 86dadc3a75 JCLOUDS-1038: Fix date deserialization in EC2 apis 2015-11-24 14:53:18 +01:00
Reijhanniel Jearl Campos 52c6c2b7b5 JCLOUDS-947: Properly configure live tests in ProfitBricks 2015-11-18 22:35:05 +01:00
Ignasi Barrera 575d39e7c5 JCLOUDS-1033: Don't fail if no private key has been provided in DigitalOcean 2015-11-16 22:58:29 +01:00
Chris Custine 5d82b40d78 JCLOUDS-1026: Remove public HP cloud compute providers
https://issues.apache.org/jira/browse/JCLOUDS-1026
2015-11-09 19:04:59 -07:00
Ignasi Barrera 667252d9e8 Fix Google Compute Engine live tests 2015-11-03 00:16:40 +01:00
Ignasi Barrera 9df30c5a09 JCLOUDS-717: Join Enterprise and OpenSource Chef 2015-10-30 01:02:53 +01:00
Ignasi Barrera 3fbd399f6b Prefer polling the status of the node 2015-10-29 15:55:23 +01:00
Ignasi Barrera c9306c1fc8 Fix a bunch of aws-ec2 live tests 2015-10-29 01:54:09 +01:00
Ignasi Barrera 985d45122b JCLOUDS-987: Create security groups in AWS if subnetId is specified 2015-10-29 01:54:03 +01:00
Ruben Rubio Rey 83ff38ebee JCLOUDS-1027: When waiting to a droplet to be created we check the proper dropletId 2015-10-27 23:35:36 +01:00
Ignasi Barrera 7e866ad6a1 JCLOUDS-1022: Automatically handle DigitalOcean rate limit 2015-10-27 23:30:43 +01:00
Reijhanniel Jearl Campos 5e82bbfa46 JCLOUDS-951: Remove inheritance in ProfitBrick's AutoValue classes 2015-10-27 13:12:23 -05:00
Andrew Gaul b4eeb6393a JCLOUDS-790: Remove hpcloud-objectstorage
HP will sunset this service on 31 Jan 2016:

http://h30499.www3.hp.com/t5/Grounded-in-the-Cloud/A-new-model-to-deliver-public-cloud/ba-p/6804409
2015-10-25 20:39:39 -07:00
Ignasi Barrera 4596471bb2 JCLOUDS-1025: Add support for metadata and tags in the ComputeService 2015-10-23 00:18:45 +02:00
Ignasi Barrera 200e0e12ba JCLOUDS-1024: ImageExtension can take snapshots of stopped droplets 2015-10-22 15:53:06 +02:00
Ignasi Barrera 6254526296 JCLOUDS-1023: Fix DigitalOcean getImage() method 2015-10-22 11:13:30 +02:00
Ignasi Barrera 0c1de23a9a Fix line endings. Use Unix line endings everywhere 2015-10-13 17:05:59 +02:00
Andrew Kennedy cf0e659ccf Add new Softlayer API method to return arbitrary VirtualGuest fields 2015-10-07 20:40:51 +02:00
Stuart Hendren c3f1775123 Adding elastichosts Dallas and Miami providers 2015-10-07 20:39:36 +02:00
Stuart Hendren 26df7e3c9e Fix for Go2Cloud provider endpoint
See JCLOUDS-1004 - Update the Go2Cloud endpoint

https://issues.apache.org/jira/browse/JCLOUDS-1004
2015-09-23 12:31:38 +02:00
Ignasi Barrera ed425c202a Remove accidentally committed file 2015-09-21 23:22:29 +02:00
Michael Wilson 962980cd9d JCLOUDS-1001. Add preemptible support to the Google Compute provider.
The Google Compute provider should support preemptible instances.
2015-09-21 22:17:18 +02:00
Ignasi Barrera 042222b647 GCE hardware profiles might not have volumes 2015-09-18 10:05:34 +02:00
Timur Alperovich f8eff7e00e JCLOUDS-217: AWS-S3: Remove special encoding.
AWS-S3 provider should not pre-encode parameters that are passed to
the jclouds request. This comes up in the AWSS3BlobRequestSigner as
the only place where a parameter is pre-encoded.
2015-09-17 13:08:44 -07:00
Timur Alperovich 4bc4564900 Skip broken Azure test. 2015-09-11 14:27:24 -07:00
Timur Alperovich cbea1b64ef JCLOUDS-217: AWS EC2: Do not use encoded params.
AWS EC2 tests should not pre-encode HTTP parameters.
2015-09-08 15:19:03 -07:00
Timur Alperovich cdabc59ad8 JCLOUDS-217: Azure: Handle blobs with % correctly.
When constructing a URI path for a blob in the listing results, the
Azure provider should re-encode any "bad" characters. Azure provider
also should not call trim() on the blob name, as that will remove any
leading or trailing space characters (which the provider supports). In
fact, the trim() call is only required because of the fact that when
parsing the XML document in the Azure tests, the white space between
the tags was also included in the values. Changing when the character
array is reset eliminates the need to do so.
2015-09-08 15:19:02 -07:00
Oliver Gondža edde721937 JCLOUDS-962: Make all @Provider methods final 2015-09-02 23:54:44 +02:00
Timur Alperovich 5fcfcf3afe JCLOUDS-992: Handle directories as blobs in HPCS. 2015-08-20 12:42:11 -07:00
Timur Alperovich 04ba8905f8 JCLOUDS-992: Handle directories as blobs in Azure. 2015-08-20 12:42:11 -07:00