Commit Graph

1950 Commits

Author SHA1 Message Date
Ignasi Barrera df30057386 JCLOUDS-1278: Allow to configure virtual machine NICs 2017-04-28 09:03:40 +02:00
Ignasi Barrera ec67fdea32 JCLOUDS-1274: Delete managed disks when cleaning up VM resources 2017-04-27 22:54:08 +02:00
Ignasi Barrera 3a9f5787bf Better encapsulated the image id encoding logic 2017-04-26 00:13:06 +02:00
Ignasi Barrera 3b9609f2d5 Added ID to the LoadBalancer entity 2017-04-26 00:13:02 +02:00
Ignasi Barrera 3d274239a1 Properly honor the configured regions in all list methods (list nodes, images and security groups) 2017-04-26 00:12:57 +02:00
Ignasi Barrera 83c0a3c7b2 JCLOUDS-1273/JCLOUDS-1226: Support multiple resource groups in ARM 2017-04-26 00:12:53 +02:00
Dani Estevez cc13cfeda1 Update ImageExtension to work with Managed Disks 2017-04-24 08:22:43 +02:00
Andrew Gaul 05f64f52b2 JCLOUDS-1109: update Azure signed URL expect tests 2017-04-22 12:07:26 -07:00
Andrew Gaul 1e04eafbab JCLOUDS-255: JCLOUDS-1109: Azure signed URLs expiration
This commit also changes signed URLs from header-based to query
parameter-based.
2017-04-22 10:59:15 -07:00
Duncan Godwin 8c973e409e Increase Packet timeouts for node interactions 2017-04-21 11:27:59 +02:00
Andrea Turli 1e403bbee0 Update README.md
improve packet readme
2017-04-21 11:15:52 +02:00
Andrew Gaul b671d2c0d2 JCLOUDS-902: Google Cloud Storage signed URLs 2017-04-20 01:14:07 -07:00
Andrew Gaul 2e7de9f850 JCLOUDS-1271: Deprecate signRemoveBlob
URL signing should always use authentication parameters instead of
headers yet no provider supports DELETEs with the former.
2017-04-19 18:08:52 -07:00
Andrew Gaul f0e11d5c2e Remove unused imports
Fixes regressions introduced by
db00f679ef.
2017-04-19 10:01:30 -07:00
Andrew Gaul db00f679ef JCLOUDS-255: Consistently use query string auth
Fixes regressions introduced in
7a110b31ba.
2017-04-19 00:54:33 -07:00
Andrew Gaul 7a110b31ba JCLOUDS-255: Support S3 signed URLs with expiry
Mostly code motion from AWSS3BlobRequestSigner to S3BlobRequestSigner
with some additional cleanups.
2017-04-18 18:51:22 -07:00
Andrew Gaul a1af4f7fec Use a random UUID for fake upload ID
This matches the Azure provider.
2017-04-13 13:00:50 -07:00
Andrew Gaul 46d3645111 Set ListBlobsOptions.datasets in setter 2017-04-12 13:18:41 -07:00
Andrea Turli 37dcb87dfa Initial support ManagedDataDisks
- add DiskApi + tests
- add ImageApi + tests
- add TemplateOptions.dataDisks
- use dataDisks in adapter
- fix CreateOptions enum usage
- fix VirtualMachineApiMockTest
2017-04-11 11:45:18 +02:00
Andrew Gaul 5a1c95525f JCLOUDS-1262: Correct US-OH region
Follow on to 04ab255d9f.
2017-04-10 13:11:38 -07:00
Andrew Gaul c94dfa23e1 Encode filename in B2 download URL
Previously this caused downloads of file names with % to fail.
2017-04-08 15:44:22 -07:00
Andrew Gaul 0d3b88be97 JCLOUDS-1266: Reduce minimum B2 multipart size
Backblaze B2 advertises two new attributes: absoluteMinimumPartSize
and recommendedPartSize, the former allowing smaller 5 MB multipart
uploads.
2017-04-08 04:29:29 -07:00
Andrew Gaul 8188287bc2 Correct Cache-Control SkipException message 2017-04-07 19:53:09 -07:00
Andrew Gaul 66caf6d954 JCLOUDS-1267: Allow B2 streaming uploads
B2 now supports uploads without calculating the SHA-1 hash.  This
allows uploading without a repeatable payload.
2017-04-07 19:48:58 -07:00
Ignasi Barrera 04ab255d9f JCLOUDS-1262: Add the Ohio region to AWS 2017-03-29 09:17:41 +02:00
Michelle Zhang 96a1c4427e JCLOUDS-1217/JCLOUDS-1258: Add Canada, London and China regions to AWS 2017-03-29 08:53:07 +02:00
Dani Estevez c45728e085 JCLOUDS-1254 Filters storage account by current available locations 2017-03-28 08:23:46 +02:00
Andrew Gaul ca75641fc0 JCLOUDS-1259: Add GCS multi-regional and coldline 2017-03-20 18:42:32 -07:00
Andrew Gaul e058973abc Ensure SOME_CONSTANTS are static final
Found via error-prone.
2017-03-17 16:59:41 -07:00
Andrew Gaul 4193031c62 Fix mixed array dimensions
Found via error-prone.
2017-03-17 16:42:42 -07:00
Andrew Gaul cff54601ea Make inner classes static
Found via error-prone.
2017-03-17 16:42:32 -07:00
Tomasz Wojtuń fdaa3fd721 Wrap Image with Optional in DiskURIToImage 2017-03-14 08:40:11 +01:00
Andrew Gaul 8408242279 Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 22:16:37 -08:00
Andrew Gaul 8e50fe69ad Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 22:15:41 -08:00
Andrew Gaul 87eda15085 Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 20:35:24 -08:00
Andrew Gaul 49f4617afa JCLOUDS-1101: Upgrade to auto-value 1.4-rc2
This resolves issues using Java 9.  Release notes:

https://github.com/google/auto/releases/tag/auto-value-1.4-rc2
2017-03-07 00:18:21 -08:00
Andrea Turli 894be791ea edit VirtualMachineApi.create to createOrUpdate
- add live test for update vm
- update virtual machine api docs
- fix VirtualMachineApiMockTest
2017-03-03 15:28:07 +01:00
Ignasi Barrera 2f70f85c2b Remove all sonatype snapshot repositories 2017-03-03 10:49:48 +01:00
Ignasi Barrera 1409317beb Remove all sonatype snapshot repositories 2017-03-01 11:58:19 +01:00
Ignasi Barrera cec73089eb Improve image lookup when getting node info 2017-03-01 10:40:22 +01:00
Ignasi Barrera 6f23b89c69 Better create rules and explicit test for the ALL protocols 2017-02-21 23:04:20 +01:00
Daniel Estevez 21cda804b8 Checks existence of node before getting SecurityGroups and Images 2017-02-17 14:16:27 +01:00
Ignasi Barrera efb3dd53d0 Fix NPE in ARM VirtualMachineToNodeMetadata 2017-02-17 10:50:22 +01:00
Daniel Estevez dd9bbff452 Adds new available Azure locations according to https://azure.microsoft.com/en-ca/regions/ 2017-02-16 14:51:04 +01:00
Daniel Estevez 6641b5be58 Minor fixes: logging correctly availabilitySetName 2017-02-15 15:45:09 +01:00
Ignasi Barrera e0918405c6 Cleanup orphaned availability sets 2017-02-06 22:15:49 +01:00
Daniel Estevez a312d661f6 Add Load Balancer APIs to Azure ARM 2017-02-06 10:37:24 +01:00
Andrea Turli d65f9ca621 Add Packet ComputeAdapter
- add CreateSshKeysThenCreateNodes strategy
- add PacketComputeServiceLiveTest
- add PacketTemplateBuilderLiveTest
- refactor deviceApi.actions into separate operations
- fix Device.State
- remove overriden live test as it is now pushed up to jclouds/jclouds
- improve comments on the adapter
2017-01-31 15:55:06 +01:00
Andrea Turli ae9d4b366f [azurecompute-arm] performance improvements misc
- improve cleanup performances: by using resourceGroupApi.resources
2017-01-30 15:12:36 +01:00
Ignasi Barrera 9519021564 Inspect all known OSFamilies 2017-01-27 14:20:18 +01:00
Ignasi Barrera c9e2286f73 JCLOUDS-1229: Enable the rate limit module by default 2017-01-26 22:41:07 +01:00
Ignasi Barrera 176abfa7fd Cleanup legacy code and introduce the resource group cache 2017-01-26 21:58:23 +01:00
Daniel Estevez cffee28afa JCLOUDS-1231: Implement the SecurityGroupExtension in ARM 2017-01-26 21:58:23 +01:00
Andrea Turli 3696412213 add compute functions
- fix Device and PaginatedCollection
- improve DeviceToNodeMetadata
2017-01-25 16:31:38 +01:00
Andrea Turli 49f1d0760e Add remaining features to support the abstraction
- add DeviceApi with Mock and Live Test
- add FacilityApi with Mock and Live Test
- add OperatingSystemApi with Mock and Live Test
- add SshKeyApi with Mock and Live Test
- fix Device domain object
- refactor deviceApi.create and sshKeyApi.create as they actually return an object instead of a URI now
- add mock and live tests for device api actions
2017-01-24 10:36:57 +01:00
Andrew Gaul 87a6f2a615 JCLOUDS-1228: Include PublicAccess in responses
REST API version 2016-05-31 includes PublicAccess in List Containers
and Get Container Properties APIs.
2017-01-20 12:02:18 -08:00
Andrea Turli a7f97ac2ad add AddApiVersionToRequest filter 2017-01-17 09:13:41 +01:00
Timur Alperovich 98ea917477 GetBucketLocation should use path-style requests.
When making a GetBucketLocation request, Amazon may route the request
to the bucket region. When making it with v4 signer, the request may
fail because of the region mismatch. Concretely, a request to
test.s3.amazonaws.com may resolve to s3-us-west-2-w.amazonaws.com. The
request itself is prepared for the us-east-1 region (s3.amazonaws.com
endpoint), but then fails when the DNS resolution points to a
us-west-2 endpoint.

Bucket-in-path works around this for the GetBucketLocation requests.
That means that every GetBucketLocation request will be of the form:
https://s3.amazonaws.com/{bucket}?location. This ensures that jclouds
requests will not be subjected to Amazon's routing/DNS pointers.

Fixes: JCLOUDS-1213
2017-01-11 18:14:57 -08:00
Duncan Godwin 15193d0349 Fix generateStorageAccountName
The storageAccountName was used instead of the sanitizedStorageAccountName.
2017-01-11 18:20:11 +01:00
Andrea Turli 34d013f7db add ApiMetadata and ProviderMetadata
- add skeleton for PacketApi with ProjectApi only
- add XAuthTokenToRequest filter
- add HttpApiModule and ParserModule
- add ProjectApi feature with Mock and Live Tests
- add pagination to Project API
- add test pagination
2017-01-11 14:59:47 +01:00
Andrew Gaul 47350e354c Use eu-central-1 region in v4 signer test
Previously the test tried to create a container in eu-central-1 after
it already existed in us-standard.
2017-01-10 18:23:57 -08:00
Duncan Godwin cf256fb48b Add tenant Id lookup command 2017-01-10 18:28:45 +01:00
Andrew Gaul 64c3e35c15 JCLOUDS-1224: Update B2 domain
The old domain will no longer function after 2 Feb 2017.  Reference:

https://help.backblaze.com/hc/en-us/articles/224959187-B2-Domain-Migration-Plan
2017-01-09 19:40:15 -08:00
Andrea Turli 1620a19787 initial commit for Packet.net API
- add domain objects
2017-01-09 22:54:36 +01:00
Andrew Gaul f8025790bf JCLOUDS-1223: Use larger block blobs for Azure
This raises the maximum multipart size from 195 GB to 4.77 TB.
Reference:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:21 -08:00
Andrew Gaul a5ec80a275 JCLOUDS-1123: Azure REST API version 2016-05-31
This enables larger block blobs:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:05 -08:00
Vijay Panghal f3c3f3b306 Make user agent header configurable
Jclouds sends default user agent string with each request to cloud
services. But some of the application would like to overide this and
send custom user agent instead.

This commit define a string property to overide this default user agent
string. This property will be applied to all outgoing http request to
cloud services

JCLOUDS-819
2016-12-20 11:02:19 +01:00
Ignasi Barrera baab388c57 Deprecate user metadata in DigitalOcean 2016-12-07 17:18:23 +01:00
Fritz Elfert 92044e3d44 JCLOUDS-1206: Replace user metadata by byte[] userData 2016-12-07 17:18:19 +01:00
Zack Shoylev 301f6812af Updates the default template so live tests pass again. 2016-11-21 15:47:27 -06:00
Ignasi Barrera 1c49a1b170 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:13:00 +01:00
Ignasi Barrera f4a2be0519 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:13:00 +01:00
Ignasi Barrera d36ceddbb3 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:13:00 +01:00
Ignasi Barrera 1b48ba5942 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:13:00 +01:00
Ignasi Barrera d290705419 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:12:59 +01:00
Ignasi Barrera 214a5e7810 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:48:47 +01:00
Ignasi Barrera 15a1c6abfd Apache jclouds 2.0.0-rc3 release 2016-11-09 22:43:56 +01:00
Ignasi Barrera e38e486ff0 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:40:00 +01:00
Ignasi Barrera 6028b175c6 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:40:00 +01:00
Ignasi Barrera 6a3a37f4e0 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:30:45 +01:00
Ignasi Barrera 139a6367da Revert "Apache jclouds 2.0.0 release"
This reverts commit 43c102065eab2d5fbf98e75811d9088cb7cf76bc.
2016-11-09 21:49:17 +01:00
Ignasi Barrera eb7193e3a5 Revert "Apache jclouds 2.0.0 release"
This reverts commit 43c102065eab2d5fbf98e75811d9088cb7cf76bc.
2016-11-09 21:49:17 +01:00
Ignasi Barrera 0df84d305e Apache jclouds 2.0.0 release 2016-11-03 13:13:04 +01:00
Ignasi Barrera 5459d61f2e Apache jclouds 2.0.0 release 2016-11-03 13:13:04 +01:00
Andrea Turli 8649c3ff79 [aws-ec2] Add CRUD for VPC 2016-10-31 14:56:15 +01:00
Ignasi Barrera a600a1221d Do not leave open streams when loading test mock files 2016-10-26 15:57:28 +02:00
Ignasi Barrera 06b69ffed4 Fix AWS EC2 compute live tests 2016-10-25 15:19:50 +02:00
Andrew Gaul 3c9f66b8e9 Avoid lower-case l literal suffix
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
2016-10-23 14:24:35 -07:00
Andrew Gaul 89787b4c97 Avoid lower-case l literal suffix
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
2016-10-23 14:15:09 -07:00
Andrew Gaul 8117574c83 Avoid C-style array declarations
Found via error-prone.
2016-10-23 13:51:59 -07:00
Andrew Gaul 424a88fdc5 Avoid C-style array declarations
Found via error-prone.
2016-10-23 13:49:11 -07:00
Andrew Gaul 25baad6d32 Address confusing operator precedence
Found via error-prone.
2016-10-23 06:39:46 -07:00
Andrew Gaul 2a04a52d56 Remove unused imports
Found via error-prone.
2016-10-23 06:39:46 -07:00
Andrew Gaul ea82f58b35 Avoid improper equality comparisons
Found via error-prone.
2016-10-23 06:38:46 -07:00
Ignasi Barrera 8030e53f32 Move digital ocean rate limit handler to core to make it reusable 2016-10-19 16:56:51 +02:00
Ignasi Barrera d4eed40206 Ignore storage account access failures when listing custom images 2016-10-19 16:55:10 +02:00
Ignasi Barrera d030ecac5a Added rate limit module 2016-10-19 16:50:50 +02:00
Andrew Gaul bc97afc0c1 JCLOUDS-1182: Added Seoul and Mumbai regions to AWS
This commit addresses test failures in
AWSS3ServiceIntegrationLiveTest#testGetAssignableLocations.
2016-10-18 21:06:15 -07:00
Shri Javadekar 7826d22d30 JCLOUDS-1161: Make AWSS3BlobRequestSignerV4 the default signer.
Added new live tests and fixed some unit tests accordingly.
2016-10-18 20:06:34 -07:00
Ignasi Barrera e3dc3fb976 Null guards 2016-10-18 12:32:08 +02:00
Ignasi Barrera bf40d2ed2b Configure jclouds group in virtualmachine tags 2016-10-18 12:09:07 +02:00
Ignasi Barrera 43eb65938c Configuration to deploy VMs from the Marketplace 2016-10-18 12:09:07 +02:00
Ignasi Barrera 25656f5f63 Added support for metadata and tags to Azure ARM 2016-10-17 13:27:25 +02:00
Ignasi Barrera 00d9138864 Create one resource group in each region 2016-10-17 13:24:57 +02:00
Andrea Turli cd16826dca Refactored Azure ARM to not use Deployments
* Simplified ImageExtension
* Fixed access to deployed VMS
* Made api-version configurable for all apis"
* Fixed all feature live tests
* Fixed the AzureComputeServiceLiveTest
* Fixed the AzureTemplateBuilderLiveTest
* Fixed the AzureComputeImageExtensionLiveTest
2016-10-14 11:43:00 +02:00
Andrea Turli 2c6caa04bf reduce payload for GET VirtualGuests 2016-10-14 10:45:57 +02:00
Ignasi Barrera b06795ebe4 JCLOUDS-1182: Added Seoul and Mumbai regions to AWS 2016-10-13 18:14:20 +02:00
Ignasi Barrera 3b726b5686 Fix DigitalOcean2 live tests 2016-10-13 15:06:50 +02:00
Andrew Gaul 50e6d44433 JCLOUDS-945: fix local blobstore marker handling
Previously using prefix markers would not correctly find the next key.
Add test for this behavior.
2016-10-12 22:22:28 -07:00
Stuart Hendren 26c060a0e8 JCLOUDS-1185 Allow rangeIPv4 to be null
The default network of recently created projects have a null value for rangeIPv4
And all regions as subnets, which do have values for the rangeIPv4.

Fixes JCLOUDS-1158
2016-10-07 14:12:08 +02:00
Andrew Gaul 11c636b6b3 JCLOUDS-945: ignore marker prefix test on GCS 2016-10-04 23:03:03 -07:00
Andrea Turli 8df58654b8 fix azure-arm features live tests
- add image publishers filter to AzureComputeServiceLiveTest
- add parser module to provider
- fix create network card interface
- fix checkstyle
2016-09-27 15:27:53 +02:00
Ignasi Barrera 8e0e781df0 GCE live test fixes 2016-09-26 13:25:46 +02:00
Ignasi Barrera d98348d503 Better predicate signature for node operations 2016-09-23 10:22:23 +02:00
Ignasi Barrera 8cbf312c32 Use the existing region suppliers to filter 2016-09-21 17:10:01 +02:00
Andrea Turli b3294bb177 separate the DeploymentToVMDeployment to a function
- refactor logback-test.xml
- change jsonBall to Value
2016-09-21 16:32:43 +02:00
Andrea Turli 204d54d57c add support for whitelisting locations
- change location scope to ZONE vs REGION
- edit the README
- fix Region.byName
- add more Regions in Region class
- address initial comments from @nacx
- revert ZONES to REGIONS
- add parser module
- remove parser from HttpApiModule
- use one region in AzureLiveTestUtils
2016-09-20 16:23:58 +02:00
Andrew Gaul 080bcce224 Address Checkstyle violations
Regression from 76995a363d.
2016-09-17 14:27:03 -07:00
Andrew Gaul 76995a363d Do not fail AWS S3 signer tests with expiry
Regression from 41bdd9c5a9.
References #1008.
2016-09-17 12:13:28 -07:00
Ignasi Barrera 1e484fc2ce Fix package export 2016-09-17 00:56:17 +02:00
Andrew Gaul 7cde28a4d2 JCLOUDS-1074: Guava 20 compatibility
* dynamically call TypeToken.isSupertypeOf with Guava 19 and later and
  TypeToken.isAssignableFrom with Guava 18 and earlier
* consume or ignore values from methods with CheckReturnValue
* replace usage of removed Iterators.emptyIterator
2016-09-06 21:49:20 -07:00
Zack Shoylev 05c05e3de2 Allows users to download large files efficiently and directly to disk. 2016-09-02 14:05:26 -05:00
Iván Lomba 557a115694 JCLOUDS-482: Fix ProfitBricksComputeServiceLiveTest custom hardware assert 2016-08-16 23:12:42 +02:00
Iván Lomba aac9b5fd5d JCLOUDS-482: Add support for ProfitBricks 2016-08-16 02:44:13 +02:00
Iván Lomba 79e95c5a4c JCLOUDS-482: Add support for arbitrary CPU and RAM
This is a combination of 16 commits:

* First approach to ArbitraryCpuRamTemplateBuilderImpl
* Several fixes: refactoring some names, format, identation problems, some missing license headers and generateId method
* Refactored parse utility
* Added GoogleComputeEngineArbitraryCpuRamTemplateBuilderImpl to support GCE custom machine URI
* extracted hardware creation to automaticHardwareForCpuAndRam method
* Fixed ide automatic asterisk imports
* correcting WIP base case PR according to comments
* added machineTypeUriToHardware to set custom hardware in nodes
* fix checkstyle violations and other PR comments
* Set the providerId to custom machineType URI and fix adding node log
* Arbitrary hardware tests added to BaseTemplateBuilderLiveTest and GoogleComputeEngineTemplateBuilderLiveTest
* Added two more tests to BaseTemplateBuilderLiveTest
* Move repeated constants to TestUtils to reuse code
* Fix full path in the Hardware id and URI
* Add custom hardware tests to BaseComputeServiceLiveTest and GCEServiceLiveTest
* Change customHardware test to use buildTemplate and fix identation
2016-08-16 02:44:04 +02:00
Ignasi Barrera 1e4d0beae2 JCLOUDS-1145: Fix DigitalOceanImageExtension and live tests 2016-08-16 00:18:05 +02:00
Janne Koskinen 3c790ae3ae JCLOUDS-664 Azurecompute-arm ImageExtension 2016-08-10 00:07:37 +02:00
Andrea Turli 4f62f40036 [azure-arm] add controlled storage account name generation
- add unit test for storage account name generation
2016-08-06 14:51:26 +02:00
Andrea Turli 4fe2374964 add unit test for storage account name generation 2016-08-06 14:41:01 +02:00
Andrea Turli 93028b7529 GCE: fix tags order 2016-08-02 20:12:45 +02:00
Andrea Turli deeedd55e8 add support for security groups 2016-08-02 16:46:04 +02:00
Ladislav Thon f67cf8b9db [JCLOUDS-664] make getImage(id) only do a single API request
* Fill in the private IP addresses in NodeMetadata
* Unify how getNode and listNodes build the VMDeployment
* Change VMDeployment to use AutoValue
2016-07-17 23:26:26 +02:00
Andrea Turli 26e3d6cfdb [azure-arm] add supports to port ranges to addNetworkSecurityGroup
- add unit tests
2016-07-15 10:58:13 +02:00
Andrea Turli a515ce2f22 Change line endings on files recursively 2016-07-14 00:02:13 +02:00
Rita Zhang cf438b6c1a JCLOUDS-664 Azurecompute-arm Update image name logic 2016-07-12 23:37:28 +02:00
Rita Zhang 10d9b38976 JCLOUDS-664 Azurecompute-arm image capture userdata keyvault 2016-07-01 00:30:29 +02:00
Andrew Gaul 2b0743d579 JCLOUDS-1005: Backblaze B2 portable abstraction 2016-06-24 17:14:36 -07:00
Andrew Gaul a2e2ff8e4f JCLOUDS-1005: Percent encode user metadata values 2016-06-23 20:41:28 -07:00
Andrew Gaul de04c69141 Consistently name test container names
Previously jclouds allocated the initial container pool as
$USERNAME-blobstore-1, 2, etc. and subsequent containers with
$USERNAME-blobstore-$RANDOM.  Use only the former instead.
2016-06-22 22:50:22 -07:00
Andrew Gaul 2ff68fc79e JCLOUDS-1005: Retry on 500 and 503 errors
This requires rewriting the URL for b2_upload_file and b2_upload_part
requests.
2016-06-21 18:12:36 -07:00
Rita Zhang cadd60dc22 JCLOUDS-664 Azurecompute-arm compute service 2016-06-17 22:24:32 +02:00
Ignasi Barrera bde70457d0 JCLOUDS-1105: Do not create the default security group if custom groups are specified 2016-06-17 22:18:35 +02:00
Ignasi Barrera 179ed3b2f6 Properly set the permissions in the ~/.ssh folder
When writing the ~/.ssh/authorized_keys file in a script that is being
run as sudo, the file is created with the root owner, instead of the
user defined by the node credentials. File ownership should be enforced
to make sure the right owner is alwaays set.
2016-06-17 22:16:19 +02:00
Andrew Gaul f66e0a3fcc JCLOUDS-1005: Do not map "none" SHA1 to null
Callers expect that ETag has a non-null value.
2016-06-17 13:11:41 -07:00
Andrew Gaul 3d84d3cb2d JCLOUDS-1005: Backblaze B2 large file operations 2016-06-16 16:12:32 -07:00
Andrew Gaul 882a65bab7 JCLOUDS-1005: Factor out common test code 2016-06-16 16:12:32 -07:00
Andrew Gaul 230448a454 JCLOUDS-1028: Configure idempotent methods
Enable for GCS.
2016-06-15 16:38:53 -07:00
Andrew Gaul 5fec2346a6 JCLOUDS-1028: Configure idempotent methods
Enable POST for Atmos, S3, and Swift.
2016-06-15 16:35:22 -07:00
Valentin Aitken f98116ec83 GCE ResetWindowsPassword
- Function which tells to GCE to reset Windows password

- InstanceApiLiveTest for windows

- Unit test for decrypting windows password

- fixed compile errors
2016-06-15 12:31:48 +02:00
Andrew Gaul 5baa49d9b8 JCLOUDS-1125: GCS list multipart uploads
Not supported.
2016-06-13 17:11:39 -07:00
Andrew Gaul 0bd2959410 JCLOUDS-1125: portable list multipart uploads
Only Azure, B2, and S3 support this operation.  Some MultipartUpload
fields become nullable.
2016-06-13 16:26:43 -07:00
Andrew Gaul 61ab28cc50 JCLOUDS-1125: Azure list other blobs
Some BlobProperties fields become nullable due to these new blob types.
2016-06-13 16:26:43 -07:00
Andrew Gaul bd6a495a04 JCLOUDS-1005: Backblaze B2 object operations 2016-06-09 16:15:11 -07:00
Zack Shoylev c1ce819f61 updateTemporaryUrlKey test 2016-06-07 17:37:39 -05:00
Zack Shoylev de88a72e7a Change the template to use CentOS instead. Avoids some openjdk-6 problems. 2016-06-07 17:37:33 -05:00
Jim Spring 8d8cd1728d Network Security Group API 2016-06-07 22:25:16 +02:00
Andrew Gaul 4393c47e7f JCLOUDS-1005: Remove unused Credentials 2016-06-05 12:26:47 -07:00
Andrew Gaul ae1f6d0c3f JCLOUDS-866: Reduce GCS multipart limit to 32 2016-06-04 00:23:40 -07:00
Andrew Gaul ed262f7bd6 Delete GCS composite object components
Previously we left dangling subobjects.  The composite object retains
a reference to the components data.
2016-06-04 00:23:22 -07:00
Andrew Gaul c2a22bc32c JCLOUDS-912: GCS upload InputStream work around 2016-06-03 12:38:43 -07:00
Andrew Gaul 5d437312bf JCLOUDS-912: Remove GCS simpleUpload UploadBinder
This is not necessary; jclouds binds the Payload automatically;
jclouds binds the Payload automatically.
2016-06-02 22:35:54 -07:00
Andrew Gaul 2b02db4f22 Add ObjectTemplate.toString 2016-06-02 16:24:13 -07:00
Rita Zhang f2b5c15566 JCLOUDS-664 Azurecompute-arm DeploymentApi OSImageApi VMSizeApi 2016-06-03 00:25:57 +02:00
Andrew Gaul a67ae3f27b Make inner classes static where possible
Found via error-prone.
2016-06-01 20:03:54 -07:00
Andrew Gaul 26d85068ca JCLOUDS-1005: Correct B2 package names
Addresses javadoc failures.
2016-06-01 15:18:16 -07:00
Andrew Gaul bd3bbc4532 JCLOUDS-1005: Backblaze B2 skeleton and bucket ops 2016-05-28 13:08:23 -07:00
Sergey Torgashov ccd1ef2b4d JCLOUDS-1114: Adding support for "Placement.Tenancy" and "Placement.HostId" AWS EC2 parameters 2016-05-20 00:07:47 +02:00
Andrew Gaul 41bdd9c5a9 Skip unimplemented signed URL tests in S3 provider
jclouds aws-s3 provider supports these but s3 does not.  Also expect
failure in atmos and azureblob.  Follow on to
a4c40e15cd.
2016-05-12 12:12:52 -07:00
Rita Zhang a266511f18 JCLOUDS-664 Azurecompute-arm NicApi PublicIPApi and VMApi 2016-05-11 16:05:13 -07:00
Andrew Gaul f6210d58d3 Handle unimplemented signed URL tests in providers
This commit makes it evident in source code which providers do not
support this feature.
2016-05-06 14:38:57 -07:00
Andrew Gaul a4c40e15cd Handle unimplemented signed URL tests in providers
This commit makes it evident in source code which providers do not
support this feature.
2016-05-06 10:31:37 -07:00
Andrew Gaul da386ad0e2 Correct FindBugs warnings 2016-04-27 20:28:37 -07:00
Rita Zhang 8c7573164f JCLOUDS-664 Azurecompute-arm VNetApi and SubnetApi 2016-04-27 14:49:12 +02:00
Andrew Gaul 66cda12b50 Avoid eager evaluation of Preconditions messages
Found via error-prone.
2016-04-24 23:28:55 -07:00
Rita Zhang cadc43cbbc JCLOUDS-664 Azurecompute-arm StorageAccountApi 2016-04-19 16:28:09 +02:00
Andrew Gaul 3cf4e3d79c JCLOUDS-1101: Correct generics wildcard errors
Always incorrect but previously broken on Java 9.  Reference:

https://bugs.openjdk.java.net/browse/JDK-8075793
2016-04-18 09:49:58 -07:00
Ignasi Barrera cf07407c2d JCLOUDS-1077: Fix ProjectApiLiveTest in Google Compute Engine 2016-04-16 02:05:29 +02:00
Rita Zhang f85646f259 JCLOUDS-664 Update live tests for Azurecompute-arm LocationApi 2016-04-13 23:43:22 +02:00
Rita Zhang 8d21b5eca6 JCLOUDS-664 Azurecompute-arm LocationApi 2016-04-13 09:37:38 +02:00
Ignasi Barrera ac57c72f3a Updated azurecompute-arm build status link 2016-04-07 12:15:35 +02:00
Ignasi Barrera 397b0c9ba4 Azure ARM fixes 2016-04-07 11:58:36 +02:00
Ignasi Barrera a780cdad59 Depend on OAuth test jar for tests 2016-04-07 11:56:45 +02:00
Ignasi Barrera 819141a608 Fixed OAuth authentication flow injections 2016-04-07 10:10:10 +02:00
Rita Zhang 053a18ab16 JCLOUDS-664 Azurecompute-arm ResourceGroupApi 2016-04-06 21:23:08 +02:00
Andrew Gaul 0f77386c77 JCLOUDS-766: JCLOUDS-1090: Use AWS v4 signature
Previous commits added support for v4 but did not default to it.  URL
signing continues to use v2 signatures due to a conflict between PUT
requests and v4 content signing.  Addresses
AWSS3ServiceIntegrationLiveTest.testAllLocations test failures.
2016-03-27 16:27:30 -07:00
Andrew Gaul fdec2fa99f JCLOUDS-766: Do not resign already-signed requests
Previously jclouds would add both a V2 and V4 signature to some
requests which Amazon rejects.  Addresses AWSS3BlobSignerLiveTest test
failures with time-limited requests.
2016-03-27 16:24:12 -07:00
Andrew Gaul 6964ef6c8f Actually send RRS in putBlobWithReducedRedundancy
Regression from 0f6ab3944f.
2016-03-27 14:25:56 -07:00
Andrew Gaul 28f10f90b8 Use correct payload length in GCS test
This avoids MWS unexpected end of stream errors.  Regression from
b9322c583d.
2016-03-23 19:35:41 -04:00
Andrew Gaul 2501122a20 JCLOUDS-766: Add eu-central-1 to test expectations
Addresses AWSS3ServiceIntegrationLiveTest.testGetAssignableLocations
test failures.  Follow-on to c18371a793.
2016-03-17 23:48:07 -07:00
Alex Heneveld d649c90d98 fix for issue if SL machine has multiple credentials registered
now just pick the best one. it matters only when we are going to log in to a machine.
the only time the problem has been observed has been with pre-existing machines set up
outwith jclouds with multiple password.
2016-03-08 14:59:20 +01:00
Andrew Gaul c18371a793 JCLOUDS-766: Add eu-central-1 to AWS S3 regions
Also clean up some missing and duplicated properties.
2016-03-07 21:21:08 -08:00
Ignasi Barrera 72f2652dca Properly handler ProfitBricks service errors 2016-03-02 14:51:29 +01:00
Ignasi Barrera 59a88ff898 Fix ProfitBricks TemplateBuilderLiveTests 2016-02-24 22:56:40 +01:00
Reijhanniel Jearl Campos 9a8b4d074b Move html responses to a subfolder for cleaner rat plugin exclude 2016-02-23 19:30:03 +08:00
Reijhanniel Jearl Campos d5b74179a4 Update profitbricks readme to reflect previous refactoring changes 2016-02-20 01:33:26 +08:00
Reijhanniel Jearl Campos d05cecc39c Update pom details for ProfitBricks 2016-02-19 23:02:29 +08:00
Reijhanniel Jearl Campos 1af52159c9 Merge remote-tracking branch 'jclouds-labs-profitbricks-local/promote-profitbricks-moved' into promoted-profitbricks 2016-02-19 22:04:55 +08:00
Ignasi Barrera 7202e0557f Refactored locations to not rely on existing DataCenters 2016-02-18 10:48:00 +01:00
Andrew Gaul 6cdb1216a7 JCLOUDS-651: S3 support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul 467f3483bc JCLOUDS-651: Azure support for conditional copies 2016-02-16 16:29:54 -08:00
Andrew Gaul 293d3f864e Convert CopyOptions into an AutoValue
This commit requires an interface change since AutoValue lacks support
for Optional and uses Nullable annotations instead.
2016-02-16 16:29:54 -08:00
Andrew Gaul 2499cb0ac2 GCS support for conditional copies 2016-02-12 20:44:18 -08:00
Andrew Gaul 165e9afd9f Convert CopyOptions into an AutoValue
This commit requires an interface change since AutoValue lacks support
for Optional and uses Nullable annotations instead.
2016-02-12 19:29:38 -08:00
Andrew Gaul 0cf13c61ef Do not remove during Azure abortMultipartUpload
Explicitly removing the blob removes any previously existing blob with
the same name.
2016-02-03 23:34:37 -08:00
Andrew Gaul e50bd79f01 Map PublicAccess.CONTAINER to PUBLIC_READ
This better matches the semantics of other providers and allows
clients to list a publicly readable container.
2016-01-31 18:14:25 -08:00
Andrew Gaul 6360023f09 Remove unnecessary static imports
Found via error-prone.
2016-01-29 09:14:55 -08:00
Andrew Gaul 4be8a2eb72 Add missing hashCode methods
Found via error-prone.
2016-01-29 08:37:46 -08:00
Andrew Gaul b2c0786fc0 Enable range tests for azureblob 2016-01-23 12:38:50 -08:00
Andrew Gaul 9c05604e99 Skip ACL tests on GCS
These tests use request signing which GCS does not currently support.
2016-01-22 21:09:54 -08:00
Andrew Gaul 10318ed777 JCLOUDS-943: JCLOUDS-1056: Configure OSGi packaging 2016-01-22 16:10:57 -08:00
Andrew Gaul 3a65df1e2e JCLOUDS-988: Subclass StaticLargeObjectApiLiveTest in Cloudfiles providers
This allows tests to run.
2016-01-22 14:01:49 -08:00
Ignasi Barrera ef7b85130e JCLOUDS-1056: Configure OSGi packaging 2016-01-22 11:34:07 +01:00
Ignasi Barrera edacad2b6e Amend poms after promoting DigitalOcean v2 2016-01-21 01:02:58 +01:00
Ignasi Barrera 886aa156b4 Promote DigitalOcean v2 2016-01-20 23:57:03 +01:00
Ignasi Barrera c188570444 Improved DigitalOcean image extension
Do not block when waiting for the images to become available.
2016-01-20 12:24:46 +01:00
Reijhanniel Jearl Campos 235b4b98d4 JCLOUDS-1047: Fix ProfitBricks compute service live tests 2016-01-19 15:29:57 +01:00
Ignasi Barrera 40f31786c5 JCLOUDS-512: Implement the ImageCache
This commit refactors the ImageCacheSupplier to act as a
proper cache. It is used by the ImageExtesion and all operations
on the images are propagated to the cache.

A method has also been added to the TemplateBuilder to let users
force a cache refresh. There have been several requests to provide a way
to disable image caching in the compute abstraction, and this new method
should fix that.
2016-01-19 11:25:09 +01:00
Ignasi Barrera 62f1c0bc9a Remove unnecessary code to register the compute extensions 2016-01-19 11:17:21 +01:00
Andrew Gaul 0f6ab3944f JCLOUDS-1042: Remove unused bucketAcls
Follow-on to 6bc2ff7e00.
2016-01-17 23:05:08 -08:00
Andrew Gaul 01e10bba66 JCLOUDS-948: Azure Cache-Control support
References JCLOUDS-185.
2016-01-15 04:41:01 -08:00
Zhao Jin 8bddbb496a JCLOUDS-480: AWS S3 v4 signature
This includes support for chunked uploads.
2016-01-13 15:08:18 -08:00
Rita Zhang a12ce5a8b7 Add support for AzureBlobStore.getBlobAccess and RegionScopedSwiftBlobStore.getBlobAccess.
They are currently throwing UnsupportedOperationException exception.
2016-01-05 15:33:50 -08:00
Ignasi Barrera 1ac6fa8426 JCLOUDS-1052: Fix DigitalOcean2 deleteImage 2015-12-22 23:12:59 +01:00
Andrew Gaul f926944949 JCLOUDS-844: Azure putBlob ACLs 2015-12-22 00:46:34 -08:00
Andrew Gaul 57d162c646 JCLOUDS-844: GCS putBlob ACLs 2015-12-21 23:25:00 -08:00
Andrew Gaul 13701bf7ab Do not test marker contents
Some providers like Azure have opaque markers.
2015-12-19 15:24:12 -08:00
Zack Shoylev 415a8a6600 Allows extensions to fall back on using an optional name in keystone/openstack 2015-12-14 10:24:59 -06:00
Andrew Gaul b64d05abb9 Allow setting content metadata during copyBlob
Also remove unneeded call to setBlobMetadata which copy sets.
2015-12-13 22:33:08 -08:00
Andrew Gaul 85bc4a6b7e Fix Azure setBlobProperties
Also backfill test.
2015-12-13 22:24:53 -08:00
Andrew Gaul 0634da98a7 Return ETag from AzureBlobClient.copyBlob
This avoids a call to getBlobProperties in AzureBlobStore.copyBlob.
2015-12-13 18:12:57 -08:00
Andrew Gaul bc41e96c49 Use correct package name for CloudFiles tests
Found via error-prone.
2015-12-13 04:27:40 -08:00
Andrew Gaul b47c50b7a5 Correct malformed format strings
Found via error-prone.
2015-12-12 08:53:08 +08:00
Andrew Gaul 28d090139d Make inner classes static when possible
Found via error-prone.
2015-12-12 08:53:07 +08:00
Andrew Gaul 06e379d7a5 Remove @Nullable from methods returning primitives
Found via error-prone.
2015-12-12 08:53:07 +08:00
Andrew Gaul 639e96d5e7 Remove @Nullable from methods returning primitives
Found via error-prone.
2015-12-12 08:22:27 +08:00
Ignasi Barrera 86dadc3a75 JCLOUDS-1038: Fix date deserialization in EC2 apis 2015-11-24 14:53:18 +01:00
Reijhanniel Jearl Campos 52c6c2b7b5 JCLOUDS-947: Properly configure live tests in ProfitBricks 2015-11-18 22:35:05 +01:00
Ignasi Barrera 575d39e7c5 JCLOUDS-1033: Don't fail if no private key has been provided in DigitalOcean 2015-11-16 22:58:29 +01:00
Chris Custine 5d82b40d78 JCLOUDS-1026: Remove public HP cloud compute providers
https://issues.apache.org/jira/browse/JCLOUDS-1026
2015-11-09 19:04:59 -07:00
Ignasi Barrera 667252d9e8 Fix Google Compute Engine live tests 2015-11-03 00:16:40 +01:00
Ignasi Barrera 9df30c5a09 JCLOUDS-717: Join Enterprise and OpenSource Chef 2015-10-30 01:02:53 +01:00
Ignasi Barrera 3fbd399f6b Prefer polling the status of the node 2015-10-29 15:55:23 +01:00
Ignasi Barrera c9306c1fc8 Fix a bunch of aws-ec2 live tests 2015-10-29 01:54:09 +01:00
Ignasi Barrera 985d45122b JCLOUDS-987: Create security groups in AWS if subnetId is specified 2015-10-29 01:54:03 +01:00
Ruben Rubio Rey 83ff38ebee JCLOUDS-1027: When waiting to a droplet to be created we check the proper dropletId 2015-10-27 23:35:36 +01:00
Ignasi Barrera 7e866ad6a1 JCLOUDS-1022: Automatically handle DigitalOcean rate limit 2015-10-27 23:30:43 +01:00
Reijhanniel Jearl Campos 5e82bbfa46 JCLOUDS-951: Remove inheritance in ProfitBrick's AutoValue classes 2015-10-27 13:12:23 -05:00
Andrew Gaul b4eeb6393a JCLOUDS-790: Remove hpcloud-objectstorage
HP will sunset this service on 31 Jan 2016:

http://h30499.www3.hp.com/t5/Grounded-in-the-Cloud/A-new-model-to-deliver-public-cloud/ba-p/6804409
2015-10-25 20:39:39 -07:00
Ignasi Barrera 4596471bb2 JCLOUDS-1025: Add support for metadata and tags in the ComputeService 2015-10-23 00:18:45 +02:00
Ignasi Barrera 200e0e12ba JCLOUDS-1024: ImageExtension can take snapshots of stopped droplets 2015-10-22 15:53:06 +02:00