Commit Graph

1718 Commits

Author SHA1 Message Date
Andrew Gaul 5a1c95525f JCLOUDS-1262: Correct US-OH region
Follow on to 04ab255d9f.
2017-04-10 13:11:38 -07:00
Andrew Gaul c94dfa23e1 Encode filename in B2 download URL
Previously this caused downloads of file names with % to fail.
2017-04-08 15:44:22 -07:00
Andrew Gaul 0d3b88be97 JCLOUDS-1266: Reduce minimum B2 multipart size
Backblaze B2 advertises two new attributes: absoluteMinimumPartSize
and recommendedPartSize, the former allowing smaller 5 MB multipart
uploads.
2017-04-08 04:29:29 -07:00
Andrew Gaul 8188287bc2 Correct Cache-Control SkipException message 2017-04-07 19:53:09 -07:00
Andrew Gaul 66caf6d954 JCLOUDS-1267: Allow B2 streaming uploads
B2 now supports uploads without calculating the SHA-1 hash.  This
allows uploading without a repeatable payload.
2017-04-07 19:48:58 -07:00
Ignasi Barrera 04ab255d9f JCLOUDS-1262: Add the Ohio region to AWS 2017-03-29 09:17:41 +02:00
Michelle Zhang 96a1c4427e JCLOUDS-1217/JCLOUDS-1258: Add Canada, London and China regions to AWS 2017-03-29 08:53:07 +02:00
Andrew Gaul ca75641fc0 JCLOUDS-1259: Add GCS multi-regional and coldline 2017-03-20 18:42:32 -07:00
Andrew Gaul e058973abc Ensure SOME_CONSTANTS are static final
Found via error-prone.
2017-03-17 16:59:41 -07:00
Andrew Gaul 4193031c62 Fix mixed array dimensions
Found via error-prone.
2017-03-17 16:42:42 -07:00
Andrew Gaul cff54601ea Make inner classes static
Found via error-prone.
2017-03-17 16:42:32 -07:00
Tomasz Wojtuń fdaa3fd721 Wrap Image with Optional in DiskURIToImage 2017-03-14 08:40:11 +01:00
Andrew Gaul 8408242279 Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 22:16:37 -08:00
Andrew Gaul 8e50fe69ad Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 22:15:41 -08:00
Andrew Gaul 87eda15085 Return more metadata from listMultipartUpload
Include Content-Length and Last-Modified.
2017-03-08 20:35:24 -08:00
Andrew Gaul 49f4617afa JCLOUDS-1101: Upgrade to auto-value 1.4-rc2
This resolves issues using Java 9.  Release notes:

https://github.com/google/auto/releases/tag/auto-value-1.4-rc2
2017-03-07 00:18:21 -08:00
Ignasi Barrera 2f70f85c2b Remove all sonatype snapshot repositories 2017-03-03 10:49:48 +01:00
Ignasi Barrera 1409317beb Remove all sonatype snapshot repositories 2017-03-01 11:58:19 +01:00
Andrea Turli d65f9ca621 Add Packet ComputeAdapter
- add CreateSshKeysThenCreateNodes strategy
- add PacketComputeServiceLiveTest
- add PacketTemplateBuilderLiveTest
- refactor deviceApi.actions into separate operations
- fix Device.State
- remove overriden live test as it is now pushed up to jclouds/jclouds
- improve comments on the adapter
2017-01-31 15:55:06 +01:00
Andrea Turli 3696412213 add compute functions
- fix Device and PaginatedCollection
- improve DeviceToNodeMetadata
2017-01-25 16:31:38 +01:00
Andrea Turli 49f1d0760e Add remaining features to support the abstraction
- add DeviceApi with Mock and Live Test
- add FacilityApi with Mock and Live Test
- add OperatingSystemApi with Mock and Live Test
- add SshKeyApi with Mock and Live Test
- fix Device domain object
- refactor deviceApi.create and sshKeyApi.create as they actually return an object instead of a URI now
- add mock and live tests for device api actions
2017-01-24 10:36:57 +01:00
Andrew Gaul 87a6f2a615 JCLOUDS-1228: Include PublicAccess in responses
REST API version 2016-05-31 includes PublicAccess in List Containers
and Get Container Properties APIs.
2017-01-20 12:02:18 -08:00
Andrea Turli a7f97ac2ad add AddApiVersionToRequest filter 2017-01-17 09:13:41 +01:00
Timur Alperovich 98ea917477 GetBucketLocation should use path-style requests.
When making a GetBucketLocation request, Amazon may route the request
to the bucket region. When making it with v4 signer, the request may
fail because of the region mismatch. Concretely, a request to
test.s3.amazonaws.com may resolve to s3-us-west-2-w.amazonaws.com. The
request itself is prepared for the us-east-1 region (s3.amazonaws.com
endpoint), but then fails when the DNS resolution points to a
us-west-2 endpoint.

Bucket-in-path works around this for the GetBucketLocation requests.
That means that every GetBucketLocation request will be of the form:
https://s3.amazonaws.com/{bucket}?location. This ensures that jclouds
requests will not be subjected to Amazon's routing/DNS pointers.

Fixes: JCLOUDS-1213
2017-01-11 18:14:57 -08:00
Andrea Turli 34d013f7db add ApiMetadata and ProviderMetadata
- add skeleton for PacketApi with ProjectApi only
- add XAuthTokenToRequest filter
- add HttpApiModule and ParserModule
- add ProjectApi feature with Mock and Live Tests
- add pagination to Project API
- add test pagination
2017-01-11 14:59:47 +01:00
Andrew Gaul 47350e354c Use eu-central-1 region in v4 signer test
Previously the test tried to create a container in eu-central-1 after
it already existed in us-standard.
2017-01-10 18:23:57 -08:00
Andrew Gaul 64c3e35c15 JCLOUDS-1224: Update B2 domain
The old domain will no longer function after 2 Feb 2017.  Reference:

https://help.backblaze.com/hc/en-us/articles/224959187-B2-Domain-Migration-Plan
2017-01-09 19:40:15 -08:00
Andrea Turli 1620a19787 initial commit for Packet.net API
- add domain objects
2017-01-09 22:54:36 +01:00
Andrew Gaul f8025790bf JCLOUDS-1223: Use larger block blobs for Azure
This raises the maximum multipart size from 195 GB to 4.77 TB.
Reference:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:21 -08:00
Andrew Gaul a5ec80a275 JCLOUDS-1123: Azure REST API version 2016-05-31
This enables larger block blobs:

https://azure.microsoft.com/en-us/blog/general-availability-larger-block-blobs-in-azure-storage/
2017-01-08 15:28:05 -08:00
Vijay Panghal f3c3f3b306 Make user agent header configurable
Jclouds sends default user agent string with each request to cloud
services. But some of the application would like to overide this and
send custom user agent instead.

This commit define a string property to overide this default user agent
string. This property will be applied to all outgoing http request to
cloud services

JCLOUDS-819
2016-12-20 11:02:19 +01:00
Ignasi Barrera baab388c57 Deprecate user metadata in DigitalOcean 2016-12-07 17:18:23 +01:00
Fritz Elfert 92044e3d44 JCLOUDS-1206: Replace user metadata by byte[] userData 2016-12-07 17:18:19 +01:00
Zack Shoylev 301f6812af Updates the default template so live tests pass again. 2016-11-21 15:47:27 -06:00
Ignasi Barrera f4a2be0519 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:13:00 +01:00
Ignasi Barrera 1b48ba5942 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:13:00 +01:00
Ignasi Barrera d290705419 Next development version 2.1.0-SNAPSHOT 2016-11-15 01:12:59 +01:00
Ignasi Barrera 214a5e7810 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:48:47 +01:00
Ignasi Barrera 6028b175c6 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:40:00 +01:00
Ignasi Barrera 6a3a37f4e0 Apache jclouds 2.0.0-rc3 release 2016-11-09 22:30:45 +01:00
Ignasi Barrera eb7193e3a5 Revert "Apache jclouds 2.0.0 release"
This reverts commit 43c102065eab2d5fbf98e75811d9088cb7cf76bc.
2016-11-09 21:49:17 +01:00
Ignasi Barrera 5459d61f2e Apache jclouds 2.0.0 release 2016-11-03 13:13:04 +01:00
Andrea Turli 8649c3ff79 [aws-ec2] Add CRUD for VPC 2016-10-31 14:56:15 +01:00
Ignasi Barrera a600a1221d Do not leave open streams when loading test mock files 2016-10-26 15:57:28 +02:00
Ignasi Barrera 06b69ffed4 Fix AWS EC2 compute live tests 2016-10-25 15:19:50 +02:00
Andrew Gaul 3c9f66b8e9 Avoid lower-case l literal suffix
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
2016-10-23 14:24:35 -07:00
Andrew Gaul 89787b4c97 Avoid lower-case l literal suffix
Readers can confuse this with 1.  Found via error-prone.  Fixed via:

find -name \*.java | xargs sed -i 's/\( [0-9][0-9]*\)l/\1L/g'
find -name \*.java | xargs sed -i 's/\(([0-9][0-9]*\)l/\1L/g'
2016-10-23 14:15:09 -07:00
Andrew Gaul 8117574c83 Avoid C-style array declarations
Found via error-prone.
2016-10-23 13:51:59 -07:00
Andrew Gaul 25baad6d32 Address confusing operator precedence
Found via error-prone.
2016-10-23 06:39:46 -07:00
Andrew Gaul 2a04a52d56 Remove unused imports
Found via error-prone.
2016-10-23 06:39:46 -07:00
Ignasi Barrera 8030e53f32 Move digital ocean rate limit handler to core to make it reusable 2016-10-19 16:56:51 +02:00
Andrew Gaul bc97afc0c1 JCLOUDS-1182: Added Seoul and Mumbai regions to AWS
This commit addresses test failures in
AWSS3ServiceIntegrationLiveTest#testGetAssignableLocations.
2016-10-18 21:06:15 -07:00
Shri Javadekar 7826d22d30 JCLOUDS-1161: Make AWSS3BlobRequestSignerV4 the default signer.
Added new live tests and fixed some unit tests accordingly.
2016-10-18 20:06:34 -07:00
Andrea Turli 2c6caa04bf reduce payload for GET VirtualGuests 2016-10-14 10:45:57 +02:00
Ignasi Barrera b06795ebe4 JCLOUDS-1182: Added Seoul and Mumbai regions to AWS 2016-10-13 18:14:20 +02:00
Ignasi Barrera 3b726b5686 Fix DigitalOcean2 live tests 2016-10-13 15:06:50 +02:00
Andrew Gaul 50e6d44433 JCLOUDS-945: fix local blobstore marker handling
Previously using prefix markers would not correctly find the next key.
Add test for this behavior.
2016-10-12 22:22:28 -07:00
Stuart Hendren 26c060a0e8 JCLOUDS-1185 Allow rangeIPv4 to be null
The default network of recently created projects have a null value for rangeIPv4
And all regions as subnets, which do have values for the rangeIPv4.

Fixes JCLOUDS-1158
2016-10-07 14:12:08 +02:00
Andrew Gaul 11c636b6b3 JCLOUDS-945: ignore marker prefix test on GCS 2016-10-04 23:03:03 -07:00
Ignasi Barrera 8e0e781df0 GCE live test fixes 2016-09-26 13:25:46 +02:00
Ignasi Barrera d98348d503 Better predicate signature for node operations 2016-09-23 10:22:23 +02:00
Andrew Gaul 080bcce224 Address Checkstyle violations
Regression from 76995a363d.
2016-09-17 14:27:03 -07:00
Andrew Gaul 76995a363d Do not fail AWS S3 signer tests with expiry
Regression from 41bdd9c5a9.
References #1008.
2016-09-17 12:13:28 -07:00
Andrew Gaul 7cde28a4d2 JCLOUDS-1074: Guava 20 compatibility
* dynamically call TypeToken.isSupertypeOf with Guava 19 and later and
  TypeToken.isAssignableFrom with Guava 18 and earlier
* consume or ignore values from methods with CheckReturnValue
* replace usage of removed Iterators.emptyIterator
2016-09-06 21:49:20 -07:00
Zack Shoylev 05c05e3de2 Allows users to download large files efficiently and directly to disk. 2016-09-02 14:05:26 -05:00
Iván Lomba 557a115694 JCLOUDS-482: Fix ProfitBricksComputeServiceLiveTest custom hardware assert 2016-08-16 23:12:42 +02:00
Iván Lomba aac9b5fd5d JCLOUDS-482: Add support for ProfitBricks 2016-08-16 02:44:13 +02:00
Iván Lomba 79e95c5a4c JCLOUDS-482: Add support for arbitrary CPU and RAM
This is a combination of 16 commits:

* First approach to ArbitraryCpuRamTemplateBuilderImpl
* Several fixes: refactoring some names, format, identation problems, some missing license headers and generateId method
* Refactored parse utility
* Added GoogleComputeEngineArbitraryCpuRamTemplateBuilderImpl to support GCE custom machine URI
* extracted hardware creation to automaticHardwareForCpuAndRam method
* Fixed ide automatic asterisk imports
* correcting WIP base case PR according to comments
* added machineTypeUriToHardware to set custom hardware in nodes
* fix checkstyle violations and other PR comments
* Set the providerId to custom machineType URI and fix adding node log
* Arbitrary hardware tests added to BaseTemplateBuilderLiveTest and GoogleComputeEngineTemplateBuilderLiveTest
* Added two more tests to BaseTemplateBuilderLiveTest
* Move repeated constants to TestUtils to reuse code
* Fix full path in the Hardware id and URI
* Add custom hardware tests to BaseComputeServiceLiveTest and GCEServiceLiveTest
* Change customHardware test to use buildTemplate and fix identation
2016-08-16 02:44:04 +02:00
Ignasi Barrera 1e4d0beae2 JCLOUDS-1145: Fix DigitalOceanImageExtension and live tests 2016-08-16 00:18:05 +02:00
Andrea Turli 93028b7529 GCE: fix tags order 2016-08-02 20:12:45 +02:00
Andrea Turli deeedd55e8 add support for security groups 2016-08-02 16:46:04 +02:00
Andrea Turli a515ce2f22 Change line endings on files recursively 2016-07-14 00:02:13 +02:00
Andrew Gaul 2b0743d579 JCLOUDS-1005: Backblaze B2 portable abstraction 2016-06-24 17:14:36 -07:00
Andrew Gaul a2e2ff8e4f JCLOUDS-1005: Percent encode user metadata values 2016-06-23 20:41:28 -07:00
Andrew Gaul de04c69141 Consistently name test container names
Previously jclouds allocated the initial container pool as
$USERNAME-blobstore-1, 2, etc. and subsequent containers with
$USERNAME-blobstore-$RANDOM.  Use only the former instead.
2016-06-22 22:50:22 -07:00
Andrew Gaul 2ff68fc79e JCLOUDS-1005: Retry on 500 and 503 errors
This requires rewriting the URL for b2_upload_file and b2_upload_part
requests.
2016-06-21 18:12:36 -07:00
Ignasi Barrera bde70457d0 JCLOUDS-1105: Do not create the default security group if custom groups are specified 2016-06-17 22:18:35 +02:00
Ignasi Barrera 179ed3b2f6 Properly set the permissions in the ~/.ssh folder
When writing the ~/.ssh/authorized_keys file in a script that is being
run as sudo, the file is created with the root owner, instead of the
user defined by the node credentials. File ownership should be enforced
to make sure the right owner is alwaays set.
2016-06-17 22:16:19 +02:00
Andrew Gaul f66e0a3fcc JCLOUDS-1005: Do not map "none" SHA1 to null
Callers expect that ETag has a non-null value.
2016-06-17 13:11:41 -07:00
Andrew Gaul 3d84d3cb2d JCLOUDS-1005: Backblaze B2 large file operations 2016-06-16 16:12:32 -07:00
Andrew Gaul 882a65bab7 JCLOUDS-1005: Factor out common test code 2016-06-16 16:12:32 -07:00
Andrew Gaul 230448a454 JCLOUDS-1028: Configure idempotent methods
Enable for GCS.
2016-06-15 16:38:53 -07:00
Andrew Gaul 5fec2346a6 JCLOUDS-1028: Configure idempotent methods
Enable POST for Atmos, S3, and Swift.
2016-06-15 16:35:22 -07:00
Valentin Aitken f98116ec83 GCE ResetWindowsPassword
- Function which tells to GCE to reset Windows password

- InstanceApiLiveTest for windows

- Unit test for decrypting windows password

- fixed compile errors
2016-06-15 12:31:48 +02:00
Andrew Gaul 5baa49d9b8 JCLOUDS-1125: GCS list multipart uploads
Not supported.
2016-06-13 17:11:39 -07:00
Andrew Gaul 0bd2959410 JCLOUDS-1125: portable list multipart uploads
Only Azure, B2, and S3 support this operation.  Some MultipartUpload
fields become nullable.
2016-06-13 16:26:43 -07:00
Andrew Gaul 61ab28cc50 JCLOUDS-1125: Azure list other blobs
Some BlobProperties fields become nullable due to these new blob types.
2016-06-13 16:26:43 -07:00
Andrew Gaul bd6a495a04 JCLOUDS-1005: Backblaze B2 object operations 2016-06-09 16:15:11 -07:00
Zack Shoylev c1ce819f61 updateTemporaryUrlKey test 2016-06-07 17:37:39 -05:00
Zack Shoylev de88a72e7a Change the template to use CentOS instead. Avoids some openjdk-6 problems. 2016-06-07 17:37:33 -05:00
Andrew Gaul 4393c47e7f JCLOUDS-1005: Remove unused Credentials 2016-06-05 12:26:47 -07:00
Andrew Gaul ae1f6d0c3f JCLOUDS-866: Reduce GCS multipart limit to 32 2016-06-04 00:23:40 -07:00
Andrew Gaul ed262f7bd6 Delete GCS composite object components
Previously we left dangling subobjects.  The composite object retains
a reference to the components data.
2016-06-04 00:23:22 -07:00
Andrew Gaul c2a22bc32c JCLOUDS-912: GCS upload InputStream work around 2016-06-03 12:38:43 -07:00
Andrew Gaul 5d437312bf JCLOUDS-912: Remove GCS simpleUpload UploadBinder
This is not necessary; jclouds binds the Payload automatically;
jclouds binds the Payload automatically.
2016-06-02 22:35:54 -07:00
Andrew Gaul 2b02db4f22 Add ObjectTemplate.toString 2016-06-02 16:24:13 -07:00
Andrew Gaul a67ae3f27b Make inner classes static where possible
Found via error-prone.
2016-06-01 20:03:54 -07:00
Andrew Gaul 26d85068ca JCLOUDS-1005: Correct B2 package names
Addresses javadoc failures.
2016-06-01 15:18:16 -07:00
Andrew Gaul bd3bbc4532 JCLOUDS-1005: Backblaze B2 skeleton and bucket ops 2016-05-28 13:08:23 -07:00
Sergey Torgashov ccd1ef2b4d JCLOUDS-1114: Adding support for "Placement.Tenancy" and "Placement.HostId" AWS EC2 parameters 2016-05-20 00:07:47 +02:00