10824 Commits

Author SHA1 Message Date
Andrew Gaul
222fb84f5c Add test for aborting a single part MPU
Also tighten up checks to ensure there is no litter, mostly for
transient and filesystem blobstores.
2019-02-06 17:13:05 -08:00
Andrew Gaul
d14276d9a5 Upgrade to modernizer-maven-plugin 1.8.0
Notably this adds support for inline suppressions.  Release notes:

https://github.com/gaul/modernizer-maven-plugin/releases
2019-02-03 13:09:12 -08:00
Andrew Gaul
e15077ea78 Revert "Disable Javadoc lint"
This reverts commit 338f052579e3326fd25d71fd2493e08df460d808.
2019-02-02 11:00:40 -08:00
Andrew Gaul
338f052579 Disable Javadoc lint
mvn site running on Java 8 complains about thousands of missing
@return tags among other things.
2019-02-02 10:10:24 -08:00
Andrew Gaul
91b0498b01 Remove JavaScript from footer
Addresses an error while building Javadoc.
2019-02-01 23:19:01 -08:00
Andrew Gaul
fd7bacbfd3 Correct some Checkstyle violations
Follow-on to 13f32b28c90f4dda7ea21c95380d8c0879ba91fe.
2019-02-01 08:57:57 -08:00
Andrew Gaul
13f32b28c9 Lazily open InputStream during complete MPU
Previously the filesystem provider could exhaust file descriptors by
eagerly opening up to 10,000 parts.  This partially undoes
JCLOUDS-1367.
2019-01-29 21:54:47 -08:00
Andrew Gaul
29eec441e9 JCLOUDS-1371: JCLOUDS-1488: list optimize prefix
Previously getBlobKeysInsideContainer returned all keys and filtered
in LocalBlobStore.  Now getBlobKeysInsideContainer filters via prefix
which can dramatically decrease the number of keys returned,
especially for the filesystem provider.  Further optimizations are
possible for delimiter.
2019-01-29 17:39:51 -08:00
Jean-Baptiste Onofré
3135aca109 Update scm to gitbox 2019-01-06 07:54:38 +01:00
Andrew Gaul
2393c7920b JCLOUDS-1366: JCLOUDS-1472: Fix InputStream MPU
Previously jclouds attempted to slice non-repeatable InputStream
Payloads in order to upload sequentially.  This never worked due to
mutating the single stream via skip and close.  Also backfill test
which spuriously succeeded.
2019-01-04 15:42:17 -08:00
Joe Meiring
a36c9dcef0 Fix for FileSystem blob store clearContainer with options 2019-01-04 14:17:00 -08:00
Andrew Gaul
f9cebd59f8 Add error handling for missing xattr
Previously this prevented listing inside a directory when using file
systems like HFS and NFS.  References gaul/s3proxy#279.
2019-01-04 11:41:32 -08:00
duc
70f0635ac2 JCLOUDS-1479: populate container cache on create 2019-01-02 19:29:31 -08:00
Andrew Gaul
7e2723c9a4 JCLOUDS-1452: Add missing b2 test field
Fixes regression from 9524383e49c9d202d5cc81979337855dc056f41e.
2019-01-01 11:10:59 -08:00
Andrew Gaul
9524383e49 JCLOUDS-1452: Add new v2 fields
Some of these only give consistency with similar requests.
2018-12-31 19:39:37 -08:00
Andrew Gaul
a0f496e5ec JCLOUDS-1452: Remove Authorization.minimumPartSize
Superseded by absoluteMinimumPartSize and recommendedPartSize.
2018-12-31 18:47:38 -08:00
Andrew Gaul
750809f97f JCLOUDS-1452: Replace size with contentLength
Tracking B2 v2 API changes.
2018-12-31 18:47:38 -08:00
Andrew Gaul
ce163f3498 JCLOUDS-1452: Switch to B2 v2 API
Some cleanups but no major changes:

https://www.backblaze.com/blog/backblaze-b2-api-version-2-beta-is-now-open/
2018-12-31 18:47:38 -08:00
Dani Estevez
d621edd79f [JCLOUDS-1474] Adds SKU field to both LB and PublicIP
Changes order in parameters to keep properties as last parameter
Removes wrong @Nullable parameters

Moves LoadBalancer and PublicAddress to new package with SKU as inner
class

Moves LoadBalancerSKU inside LoadBalancer. Creates new loadbalancer package

Refactors PublicAddress domain objects

Extracts SKU from LoadBalancer

LoadBalancer SKU as inner class

PublicIPAddress SKU as inner class

Reorder parameters sku and properties
2018-12-28 16:55:35 -05:00
Simone Locci
2d9bb93427 Fix azure listNodes 2018-12-28 16:16:37 -05:00
Andrew Gaul
33d3266205 Enable B2 testCopy* tests
Backblaze has changed something such that these now pass.
2018-12-19 10:16:20 -08:00
Andrew Gaul
4cc4e1d76c Correct B2 SkipException for testPutObjectStream 2018-12-19 03:22:52 -08:00
Andrew Gaul
a6cb6cde29 JCLOUDS-1477: Upload single part for small B2 MPU
B2 requires two parts to use multi-part upload but jclouds will
attempt to use one with small uploads.  Instead it should fall back to
single-part when the content length is small.
2018-12-18 22:42:01 -08:00
John McDonnell
25f2bcd8c9 [JCLOUDS-1468] Adding missing options for the ListUsageRecords API call. 2018-12-05 19:46:24 +01:00
kraza
5916059be9 JCLOUDS-1467
Added support for c5d & m5d AWS nodes.

JCLOUDS-1467
Updated the SSD drive information.
2018-12-03 17:22:46 -05:00
Dani Estevez
8e827d595e Adds method listAvailableSizes to VirtualMachineApi
Updates API version for VirtualMachineApi
2018-11-20 12:30:14 -05:00
Andrew Gaul
b7d59e3fe9 Correct precondition
Follow on to 1ae735bb7d8fa4d512e744f79582477efdfd7f26.
2018-11-14 14:53:05 -08:00
Andrew Gaul
1ae735bb7d Do not allow options in filesystem clearContainer
This requires some additional logic to clean up empty directories.
Test regression from 22ce5484a412bc06ef62995675c07e7a85f66bdf.
2018-11-14 14:42:30 -08:00
Timur Alperovich
896e99df09 Filesystem: Fix the MPU ETags to match S3.
Prior commit introduced a bug in the computation of the MPU ETag value,
where it was concatenating strings, rather than operating on the bytes
of the integer value.
2018-11-02 12:25:17 -07:00
Joe Meiring
22ce5484a4 Removed unneeded check for prefix in clearContainer 2018-11-02 12:19:01 -07:00
filecatalyst
bbb41b4590 JCLOUDS-1464: Update Google Cloud Storage regions
Added missing regions.  For reference:
https://cloud.google.com/storage/docs/bucket-locations
2018-10-30 11:18:08 -07:00
Timur Alperovich
539a9854c1 JCLOUDS-1450: Use S3-style ETags for MPUs.
S3 uses a different ETag for multipart uploads (MPUs) than regular
objects. The ETag consists of the md5 hash of the concatenated ETags of
individual parts followed by the number of parts (separated by "-").

The patch changes the LocalBlobStore's implementation of
CompleteMultipartUpload to set the S3-style ETag before calling
putBlob() and return that ETag to the caller.

To simplify testing, a new protected method with a default NOOP
implementation is added to the BaseBlobIntegrationTest. It allows
providers to further verify MPUs (i.e. ensuring the correct ETag has
been stored alongside the object).
2018-10-24 13:25:00 -07:00
Trent Schmidt
219e2958d7 JCLOUDS-1460: Adding instances to AWS 2018-10-24 14:42:46 -04:00
Ignasi Barrera
9dd50b39c9 JCLOUDS-1463: Do not return MachineTypes from zones that are not available for deploy 2018-10-24 09:20:22 +02:00
Ignasi Barrera
767240f360 JCLOUDS-1462: Upgrade Apache Http driver to 4.3.6
In response to https://nvd.nist.gov/vuln/detail/CVE-2015-5262
2018-10-18 16:50:18 -04:00
Oliver Gondža
8b17dfea87 Make NovaErrorHandler logging of sensitive information configurable 2018-10-18 11:32:04 +02:00
Mahmoud Ismail
f7b83f4563 Mark sourceImage as Nullable 2018-10-18 11:27:58 +02:00
Andrew Gaul
cc65957997 Error-prone 2.3.2 fixes 2018-10-12 23:28:00 -07:00
smedavaram75
17cf6fec9e JCLOUDS-1419: Add missing REGIONAL storage class 2018-09-13 13:28:19 -07:00
David Currie
7ebf12bf38 JCLOUDS-1447: URL encode x-amz-copy-source
The x-amz-copy-source header on S3 CopyObject should be URL encoded (as
a path). This is not universally true of all headers though (for example
the = in x-amz-copy-source-range) therefore introducing a new parameter
on @Headers to indicate whether URL encoding should take place.
2018-09-12 08:01:43 -07:00
David Currie
5803de0f8e Correct failing testUseBucketWithUpperCaseName
As of March 1 2018, bucket names must be DNS compliant in all regions
therefore removing failing test of legacy names in US regions.
2018-09-12 08:01:43 -07:00
Dani Estevez
a07ab5a982 JCLOUDS-1441: Enables support for ARM regions in China
Adds new china regions

Fixes pattern matching for China provider oauth string

Modifies test for oauth string

overrides jclouds.oauth.resource property for tests

Graph and Vault API Endpoints need to be configurable

jclouds.oauth.resource is not mandatory

Adapted Endpoints for APIs GraphRBAC and Vault

Adds unit test for china oauth endpoint check

Minor fix to regular expression
2018-09-06 10:42:47 -04:00
Markus Alexander Kuppe
88f44a6d8e JCLOUDS-1339: Support launching an x1 EC2 instance
https://issues.apache.org/jira/browse/JCLOUDS-1339
2018-08-23 20:25:05 +02:00
Mathieu Tortuyaux
bcc6a26488 JCLOUDS-1443: fix(rest/processor): check if / is ending a default endpoint 2018-08-23 20:24:38 +02:00
Vikas Rangarajan
cf67233765 JCLOUDS-1436: Add support for aws ec2 m5 instance types
fix: remove duplicate imports
2018-08-01 17:28:09 -04:00
Vikas Rangarajan
982c6bea02 JCLOUDS-1387: Add support for c5 instance types in AWS ec2 2018-08-01 16:53:06 -04:00
Dani Estevez
92076d6b79 Adds method checkIpAvailability to VirtualNetworkApi
Addresses @nacx comments

Fixed formatter maximum line width. Removed redundantTest
2018-07-13 07:10:28 -07:00
Dani Estevez
e45c262ff2 Adds missing virtualMachine field to NetworkInterfaceCardProperties 2018-07-12 09:24:00 -07:00
Dani Estevez
566ac23392 Adds listAll to PublicIPAddressAPI
Adds listAll to NetworkInterfaceCardApi

Addresses comments on tests

Sets resourcegroup pathparam as nullable for NetworkInterfaceCardApi and PublicIPAddressApi
2018-07-12 09:23:27 -07:00
Ignasi Barrera
4958f1f29a Adds ConcurrentModificationException to the list of propagatable types 2018-07-11 09:43:04 -07:00