Commit Graph

8965 Commits

Author SHA1 Message Date
Andrew Gaul 49d7d9d3b7 Reorder list option handling for local blobstores
We should apply the prefix first, recursive second, marker third, and
max keys last.  Also add some fixes to pass delimiter tests.
2015-01-22 11:37:46 -08:00
Andrew Gaul c770ffbeb0 Use sorted set to order relative paths correctly 2015-01-22 11:37:46 -08:00
Andrew Gaul da3e7463fd Add more tests for delimiter, prefixes, and marker
s3-tests uncovered interactions between these options which existing
tests do not exercise.
2015-01-22 11:37:46 -08:00
Zack Shoylev 46f4a4e454 More robust line-ending detection for Bundles 2015-01-22 12:45:54 -06:00
Zack Shoylev f5523c9412 Fixes the exponential backoff for small delay values 2015-01-21 16:50:01 -06:00
Jeremy Daggett c902fbf906 Add CDN service type for OpenStack Poppy 2015-01-21 11:20:37 -08:00
Everett Toews 7375ca4619 Normalize deprecation messages to make them easier to find 2015-01-21 11:00:43 -06:00
Ka-Hing Cheung 3cabb196ce fix usermetadata check on OS X
Java on OS X does not support extended attributes, which the
filesystem blobstore uses to implement user metadata. This disable
the relevant test on OS X
2015-01-20 17:33:22 -08:00
Jeremy Daggett 24f9af7c68 Update AutoValue to version 1.0 2015-01-16 17:44:50 -08:00
Andrew Gaul 0512fc6e35 Add @Nullable attribute to BlobStore methods
blobMetadata and getBlob return null when a blob does not exist and
callers should check for this.
2015-01-16 15:06:16 -08:00
Jeremy Daggett ade72d44ef Add Rackspace CDN service type 2015-01-16 10:24:37 -08:00
Andrew Gaul 9542fa5d31 Do not check object counts in multi-part tests
Some providers, e.g., GCS and Swift, create multi-part blobs with a
manifest pointing to other blobs.  Thus a container will have
additional objects in its listing.
2015-01-16 05:45:27 -08:00
Andrew Gaul 8c5391505d JCLOUDS-805: Allow overriding addContentMetadata
For symmetry with checkContentMetadata.
2015-01-16 05:12:00 -08:00
Andrew Gaul e170f1e632 JCLOUDS-654: Add size to Swift StorageMetadata
This allows callers to read the content length during container
listing.  Follow-on to fae097e144.
2015-01-15 17:46:24 -08:00
Jeremy Daggett e09b6158ad Update okhttp to version 2.2.0 2015-01-14 13:04:58 -08:00
Ignasi Barrera 8f9acd1cad Custom Chef version in the Omnibus installer 2015-01-14 11:33:12 +01:00
Ka-Hing Cheung 5edd5de38c make xattr work in docker volume
when you bind a host volume into docker, java does not correctly
detect that and checks the xattr support on the root fs instead
of the host fs. The root fs often does not support xattr, so
the check would fail even if the target really does support xattr.

the fix is just try setting the xattrs anyway, and let them fail
if there really isn't xattrs support
2015-01-13 18:08:55 -08:00
Andrew Gaul 0fad16e07f Enable testListContainerMarker for Atmos
Confirmed that this passes against Atmos Online.
2015-01-12 19:42:35 -08:00
Andrew Gaul 58612bc473 Expand pagination test and enable for Atmos
Tested against atmos, aws-s3, azureblob, filesystem,
google-cloud-storage, rackspace-cloudfiles-us, and transient.
2015-01-12 17:43:42 -08:00
Ka-Hing Cheung 5cc3b243fc disable directory blob tests in OS X
On OS X, java doesn't support xattrs, which is required by
directory blobs. Disable those tests on OS X
2015-01-12 12:32:41 -08:00
Andrew Gaul 2ef84dae85 Upgrade to modernizer-maven-plugin
Release notes:

https://github.com/andrewgaul/modernizer-maven-plugin/releases
2015-01-11 21:07:15 -08:00
Andrew Gaul fae097e144 JCLOUDS-654: Add object size to StorageMetadata
This allows callers to read the content length during container
listing.  Tested against: atmosonline, aws-s3, azureblob, filesystem,
and transient.  Intentionally not implemented for legacy swift
provider.
2015-01-09 22:34:56 -08:00
Andrew Gaul e183d9e651 Add ByteSourcePayloadIterator to BasePayloadSlicer
ByteSourcePayloadIterator avoids buffering the entire slice like
InputStreamPayloadIterator does.  Also rename PayloadIterator to
better reflect its intent and reduce its visibility.
2015-01-09 22:19:24 -08:00
Andrew Gaul 2c32cfee3b Add test for UpdateContainerOptions.anybodyRead 2015-01-09 22:18:19 -08:00
Andrew Gaul 694558db0c Fix testListContainerWithZeroMaxResults on Swift 2015-01-09 22:12:49 -08:00
Andrew Gaul e8f925225c Bind Swift content metadata in multipart upload 2015-01-09 21:59:25 -08:00
Andrew Gaul 317089c77e Remove tests duplicated by testPut 2015-01-09 21:59:25 -08:00
Andrew Gaul 91c47bfd92 JCLOUDS-801: Add portable multipart upload tests
Exercise both repeatable and non-repeatable payloads.  Tested against
AWS-S3, Azure, and legacy Swift.  Skipped on all other providers.
2015-01-09 21:59:25 -08:00
Andrew Gaul 38ebf0d06c JCLOUDS-801: Use Iterable payload slicer for AWS-S3
Payload slicer has a method that returns an iterable of payloads that
works on non-repeatable InputStreams that was introduced to fix
multi-part uploads in Swift (JCLOUDS-356). This commit applies the
same method to fix multi-part uploads for AWS-S3 blob store.
2015-01-09 21:59:25 -08:00
Andrew Gaul 57a1f0e986 Bind Azure content metadata in multipart upload 2015-01-09 21:59:25 -08:00
Andrew Gaul fdec63fe47 Use LinkedHashSet for BoundedHashSet
This allows enumerating Azure containers in the same order as the
service provides.  This more closely matches PageSet and the Atmos
implementation of BoundedSet.
2015-01-09 17:51:23 -08:00
Ka-Hing Cheung b7ab8b18a0 support directory blobs
make the filesystem blob store distinguish between a/ and a. a/
must be a directory blob with no content and only metadata

on listing, only directories with md5 attribute is considered a
blob and returned
2015-01-09 16:28:16 -08:00
Andrew Gaul 77eaa2c1f9 Add container creation date to local blobstores 2015-01-09 14:10:33 -08:00
Andrew Gaul 35d6313e63 JCLOUDS-660: Implement AzureBlob set ACL
Reference:

http://msdn.microsoft.com/en-us/library/azure/dd179391.aspx
2015-01-09 14:05:05 -08:00
Jeremy Daggett d3c1e2eab4 Use AutoService to generate service loader metadata 2015-01-09 11:22:12 -08:00
Andrew Gaul d6d06b71f4 Handle listing with marker after the last key
Also handle zero maxResults.  Found with Ceph s3-tests and s3proxy.
2015-01-08 16:28:02 -08:00
Ka-Hing Cheung 692691bcdc fix fs container validator test
previoisly it was testing blob key validator instead of container
name validator
2015-01-07 11:36:47 -08:00
Ignasi Barrera 6b350fb6b7 JCLOUDS-792: Configure chef-client security attributes
This commit also improves some internal behavior related to the
bootstrap configuration generation, and deprecated some methods that
will be removed in upcoming versions.

* Removes all methods that return the bootstrap DataBag or the raw
  configuration json to return the BootstrapConfig object instead.
* Deprecates all methods that provide support for old Chef versions.
* Formats the Enterprise Chef provider according to the jclouds
  formatting guidelines.
* Deprecates the ChefContext view. That view is not an abstraction and
  only provides access to the ChefService. It can be obtained from the
  ChefApi itself.
2015-01-05 14:15:54 +01:00
Andrew Gaul 38ae98e409 Always build filesystem provider 2014-12-31 15:07:35 -08:00
Andrew Gaul d5fadb598e Implement read(byte[]) with read() for consistency
Previously multiple calls to read() returned different results than a
single call to read(byte[]).
2014-12-30 17:37:26 -08:00
Andrew Gaul 3ed8db7873 Activate jre1.7 profile all JDK >= 7 2014-12-28 21:25:32 -08:00
Andrew Gaul 1c781cc5fa JCLOUDS-391: Azure multipart putBlob user metadata 2014-12-22 15:58:49 -08:00
Nikolay Sokolov 787ce446cd Fixed Version in FormSignerV4 2014-12-12 00:18:05 +01:00
Andrew Gaul 1663e0911e JCLOUDS-671: test putBlob with large multi-part InputStream 2014-12-06 13:52:27 -08:00
Eric Jutrzenka 66c4963b49 JCLOUDS-671: Use Iterable payload slicer for Azure
Payload slicer has a method that returns an iterable of payloads that
works on non-repeatable InputStreams that was introduced to fix
multi-part uploads in Swift (JCLOUDS-356). This commit applies the
same method to fix multi-part uploads for Azure blob store.
2014-12-06 13:52:27 -08:00
William Chu 06653f1dd2 JCLOUDS-788 Added support for specifying a custom node name when generating the chef bootstrap node script 2014-12-04 23:47:20 +01:00
Jeremy Daggett a2a410d05a Upgrade assertj-core to 1.7.0 and assertj-guava to 1.3.0 2014-12-03 09:45:45 -08:00
Ignasi Barrera 958d09ecbd JCLOUDS-753: Make ConnectionSpec configurable in the OkHttp driver 2014-12-02 18:17:17 +01:00
Adrian Cole c635b3006d JCLOUDS-523 fix typo in implementation. 2014-11-28 15:39:42 -08:00
Ignasi Barrera 902f1b4105 JCLOUDS-744: Upgrade to OkHttp 2.1.0 and use its native API 2014-11-27 18:44:08 +01:00