Commit Graph

296 Commits

Author SHA1 Message Date
Adrian Cole 5f43dbb6fa updated tests to include containercount parameter 2011-04-08 15:03:14 -07:00
Adrian Cole 25eb1581ea added parallel file upload test to blobstore 2011-04-07 12:26:47 -07:00
David Santiago a9f99f1b4e Update put-blob to new multipart API and add test.
How to do multipart on a put changed after the previous commit.
2011-04-06 02:53:19 -05:00
David Santiago 27189fba21 Add multipart? option to put-blob. 2011-04-06 00:29:22 -05:00
David Santiago aa89a53b86 Merge remote branch 'upstream/master' 2011-04-06 00:26:42 -05:00
David Santiago ee339e109b Update create-container to take more options.
* location is now optional, given through the :location keyword.
* public-read? option, can be set to true to create a publically readable
  container.
2011-04-05 18:57:28 -05:00
Adrian Cole 2bfc84beeb Issue 430: PutOptions.multipart() 2011-04-05 12:26:16 -07:00
David Santiago 793740b9be Merge remote branch 'upstream/master' 2011-04-05 02:48:48 -05:00
David Santiago ed90e29d68 Further refinements to blobstore2 in response to feedback on Github and IRC.
* Removed redundant functions, made others delegate to others instead
  of calling right into Java.
* Fixed typos, removed unused dependency references.
* Better naming for key functions: list-container -> blobs, list-blobs ->
  container-seq.
* Made blob fn no longer require a blobstore argument.
* Better comments, updated tests.
2011-04-05 02:42:45 -05:00
Adrian Cole b9f0cbcb89 crypto tuning 2011-04-04 23:37:00 -07:00
David Santiago 3011ffad23 Merge remote branch 'upstream/master' 2011-04-05 01:34:25 -05:00
Adrian Cole d69d31a5d2 expose constructor for blobbuilderimpl 2011-04-04 22:35:22 -07:00
David Santiago 1239e1a7c9 Merge remote branch 'upstream/master'
Conflicts:
	blobstore/src/test/clojure/org/jclouds/blobstore_test.clj
2011-04-04 19:04:46 -05:00
David Santiago 33150c40a2 Reduce the number of blobs to test in large-container-list-test. 2011-04-04 19:02:24 -05:00
Adrian Cole ab8a7e452c tuning so that we can reliably test multiple page lists in clj 2011-04-04 17:00:28 -07:00
David Santiago c85a7f7693 Merge remote branch 'upstream/master'
Conflicts:
	blobstore/src/test/clojure/org/jclouds/blobstore_test.clj
2011-04-04 17:27:15 -05:00
David Santiago 3d7033ad3d New Clojure blobstore API in blobstore2.clj
Updates to API include more regular function arguments, fewer compound
functions, and fewer arities of dubious quality. Tests also ported.
2011-04-04 17:23:56 -05:00
Adrian Cole c0a261334b added large container list test in clj 2011-04-04 14:37:46 -07:00
David Santiago 57f0dcaf15 Add another arity to list-blobs so that it can be called without the blobstore argument. Also add some basic tests for list-blobs-test. 2011-04-04 15:54:35 -05:00
Adrian Cole 53c735fdff enforced blobs must have uri, container, and can have publicAccess 2011-04-03 18:15:09 -07:00
Adrian Cole fc8bb96363 Merge branch 'master' of https://github.com/davidsantiago/jclouds
* 'master' of https://github.com/davidsantiago/jclouds:
  Additional refinements to blobstore.clj updates.
  Updates to improve blobstore.clj.
2011-04-02 00:34:14 -07:00
Adrian Cole e4b85db4b5 added md5 test 2011-04-02 00:30:57 -07:00
Adrian Cole a3a9bc3948 fixed usage statement 2011-04-02 00:30:49 -07:00
David Santiago 3459df3653 Additional refinements to blobstore.clj updates.
* Added an option to conditionally call calculateMD5() in blob2.
* Fixed a bug in md5-blob (which predated these changes).
* Added a direct test for blob2 and calculateMD5.
2011-04-02 02:26:45 -05:00
David Santiago 85d0474068 Merge remote branch 'upstream/master' 2011-04-02 02:26:15 -05:00
Adrian Cole 82d84b1ca1 added getoptions to blob request signer 2011-04-01 21:38:53 -07:00
David Santiago 2c74c70b1f Updates to improve blobstore.clj.
* New function blob2 exposes many more options for creating blobs.
* Updated functions that use blob to use blob2.
* New functions sign-get, sign-put, and sign-delete replace the
  functionality of sign-blob-request.
* Added tests.
* Deprecation metadata added to blob and sign-blob-request.
2011-04-01 23:32:07 -05:00
Adrian Cole 54ea98ba49 fixed typo in blob builder 2011-04-01 14:43:08 -07:00
Adrian Cole ddbd6fc1d8 allow usermetadata to be null 2011-04-01 13:52:43 -07:00
Adrian Cole 5ddf9aabca added forSigning to blobBuilder 2011-04-01 11:38:10 -07:00
Adrian Cole c352895ae2 Merge branch 'fix-list-blobs' of https://github.com/joodie/jclouds
* 'fix-list-blobs' of https://github.com/joodie/jclouds:
  make prefix optional for blobstore/list-blobs
  make blobstore/list-blobs actually lazy
2011-03-31 10:03:52 -07:00
Adrian Cole 15d8aecdac Issue 488:add support for ninefold storage 2011-03-29 14:03:21 -07:00
Adrian Cole 5fd7e559f4 fixed so that you can pass properties into blobstore 2011-03-29 13:05:24 -07:00
Joost Diepenmaat 23e988ef5a make prefix optional for blobstore/list-blobs 2011-03-15 15:49:00 +01:00
Joost Diepenmaat 5983eb0402 make blobstore/list-blobs actually lazy 2011-03-15 15:34:54 +01:00
Adrian Cole f5fa2d983b added toString to common functions so that they are easier to see when debugging 2011-03-14 01:39:59 -07:00
Adrian Cole 9bdd97340b Issue 506:support hosteurope blobstore; break out scality-rs2 2011-03-12 12:14:11 -08:00
Adrian Cole e5af84ef0e Issue 486: moved netty to a driver and created a base payload slicer 2011-03-07 09:54:25 +01:00
Tibor Kiss ed27cbc7c0 AWS S3 sequential Multipart Upload strategy 2011-03-07 09:54:25 +01:00
Adrian Cole 897dc000d5 made blobmetadata parser name accessible for testing 2011-02-26 21:48:51 -08:00
Adrian Cole f38c8d5e56 Issue 475: removed builtin providers for ec2, s3, cloudservers, cloudfiles, and vcloudexpress 2011-02-15 17:51:40 +01:00
Adrian Cole 20c23e7962 Issue 462: corrected semantics of BlobMap when using inDirectory and added BlobBuilder 2011-02-13 22:32:31 +01:00
Adrian Cole 30ed6fd848 promote scaleup-storage 2011-01-31 10:20:17 -08:00
Adrian Cole c93186ef9d S3 acls are not portable, so let's not make them enums 2011-01-31 10:05:23 -08:00
Adrian Cole 675563c96a Issue 418: updated location object to include metadata and iso3166codes 2011-01-31 01:00:20 -08:00
Adrian Cole b62a6309be workaround to walrus not having NextMarker in bucket listing 2011-01-30 02:32:00 -08:00
Adrian Cole 142aec45cb walrus: workaroud date parse issue, more intelligently deduce containernotfoundexception when s3 is in 'path' mode, and adjust base test classes 2011-01-28 10:41:40 -08:00
Adrian Cole 094ed5c25c fixed integration test classes and demoted scaleup-storage to sandbox 2011-01-26 23:52:26 -08:00
Adrian Cole 02fffda058 fixed date parser when there's a wrong date format specified 2011-01-26 19:23:22 -08:00
Adrian Cole 1df15209ec fixed built-in http client 2011-01-25 10:23:58 -08:00
Adrian Cole a5211f523e switched to use eucalyptus partnercloud as community cloud hasn't enough resources to complete testing 2011-01-24 08:12:14 -08:00
Adrian Cole e00b465c78 Issue 440, 429: decoupled openstack swift from cloudfiles 2011-01-09 11:49:59 -08:00
Adrian Cole 3ca278723d Issue 440: added cloudservers and cloudfiles us and uk providers 2011-01-08 15:59:48 -08:00
Adrian Cole 2e436741bd Issue 440: split Eucalyptus Community Cloud (ecc-s3) into a provider, and moved walrus to be an api 2011-01-05 11:27:17 +01:00
Adrian Cole 90c5c40fbd moved provider agnostic location code to core 2011-01-02 12:58:35 +01:00
Adrian Cole 60b6b68556 code cleanup: http request immutability (except payload), builders, test backfill 2010-12-30 23:40:23 +01:00
Adrian Cole 9ff54e5956 worked around case problem in scaleup-storage 2010-11-30 16:06:06 +00:00
Adrian Cole 53ac4751f5 Issue 414: fixed length problem on string payload by eagerly encoding to UTF-8 2010-11-30 11:46:25 +00:00
Adrian Cole f4870b547c bad method mapping for count-blobs 2010-11-25 15:18:16 +01:00
Adrian Cole 9f51726239 Issue 413: removed use of guice internal @Nullable annotations 2010-11-24 10:43:54 +01:00
Adrian Cole 0c690f686f Issue 396: added peer1-storage provider 2010-11-06 09:44:05 +01:00
Adrian Cole fb93e81301 refactored to create typed contextspec objects 2010-10-24 22:59:01 -05:00
Adrian Cole 49b88183d2 refactored compute provider implementation 2010-10-17 18:17:24 -07:00
Adrian Cole a9de959146 Issue 377: refactored value classes and tests so that we could test and implement credential storage 2010-10-16 22:24:22 -07:00
Adrian Cole 0f0710e2f9 beta-7 regressions 2010-09-19 21:30:07 -07:00
Adrian Cole 1981b15837 regressions for beta-7 2010-09-19 19:12:44 -07:00
Adrian Cole 53f4bec356 Issue 361: normalize test properties 2010-09-19 13:30:11 -07:00
Hugo Duncan af094f6ffe Added sign-blob-request overload for default get request 2010-09-19 11:15:22 -04:00
Hugo Duncan b7307add04 added new header methods to sign-blob-request, and enabled sign-blob-request-test 2010-09-19 10:28:10 -04:00
Adrian Cole 226179869a Issue 353: updated and tested through s3, azureblob, cloudfiles, and synaptic 2010-09-19 03:37:41 -07:00
Adrian Cole 3639af0f12 Issue 353: refactored payload/blob so that contentMetadata is a type. 2010-09-19 02:15:03 -07:00
Adrian Cole ac9a642cd3 Issue 353: added disposition, encoding, language to blob and transient blobstore 2010-09-18 19:38:14 -07:00
Rainbowbreeze 4c2ff1ea63 Added futher implementation for content disposition 2010-09-17 18:05:13 +02:00
Adrian Cole 15c878c1bf updated pom and examples to include filesystem provider 2010-09-14 10:04:05 -07:00
Adrian Cole 0e5823afad Issue 352: added transient blob signing 2010-09-13 22:41:19 -07:00
Hugo Duncan 8088bdc1a1 Comment failing (new) tests 2010-09-13 23:43:04 -04:00
Hugo Duncan 754a511ec2 Added sign-blob-request method, and some tests (broken) 2010-09-13 23:30:13 -04:00
Adrian Cole f068a06354 Issue 352: refactored request signing 2010-09-13 18:24:16 -07:00
Adrian Cole 198eeec3d9 added volume to hardware object, added signed blob support, added example of how to use signed blobs with computeservice 2010-09-12 02:27:42 -07:00
Adrian Cole 462a6e5617 Issue 335: took initialization code out of injection providers and into memoized suppliers, this will allow us to tune caching and speed up injection as guice is single-threaded; fixed broken windows along the way 2010-08-17 02:08:39 -07:00
Adrian Cole 4b76982261 Issue 191: added in-memory chef-client; use provider: transientchef 2010-08-12 18:53:51 -07:00
Adrian Cole 420503d32e updated and corrected license headers 2010-08-12 16:04:26 -07:00
Adrian Cole 60908bfb6e Issue 191: added databag support 2010-08-11 18:34:50 -07:00
Adrian Cole 7a593a1630 added WriteTo interface for streaming puts 2010-08-11 02:13:28 -07:00
Adrian Cole 25bc2c0691 added get-blob-stream helper and corresponding test 2010-08-10 10:37:17 -07:00
Adrian Cole 6f180ddb4e Issu 301: refactored utilities that depend on guava. introduced Crypto, CryptoStreams, and more Payloads to help deal with encrypted payloads and headers 2010-08-01 02:07:53 -07:00
Adrian Cole a9a0c53fb2 Issue 191: added RSA PEM parsing to encryptionUtils 2010-07-30 23:58:31 -07:00
Adrian Cole 34518f54ba Issue 325: massive refactor in order to stop serializing native async http client requests 2010-07-30 01:26:55 -07:00
Adrian Cole ca247efaed Issue 324: added properties for (jclouds|provider).modules, (jclouds|provider).credential.resource, and (jclouds|provider).credential.file in order to support rewiring jclouds http and other components via properties files, and extract out where credentials are obtained from 2010-07-28 00:41:13 -07:00
Adrian Cole 7c3518f7ff Issue 191: changed encryption service so that it can decode a PEM key. updated chef to work in google appengine 2010-07-22 15:35:03 -07:00
Adrian Cole 887bb7adfe Issue 316: refactored ssh to use Payload object; deprecated non-payload methods 2010-07-19 13:08:12 -07:00
Adrian Cole 1d0949dec5 Issue 315: added auto-deserialization of json into java objects and new @Unwrap annotation; Issue 311: fixed template parsing for new cluster instance in ec2; Issue 191: started adding node support to chef 2010-07-17 01:30:37 -05:00
Phil Hagelberg 328679799b Missed a layer of nesting. 2010-07-13 17:18:21 -07:00
Phil Hagelberg 3db58174bd Fix formatting of generateMD5BufferingIfNotRepeatable call. 2010-07-13 17:00:49 -07:00
Phil Hagelberg 2ad5df1d3c Use blobstore argument in md5-blob instead of dynamically-bound var. 2010-07-13 17:00:49 -07:00
Adrian Cole 41e3ec6709 Issue 27: got eucalyptus and walrus working, after refactoring error handling 2010-07-11 01:26:56 -07:00
Adrian Cole e8d0a11cda Issue 301: refactored http payload and rewrote crufty tests 2010-07-09 21:13:11 -07:00
Adrian Cole 31d2da3c6f Issue 301: removed encryption service dependency from blob and added helper methods to blobstore.clj 2010-07-08 10:42:18 -07:00
Adrian Cole da3baf523c Issue 301: refactored http payload data from blob -> core, added content length, type, md5; fixed length bug in ec2 and added more tests to ensure this doesn't happen again 2010-07-08 03:46:34 -07:00
Adrian Cole 204c093753 refactored encryption service and exposed sha256 routine 2010-07-06 18:21:11 -07:00
Adrian Cole 8703c4a7a4 Issue 199: ning examples 2010-07-06 14:37:40 -07:00
Adrian Cole e90857d7a4 added toString hashCode and equals to context objects 2010-07-06 13:32:13 -07:00
Adrian Cole 85b5bd48f1 loosened dependency on the GeneratedHttpRequest class 2010-07-02 16:47:46 -07:00
Adrian Cole 9bac52d315 Issue 298: fixed regression on authorizationexception not propagating, and also missing gogrid file 2010-07-02 12:05:41 -07:00
Adrian Cole 714a459796 Issue 297: exposed utilities like encryption, logging, date, threads, and ssh to context objects 2010-06-29 15:45:59 -07:00
Adrian Cole 7e28286dd0 Issue 293: normalized on provider vocab 2010-06-28 12:03:35 -07:00
Adrian Cole caceae90bd Issue 293: normalized on identity/credential vocab 2010-06-28 11:33:41 -07:00
Adrian Cole 27f4f69b4c Issue 293: refactored code to provide for api versions and coherent properties for authorization 2010-06-28 05:07:36 -07:00
Adrian Cole 055c56dc08 Issue 292: added simple http client 2010-06-25 10:45:15 -07:00
Adrian Cole b2141b0d59 Issue 271 updated to support google storage and eucalyptus 2010-06-15 17:05:55 -04:00
Adrian Cole 518b453c6d Issue 271 updated to support google storage 2010-06-15 17:04:01 -04:00
Adrian Cole cba3f660fb Issue 27: added 'walrus' blobstore and 'eucalyptus' compute providers 2010-06-15 15:22:32 -04:00
Adrian Cole f25100fe9b Issue 191: corrected multipart form and added cookbook signing to chef client 2010-06-12 17:17:42 -07:00
Adrian Cole 306bb0ebde Issue 191: started cookbook support; refactored multipart form code 2010-06-11 19:02:19 -07:00
Phil Hagelberg d2c6a6f17e blobstore/download-blob should .writeTo instead of c.c.io/copy. 2010-06-10 11:27:02 -07:00
Adrian Cole ab5e8b3ab4 added new annotation @PartParam for multipart form support 2010-06-09 17:00:18 -07:00
Adrian Cole 84ad021268 added retry handler for io exceptions, created modular rest client, swapped generic type args on restcontext 2010-06-06 23:01:48 -07:00
Phil Hagelberg 438ee7abe2 Don't need to qualify blobstore/list-containers. 2010-05-26 15:39:55 -10:00
Phil Hagelberg e64fd52a60 Add list-blobs function to create a lazy-seq of blobs.
list-container is still available as a low-level call, but list-blobs
should be preferred going forward since it doesn't need to be manually
paginated.
2010-05-26 15:22:13 -10:00
Adrian Cole 0684dc2344 Issue 264: fixed blob stuff in rackspace 2010-05-24 12:29:39 -07:00
Adrian Cole d45dfff1ec fixed regression 2010-05-24 00:44:54 -07:00
Adrian Cole 7c4307ba56 Issue 262: name of the blob didn't parse correctly; fixed 2010-05-24 00:13:17 -07:00
Adrian Cole a4bdd433f4 Issue 260: fixed i/o threadpool to min=max; refactored session expiry logic. Issue 258 refactored load balancer code 2010-05-23 15:39:49 -07:00
Adrian Cole efc47969d9 Issue 254: distinguish between id and providerId 2010-05-20 19:36:25 -07:00
Adrian Cole 239519c8ca added exceptions to ssh commands and changed interface to not index on id, since ids are not guaranteed unique 2010-05-04 15:01:01 -07:00
Adrian Cole a1c7ccfd3f Issue 241:Add provider to the Location hierarchy and make getParent a Location object; also fixed compute services where broken and added ssh logging for runscript 2010-05-03 01:04:48 -07:00
Adrian Cole 021e5e18e0 Issue 203 normalized location across blobstore and compute 2010-04-25 17:38:21 -07:00
Adrian Cole 10af8cdae8 Issues 203 234 235, add visibility to image from nodemetadata, update to stable version of guava, harden tests, normalize location 2010-04-25 00:46:54 -07:00
Alex Yarmula 25c7345177 Added options to (node) function in compute.clj, currently a single option to show/fetch details.
Extended the doc in blobstore.clj.
2010-04-19 15:20:08 -07:00
Chas Emerick 82f6b1c777 refactor out clojure-contrib :require and :use declarations to provide clojure 1.1/1.2 compatibility 2010-04-16 11:20:04 -04:00
Adrian Cole dedd8f8270 fixed templateBuilder logger and also fixed copyright headers 2010-04-13 23:40:56 -07:00
Adrian Cole 45384de903 Issue 202: with-details option for blobstore list 2010-04-06 19:33:26 -07:00
Adrian Cole 9837bfd3ba fixed vfs snapshot repo and added test 2010-04-05 15:57:19 -07:00
Adrian Cole 6ea95932ff fixed deleteallkeysinlist which forgot to check the status of the futures 2010-03-29 10:43:16 -07:00
Phil Hagelberg a5454fe040 Update clojure blobstore tests to reflect new argument order. 2010-03-26 10:31:14 -07:00
Phil Hagelberg f17352c70f Handle container-name arg correctly in list-container. 2010-03-26 10:30:55 -07:00
phil a87560113e Remove magic ListOptionsContainer macros in favour of explicit fn mapping. 2010-03-26 01:09:21 +00:00
phil 91f09690b6 Rename create-blob to upload-blob. 2010-03-26 01:07:13 +00:00
phil 94b6efe802 Reorder arguments so optional args are always last. 2010-03-26 00:32:13 +00:00
Hugo Duncan 53bac3fa65 Fixed bug in extension module option parsing 2010-03-24 17:33:01 -04:00
Adrian Cole 574af762f6 added md5OutputStream to encryptionService and refactored blobstore.clj to use it 2010-03-21 21:04:10 -07:00
Adrian Cole 614cbb24c6 Issue 207: increased ferocity of tests to do concurrent 5MB downloads w/checksum on both http and blobstore level. 2010-03-21 16:48:16 -07:00
Phil Hagelberg 0d0b4e849f Factor out service args into a fixture so other modules can reuse tests. 2010-03-19 15:41:14 -07:00
Phil Hagelberg 7a4b513191 Add a test to blobstore_test.clj to detect for corrupt downloads. 2010-03-19 12:59:46 -07:00
Jim c0d8e90e72 Added retry to download-blob if MD5 checksums don't match. 2010-03-17 14:05:35 -07:00
Adrian Cole 7def9eee7c missing file 2010-03-15 15:32:40 -07:00
Adrian Cole 3be3966f45 fixed bad naming convention on constant 2010-03-15 10:42:46 -07:00
Adrian Cole dc512e8bae Issue 202: withDetails support for BlobStore.list(String,ListContainerOptions) 2010-03-14 23:34:47 -07:00
Phil Hagelberg dba85d84dd Automatically generate MD5 of payload in create-blob function. 2010-03-12 14:11:08 -08:00
Phil Hagelberg 769ba19157 Correct the argument order of create-container. 2010-03-11 17:17:18 -08:00