Commit Graph

320 Commits

Author SHA1 Message Date
Adrian Cole e4b85db4b5 added md5 test 2011-04-02 00:30:57 -07:00
Adrian Cole a3a9bc3948 fixed usage statement 2011-04-02 00:30:49 -07:00
David Santiago 3459df3653 Additional refinements to blobstore.clj updates.
* Added an option to conditionally call calculateMD5() in blob2.
* Fixed a bug in md5-blob (which predated these changes).
* Added a direct test for blob2 and calculateMD5.
2011-04-02 02:26:45 -05:00
David Santiago 85d0474068 Merge remote branch 'upstream/master' 2011-04-02 02:26:15 -05:00
Adrian Cole 82d84b1ca1 added getoptions to blob request signer 2011-04-01 21:38:53 -07:00
David Santiago 2c74c70b1f Updates to improve blobstore.clj.
* New function blob2 exposes many more options for creating blobs.
* Updated functions that use blob to use blob2.
* New functions sign-get, sign-put, and sign-delete replace the
  functionality of sign-blob-request.
* Added tests.
* Deprecation metadata added to blob and sign-blob-request.
2011-04-01 23:32:07 -05:00
Adrian Cole 54ea98ba49 fixed typo in blob builder 2011-04-01 14:43:08 -07:00
Adrian Cole ddbd6fc1d8 allow usermetadata to be null 2011-04-01 13:52:43 -07:00
Adrian Cole 5ddf9aabca added forSigning to blobBuilder 2011-04-01 11:38:10 -07:00
Adrian Cole c352895ae2 Merge branch 'fix-list-blobs' of https://github.com/joodie/jclouds
* 'fix-list-blobs' of https://github.com/joodie/jclouds:
  make prefix optional for blobstore/list-blobs
  make blobstore/list-blobs actually lazy
2011-03-31 10:03:52 -07:00
Adrian Cole 15d8aecdac Issue 488:add support for ninefold storage 2011-03-29 14:03:21 -07:00
Adrian Cole 5fd7e559f4 fixed so that you can pass properties into blobstore 2011-03-29 13:05:24 -07:00
Joost Diepenmaat 23e988ef5a make prefix optional for blobstore/list-blobs 2011-03-15 15:49:00 +01:00
Joost Diepenmaat 5983eb0402 make blobstore/list-blobs actually lazy 2011-03-15 15:34:54 +01:00
Adrian Cole f5fa2d983b added toString to common functions so that they are easier to see when debugging 2011-03-14 01:39:59 -07:00
Adrian Cole 9bdd97340b Issue 506:support hosteurope blobstore; break out scality-rs2 2011-03-12 12:14:11 -08:00
Adrian Cole e5af84ef0e Issue 486: moved netty to a driver and created a base payload slicer 2011-03-07 09:54:25 +01:00
Tibor Kiss ed27cbc7c0 AWS S3 sequential Multipart Upload strategy 2011-03-07 09:54:25 +01:00
Adrian Cole 897dc000d5 made blobmetadata parser name accessible for testing 2011-02-26 21:48:51 -08:00
Adrian Cole f38c8d5e56 Issue 475: removed builtin providers for ec2, s3, cloudservers, cloudfiles, and vcloudexpress 2011-02-15 17:51:40 +01:00
Adrian Cole 20c23e7962 Issue 462: corrected semantics of BlobMap when using inDirectory and added BlobBuilder 2011-02-13 22:32:31 +01:00
Adrian Cole 30ed6fd848 promote scaleup-storage 2011-01-31 10:20:17 -08:00
Adrian Cole c93186ef9d S3 acls are not portable, so let's not make them enums 2011-01-31 10:05:23 -08:00
Adrian Cole 675563c96a Issue 418: updated location object to include metadata and iso3166codes 2011-01-31 01:00:20 -08:00
Adrian Cole b62a6309be workaround to walrus not having NextMarker in bucket listing 2011-01-30 02:32:00 -08:00
Adrian Cole 142aec45cb walrus: workaroud date parse issue, more intelligently deduce containernotfoundexception when s3 is in 'path' mode, and adjust base test classes 2011-01-28 10:41:40 -08:00
Adrian Cole 094ed5c25c fixed integration test classes and demoted scaleup-storage to sandbox 2011-01-26 23:52:26 -08:00
Adrian Cole 02fffda058 fixed date parser when there's a wrong date format specified 2011-01-26 19:23:22 -08:00
Adrian Cole 1df15209ec fixed built-in http client 2011-01-25 10:23:58 -08:00
Adrian Cole a5211f523e switched to use eucalyptus partnercloud as community cloud hasn't enough resources to complete testing 2011-01-24 08:12:14 -08:00
Adrian Cole e00b465c78 Issue 440, 429: decoupled openstack swift from cloudfiles 2011-01-09 11:49:59 -08:00
Adrian Cole 3ca278723d Issue 440: added cloudservers and cloudfiles us and uk providers 2011-01-08 15:59:48 -08:00
Adrian Cole 2e436741bd Issue 440: split Eucalyptus Community Cloud (ecc-s3) into a provider, and moved walrus to be an api 2011-01-05 11:27:17 +01:00
Adrian Cole 90c5c40fbd moved provider agnostic location code to core 2011-01-02 12:58:35 +01:00
Adrian Cole 60b6b68556 code cleanup: http request immutability (except payload), builders, test backfill 2010-12-30 23:40:23 +01:00
Adrian Cole 9ff54e5956 worked around case problem in scaleup-storage 2010-11-30 16:06:06 +00:00
Adrian Cole 53ac4751f5 Issue 414: fixed length problem on string payload by eagerly encoding to UTF-8 2010-11-30 11:46:25 +00:00
Adrian Cole f4870b547c bad method mapping for count-blobs 2010-11-25 15:18:16 +01:00
Adrian Cole 9f51726239 Issue 413: removed use of guice internal @Nullable annotations 2010-11-24 10:43:54 +01:00
Adrian Cole 0c690f686f Issue 396: added peer1-storage provider 2010-11-06 09:44:05 +01:00
Adrian Cole fb93e81301 refactored to create typed contextspec objects 2010-10-24 22:59:01 -05:00
Adrian Cole 49b88183d2 refactored compute provider implementation 2010-10-17 18:17:24 -07:00
Adrian Cole a9de959146 Issue 377: refactored value classes and tests so that we could test and implement credential storage 2010-10-16 22:24:22 -07:00
Adrian Cole 0f0710e2f9 beta-7 regressions 2010-09-19 21:30:07 -07:00
Adrian Cole 1981b15837 regressions for beta-7 2010-09-19 19:12:44 -07:00
Adrian Cole 53f4bec356 Issue 361: normalize test properties 2010-09-19 13:30:11 -07:00
Hugo Duncan af094f6ffe Added sign-blob-request overload for default get request 2010-09-19 11:15:22 -04:00
Hugo Duncan b7307add04 added new header methods to sign-blob-request, and enabled sign-blob-request-test 2010-09-19 10:28:10 -04:00
Adrian Cole 226179869a Issue 353: updated and tested through s3, azureblob, cloudfiles, and synaptic 2010-09-19 03:37:41 -07:00
Adrian Cole 3639af0f12 Issue 353: refactored payload/blob so that contentMetadata is a type. 2010-09-19 02:15:03 -07:00
Adrian Cole ac9a642cd3 Issue 353: added disposition, encoding, language to blob and transient blobstore 2010-09-18 19:38:14 -07:00
Rainbowbreeze 4c2ff1ea63 Added futher implementation for content disposition 2010-09-17 18:05:13 +02:00
Adrian Cole 15c878c1bf updated pom and examples to include filesystem provider 2010-09-14 10:04:05 -07:00
Adrian Cole 0e5823afad Issue 352: added transient blob signing 2010-09-13 22:41:19 -07:00
Hugo Duncan 8088bdc1a1 Comment failing (new) tests 2010-09-13 23:43:04 -04:00
Hugo Duncan 754a511ec2 Added sign-blob-request method, and some tests (broken) 2010-09-13 23:30:13 -04:00
Adrian Cole f068a06354 Issue 352: refactored request signing 2010-09-13 18:24:16 -07:00
Adrian Cole 198eeec3d9 added volume to hardware object, added signed blob support, added example of how to use signed blobs with computeservice 2010-09-12 02:27:42 -07:00
Adrian Cole 462a6e5617 Issue 335: took initialization code out of injection providers and into memoized suppliers, this will allow us to tune caching and speed up injection as guice is single-threaded; fixed broken windows along the way 2010-08-17 02:08:39 -07:00
Adrian Cole 4b76982261 Issue 191: added in-memory chef-client; use provider: transientchef 2010-08-12 18:53:51 -07:00
Adrian Cole 420503d32e updated and corrected license headers 2010-08-12 16:04:26 -07:00
Adrian Cole 60908bfb6e Issue 191: added databag support 2010-08-11 18:34:50 -07:00
Adrian Cole 7a593a1630 added WriteTo interface for streaming puts 2010-08-11 02:13:28 -07:00
Adrian Cole 25bc2c0691 added get-blob-stream helper and corresponding test 2010-08-10 10:37:17 -07:00
Adrian Cole 6f180ddb4e Issu 301: refactored utilities that depend on guava. introduced Crypto, CryptoStreams, and more Payloads to help deal with encrypted payloads and headers 2010-08-01 02:07:53 -07:00
Adrian Cole a9a0c53fb2 Issue 191: added RSA PEM parsing to encryptionUtils 2010-07-30 23:58:31 -07:00
Adrian Cole 34518f54ba Issue 325: massive refactor in order to stop serializing native async http client requests 2010-07-30 01:26:55 -07:00
Andrew Phillips e1f5369243 Removed 1,000,000 redundant .gitignores (they're inherited) 2010-07-28 14:38:28 +02:00
Adrian Cole ca247efaed Issue 324: added properties for (jclouds|provider).modules, (jclouds|provider).credential.resource, and (jclouds|provider).credential.file in order to support rewiring jclouds http and other components via properties files, and extract out where credentials are obtained from 2010-07-28 00:41:13 -07:00
Adrian Cole 7c3518f7ff Issue 191: changed encryption service so that it can decode a PEM key. updated chef to work in google appengine 2010-07-22 15:35:03 -07:00
Adrian Cole 887bb7adfe Issue 316: refactored ssh to use Payload object; deprecated non-payload methods 2010-07-19 13:08:12 -07:00
Adrian Cole 1d0949dec5 Issue 315: added auto-deserialization of json into java objects and new @Unwrap annotation; Issue 311: fixed template parsing for new cluster instance in ec2; Issue 191: started adding node support to chef 2010-07-17 01:30:37 -05:00
Phil Hagelberg 328679799b Missed a layer of nesting. 2010-07-13 17:18:21 -07:00
Phil Hagelberg 3db58174bd Fix formatting of generateMD5BufferingIfNotRepeatable call. 2010-07-13 17:00:49 -07:00
Phil Hagelberg 2ad5df1d3c Use blobstore argument in md5-blob instead of dynamically-bound var. 2010-07-13 17:00:49 -07:00
Adrian Cole 41e3ec6709 Issue 27: got eucalyptus and walrus working, after refactoring error handling 2010-07-11 01:26:56 -07:00
Adrian Cole e8d0a11cda Issue 301: refactored http payload and rewrote crufty tests 2010-07-09 21:13:11 -07:00
Adrian Cole 31d2da3c6f Issue 301: removed encryption service dependency from blob and added helper methods to blobstore.clj 2010-07-08 10:42:18 -07:00
Adrian Cole da3baf523c Issue 301: refactored http payload data from blob -> core, added content length, type, md5; fixed length bug in ec2 and added more tests to ensure this doesn't happen again 2010-07-08 03:46:34 -07:00
Adrian Cole 204c093753 refactored encryption service and exposed sha256 routine 2010-07-06 18:21:11 -07:00
Adrian Cole 8703c4a7a4 Issue 199: ning examples 2010-07-06 14:37:40 -07:00
Adrian Cole e90857d7a4 added toString hashCode and equals to context objects 2010-07-06 13:32:13 -07:00
Adrian Cole 85b5bd48f1 loosened dependency on the GeneratedHttpRequest class 2010-07-02 16:47:46 -07:00
Adrian Cole 9bac52d315 Issue 298: fixed regression on authorizationexception not propagating, and also missing gogrid file 2010-07-02 12:05:41 -07:00
Adrian Cole 714a459796 Issue 297: exposed utilities like encryption, logging, date, threads, and ssh to context objects 2010-06-29 15:45:59 -07:00
Adrian Cole 7e28286dd0 Issue 293: normalized on provider vocab 2010-06-28 12:03:35 -07:00
Adrian Cole caceae90bd Issue 293: normalized on identity/credential vocab 2010-06-28 11:33:41 -07:00
Adrian Cole 27f4f69b4c Issue 293: refactored code to provide for api versions and coherent properties for authorization 2010-06-28 05:07:36 -07:00
Adrian Cole 055c56dc08 Issue 292: added simple http client 2010-06-25 10:45:15 -07:00
Adrian Cole b2141b0d59 Issue 271 updated to support google storage and eucalyptus 2010-06-15 17:05:55 -04:00
Adrian Cole 518b453c6d Issue 271 updated to support google storage 2010-06-15 17:04:01 -04:00
Adrian Cole cba3f660fb Issue 27: added 'walrus' blobstore and 'eucalyptus' compute providers 2010-06-15 15:22:32 -04:00
Adrian Cole f25100fe9b Issue 191: corrected multipart form and added cookbook signing to chef client 2010-06-12 17:17:42 -07:00
Adrian Cole 306bb0ebde Issue 191: started cookbook support; refactored multipart form code 2010-06-11 19:02:19 -07:00
Phil Hagelberg d2c6a6f17e blobstore/download-blob should .writeTo instead of c.c.io/copy. 2010-06-10 11:27:02 -07:00
Adrian Cole ab5e8b3ab4 added new annotation @PartParam for multipart form support 2010-06-09 17:00:18 -07:00
Adrian Cole 84ad021268 added retry handler for io exceptions, created modular rest client, swapped generic type args on restcontext 2010-06-06 23:01:48 -07:00
Phil Hagelberg 438ee7abe2 Don't need to qualify blobstore/list-containers. 2010-05-26 15:39:55 -10:00
Phil Hagelberg e64fd52a60 Add list-blobs function to create a lazy-seq of blobs.
list-container is still available as a low-level call, but list-blobs
should be preferred going forward since it doesn't need to be manually
paginated.
2010-05-26 15:22:13 -10:00
Adrian Cole 0684dc2344 Issue 264: fixed blob stuff in rackspace 2010-05-24 12:29:39 -07:00
Adrian Cole d45dfff1ec fixed regression 2010-05-24 00:44:54 -07:00
Adrian Cole 7c4307ba56 Issue 262: name of the blob didn't parse correctly; fixed 2010-05-24 00:13:17 -07:00
Adrian Cole a4bdd433f4 Issue 260: fixed i/o threadpool to min=max; refactored session expiry logic. Issue 258 refactored load balancer code 2010-05-23 15:39:49 -07:00
Adrian Cole efc47969d9 Issue 254: distinguish between id and providerId 2010-05-20 19:36:25 -07:00
Adrian Cole 239519c8ca added exceptions to ssh commands and changed interface to not index on id, since ids are not guaranteed unique 2010-05-04 15:01:01 -07:00
Adrian Cole a1c7ccfd3f Issue 241:Add provider to the Location hierarchy and make getParent a Location object; also fixed compute services where broken and added ssh logging for runscript 2010-05-03 01:04:48 -07:00
Adrian Cole 021e5e18e0 Issue 203 normalized location across blobstore and compute 2010-04-25 17:38:21 -07:00
Adrian Cole 10af8cdae8 Issues 203 234 235, add visibility to image from nodemetadata, update to stable version of guava, harden tests, normalize location 2010-04-25 00:46:54 -07:00
Alex Yarmula 25c7345177 Added options to (node) function in compute.clj, currently a single option to show/fetch details.
Extended the doc in blobstore.clj.
2010-04-19 15:20:08 -07:00
Chas Emerick 82f6b1c777 refactor out clojure-contrib :require and :use declarations to provide clojure 1.1/1.2 compatibility 2010-04-16 11:20:04 -04:00
Adrian Cole dedd8f8270 fixed templateBuilder logger and also fixed copyright headers 2010-04-13 23:40:56 -07:00
Adrian Cole 45384de903 Issue 202: with-details option for blobstore list 2010-04-06 19:33:26 -07:00
Adrian Cole 9837bfd3ba fixed vfs snapshot repo and added test 2010-04-05 15:57:19 -07:00
Adrian Cole 6ea95932ff fixed deleteallkeysinlist which forgot to check the status of the futures 2010-03-29 10:43:16 -07:00
Phil Hagelberg a5454fe040 Update clojure blobstore tests to reflect new argument order. 2010-03-26 10:31:14 -07:00
Phil Hagelberg f17352c70f Handle container-name arg correctly in list-container. 2010-03-26 10:30:55 -07:00
phil a87560113e Remove magic ListOptionsContainer macros in favour of explicit fn mapping. 2010-03-26 01:09:21 +00:00
phil 91f09690b6 Rename create-blob to upload-blob. 2010-03-26 01:07:13 +00:00
phil 94b6efe802 Reorder arguments so optional args are always last. 2010-03-26 00:32:13 +00:00
Hugo Duncan 53bac3fa65 Fixed bug in extension module option parsing 2010-03-24 17:33:01 -04:00
Hugo Duncan 88bf948eb6 changed clojure-maven-plugin to 1.3.2 and removed its configuration in blobstore/pom.xml 2010-03-24 12:26:55 -04:00
Adrian Cole 574af762f6 added md5OutputStream to encryptionService and refactored blobstore.clj to use it 2010-03-21 21:04:10 -07:00
Adrian Cole 614cbb24c6 Issue 207: increased ferocity of tests to do concurrent 5MB downloads w/checksum on both http and blobstore level. 2010-03-21 16:48:16 -07:00
Adrian Cole b70da07b27 Issue 212: now all modules can run clojure tests, and the test clj files will end up in the test jars 2010-03-20 16:39:11 -07:00
Phil Hagelberg 0d0b4e849f Factor out service args into a fixture so other modules can reuse tests. 2010-03-19 15:41:14 -07:00
Phil Hagelberg 7a4b513191 Add a test to blobstore_test.clj to detect for corrupt downloads. 2010-03-19 12:59:46 -07:00
Andrew Phillips 64b68d73db Housekeeping: renamed all .svnignore files to .gitignore, and some line endings. 2010-03-19 11:30:13 +01:00
Jim c0d8e90e72 Added retry to download-blob if MD5 checksums don't match. 2010-03-17 14:05:35 -07:00
Adrian Cole 7def9eee7c missing file 2010-03-15 15:32:40 -07:00
Adrian Cole 3be3966f45 fixed bad naming convention on constant 2010-03-15 10:42:46 -07:00
Adrian Cole dc512e8bae Issue 202: withDetails support for BlobStore.list(String,ListContainerOptions) 2010-03-14 23:34:47 -07:00
Phil Hagelberg dba85d84dd Automatically generate MD5 of payload in create-blob function. 2010-03-12 14:11:08 -08:00
Phil Hagelberg 769ba19157 Correct the argument order of create-container. 2010-03-11 17:17:18 -08:00
Phil Hagelberg 2a6580d342 Switch arg name back to dir from prefix; trim long lines.
(Too used to S3 where dirs are a figment of our imagination and
prefixes are what really matter.)
2010-03-11 17:07:14 -08:00
Phil Hagelberg 4f097cd21c First arity for clear-container just calls itself instead of second arity. 2010-03-11 14:51:40 -08:00
Phil Hagelberg 7310d04ae5 Use as-blobstore when listing blobs in clojure wrapper.
Seems to be more forgiving and consistent this way.
2010-03-11 11:21:55 -08:00
Phil Hagelberg 9ba88797a0 Fix File method of download-blob multimethod. 2010-03-09 17:01:24 -08:00
Jim 5311b05192 Run clojure blobstore tests inside with-blobstore. 2010-03-09 16:16:43 -06:00
Jim 1da7c5a6b6 Added higher-level download-blob function and tests for it. 2010-03-09 16:13:23 -06:00
Phil Hagelberg 659f4b9612 Remove a redundant function, rename a test, add test todo. 2010-03-09 10:42:05 -08:00
Hugo Duncan bdba469580 changed blobstore test to use factory for renamed transient provider 2010-03-09 12:32:01 -05:00
Adrian Cole e04784373e Issue 154: added Transient blobstore 2010-03-09 09:17:33 -08:00
Hugo Duncan cb0928afae major update to blobstore clojure binding. factored out core.clj 2010-03-09 11:11:19 -05:00
Adrian Cole b190651247 refactored configuration module so that Issue 201 could occur. linked context with objects created from it 2010-03-09 00:10:27 -08:00
Adrian Cole 09e797de0b Issue 189: atmos support for att is called synaptic 2010-03-06 21:00:06 -08:00
Hugo Duncan fd066e02c1 Added resources directory back as a resource 2010-03-06 12:11:11 -08:00
Adrian Cole 0bc94f517e corrected swank version 2010-03-04 15:35:41 -08:00
Hugo Duncan 88f992a53e Added clojure to tests and jar 2010-03-04 16:03:34 -05:00
Hugo Duncan 6ad07515c5 Removed static dependency on extension modules. Removed lein project.clj files. 2010-03-04 09:22:01 -05:00
Hugo Duncan 33a31c03ed import bindings from crane. Merge branch 'jclouds' of git://github.com/bradford/crane 2010-03-03 09:17:00 -05:00