The Java Multi-Cloud Toolkit
Go to file
Shri Javadekar 655aa444d7 JCLOUDS-510 Delete objects in a container efficiently.
The existing approach for deleting objects in a container suffers
from a head-of-line blocking problem. This commit implements a better
scheme which does not have that problem. This scheme uses a counting
semaphore for making sure that a certain number of futures are
issued in parallel. As each of these futures is completed, one
permit of the semaphore is released.

Added unit tests for testing this new scheme.
2014-03-26 13:48:28 -07:00
all Adds cloud databases to jclouds-all 2014-01-03 11:46:06 -06:00
allblobstore Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00
allcompute Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00
allloadbalancer Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00
apis Remove Nova instance metadata limit 2014-03-21 19:03:07 -05:00
blobstore JCLOUDS-510 Delete objects in a container efficiently. 2014-03-26 13:48:28 -07:00
common JCLOUDS-342: Retry on HTTP 408 for swift 2014-03-03 16:47:58 -08:00
compute Prefer ByteSource over deprecated InputSupplier 2014-02-18 22:35:10 -08:00
core JCLOUDS-510 Delete objects in a container efficiently. 2014-03-26 13:48:28 -07:00
drivers Remove WriteTo 2014-02-21 17:13:31 -08:00
loadbalancer Replace calls to Closeables.closeQuietly 2013-12-21 12:30:59 -08:00
project Removing unused Sonatype OSS plugin snapshot repository 2014-02-12 00:10:33 -05:00
providers Prefer ByteSource over deprecated InputSupplier 2014-02-18 22:35:10 -08:00
resources Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00
scriptbuilder Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00
skeletons Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00
.dir-locals.el JCLOUDS-26. Adding .dir-locals.el for Emacs tab-width setting 2013-05-10 14:52:52 -07:00
.gitignore added support for vbox 4.2.6; 2012-12-31 01:33:43 +01:00
.mailmap .mailmap updates 2013-10-08 22:14:07 -07:00
README.md Updating the features section to match the website 2014-03-13 14:27:21 +01:00
pom.xml Updating to 1.8.0-SNAPSHOT 2013-12-17 11:31:56 -08:00

README.md

jclouds

jclouds allows provisioning and control of cloud resources, including blobstore and compute, from Java and Clojure. Our API allows developers to use both portable abstractions and cloud-specific features. We test support of dozens of cloud providers and cloud software stacks, including Amazon, Azure, GoGrid, Ninefold, OpenStack, and vCloud. jclouds is licensed under the Apache License, Version 2.0

Features

Even if you don't need the portable apis we provide, or could roll it your own, programming against cloud environments can be challenging. We focus on the following areas so that you can focus on using the cloud, rather than troubleshooting it!

  • SIMPLE INTERFACE Get started without dealing with REST-like APIs or WebServices. Instead of creating new object types, jclouds reuses concepts like maps so that the programming model is familiar.

  • RUNTIME PORTABILITY jclouds drivers enable you to operate in restricted environments like Google App Engine. There are very few required dependencies, so jclouds is unlikely to clash with your app.

  • DEAL WITH WEB COMPLEXITY jclouds handles issues such as transient failures and redirects that traditional network based computing introduces.

  • UNIT TESTABILITY Write your unit tests without mocking complexity or the brittleness of remote connections. Writing tests for cloud endpoints is difficult. jclouds provides you with Stub connections that simulate a cloud without creating network connections.

  • PERFORMANCE Customize configuration to match your performance needs. jclouds provides you with asynchronous commands, tunable http, date, and encryption modules.

  • LOCATION jclouds provides location-aware abstractions. For example, you can get ISO-3166 codes to tell which country or province a cloud runs in.

  • QUALITY Every provider is tested with live scenarios before each release. If the provider doesn't pass, it goes back into the sandbox.

BlobStore

Simplifies dealing with key-value providers such as Amazon S3. For example, BlobStore can give you a simple Map view of a container.

BlobStore Example (Java):

// init
context = new BlobStoreContextFactory().createContext(
"aws-s3",
accesskeyid,
secretaccesskey);
blobStore = context.getBlobStore();

// create container
blobStore.createContainerInLocation(null, "mycontainer");

// add blob
blob = blobStore.blobBuilder("test").payload("testdata").build();
blobStore.putBlob("mycontainer", blob);

BlobStore Example (Clojure):

(use 'org.jclouds.blobstore2)
(def ^:dynamic *blobstore* (blobstore "azureblob" account encodedkey))
(create-container *blobstore* "mycontainer")
(put-blob *blobstore* "mycontainer" (blob "test" :payload "testdata"))

ComputeService

Simplifies the task of managing machines in the cloud. For example, you can use ComputeService to start 5 machines and install your software on them.

Compute Example (Java):

// init
context = new ComputeServiceContextFactory().createContext(
"aws-ec2",
accesskeyid,
secretaccesskey,
ImmutableSet.of(new Log4JLoggingModule(), new SshjSshClientModule()));

client = context.getComputeService();

// define the requirements of your node
template = client.templateBuilder().osFamily(UBUNTU).smallest().build();

// setup a boot user which is the same as your login
template.getOptions().runScript(AdminAccess.standard());

// these nodes will be accessible via ssh when the call returns
nodes = client.createNodesInGroup("mycluster", 2, template);

// you can now run ad-hoc commands on the nodes based on predicates
responses = client.runScriptOnNodesMatching(inGroup("mycluster"), "uptime", wrapInInitScript(false));

Compute Example (Clojure):

(use 'org.jclouds.compute2)

; create a compute service using sshj and log4j extensions
(def compute (*compute* "trmk`-ecloud" "user" "password" :sshj :log4j))

; launch a couple nodes with the default operating system, installing your user.
(create-nodes *compute* "mycluster" 2
(TemplateOptions$Builder/runScript (AdminAccess/standard)))

; run a command on that group 
(run-script-on-nodes-matching *compute* (in-group? "mycluster") "uptime" 
(RunScriptOptions$Builder/wrapInInitScript false))

Check out https://github.com/jclouds/jclouds-examples for more examples!

Downloads

Resources

License

Copyright (C) 2009-2013 The Apache Software Foundation

Licensed under the Apache License, Version 2.0