SUSE Studio and Kiwi

SUSE Studio and Kiwi, the appliance creation tools from Novell, can be used to create customized OpenSUSE and SLES images that run on top of Eucalyptus:

http://en.opensuse.org/SDB:KIWI_Cookbook_Own_Cloud

The first section describes how to create Eucalyptus front-end and node appliance images, and the second part, 1.4, describes how to host OpenSUSE images on your Eucalyptus cloud.

boto

An integrated interface to current and future infrastructural services compatible with AWS.

Example Usage ¶

Setup boto ¶

Install boto, setup the environment, and so on.

As root,

python setup.py install 

Using ¶

Eucalyptus EC2 interface

region = RegionInfo(name="eucalyptus", endpoint="hostname")

connection = boto.connect_ec2(aws_access_key_id="access key",
                              aws_secret_access_key="secret",
                              is_secure=False,
                              region=region,
                              port=8773,
                              path="/services/Eucalyptus")

#Run commands

zones = connection.get_all_zones()

where, "hostname" is the name of the Eucalyptus front end.

For instance, if EC2_URL is set to http://192.168.9.1:8773/services/Eucalyptus,

hostname should be "192.168.9.1"

Eucalyptus S3 interface

calling_format=boto.s3.connection.OrdinaryCallingFormat()
connection = boto.s3.Connection(aws_access_key_id="access key",
                           aws_secret_access_key="secret",
                           is_secure=False,
                           host="hostname",
                           port=8773,
                           calling_format=calling_format,
                           path="/services/Walrus")

#Run commands

bucket_instance = connection.get_bucket(bucket)
keys = bucket.get_all_keys()
for k in keys:
    #do something

Interacting with Amazon EC2

Replace "hostname" in the above examples with "ec2.amazonaws.com" or "s3.amazonaws.com" and path with "/"

RightScale Platform and Eucalyptus

RightScale Inc. announced on November 4th, 2008 support for Eucalyptus-based cloud installations. As a public demonstration of this capability, the Eucalyptus Community Cloud (ECC) can be accessed via the Eucalyptus Edition of the RightScale Platform.

Limitations ¶

Just as the ECC itself, this demonstration is for evaluation purposes only and thus, the functionality in the Eucalyptus Edition is limited. Specifically, the use of this service is subject to the following restrictions and limitations:

• VM instances are time-limited to 6 hours (they will be terminated without any warning!);

• No more than 4 VM instances from one user are allowed at a time;

• VM instances are assigned public IP addresses, but only incoming network connections and inter-instance network connections are allowed (with the exception of outgoing connections to Debian mirrors - so apt-get will work). This means that you can log in to your VMs from outside, communicate between VM instances, but are not allowed to initiate any connections from a VM instance;

• Users are not allowed to upload custom disk images. Eucalyptus provides pre-packaged images for download here;

• Functionality of the Eucalyptus Edition Platform is limited to:
  • managing instances (start, stop, monitor),
  • managing SSH keys,
  • connecting to instances via an SSH terminal that were started with a key created via the Platform;

• The service offers no performance or reliability guarantees. Although we do not expect to terminate instances prematurely (before 6 hours elapse) or to lose account data, it may happen.

Signing up for the Eucalyptus Edition of RightScale ¶

1. To use the Eucalyptus Community Cloud through RightScale's Platform, one should first sign up for the Eucalyptus Public Cloud and obtain ECC credentials:
   • apply for an account here (your browser may warn you about a self-signed certificate, which you have to accept in order to use the service), and
   • wait for activation email message (which should take at most one business day but may happen within minutes) and log in using the link you received.

(See sections 1 and 2 of the Eucalyptus User's Guide for an illustration.)

2. Then, one should follow the sign-up procedure on the Eucalyptus Edition of RightScale's Platform:
   • click the sign-up link (your browser may warn you about a self-signed certificate, which you have to accept in order to use the service),
   • fill out the form on the first page (the required fields are: First and Last names, Email, the two Password fields, and the Terms and conditions checkbox),
   • enter the Eucalyptus Community Cloud credentials on page three (page two is automatically skipped): Username, Query ID, and Secret Key are all displayed on your ECC credentials page (be sure to copy them exactly, without an extra spaces before or after).

If all goes well, you should be logged into RightScale's Platform after completing the above steps. ECC instances can now be managed and accessed both using the RightScale Platform and other EC2-compatible tools.

Using the Eucalyptus Edition of RightScale ¶

There are two steps you may want to complete before attempting to start an instance:

1. To enable Shell access through the browser, at least one SSH key must be added through RightScale's Platform (any keys that you added to ECC using other tools will appear in the Platform and can be specified when starting instances, but you won' be able to open a shell to those instances directly via the Platform).

To add a key, go to Design > Eucalyptus > SSH Keys and click the yellow Add Key button in the top right corner. You can name it as you wish. Once the key is generated, if you want to use it from outside the Platform (say, to log into your instance using ssh in a terminal), you can, at any time, cut-and-paste the Private Key contents into a file.

2. At least one security group should be created before running instances: go to Design > Eucalyptus > Security Groups. (Otherwise, when you try to start an instance, the Platform will direct you to the Eucalyptus Security Groups page and say that A security group is required to launch an instance, please create one first.) Go ahead and create a security group, giving it some name, though the description is optional. Don't bother changing the Permissions in a created group as currently they are not fully supported.

To start an instance, go to Design > Eucalyptus > Images and click on the green play button next to any available image. The New Instance form will be pre-filled with adequate values, so the only thing you may want to change before pressing Launch is the Nickname of the instance. If the Platform responds with There are not enough nodes to fulfill this request in the zone., then, please, try again in a little bit.

To terminate an instance, click the red stop button next to the instance either in Home > Dashboard or in Manage > Servers > Active Servers.

Thanks for trying Eucalyptus and RightScale!

RightScale's right_aws

Example Usage ¶

Here we use irb to interactively use the right_aws gem to interact with Eucalyptus.

Setup right_aws ¶

Install right_aws, setup the environment, and start irb

 ~> sudo gem install right_aws
 ~> source ~/.euca2/eucarc
 ~> irb

Use right_aws ¶

Setup the ruby environment and use the right_aws library to interact with Eucalyptus.

irb(main):001:0> require 'rubygems'
=> true
irb(main):002:0> require 'right_aws'
=> true
irb(main):003:0> @euca = = RightAws::Ec2.new(ENV['EC2_ACCESS_KEY'],ENV['EC2_SECRET_KEY'])
irb(main):004:0> @euca.describe_images
I, [2009-07-13T11:54:55.883207 #9406]  INFO -- : Opening new HTTP connection to 192.168.7.7:8773
=> [{:aws_id=>"eki-3313191F", :aws_image_type=>"kernel", :aws_owner=>"admin", :aws_location=>"my-kernel/vmlinuz.manifest.xml", :aws_state=>"available", :aws_is_public=>true, :aws_architecture=>"x86_64"}, {:aws_id=>"eri-A3501A6C", :aws_image_type=>"ramdisk", :aws_owner=>"admin", :aws_location=>"my-ramdisk/initrd.img.manifest.xml", :aws_state=>"available", :aws_is_public=>true, :aws_architecture=>"x86_64"}, {:aws_id=>"emi-C6E71A64", :aws_image_type=>"machine", :aws_owner=>"admin", :aws_location=>"euca-my-image/disk.img.manifest.xml", :aws_kernel_id=>"eki-3313191F", :aws_state=>"available", :aws_ramdisk_id=>"eri-A3501A6C", :aws_is_public=>true, :aws_architecture=>"x86_64"}]
irb(main):009:0> 

Typica

A simple API using the QUERY interfaces which patterns the methods after those available in the AWS SOAP client

Example Usage ¶

Jec2 ec2 = new Jec2(props.getProperty("aws.accessId"), 
props.getProperty("aws.secretKey"), false, "your-host", 8773); 
ec2.setResourcePrefix("/services/Eucalyptus"); 
ec2.setSignatureVersion(1);

Cloud42

An Open Source management framework allowing you to easily manage and monitor your server instances.

EC2Dream

Replaces the command line amazon EC2 tools with a graphical environment that can be installed on your Windows, Linux, or Mac OS X machines

Installation ¶

• Download from http://ec2dream.googlecode.com/files/EC2Dream-v0.92.zip

• Follow the Installation Instructions

• Setup EC2Dream to use with Eucalyptus according to: http://www.ec2dream.webs.com/eucalyptus/.

• Additional information is available in the User Guide

Elasticfox

A Mozilla Firefox extension allowing you to launch new instances, mount volumes, map IP addresses, and more

Example Usage ¶

Click on Regions. Set Region Name to whatever you wish. Set Endpoint URL to http://<cloud front end ip>:8773/services/Eucalyptus.

Click on Credentials. Add a Eucalyptus user account. AWS Access Key = Query Id, AWS Secret Key = Secret Key.

Sometimes, you might have to restart Elasticfox for changes to take effect.

Hybridfox

A Mozilla Firefox extension allowing you to launch new instances, mount volumes, map IP addresses, and more, derived from Elastifox

Example Usage ¶

Click on Regions. Set Region Name to whatever you wish. Set Type to "Eucalyptus" and set Endpoint URL to http://<cloud front end ip>:8773/services/Eucalyptus.

Click on Credentials. Add a Eucalyptus user account. AWS Access Key = Query Id, AWS Secret Key = Secret Key. Preferred Region can be set to your Eucalyptus endpoint, which makes it easier if you regularly use different clouds since this Hybridfox will select this endpoint automatically when the account is selected.

Sometimes, you might have to restart Firefox for changes to take effect.

NOTES: if you previously had Elasticfox installed, you may have to clean up your old preferences. One way to do it is to find your prefs.js and, while firefox is disabled, to remove all the references to ec2 inside it. On Linux systems you may find the preferences under $USER/.mozilla/*

tAWS Tanacasino

Eclipse based tools called Tanacasino with support for Eucalyptus.

Installation ¶

NOTE: The contents of this document were derived from http://sourceforge.jp/projects/eclipse-aws/wiki/FrontPage#h2-Download, retreived on Jul 17, 2009.

Download ¶

Download executable binary here

Install ¶

This tool wraps ec2-api-client. The ec2-api-client is not open source license. So, you should download and install the ec2-api-client.

When extract the Tanacasino. The directory structure is following.

Copy the ec2-api-client libraries to tAWS/plugins/jp.co.intellilink.aws.api.eucalyptus/lib

Configuration ¶

File->Preference->AWS shows EC2 client setting.

If you use Eucalyptus, please select ec2-api-tools and fill the service URL/private key/X509 cert

CloudBerry S3 Explorer

Author CloudBerry Lab
Homepage www.cloudberrylab.com

Documentation documentation
Discussion forum
Download download

CloudBerry Explorer makes managing files in Walrus and Amazon S3 storage easy. By providing a user interface to Walrus and Amazon S3 accounts, files, and buckets, CloudBerry lets you manage your files on cloud just as you would on your own local computer.

s3cmd

Example Usage

Setup s3cmd

Pre-requisites: python and python-openssl.

To use s3cmd with Walrus, download version 0.9.8.3 from the s3cmd sourceforge site and untar it.

Please copy and paste the patch from using the following link (into a file called s3cmd-0.9.8.3.patch).

s3cmd version 0.9.8.3 patch

Change dir to s3cmd-0.9.8.3. Apply the patch (patch -p1 < s3cmd-0.9.8.3.patch).

Configuration

Create a config file for Walrus (called s3cfg.walrus in the examples below). Please use the following sample config as a guideline.

Sample config for Walrus

If you also wish to interact with Amazon's S3, you will need another config file. Please use the following example.

Sample config for S3

Examples

• Create a bucket s3cmd -c s3cfg.walrus mb s3://testbucket

• Delete a bucket s3cmd -c s3cfg.walrus rb s3://testbucket
• List all buckets s3cmd -c s3cfg.walrus ls
• List the contents of a bucket s3cmd -c s3cfg.walrus ls s3://testbucket
• Put an object s3cmd -c s3cfg.walrus put <filename> s3://testbucket
• Get an object s3cmd -c s3cfg.walrus get s3://testbucket/<key> <filename>
• Delete an object s3cmd -c s3cfg.walrus del s3://testbucket/<key>

Please use s3cmd -h for more options.

s3curl

S3 Curl is a tool that allows users to interact with Walrus by adding security parameters as curl headers.

You may create, delete, list buckets, put, get, delete objects, set access control policies, etc. Please refer to the Amazon S3 documentation for the S3 interface specification.

You will need the perl-Digest-HMAC package for S3 Curl, if it is not already installed on your system.

You will need to modify the file s3curl.pl in your favorite editor to change the hostname endpoint.

For example, change

my @endpoints = ( 's3.amazonaws.com' );

to

my @endpoints = ( 'your-host' );

where, your-host is the IP or the hostname on which Walrus runs. For authentication to succeed, it is crucial that your-host is the same as the host portion of the $S3_URL environment variable set by eucarc.

Be sure to source your 'eucarc' file before running the commands below.

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY <curl options>

It is preferable to add your credentials to the ".s3curl" config file. Please read the README file bundled with s3curl for details.

• For example, to create a bucket,

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --put /dev/null -- -s -v $S3_URL/bucketName

where bucketName is the name of the bucket that you want to create.

• To put an object,

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --put <filename> -- -s -v $S3_URL/bucketName/objectName

where objectName is the name of the object that you want to create.

• To get the MD5 checksum, size and last modification time for an object.

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --head -- -s -v $S3_URL/bucketName/objectName > object.head

cat object.head

• To get an object

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --get -- -s -v $S3_URL/bucketName/objectName > object

• To delete an object,

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --del -- -s -v $S3_URL/bucketName/objectName

• To delete a bucket,

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --del -- -s -v $S3_URL/bucketName

Note that, according to the S3 specification, a bucket needs to be empty before it can be deleted.

You may pipe the output through "xmlindent" (you might need to install it, if it is not already installed on your system).

• For example, to get the access control policy for a bucket,

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --get -- -s -v $S3_URL/bucketName?acl | xmlindent > bucket.acl

• To get the contents of a bucket.

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --get -- -s -v $S3_URL/bucketName  | xmlindent > bucket.list

• To list all buckets for a user.

s3curl.pl --id $EC2_ACCESS_KEY --key $EC2_SECRET_KEY --get -- -s -v $S3_URL  | xmlindent > bucketlisting

s3fs

Installation

• Download: s3fs-r177-source.tar.gz.
• Save the following patch to a file called s3fs-r177-patch: s3fs-r177 patch
• Untar s3fs-r177-source.tar.gz and patch it

  patch -p1 < s3fs-r177-patch
  

Compiling

Pre-requisites: libfuse-dev libcurl4-openssl-dev libxml2-dev

Run make (you might get a bunch of warnings).

Usage

mkdir test
./s3fs <bucket name> -o accessKeyId=<query id> -o secretAccessKey=<secret key> -o servicepath=/services/Walrus -o host=http://localhost:8773 test

where <bucket name> is an existing bucket name.

cd test; touch foo; ls ; rm foo, etc. 

Kill the s3fs daemon to unmount the bucket.

Debugging

Add "-d" to the end of the s3fs command-line. This will produce debugging output on the command line and will not daemonize s3fs.

Look for errors in cloud-error.log and/or cloud-debug.log.