[Qemu-devel] [ANNOUNCE] Sheepdog: Distributed Storage System for KVM

[MORITA Kazutaka]

Hi everyone,

Sheepdog is a distributed storage system for KVM/QEMU. It provides
highly available block level storage volumes to VMs like Amazon EBS.
Sheepdog supports advanced volume management features such as snapshot,
cloning, and thin provisioning. Sheepdog runs on several tens or hundreds
of nodes, and the architecture is fully symmetric; there is no central
node such as a meta-data server.

The following list describes the features of Sheepdog.

    * Linear scalability in performance and capacity
    * No single point of failure
    * Redundant architecture (data is written to multiple nodes)
    - Tolerance against network failure
    * Zero configuration (newly added machines will join the cluster 
automatically)
    - Autonomous load balancing
    * Snapshot
    - Online snapshot from qemu-monitor
    * Clone from a snapshot volume
    * Thin provisioning
    - Amazon EBS API support (to use from a Eucalyptus instance)

(* = current features, - = on our todo list)

More details and download links are here:

http://www.osrg.net/sheepdog/

Note that the code is still in an early stage.
There are some critical TODO items:

    - VM image deletion support
    - Support architectures other than X86_64
    - Data recoverys
    - Free space management
    - Guarantee reliability and availability under heavy load
    - Performance improvement
    - Reclaim unused blocks
    - More documentation

We hope finding people interested in working together.
Enjoy!


Here are examples:

- create images

$ kvm-img create -f sheepdog "Alice's Disk" 256G
$ kvm-img create -f sheepdog "Bob's Disk" 256G

- list images

$ shepherd info -t vdi
   40000 : Alice's Disk  256 GB (allocated: 0 MB, shared: 0 MB), 2009-10-15
16:17:18, tag:        0, current
   80000 : Bob's Disk    256 GB (allocated: 0 MB, shared: 0 MB), 2009-10-15
16:29:20, tag:        0, current

- start up a virtual machine

$ kvm --drive format=sheepdog,file="Alice's Disk"

- create a snapshot

$ kvm-img snapshot -c name sheepdog:"Alice's Disk"

- clone from a snapshot

$ kvm-img create -b sheepdog:"Alice's Disk":0 -f sheepdog "Charlie's Disk"


Thanks.

--
MORITA, Kazutaka

NTT Cyber Space Labs
OSS Computing Project
Kernel Group
E-mail: address@hidden