[sheepdog-users] Multiple storage clusters per node

[Walid Moghrabi]

Thanks for your answer but : 


> It depends on corosync or zookeeper, which act as a membership manamgent software 
> for sheepdog. 

> For corosync, you have 1:1 map of corosync to sheep daemon. So you have to setup 
> 2 corosync for two cluster on each node. 

> For zookeeper, one zk cluster manages a sheepdog cluster. So you have to setup 
> 2 zk clusters to manage different sheepdog clusters. 

I tried to install Zookeeper because it would be easier for me than 2 corosync instance (especially because corosync is used and setup by ProxMox and I don't want to play with its setup without extreme caution) but ... the Sheepdog package that is shipped with ProxMox doesn't support Zookeeper as cluster driver as you can see :( 



Starting Sheepdog Server : sheepdog-slowInvalid cluster driver 'zookeeper:10.99.0.240:2181' 
Supported drivers: corosync local 
failed! 


I'm doomed ... 


Do you have any example of setup with 2 corosync instance on the same node ? 


Regards 
----- Mail original -----

De: "Liu Yuan" <namei.unix at gmail.com> 
À: "Walid Moghrabi" <walid.moghrabi at lezard-visuel.com> 
Cc: sheepdog-users at lists.wpkg.org 
Envoyé: Mardi 4 Mars 2014 16:44:00 
Objet: Re: [sheepdog-users] Multiple storage clusters per node 

On Tue, Mar 04, 2014 at 04:35:15PM +0100, Walid Moghrabi wrote: 
> Hi everyone, 
> 
> 
> I'm definitely found of Sheepdog, this is great and this is exactly what I need and it works extremely well with ProxMox. 
> I experimented a lot with a ProxMox cluster running Sheepdog 0.8 and qemu 1.7 in our lab and it is really impressive. 
> 

Welcome to become a sheepdog walker :) 

> 
> Now, we would like to deploy this solution to replace our beta environment on a brand new 3 nodes ProxMox cluster running on dedicated servers at OVH (a french hosting company). 
> 
> 
> These nodes are identical and using this local storage layout : 
> 
> 
> Hardware RAID with LSI Logic MegaRAID controler with 1GB BBU onboard memory. 
> On this controler are defines 2 RAID volumes : 
> * one RAID1 volume with 2x3TB SATA III mechanical hard drives 
> * one RAID0 volume with 2x300GB SATA III Intel S3500 SSD drives 
> 
> 
> Our will is to create 2 Sheepdog storage clusters on these nodes : 
> * one "small but fast" using only SSD drives 
> * one "big but slow" using only mechanical SATA drives 
> 
> 
> We don't want to mix storage types to make on big sheepdog storage, we really want separated servers. 
> 
> 
> I tried different settings but I can't do that, I always end with one mixed storage even if I run 2 different sheepdog servers binded on different ports or IPs and using different rootdirs, pids, ... 
> 
> 
> Whatever I try, I'm stuck with one volume only. 
> 
> 
> So here are my questions : 
> 
> 
> * Is it possible to have multiple storage instances per nodes ? 
> * If so, how ? 

Sure. In sheepdog, one daemon actually represent a node. You can run however 
much daemons per host. 


> For now I'm stuck and I really don't know where to go now :( 
> 

It depends on corosync or zookeeper, which act as a membership manamgent software 
for sheepdog. 

For corosync, you have 1:1 map of corosync to sheep daemon. So you have to setup 
2 corosync for two cluster on each node. 

For zookeeper, one zk cluster manages a sheepdog cluster. So you have to setup 
2 zk clusters to manage different sheepdog clusters. 

For stability, we recommend zookeeper, which proves to be more realiable for long 
running sheepdog cluster. 

Thanks 
Yuan 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wpkg.org/pipermail/sheepdog-users/attachments/20140304/160fd172/attachment-0005.html>