[Sheepdog] zookeeper vs. corosync

[David Douard]

On 07/05/2012 11:08, Liu Yuan wrote:
> On 05/07/2012 04:56 PM, David Douard wrote:
> 
>> Hi,
>>
>> I'm beginning to look at the debian package for sheepdog (which ships
>> 0.2.4 only). For now, the package only support corosync. I am wondering
>> if the zookeeper backend should be supported in debian.
>>
>> What are the differences between zookeper and corosync for managing a
>> sheepdog cluster?
>>
> 
> 
> Both corosync and zookeeper (and Accord too) are used to manage
> memebership and broadcast messages to the cluster nodes.
> 
> Corosync can only works reliably with less than 15 nodes in our testbed,
> due to its implementation and design goal for small sized cluster.
> 
> If we want to add more nodes into sheepdog cluster, we should run
> sheepdog against zookeeper. We (from Taobao.com) have been working with
> the scalability of the sheepdog and currently running with around 1000
> nodes in our test environment. For several month expediencies with
> zookeeper, we have found that it works well for node number below 1000,
> with object cache enabled.
> 
> For a cluster more than 1000 nodes, I think Accord would come up to our
> rescue, but it is currently in a unstable development state. When the
> sheepdog scales up to 1000 nodes reliably, we might go to look at Accord
> and refine it to be a working state.
> 

Thanks for these informations. I've added a wiki page with them. If one
can add some more documentation on how to setup and use zookeeper or
Accord, it would be great.

David

> Thanks,
> Yuan
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: david_douard.vcf
Type: text/x-vcard
Size: 246 bytes
Desc: not available
URL: <http://lists.wpkg.org/pipermail/sheepdog/attachments/20120507/8f8a9a3b/attachment-0003.vcf>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 262 bytes
Desc: OpenPGP digital signature
URL: <http://lists.wpkg.org/pipermail/sheepdog/attachments/20120507/8f8a9a3b/attachment-0002.sig>