[sheepdog] questions for sheepdog fresh

[Hitoshi Mitake]

Sorry for my late reply

> If node(i) is down, then node(i+1) and node(i+2) still store the object Oidx

It is not always true, the behaviour is probabilistic because sheepdog
uses consistent hashing for determining object placement.
In many cases node(i+1) and node(i+2) will remain but there is no
guarantee. Placement depends on the hash function and vnode weight.

Thanks,
Hitoshi

On Fri, Apr 14, 2017 at 11:51 PM, saxion <saxion at qq.com> wrote:
> Hi Mitake,
> Thanks very much for your explanation.
>
> It's clear for me for the first problem.
>
> For the second one, It's still a little fuzzy for me.
> For example, if node(i), node(i+1) and node(i+2) store the object Oidx.
> If node(i) is down, then node(i+1) and node(i+2) still store the object Oidx, and the new node is node(i+3) which will be selected to store Oidx?
> And in a similar way, if node(i+1) or node(i+2) is down, node(i+3) will also the new node, because node(i+3) is the following node of those three nodes.
>
> Am I right?
>
>
>
> ------------------ Original ------------------
> From:  "Hitoshi Mitake";<mitake.hitoshi at gmail.com>;
> Date:  Fri, Apr 14, 2017 01:39 PM
> To:  "saxion"<saxion at qq.com>;
> Cc:  "sheepdog"<sheepdog at lists.wpkg.org>;
> Subject:  Re: [sheepdog] questions for sheepdog fresh
>
> On Wed, Apr 12, 2017 at 9:03 PM, saxion <saxion at qq.com> wrote:
>> Hello everyone, I'm learning distributed storage system sheepdog.
>> But I have some questions about sheepdog after I googled what I want to know.
>> As far as I know, consistent hashing is used in sheepdog for data distribution.
>> For example, a sheepdog cluster with 3 repica policy, an object OID will be mapped to host1, hosti and hostj.
>>
>> My question is how we get those three host? For every object, an oid will be mapped to(using consistent hashing) only one host(host1 for example), how to select the other two host(hosti and hostj)? Or is there any details I got wrong idea?
>
> Simply selecting three continuing nodes from the vnodes. You can find
> the logic here:
> https://github.com/sheepdog/sheepdog/blob/master/include/sheep.h#L109
>
>
>>
>> And, when host1 is down, how about the data rebalance/recovery, how to choose the right host to make sure there are 3 copied for every object?
>
> The vnodes are updated during membership change (e.g. join and leave).
> The membership is kept consistent for all living nodes by the atomic
> broadcast functionality of corosync or zookeeper. So every living node
> can have identical vnodes.
>
>>
>> Thanks.
>>
>> saxion
>> --
>> sheepdog mailing list
>> sheepdog at lists.wpkg.org
>> https://lists.wpkg.org/mailman/listinfo/sheepdog