[Sheepdog] misc: 1k nodes sheepdog test report

Yibin Shen zituan at taobao.com
Thu May 10 05:29:55 CEST 2012


Hey, guys:

I've updated this report , the main change is:
1) add sync flush and async flush + dio benchmark
2) add more detailed recover report
3) fix some typo

there are still something need to do,
1) disable object cache test haven't been made , because without
object cache, I/O performance is horrible
2) recover test was made in no I/O situation , I will update this
report again after another recover test mixed with heavy I/O

hmm.  there is an issue in this report, in a 'random write' test, sync
flush mode's performance is better than async,
It sounds somewhat odd, So I will repeat this test if I have time.

you can find this report here:

http://sheepdog.taobao.org/people/zituan/sheepdog1k.html

then I will try to paste it to the sheepdog wiki,  if I get the
acknowledgment from Kazum.

thanks!

Yibin Shen

On Wed, May 2, 2012 at 1:06 PM, MORITA Kazutaka
<morita.kazutaka at gmail.com> wrote:
> At Wed, 02 May 2012 13:31:16 +0900,
> MORITA Kazutaka wrote:
>>
>> At Tue, 1 May 2012 20:06:12 +0800,
>> Yibin Shen wrote:
>> >
>> > Hi, list:
>> >
>> > last weeks,
>> > we use 96 physical server to simulate 1k nodes sheepdog cluster's
>> > performance  (with zookeeper driver)
>> > and here is the report:
>> >
>> > http://sheepdog.taobao.org/people/zituan/sheepdog1k.html
>>
>> Great report, thanks!  Can you add the report to the Sheepdog wiki?
>>   https://github.com/collie/sheepdog/wiki
>>
>> I'd like to see how the result will change if we remove the '-a'
>> option from the sheep options because the option doesn't follow block
>> device semantics.
>
> Another acceptable option would be:
>  - use both '-a' and '-D' for sheep options, and
>  - disable write-caching of the local disk
>
> This ensures that the flushed data is written to the local disk at
> least, though the data is not replicated to multiple nodes until the
> backgroud thread replicates it.
>
> Thanks,
>
> Kazutaka
> --
> sheepdog mailing list
> sheepdog at lists.wpkg.org
> http://lists.wpkg.org/mailman/listinfo/sheepdog

________________________________

This email (including any attachments) is confidential and may be legally privileged. If you received this email in error, please delete it immediately and do not copy it or use it for any purpose or disclose its contents to any other person. Thank you.

本电邮(包括任何附件)可能含有机密资料并受法律保护。如您不是正确的收件人,请您立即删除本邮件。请不要将本电邮进行复制并用作任何其他用途、或透露本邮件之内容。谢谢。



More information about the sheepdog mailing list