[Sheepdog] Node left when creating preallocation vdi

dong wu archer.wudong at gmail.com
Fri Jan 6 13:07:15 CET 2012


Hello,
when i create a preallocation vdi,during the creating,one node left and
then create error!
I do like this:(I use a server with 8disks)
[root at sheepdog ~]# collie node list
   Idx - Host:Port          Vnodes       Zone
---------------------------------------------
*    0 - 192.168.130.60:7000    64 1015195840
     1 - 192.168.130.60:7001    64 1015195840
     2 - 192.168.130.60:7002    64 1015195840
     3 - 192.168.130.60:7003    64 1015195840
     4 - 192.168.130.60:7004    64 1015195840
     5 - 192.168.130.60:7005    64 1015195840
     6 - 192.168.130.60:7006    64 1015195840
     7 - 192.168.130.60:7007    64 1015195840
[root at sheepdog ~]# qemu-img create sheepdog:Alice -o preallocation=data 100G
Formatting 'sheepdog:Alice', fmt=raw size=107374182400 preallocation='data'
qemu-img: No object found

qemu-img: sheepdog:Alice: error while creating raw: Operation not permitted
when create error,check the node list as follows:
[root at sheepdog ~]# collie node list
   Idx - Host:Port          Vnodes       Zone
---------------------------------------------
 *   1 - 192.168.130.60:7001    64 1015195840
     2 - 192.168.130.60:7002    64 1015195840
     3 - 192.168.130.60:7003    64 1015195840
     4 - 192.168.130.60:7004    64 1015195840
     5 - 192.168.130.60:7005    64 1015195840
     6 - 192.168.130.60:7006    64 1015195840
     7 - 192.168.130.60:7007    64 1015195840
I have tried this several times,always the master node left.
and sheep.log as follows when fails:
........
Jan 06 02:44:31 store_queue_request(817) 3, 3, 28489a00000083 , 1
Jan 06 02:44:31 store_queue_request_local(571) 3, 28489a00000083 , 1
Jan 06 02:46:12 sd_confchg(1872) confchg nodeid 3282a8c0
Jan 06 02:46:12 sd_confchg(1874) 6 1 0
Jan 06 02:46:12 sd_confchg(1877) [0] node_id: 3282a8c0, pid: 3076
Jan 06 02:46:12 sd_confchg(1877) [1] node_id: 3282a8c0, pid: 3092
Jan 06 02:46:12 sd_confchg(1877) [2] node_id: 3282a8c0, pid: 3108
Jan 06 02:46:12 sd_confchg(1877) [3] node_id: 3282a8c0, pid: 3124
Jan 06 02:46:12 sd_confchg(1877) [4] node_id: 3282a8c0, pid: 3140
Jan 06 02:46:12 sd_confchg(1877) [5] node_id: 3282a8c0, pid: 3156
Jan 06 02:46:12 sd_confchg(1891) allow new confchg, 0x26e3f20
Jan 06 02:46:12 start_cpg_event_work(1716) 0 0
........
at times,I create succefully,but when I use iscsi to mount on one linux
host,then use iometer to test the performance
during the test,this error occurs again,the master node left,even worse,all
the other nodes left one by one.

If I create a preallocation vdi not that big(eg. 15G),i can create
successfully,
but the performance i test using iometer is very slow
4k   %100read  100%sequence    2.897764M/s
4k   %100write 100%sequence     0.089305M/s
1M  %100read  100%sequence    29.83363M/s
1M  %100write  100%sequence    10.05084M/s
4M  %100read   100%sequence    50.71799M/s
4M  %100write   100%sequence    9.699951M/s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wpkg.org/pipermail/sheepdog/attachments/20120106/8ba96d3e/attachment-0002.html>


More information about the sheepdog mailing list