[sheepdog-users] collie of sheepdog 0.5.5 couldn't create VDI

飞来虫 239965 at qq.com
Fri Dec 28 02:57:08 CET 2012


I installed  sheepdog 0.5.5 in Centos 6.2(Linux 2.6.32-220.el6.x86_64 #1 SMP) within four nodes. The problem is while the cluster can be successfully started,collie is blocking new files created by using "collie vdi create" ,Only by pressing Ctrl+C, will collie return. But the purpose of creating a new file is failed.


It seems that add_vdi function doesn't get back after invoking notify_vdi_add function in the souce file vdi.c  It's really confusing because everything is ok while executing sheepdog 0.4.0.




Folling is related information:


[root at localhost home]# collie vdi create zzzzz 20G
*** Program in waiting never returned,unless press ctrl+C


[root at localhost ~]# collie node list
M   Id   Host:Port         V-Nodes       Zone
-    0   192.168.1.2:7000       149   33663168
-    1   192.168.1.6:7000       40  100772032
-    2   192.168.1.7:7000       64  117549248
-    3   192.168.1.8:7000        2  134326464


[root at localhost home]# collie cluster info
Cluster status: running


Cluster created at Thu Dec 27 21:55:51 2012


Epoch Time           Version
2012-12-27 21:54:33      1 [192.168.1.2:7000, 192.168.1.6:7000, 192.168.1.7:7000, 192.168.1.8:7000]


------------------------------------------
sheepdog log


Dec 27 21:52:19 [main] init_signal(169) register signal_handler for 10
Dec 27 21:52:19 [main] init_disk_space(370) disk free space is 21601484800
Dec 27 21:52:19 [main] zk_init(815) request session timeout:30000ms, negotiated session timeout:30000ms
Dec 27 21:52:19 [main] watcher(543) path:, type:-1
Dec 27 21:52:19 [main] watcher(548) session change, clientid:88907159795466244
Dec 27 21:52:20 [main] zk_create(97) rc:-110
Dec 27 21:52:20 [main] zk_create(97) rc:-110
Dec 27 21:52:20 [main] zk_create(97) rc:-110
Dec 27 21:52:20 [main] create_cluster(1179) zone id = 134326464
Dec 27 21:52:20 [main] zk_exists(144) rc:-101
Dec 27 21:52:20 [main] zk_join(600) clientid:88907159795466244
Dec 27 21:52:20 [main] zk_queue_push(193) create path:/sheepdog/queue/0000000004, nr_nodes:0, queue_pos:0000000000, len:136, rc:0
Dec 27 21:52:20 [main] zk_queue_push(198) path:/sheepdog/queue/0000000004, seq:0000000004
Dec 27 21:52:20 [main] zk_queue_push(204) write event to efd:14
Dec 27 21:52:20 [main] send_join_request(1014) IPv4 ip:192.168.1.8 port:7000
Dec 27 21:52:20 [main] main(616) sheepdog daemon (version 0.5.5) started
Dec 27 21:52:20 [main] zk_handler(664) read event
Dec 27 21:52:20 [main] zk_queue_pop(299) read path:/sheepdog/queue/0000000004, nr_nodes:0, type:1, len:136, rc:0
Dec 27 21:52:20 [main] zk_handler(678) JOIN REQUEST nr_nodes: 0, sender: IPv4 ip:192.168.1.8 port:7000, joined: 0
Dec 27 21:52:20 [main] watcher(543) path:/sheepdog/queue/0000000004, type:3
Dec 27 21:52:20 [main] watcher(577) write event to efd:14
Dec 27 21:52:20 [main] zk_queue_push_back(221) queue_pos:0000000004
Dec 27 21:52:20 [main] zk_handler(664) read event
Dec 27 21:52:20 [main] zk_queue_pop(299) read path:/sheepdog/queue/0000000004, nr_nodes:0, type:2, len:136, rc:0
Dec 27 21:52:20 [main] zk_exists(144) rc:-101
Dec 27 21:52:20 [main] zk_queue_pop(314) watch path:/sheepdog/queue/0000000005, exists:0
Dec 27 21:52:20 [main] zk_handler(701) JOIN RESPONSE
Dec 27 21:52:21 [main] zk_member_init(488) nr_nodes:3
Dec 27 21:52:21 [main] zk_handler(738) one sheep joined[down], nr_nodes:4, sender:IPv4 ip:192.168.1.8 port:7000, joined:1
Dec 27 21:52:21 [main] zk_handler(746) create path:/sheepdog/member/IPv4 ip:192.168.1.8 port:7000
Dec 27 21:52:21 [main] watcher(543) path:/sheepdog/member/IPv4 ip:192.168.1.8 port:7000, type:1
Dec 27 21:52:21 [main] build_node_list(412) nr_sd_nodes:4
Dec 27 21:52:21 [main] sd_join_handler(1044) join IPv4 ip:192.168.1.8 port:7000
Dec 27 21:52:21 [main] sd_join_handler(1046) [0] IPv4 ip:192.168.1.2 port:7000
Dec 27 21:52:21 [main] sd_join_handler(1046) [1] IPv4 ip:192.168.1.6 port:7000
Dec 27 21:52:21 [main] sd_join_handler(1046) [2] IPv4 ip:192.168.1.7 port:7000
Dec 27 21:52:21 [main] sd_join_handler(1046) [3] IPv4 ip:192.168.1.8 port:7000
Dec 27 21:52:21 [main] update_cluster_info(799) status = 2, epoch = 0, finished: 0
Dec 27 21:52:21 [main] sockfd_cache_add_group(252) 4
Dec 27 21:52:21 [main] recalculate_vnodes(787) node 7000 has 149 vnodes, free space 1325555773440
Dec 27 21:52:21 [main] recalculate_vnodes(787) node 7000 has 40 vnodes, free space 351191306240
Dec 27 21:52:21 [main] recalculate_vnodes(787) node 7000 has 64 vnodes, free space 571714125824
Dec 27 21:52:21 [main] recalculate_vnodes(787) node 7000 has 2 vnodes, free space 21601484800
Dec 27 21:52:21 [main] sd_join_handler(1055) join Sheepdog cluster
Dec 27 21:52:21 [main] watcher(559) watch path:/sheepdog/member/IPv4 ip:192.168.1.8 port:7000, exists:1
Dec 27 21:52:21 [main] watcher(577) write event to efd:14
Dec 27 21:52:21 [main] watcher(543) path:/sheepdog/member, type:4
Dec 27 21:52:21 [main] zk_handler(664) read event
Dec 27 21:52:21 [main] zk_exists(144) rc:-101
Dec 27 21:54:33 [main] watcher(543) path:/sheepdog/queue/0000000005, type:1
Dec 27 21:54:33 [main] watcher(577) write event to efd:14
Dec 27 21:54:33 [main] zk_handler(664) read event
Dec 27 21:54:33 [main] zk_queue_pop(299) read path:/sheepdog/queue/0000000005, nr_nodes:4, type:5, len:189, rc:0
Dec 27 21:54:33 [main] zk_exists(144) rc:-101
Dec 27 21:54:33 [main] zk_queue_pop(314) watch path:/sheepdog/queue/0000000006, exists:0
Dec 27 21:54:33 [main] zk_handler(787) NOTIFY
Dec 27 21:54:33 [main] sd_notify_handler(870) op MAKE_FS, size: 101, from: IPv4 ip:192.168.1.6 port:7000
Dec 27 21:54:33 [main] default_format(465) try get a clean store
Dec 27 21:54:33 [main] farm_init(113) use farm store driver
Dec 27 21:54:33 [main] default_init(236) use plain store driver
Dec 27 21:54:33 [main] update_epoch_log(48) update epoch: 1, 4
Dec 27 21:54:33 [main] have_enough_zones(99) flags 1, nr_zones 4, min copies 0
Dec 27 21:55:20 [main] watcher(543) path:/sheepdog/queue/0000000006, type:1
Dec 27 21:55:20 [main] watcher(577) write event to efd:14
Dec 27 21:55:20 [main] zk_handler(664) read event
Dec 27 21:55:20 [main] zk_queue_pop(299) read path:/sheepdog/queue/0000000006, nr_nodes:4, type:4, len:88, rc:0
Dec 27 21:55:20 [main] zk_handler(779) BLOCK
Dec 27 21:55:20 [main] zk_queue_push_back(221) queue_pos:0000000006
Dec 28 09:11:11 [main] listen_handler(876) accepted a new connection: 16
Dec 28 09:11:11 [main] client_handler(811) 1, rx 0, tx 0
Dec 28 09:11:11 [main] finish_rx(614) 16, ::1:49843
Dec 28 09:11:11 [main] queue_request(354) NEW_VDI, 1
Dec 28 09:11:11 [main] queue_cluster_request(315) NEW_VDI (0x4a2fb50)
Dec 28 09:11:11 [main] zk_queue_push(193) create path:/sheepdog/queue/0000000008, nr_nodes:4, queue_pos:0000000006, len:88, rc:0
Dec 28 09:11:11 [main] zk_queue_push(198) path:/sheepdog/queue/0000000008, seq:0000000008
Dec 28 09:11:12 [main] client_handler(811) 19, rx 0, tx 0
Dec 28 09:11:12 [main] clear_client_info(740) connection seems to be dead
Dec 28 09:11:12 [main] clear_client_info(761) refcnt:1, fd:16, ::1:49843
Dec 28 09:11:13 [main] listen_handler(876) accepted a new connection: 17
Dec 28 09:11:13 [main] client_handler(811) 1, rx 0, tx 0
Dec 28 09:11:13 [main] finish_rx(614) 17, ::1:49844
Dec 28 09:11:13 [main] queue_request(354) NEW_VDI, 1
Dec 28 09:11:13 [main] queue_cluster_request(315) NEW_VDI (0x4a2fd30)
Dec 28 09:11:13 [main] zk_queue_push(193) create path:/sheepdog/queue/0000000009, nr_nodes:4, queue_pos:0000000006, len:88, rc:0
Dec 28 09:11:13 [main] zk_queue_push(198) path:/sheepdog/queue/0000000009, seq:0000000009
***  program blocked here  ****
Dec 28 09:12:05 [main] client_handler(811) 19, rx 0, tx 0
Dec 28 09:12:05 [main] clear_client_info(740) connection seems to be dead
Dec 28 09:12:05 [main] clear_client_info(761) refcnt:1, fd:17, ::1:49844
Dec 28 09:13:25 [main] listen_handler(876) accepted a new connection: 18
Dec 28 09:13:25 [main] client_handler(811) 1, rx 0, tx 0
Dec 28 09:13:25 [main] finish_rx(614) 18, ::1:49845
Dec 28 09:13:25 [main] queue_request(354) GET_NODE_LIST, 1
Dec 28 09:13:25 [io 1] do_process_work(1222) 82, 0, 1
Dec 28 09:13:25 [main] client_handler(811) 4, rx 0, tx 0
Dec 28 09:13:25 [main] clear_client_info(740) connection seems to be dead
Dec 28 09:13:25 [main] clear_client_info(761) refcnt:0, fd:18, ::1:49845
Dec 28 09:13:25 [main] destroy_client(731) connection from: ::1:49845
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wpkg.org/pipermail/sheepdog-users/attachments/20121228/645a112e/attachment-0003.html>


More information about the sheepdog-users mailing list