[sheepdog] Bug in v0.4.0 ? get_sha1_file(80) PANIC: Operation not supported

[Jens WEBER]

build from tag v0.4.0

2 node setup
collie cluster format -b farm -c 1 -H

node 1 works, but if node 2 start up
root at none:/var/lib/sheepdog# sheep -f -D -g -p 7000 -z 999 -d /var/lib/sheepdog/
Aborted

sheep.log node 2:
Jul 13 21:28:59 [main] create_cluster(1092) use corosync cluster driver as default
Jul 13 21:28:59 [main] create_cluster(1121) zone id = 999
Jul 13 21:28:59 [main] send_join_request(961) IPv4 ip:10.255.255.12 port:7000
Jul 13 21:28:59 [main] main(272) sheepdog daemon (version 0.4.0) started
Jul 13 21:28:59 [main] cdrv_cpg_confchg(568) mem:2, joined:1, left:0
Jul 13 21:28:59 [main] cdrv_cpg_confchg(634) Not promoting because member is not in our event list.
Jul 13 21:28:59 [main] cdrv_cpg_deliver(454) 0
Jul 13 21:28:59 [main] cdrv_cpg_deliver(454) 1
Jul 13 21:28:59 [main] sd_join_handler(990) join IPv4 ip:10.255.255.12 port:7000
Jul 13 21:28:59 [main] sd_join_handler(992) [0] IPv4 ip:10.255.255.11 port:7000
Jul 13 21:28:59 [main] sd_join_handler(992) [1] IPv4 ip:10.255.255.12 port:7000
Jul 13 21:28:59 [main] update_cluster_info(778) status = 1, epoch = 9, finished: 0
Jul 13 21:28:59 [main] farm_init(333) use farm store driver
Jul 13 21:28:59 [main] init_sys_vdi_bitmap(306) found the working directory /var/lib/sheepdog//obj/
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] get_trunk_sha1(212) 0
Jul 13 21:28:59 [main] cleanup_working_dir(635) try clean up working dir
Jul 13 21:28:59 [main] trunk_reset(402) clean
Jul 13 21:28:59 [main] sockfd_cache_add_group(242) 2
Jul 13 21:28:59 [main] update_epoch_log(55) update epoch: 10, 2
Jul 13 21:28:59 [block] connect_to(256) 13, 10.255.255.11:7000
Jul 13 21:28:59 [block] get_vdi_bitmap_from(663) 10.255.255.11:7000
Jul 13 21:28:59 [recovery] prepare_object_list(553) 10
Jul 13 21:28:59 [recovery] fetch_object_list(475) 10.255.255.11 7000
Jul 13 21:28:59 [main] sd_join_handler(1001) join Sheepdog cluster
Jul 13 21:28:59 [recovery] connect_to(256) 14, 10.255.255.11:7000
Jul 13 21:28:59 [recovery] fetch_object_list(502) 0
Jul 13 21:28:59 [recovery] prepare_object_list(582) 0
Jul 13 21:28:59 [main] farm_end_recover(578) old epoch 9
Jul 13 21:28:59 [main] get_sha1_file(80) PANIC: Operation not supported
Jul 13 21:28:59 [main] crash_handler(408) sheep pid 10887 exited unexpectedly.

sheep.log node 1:
Jul 13 21:29:04 [main] cdrv_cpg_confchg(568) mem:2, joined:1, left:0
Jul 13 21:29:04 [main] cdrv_cpg_deliver(454) 0
Jul 13 21:29:04 [main] sd_check_join_cb(918) 10.255.255.12:7000: ret = 0x0, cluster_status = 0x1
Jul 13 21:29:04 [main] cdrv_cpg_deliver(454) 1
Jul 13 21:29:04 [main] sd_join_handler(990) join IPv4 ip:10.255.255.12 port:7000
Jul 13 21:29:04 [main] sd_join_handler(992) [0] IPv4 ip:10.255.255.11 port:7000
Jul 13 21:29:04 [main] sd_join_handler(992) [1] IPv4 ip:10.255.255.12 port:7000
Jul 13 21:29:04 [main] update_cluster_info(778) status = 1, epoch = 9, finished: 1
Jul 13 21:29:04 [main] update_epoch_log(55) update epoch: 10, 2
Jul 13 21:29:04 [main] sockfd_cache_add(271) 10.255.255.12:7000, count 2
Jul 13 21:29:04 [recovery] prepare_object_list(553) 10
Jul 13 21:29:04 [recovery] fetch_object_list(475) 10.255.255.11 7000
Jul 13 21:29:04 [main] listen_handler(819) accepted a new connection: 14
Jul 13 21:29:04 [main] listen_handler(819) accepted a new connection: 15
Jul 13 21:29:04 [main] client_rx_handler(577) connection from: 14, 10.255.255.12:59058
Jul 13 21:29:04 [main] queue_request(323) 15
Jul 13 21:29:04 [main] listen_handler(819) accepted a new connection: 16
Jul 13 21:29:04 [main] client_rx_handler(577) connection from: 15, 10.255.255.12:59059
Jul 13 21:29:04 [main] queue_request(323) a1
Jul 13 21:29:04 [recovery] connect_to(256) 13, 10.255.255.11:7000
Jul 13 21:29:04 [main] client_rx_handler(577) connection from: 16, 10.255.255.11:49744
Jul 13 21:29:04 [main] queue_request(323) a1
Jul 13 21:29:04 [io 7] do_process_work(990) a1, 9 , 10
Jul 13 21:29:04 [main] client_tx_handler(663) connection from: 15, 10.255.255.12:59059
Jul 13 21:29:04 [io 8] do_process_work(990) a1, 9 , 10
Jul 13 21:29:04 [main] client_tx_handler(663) connection from: 16, 10.255.255.11:49744
Jul 13 21:29:04 [recovery] fetch_object_list(502) 0
Jul 13 21:29:04 [recovery] prepare_object_list(582) 0
Jul 13 21:29:04 [main] client_handler(764) connection seems to be dead
Jul 13 21:29:04 [main] clear_client(703) refcnt:0, fd:16, 10.255.255.11:49744
Jul 13 21:29:04 [main] destroy_client(672) connection from: 10.255.255.11:49744
Jul 13 21:29:04 [main] farm_end_recover(578) old epoch 9
Jul 13 21:29:04 [main] snap_file_write(178) epoch: 9, sha1: b3e63f3cd6ab79dab88e88ca7aed8b4600849459
Jul 13 21:29:04 [main] finish_recovery(349) recovery complete: new epoch 10
Jul 13 21:29:04 [io 9] do_process_work(990) 15, 0 , 10
Jul 13 21:29:04 [main] client_handler(764) connection seems to be dead
Jul 13 21:29:04 [main] clear_client(703) refcnt:0, fd:15, 10.255.255.12:59059
Jul 13 21:29:04 [main] destroy_client(672) connection from: 10.255.255.12:59059
Jul 13 21:29:04 [main] client_handler(764) connection seems to be dead
Jul 13 21:29:04 [main] clear_client(703) refcnt:0, fd:14, 10.255.255.12:59058
Jul 13 21:29:04 [main] destroy_client(672) connection from: 10.255.255.12:59058
Jul 13 21:29:04 [main] cdrv_cpg_confchg(568) mem:1, joined:0, left:1
Jul 13 21:29:04 [main] sd_leave_handler(1059) leave IPv4 ip:10.255.255.12 port:7000
Jul 13 21:29:04 [main] sd_leave_handler(1061) [0] IPv4 ip:10.255.255.11 port:7000
Jul 13 21:29:04 [main] update_epoch_log(55) update epoch: 11, 1
Jul 13 21:29:04 [main] sockfd_cache_del(218) 10.255.255.12:7000, count 1
Jul 13 21:29:04 [recovery] prepare_object_list(553) 11
Jul 13 21:29:04 [recovery] fetch_object_list(475) 10.255.255.11 7000
Jul 13 21:29:04 [main] listen_handler(819) accepted a new connection: 14
Jul 13 21:29:04 [recovery] connect_to(256) 13, 10.255.255.11:7000
Jul 13 21:29:04 [main] client_rx_handler(577) connection from: 14, 10.255.255.11:49745
Jul 13 21:29:04 [main] queue_request(323) a1
Jul 13 21:29:04 [io 10] do_process_work(990) a1, a , 11
Jul 13 21:29:04 [main] client_tx_handler(663) connection from: 14, 10.255.255.11:49745
Jul 13 21:29:04 [recovery] fetch_object_list(502) 0
Jul 13 21:29:04 [recovery] prepare_object_list(582) 0
Jul 13 21:29:04 [main] client_handler(764) connection seems to be dead
Jul 13 21:29:04 [main] clear_client(703) refcnt:0, fd:14, 10.255.255.11:49745
Jul 13 21:29:04 [main] destroy_client(672) connection from: 10.255.255.11:49745
Jul 13 21:29:04 [main] farm_end_recover(578) old epoch 10
Jul 13 21:29:04 [main] snap_file_write(178) epoch: 10, sha1: d08b762926216f227cad950f9fee49886b56ba2c
Jul 13 21:29:04 [main] finish_recovery(349) recovery complete: new epoch 11