[sheepdog-users] sheep.log after cluster restart

[Valerio Pachera]

I noticed that, after stopping and starting the cluster, I see
different messages in sheep.log

# collie node list
M   Id   Host:Port         V-Nodes       Zone
-    0   192.168.6.41:7000      60  688302272
-    1   192.168.6.42:7000      60  705079488
-    2   192.168.6.43:7000      77  721856704
-    3   192.168.6.44:7000      60  738633920


id 0
Jun 17 10:18:06 [main] main(781) shutdown
Jun 17 11:33:23 [main] md_add_disk(161)
/mnt/ST2000DM001-1CH164_W1E2N5G6/obj, nr 1
Jun 17 11:33:23 [main] send_join_request(1101) IPv4 ip:192.168.6.41 port:7000
Jun 17 11:33:23 [main] for_each_object_in_stale(403)
/mnt/ST2000DM001-1CH164_W1E2N5G6/obj/.stale
Jun 17 11:33:23 [main] check_host_env(404) Allowed core file size 0,
suggested unlimited
Jun 17 11:33:23 [main] main(774) sheepdog daemon (version
0.6.0_26_g9663187) started
Jun 17 11:33:23 [main] update_cluster_info(877) status = 4, epoch =
19, finished: 0
Jun 17 11:33:31 [main] sd_check_join_cb(1061) 192.168.6.42:7000: ret =
0x0, cluster_status = 0x4
Jun 17 11:33:31 [main] update_cluster_info(877) status = 4, epoch =
19, finished: 1
Jun 17 11:33:51 [main] sd_check_join_cb(1061) 192.168.6.43:7000: ret =
0x0, cluster_status = 0x4
Jun 17 11:33:51 [main] update_cluster_info(877) status = 4, epoch =
19, finished: 1
Jun 17 11:34:10 [main] sd_check_join_cb(1061) 192.168.6.44:7000: ret =
0x0, cluster_status = 0x1
Jun 17 11:34:10 [main] update_cluster_info(877) status = 1, epoch =
19, finished: 1


id 1
Jun 17 10:18:06 [main] main(781) shutdown
Jun 17 11:33:31 [main] md_add_disk(161)
/mnt/ST2000DM001-1CH164_W1E2N5GM/obj, nr 1
Jun 17 11:33:31 [main] md_add_disk(161) /mnt/wd_WMAYP1690412, nr 2
Jun 17 11:33:31 [main] send_join_request(1101) IPv4 ip:192.168.6.42 port:7000
Jun 17 11:33:31 [main] for_each_object_in_stale(403)
/mnt/ST2000DM001-1CH164_W1E2N5GM/obj/.stale
Jun 17 11:33:31 [main] for_each_object_in_stale(403) /mnt/wd_WMAYP1690412/.stale
Jun 17 11:33:32 [main] check_host_env(404) Allowed core file size 0,
suggested unlimited
Jun 17 11:33:32 [main] main(774) sheepdog daemon (version
0.6.0_26_g9663187) started
Jun 17 11:33:32 [main] update_cluster_info(877) status = 4, epoch =
19, finished: 0
Jun 17 11:33:51 [main] update_cluster_info(877) status = 4, epoch =
19, finished: 1
Jun 17 11:34:10 [main] update_cluster_info(877) status = 1, epoch =
19, finished: 1

id 2
Jun 17 10:18:06 [main] main(781) shutdown
Jun 17 11:33:50 [main] md_add_disk(161) /mnt/sheep/dsk01/obj, nr 1
Jun 17 11:33:51 [main] md_add_disk(161) /mnt/sheep/dsk02, nr 2
Jun 17 11:33:51 [main] send_join_request(1101) IPv4 ip:192.168.6.43 port:7000
Jun 17 11:33:51 [main] for_each_object_in_stale(403) /mnt/sheep/dsk01/obj/.stale
Jun 17 11:33:51 [main] for_each_object_in_stale(403) /mnt/sheep/dsk02/.stale
Jun 17 11:34:00 [main] check_host_env(404) Allowed core file size 0,
suggested unlimited
Jun 17 11:34:00 [main] main(774) sheepdog daemon (version
0.6.0_26_g9663187) started
Jun 17 11:34:00 [main] update_cluster_info(877) status = 4, epoch =
19, finished: 0
Jun 17 11:34:10 [main] update_cluster_info(877) status = 1, epoch =
19, finished: 1


id 3
Jun 17 10:18:06 [main] main(781) shutdown
Jun 17 11:34:10 [main] md_add_disk(161) /mnt/wd_WCAYUEP99298/obj, nr 1
Jun 17 11:34:10 [main] md_add_disk(161) /mnt/wd_WCAWZ1588874, nr 2
Jun 17 11:34:10 [main] send_join_request(1101) IPv4 ip:192.168.6.44 port:7000
Jun 17 11:34:10 [main] for_each_object_in_stale(403)
/mnt/wd_WCAYUEP99298/obj/.stale
Jun 17 11:34:10 [main] for_each_object_in_stale(403) /mnt/wd_WCAWZ1588874/.stale
Jun 17 11:34:10 [main] init_vdi_state(194) failed to read inode header
8002e51900000000 0
Jun 17 11:34:10 [main] init_vdi_state(194) failed to read inode header
80c8d12d00000000 0
Jun 17 11:34:10 [main] init_vdi_state(194) failed to read inode header
80c8be4d00000000 0
Jun 17 11:34:10 [main] init_vdi_state(194) failed to read inode header
80c8d12c00000000 0
Jun 17 11:34:10 [main] check_host_env(404) Allowed core file size 0,
suggested unlimited
Jun 17 11:34:10 [main] main(774) sheepdog daemon (version
0.6.0_26_g9663187) started
Jun 17 11:34:10 [main] update_cluster_info(877) status = 1, epoch =
19, finished: 0
Jun 17 11:34:21 [gway 6820] gateway_read_obj(60) local read
8002e51900000000 failed, No object found
Jun 17 11:34:21 [gway 6820] gateway_read_obj(60) local read
8002e51900000000 failed, No object found
Jun 17 11:34:21 [gway 6820] gateway_read_obj(60) local read
80c8be4d00000000 failed, No object found
Jun 17 11:34:21 [gway 6820] gateway_read_obj(60) local read
80c8d12800000000 failed, No object found
Jun 17 11:34:22 [gway 6820] gateway_read_obj(60) local read
80c8d12c00000000 failed, No object found
Jun 17 11:34:22 [gway 6820] gateway_read_obj(60) local read
80c8d12c00000000 failed, No object found
Jun 17 11:34:22 [gway 6820] gateway_read_obj(60) local read
80c8d12d00000000 failed, No object found
Jun 17 11:34:22 [gway 6820] gateway_read_obj(60) local read
80c8d12d00000000 failed, No object found

About node id 0: what does 'cluster_status = 0xN' means?

About node id 3: what do you think about 'No object found' ?