[sheepdog-users] Automatic disconnection of client during recovery

Valerio Pachera sirio81 at gmail.com
Fri Dec 13 09:19:47 CET 2013 

I summarize sheep.log of test007.
When you see (...) it means the same row or block repats many times.

Dec 12 17:11:58   INFO [main] md_add_disk(310) /mnt/sheep/dsk01, vdisk nr
220, total disk 1
Dec 12 17:11:58   INFO [main] md_add_disk(310) /mnt/sheep/dsk02, vdisk nr
298, total disk 2
Dec 12 17:11:58   INFO [main] send_join_request(777) IPv4 ip:192.168.2.47
port:7000
Dec 12 17:11:59   INFO [main] check_host_env(477) Allowed open files
1024000, suggested 6144000
Dec 12 17:11:59   INFO [main] main(881) sheepdog daemon (version
0.7.0_197_g9f718d2) started
Dec 12 17:12:08  ERROR [io 7712] do_epoch_log_read(54) failed to open epoch
25 log, No such file or directory
...
Dec 12 17:12:18  ALERT [main] get_vdi_copy_number(100) copy number for
539419 not found, set 2
Dec 12 17:12:18  ALERT [main] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
...
Dec 12 17:12:20  ALERT [rw] get_vdi_copy_number(100) copy number for 539419
not found, set 2
...
Dec 12 17:12:20  ALERT [rw] get_vdi_copy_policy(117) copy policy for 539419
not found, set 0
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
53941900001284 is recovered (381/32537)
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
605eca00000336 is recovered (382/32537)
Dec 12 17:12:21  ERROR [io 7712] vid_is_snapshot(74) No VDI entry for
539419 found
Dec 12 17:12:21  ALERT [io 7712] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
Dec 12 17:12:21  ALERT [io 7712] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
20717c00000d3b is recovered (383/32537)
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
20717c00000fc7 is recovered (384/32537)
Dec 12 17:12:21  ERROR [io 7712] vid_is_snapshot(74) No VDI entry for
539419 found
Dec 12 17:12:21  ALERT [io 7712] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
Dec 12 17:12:21  ALERT [io 7712] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
605eca00000efd is recovered (385/32537)
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
4d7b16000000e3 is recovered (386/32537)
Dec 12 17:12:21  ERROR [rw] sheep_exec_req(933) failed No object found
...
Dec 12 17:12:21  ERROR [rw] do_epoch_log_read(54) failed to open epoch 25
log, No such file or directory
Dec 12 17:12:21  ERROR [rw] sheep_exec_req(933) failed No object found
Dec 12 17:12:21  ERROR [rw] sheep_exec_req(933) failed No object found
Dec 12 17:12:21  ERROR [rw] do_epoch_log_read(54) failed to open epoch 23
log, No such file or directory
Dec 12 17:12:21  ERROR [rw] sheep_exec_req(933) failed No object found
...
Dec 12 17:12:21  ERROR [rw] do_epoch_log_read(54) failed to open epoch 1
log, No such file or directory
Dec 12 17:12:21  ERROR [rw] sheep_exec_req(933) failed Failed to find
requested tag
Dec 12 17:12:21  ALERT [rw] rollback_vnode_info(109) cannot get epoch 1
Dec 12 17:12:21  ALERT [rw] rollback_vnode_info(110) clients may see old
data
Dec 12 17:12:21  ERROR [rw] recover_replication_object(378) can not recover
oid 8005a0ce00000000
Dec 12 17:12:21  ERROR [rw] recover_object_work(531) failed to recover
object 8005a0ce00000000
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
8005a0ce00000000 is recovered (387/32537)
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
d398e500000a31 is recovered (388/32537)
Dec 12 17:12:21  ALERT [rw] get_vdi_copy_policy(117) copy policy for 53941a
not found, set 0
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
53941a000004bb is recovered (389/32537)
Dec 12 17:12:21  ERROR [io 7712] vid_is_snapshot(74) No VDI entry for
539419 found
Dec 12 17:12:21  ALERT [io 7712] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
Dec 12 17:12:21  ALERT [io 7712] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
Dec 12 17:12:21  ERROR [io 7737] do_epoch_log_read(54) failed to open epoch
19 log, No such file or directory
Dec 12 17:12:21   INFO [main] recover_object_main(841) object
605ecc00001598 is recovered (390/32537)
Dec 12 17:12:22  ERROR [io 7737] do_epoch_log_read(54) failed to open epoch
17 log, No such file or directory
...
Dec 12 17:12:22   INFO [main] recover_object_main(841) object
20717c00000a40 is recovered (391/32537)
Dec 12 17:12:22  ALERT [rw] get_vdi_copy_policy(117) copy policy for 539419
not found, set 0
Dec 12 17:12:22   INFO [main] recover_object_main(841) object
53941900000ea9 is recovered (392/32537)
Dec 12 17:12:22   INFO [main] recover_object_main(841) object
605eca000024db is recovered (393/32537)
Dec 12 17:12:22   INFO [main] recover_object_main(841) object
cbb2a600000653 is recovered (394/32537)
Dec 12 17:12:22   INFO [main] recover_object_main(841) object
20717c00000c4d is recovered (395/32537)
Dec 12 17:12:22  ERROR [io 7712] vid_is_snapshot(74) No VDI entry for
53941a found
...
Dec 12 17:12:32  ALERT [rw] get_vdi_copy_policy(117) copy policy for 539419
not found, set 0
Dec 12 17:12:32  ALERT [main] get_vdi_copy_number(100) copy number for
539419 not found, set 2
Dec 12 17:12:32  ALERT [main] get_vdi_copy_policy(117) copy policy for
539419 not found, set 0
...
Dec 12 17:12:35   INFO [main] recover_object_main(841) object
53941d000005df is recovered (1/27301)
....
Dec 12 17:12:35  ERROR [rw] sheep_exec_req(933) failed No object found
....
Dec 12 17:12:35  ERROR [rw] do_epoch_log_read(54) failed to open epoch 25
log, No such file or directory
Dec 12 17:12:35  ERROR [rw] sheep_exec_req(933) failed No object found
Dec 12 17:12:35  ERROR [rw] sheep_exec_req(933) failed No object found
....
Dec 12 17:12:35  ERROR [rw] recover_replication_object(378) can not recover
oid 8005a0e700000000
Dec 12 17:12:35  ERROR [rw] recover_object_work(531) failed to recover
object 8005a0e700000000
Dec 12 17:12:35   INFO [main] recover_object_main(841) object
8005a0e700000000 is recovered (401/27301)
Dec 12 17:12:35   INFO [main] recover_object_main(841) object
20717c00000cbf is recovered (402/27301)
Dec 12 17:12:35   INFO [main] recover_object_main(841) object
20717c000004ac is recovered (403/27301)
Dec 12 17:12:35   INFO [main] recover_object_main(841) object
5ddf88000005b0 is recovered (404/27301)
Dec 12 17:12:36   INFO [main] recover_object_main(841) object
d398e500000637 is recovered (405/27301)
Dec 12 17:12:36  ERROR [io 7712] default_read_from_path(287) failed to read
object 80d398e900000000, path=/mnt/sheep/dsk01/80d398e900000000, offset=0,
size=4198976, result=4198968, No data available
Dec 12 17:12:36  ERROR [io 7712] err_to_sderr(115) oid=80d398e900000000, No
data available
Dec 12 17:12:36   INFO [main] md_remove_disk(316) /mnt/sheep/dsk01 from
multi-disk array
Dec 12 17:12:36  ERROR [io 7737] default_read_from_path(287) failed to read
object 80d398ec00000000, path=/mnt/sheep/dsk02/80d398ec00000000, offset=0,
size=4198976, result=4198968, No data available
Dec 12 17:12:36  ERROR [io 7737] err_to_sderr(115) oid=80d398ec00000000, No
data available
Dec 12 17:12:36   INFO [main] md_remove_disk(316) /mnt/sheep/dsk02 from
multi-disk array
Dec 12 17:12:36  ERROR [io 7737] err_to_sderr(97)
/all/disks/are/broken/,ps/əʌo7/! corrupted
Dec 12 17:12:36  ERROR [main] io_op_done(48) leaving sheepdog cluster
Dec 12 17:12:36  ERROR [io 7737] err_to_sderr(97)
/all/disks/are/broken/,ps/əʌo7/! corrupted
Dec 12 17:12:36  ERROR [main] io_op_done(48) leaving sheepdog cluster
Dec 12 17:12:36  ERROR [rw] default_create_and_write(379) failed to open
/all/disks/are/broken/,ps/əʌo7/!/0053941d000005df.tmp: No such file or
directory
Dec 12 17:12:36  ERROR [rw] err_to_sderr(97)
/all/disks/are/broken/,ps/əʌo7/! corrupted
Dec 12 17:12:36  ERROR [rw] err_to_sderr(97)
/all/disks/are/broken/,ps/əʌo7/! corrupted
Dec 12 17:12:36  ERROR [rw] sheep_exec_req(933) failed Request has an old
epoch
Dec 12 17:12:36  ERROR [rw] recover_object_work(531) failed to recover
object 53941d000005df
Dec 12 17:12:36  ERROR [main] check_request_epoch(151) old node version 38,
37 (READ_PEER)


grep -c ALERT sheep.log.old
21250
grep -c INFO sheep.log.old
896
grep -c ERROR sheep.log.old
205
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wpkg.org/pipermail/sheepdog-users/attachments/20131213/d62407fc/attachment-0005.html>

More information about the sheepdog-users mailing list