[sheepdog-users] no object found after rejoining the cluster

[Valerio Pachera]

As you can see I disconnected a node and re-joined the cluster 30 seconds
after.
In the log then I get errors of object not found.

It doesn't sound good.

sheep -v
Sheepdog daemon version 0.9.0_293_g4aa4db4

dog cluster info -v
Cluster status: running, auto-recovery enabled
Cluster store: plain with 2:2 redundancy policy
Cluster vnodes strategy: auto
Cluster vnode mode: disk
Cluster created at Sat Oct  3 16:30:34 2015

Epoch Time           Version [Host:Port:V-Nodes,,,]
2015-10-06 10:30:06      3 [192.168.6.44:7000:645(2), 192.168.6.45:7000:644(3),
192.168.6.47:7000:324(3), 192.168.6.48:7000:432(1)]
2015-10-06 10:29:23      2 [192.168.6.45:7000:644(3), 192.168.6.47:7000:324(3),
192.168.6.48:7000:432(1)]
2015-10-03 16:30:38      1 [192.168.6.44:7000:645(2), 192.168.6.45:7000:644(3),
192.168.6.47:7000:324(3), 192.168.6.48:7000:432(1)]

sheep.log
Oct 06 10:30:06   WARN [rw 3865] read_erasure_object(237) can not read
a34a050000066f idx 1
Oct 06 10:30:06   WARN [rw 3864] read_erasure_object(237) can not read
a34a0500000677 idx 2
Oct 06 10:30:06   WARN [rw 3862] read_erasure_object(237) can not read
a34a0500000679 idx 0
Oct 06 10:30:06   WARN [rw 3866] read_erasure_object(237) can not read
a34a050000067a idx 0
Oct 06 10:30:06   WARN [rw 3860] read_erasure_object(237) can not read
a34a050000067b idx 0
Oct 06 10:30:06   WARN [rw 3860] read_erasure_object(237) can not read
a34a0500000680 idx 1
Oct 06 10:30:06   WARN [rw 3862] read_erasure_object(237) can not read
a34a0500000681 idx 1
Oct 06 10:30:06   WARN [rw 3861] read_erasure_object(237) can not read
a34a0500000682 idx 1
Oct 06 10:30:06   WARN [rw 20793] read_erasure_object(237) can not read
a34a0500000684 idx 0
Oct 06 10:30:06  ERROR [main] check_request_epoch(153) old node version 3,
2 (READ_PEER)
Oct 06 10:30:06  ERROR [main] check_request_epoch(153) old node version 3,
2 (READ_PEER)
Oct 06 10:30:06   WARN [rw 3862] sheep_exec_req(1155) failed Request has an
old epoch, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:06  ERROR [rw 3862] recover_object_work(637) failed to recover
object a34a0500000681
Oct 06 10:30:07   WARN [rw 20793] sheep_exec_req(1155) failed Request has
an old epoch, remote address: 192.168.6.48:7000, op name: READ_PEER
Oct 06 10:30:07  ERROR [rw 20793] recover_object_work(637) failed to
recover object a34a0500000684
Oct 06 10:30:07  ERROR [main] check_request_epoch(153) old node version 3,
2 (READ_PEER)
Oct 06 10:30:07   WARN [rw 3861] sheep_exec_req(1155) failed Request has an
old epoch, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07  ERROR [rw 3861] recover_object_work(637) failed to recover
object a34a0500000682
Oct 06 10:30:07   WARN [rw 3864] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3864] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.47:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3864] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.48:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [block] do_add_vdi_state(379) caution, updating
parent VID of VID: a34a0a (old parent VID: a34a09, new parent VID: a34a09)
Oct 06 10:30:07   WARN [rw 3862] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3866] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 20793] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3861] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3866] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.47:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3861] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.47:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3860] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3866] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.48:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3861] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.48:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3864] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.45:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3860] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.47:7000, op name: READ_PEER
Oct 06 10:30:07   WARN [rw 3864] sheep_exec_req(1155) failed No object
found, remote address: 192.168.6.47:7000, op name: READ_PEER
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wpkg.org/pipermail/sheepdog-users/attachments/20151006/c473e8e0/attachment.html>