HI,<br><p>We would like to set up a iscsi high availability with sheepdog distributed
<br> storage .
<br> </p><p>Here is our system set up: OS - Ubuntu. Four nodes with sheepdog
<br> distributed storage and we are sharing this storage through iscsi using
<br> two nodes as well as using a virtual ip set up using ucarp.Two nodes
are<br> using same iqn. And mounted the iscsi storage as lvm partition (sdc)
<br> </p><p>node a
<br> node b
<br> node c
<br> node d
<br> node x is the initiator
<br> node a and b having common virtual ip because if 'node a' fails 'node
<br> b' should serve as iscsi target, both have same iqn.
<br> </p><p>Problem: when a failover happens ie iscsi switching from node one to
<br> two, the iscsi disk fails on initiator 'node x' <br></p><p><br></p><p></p><p>Here is the /var/log/messeage <br></p><p>Apr 16 10:57:14 prox1 kernel: scsi7 : iSCSI Initiator over TCP/IP<br>Apr 16 10:57:14 prox1 kernel: scsi 7:0:0:0: RAID IET Controller 0001 PQ: 0 ANSI: 5<br>
Apr 16 10:57:14 prox1 kernel: scsi 7:0:0:1: Direct-Access IET VIRTUAL-DISK 0001 PQ: 0 ANSI: 5<br>Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] <a href="tel:2252800%20512" value="+12252800512" target="_blank">2252800 512</a>-byte logical blocks: (1.15 GB/1.07 GiB)<br>
Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] Write Protect is off<br>
Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA<br>Apr 16 10:57:14 prox1 kernel: sdc: unknown partition table<br>Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] Attached SCSI disk<br>
<br>Apr 16 10:59:47 prox1 kernel: connection2:0: detected conn error (1020)<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE<br>
Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] <br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00<br>
Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] <br>
Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code<br>
Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] <br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error<br>
Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE<br>
Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] <br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error<br>Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00<br>
Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code<br></p><p>root@prox1:~# pvdisplay <br> /dev/sdc: read failed after 0 of 4096 at 1153368064: Input/output error<br> /dev/sdc: read failed after 0 of 4096 at 1153425408: Input/output error</p>
<p>sheepdog with single node iscsi ( <a href="https://github.com/collie/sheepdog/wiki/General-protocol-support" target="_blank">https://github.com/collie/sheepdog/wiki/General-protocol-support</a>) works well<br></p><p> should we do anything on lvm.conf? should we use multipath-tools? is this the right procedure?<br>
</p><br>Thanks,<br clear="all"><br><br>Joby Xavier<br><br>