HI, We would like to set up a iscsi high availability with sheepdog distributed storage . Here is our system set up: OS - Ubuntu. Four nodes with sheepdog distributed storage and we are sharing this storage through iscsi using two nodes as well as using a virtual ip set up using ucarp.Two nodes are using same iqn. And mounted the iscsi storage as lvm partition (sdc) node a node b node c node d node x is the initiator node a and b having common virtual ip because if 'node a' fails 'node b' should serve as iscsi target, both have same iqn. Problem: when a failover happens ie iscsi switching from node one to two, the iscsi disk fails on initiator 'node x' Here is the /var/log/messeage Apr 16 10:57:14 prox1 kernel: scsi7 : iSCSI Initiator over TCP/IP Apr 16 10:57:14 prox1 kernel: scsi 7:0:0:0: RAID IET Controller 0001 PQ: 0 ANSI: 5 Apr 16 10:57:14 prox1 kernel: scsi 7:0:0:1: Direct-Access IET VIRTUAL-DISK 0001 PQ: 0 ANSI: 5 Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] 2252800 512-byte logical blocks: (1.15 GB/1.07 GiB) Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] Write Protect is off Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA Apr 16 10:57:14 prox1 kernel: sdc: unknown partition table Apr 16 10:57:14 prox1 kernel: sd 7:0:0:1: [sdc] Attached SCSI disk Apr 16 10:59:47 prox1 kernel: connection2:0: detected conn error (1020) Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00 Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00 Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 08 00 00 08 00 Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Result: hostbyte=invalid driverbyte=DRIVER_SENSE Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Sense Key : Medium Error [current] Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Add. Sense: Unrecovered read error Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] CDB: Read(10): 28 00 00 00 00 00 00 00 08 00 Apr 16 10:59:51 prox1 kernel: sd 7:0:0:1: [sdc] Unhandled sense code root at prox1:~# pvdisplay /dev/sdc: read failed after 0 of 4096 at 1153368064: Input/output error /dev/sdc: read failed after 0 of 4096 at 1153425408: Input/output error sheepdog with single node iscsi ( https://github.com/collie/sheepdog/wiki/General-protocol-support) works well should we do anything on lvm.conf? should we use multipath-tools? is this the right procedure? Thanks, Joby Xavier -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.wpkg.org/pipermail/sheepdog/attachments/20120416/9cdba31a/attachment.html> |