[Sheepdog] No redundancy with sheepdog

James Ray j.ray at qmul.ac.uk
Tue Aug 24 17:32:45 CEST 2010


All,

Started playing with sheepdog today, I have following the
instructions at:
http://www.osrg.net/sheepdog/usage.html
Pulled the latest sheepdog git (last commit tag is
4d4d2a928fbc098ab1cf6afdd01bcad540afe7b4)

I dont seem to get any redundancy in my setup, killing sheep on any one of
the boxes causes all IO to die. My full build details are lower down the
email. But here is what I do to get a failiure:

Started converting an debian qcow file to sheepdog like this:
[root at pavlov sheepdog]# qemu-img convert \
debian_lenny_amd64_small.qcow2 sheepdog:debian

While it is converting I kill sheep on a machine with kill -9 (not very
nice, but should be handled) and I get the following error from qemu-img:

I/O error
qemu-img: error while writing

The same happends if I am running a VM. On restarting sheep things don't
seem to get any better with all the 'collie vdi show' commands reporting:

   name        id    size    used  shared    creation time   vdi id
------------------------------------------------------------------
error 11661488, 0

Any ideas?

Full build details:

I've compiled sheepdog like so:
LDFLAGS=-lpthread ./autogen.sh && \
    LDFLAGS=-lpthread ./configure --prefix=/usr/local/
(need to add LDFLAGS else I get:
gcc  -g -O2  -ggdb3  	  -Wall -Wshadow -Wmissing-prototypes
-Wmissing-declarations -Wstrict-prototypes -Wdeclaration-after-statement
-Wpointer-arith -Wwrite-strings -Wcast-align -Wbad-function-cast
-Wmissing-format-attribute -Wformat=2 -Wformat-security
-Wformat-nonliteral -Wno-long-long -Wno-strict-aliasing
-D_GNU_SOURCE   -o sheep sheep.o group.o sdnet.o store.o vdi.o
work.o -lcpg   -lcfg   ../lib/libsheepdog.a 
/usr/bin/ld: work.o: undefined reference to symbol 'pthread_create@@GLIBC_2.2.5'
/usr/bin/ld: note: 'pthread_create@@GLIBC_2.2.5' is defined in DSO
/lib64/libpthread.so.0 so try adding it to the linker command line
/lib64/libpthread.so.0: could not read symbols: Invalid operation
)

make clean && make && make install

Started sheepdog on 4 machines like so:
sheep /store

and formatted:
collie cluster format --copies=3

Confirmed it all looked working like this:
[root at benji ~]# collie node list
   Idx	Node id (FNV-1a) - Host:Port
------------------------------------------------
   0	059797cd439cf400 - xx.xx.xx.47:7000
   1	4ae7638456288f7f - xx.xx.xx.44:7000
* 2	74107991fa9b2ccc - xx.xx.xx.43:7000
   3	8822daf81a599f0a - xx.xx.xx.45:7000

-- 
James Ray



More information about the sheepdog mailing list