[sheepdog-users] Zookeeper failed to init node

[Hitoshi Mitake]

At Mon, 13 Jul 2015 15:44:05 +0000,
zhanghongzhou wrote:
> 
> [1  <multipart/alternative (7bit)>]
> [1.1  <text/plain; gb2312 (base64)>]
> Hi experts,
> I was uploading data and run into below panic. Seems one zookeeper is dead but sheepdog should not panic itself. Reproducible.Configuration: 3 zookeeper, 14 sheepJun 26 10:11:26 EMERG [http 5107] lock_table_lookup_acquire(353) PANIC: Failed to init node /sheepdog/lock/7214379Jun 26 10:11:26 EMERG [http 5107] crash_handler(268) sheep exits unexpectedly (Aborted).Jun 26 10:11:27 EMERG [http 5107] sd_backtrace(833) sheep.c:289: crash_handlerJun 26 10:11:27 EMERG [http 5107] sd_backtrace(847) /lib64/libpthread.so.0(+0xf70f) [0x7f34053c070f]Jun 26 10:11:27 EMERG [http 5107] sd_backtrace(847) /lib64/libc.so.6(gsignal+0x34) [0x7f340454d924]Jun 26 10:11:28 EMERG [http 5107] sd_backtrace(847) /lib64/libc.so.6(abort+0x174) [0x7f340454f104]Jun 26 10:11:28 EMERG [http 5107] sd_backtrace(833) zookeeper.c:355: lock_table_lookup_acquireJun 26 10:11:28 EMERG [http 5107] sd_backtrace(833) kv.c:737: onode_allocate_extentsJun 26 10:11:28 EMERG [http 5107] sd_backtrace(833) kv.c:876: onode_append_dataJun 26 10:11:28 EMERG [http 5107] sd_backtrace(833) swift.c:255: swift_put_objectJun 26 10:11:29 EMERG [http 5107] sd_backtrace(833) swift.c:349: swift_handle_requestJun 26 10:11:29 EMERG [http 5107] sd_backtrace(833) http.c:283: http_run_requestJun 26 10:11:29 EMERG [http 5107] sd_backtrace(833) work.c:350: worker_routineJun 26 10:11:29 EMERG [http 5107] sd_backtrace(847) /lib64/libpthread.so.0(+0x79d0) [0x7f34053b89d0]Jun 26 10:11:30 EMERG [http 5107] sd_backtrace(847) /lib64/libc.so.6(clone+0x6c) [0x7f3404603b6c]
> Thanks.Hongzhou 		 	   		  
> [1.2  <text/html; gb2312 (base64)>]
> 
> [2  <text/plain; us-ascii (7bit)>]

Thanks for your report. I'll create a patch for printing error code in the above case. Fortunately, the problem can be reproduced. Could you try with the patch I'll send?

Thanks,
Hitoshi

> -- 
> sheepdog-users mailing lists
> sheepdog-users at lists.wpkg.org
> https://lists.wpkg.org/mailman/listinfo/sheepdog-users