[sheepdog-users] Sheepdog 0.8 (gateway only) died

Hitoshi Mitake mitake.hitoshi at gmail.com
Thu Apr 17 03:36:09 CEST 2014


On Wed, Apr 16, 2014 at 7:20 PM, Giovanni Bellac
<giovannib1979 at ymail.com> wrote:
> Hello all,
>
> sheepdog died yesterday on a "compute node" (sheepdog gateway only) with
> following error. We are using sheepdog 0.8.0 and a read-only SSD cache on
> our compute node (sheepdog gateway only) device:
>
> /dev/md2                                                1.9G  1.1G  706M
> 60% /opt/sheep/journal
> /dev/md3                                                 63G   24G   36G
> 40% /opt/sheep/cache
>
> Sheepdog is started with:
> # sheep -p 7000 -b 127.0.0.1 -i host=172.18.18.21 port=3333 -j
> dir=/opt/sheep/journal size=1024M -c
> zookeeper:172.18.18.11:2181,172.18.18.12:2181,172.18.18.13:2181,172.18.18.21:2181,172.18.18.22:2181
> -g -w size=40000M dir=/opt/sheep/cache/ /opt/sheep/storage
>
>
> The error log:
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:08:54  ERROR [main] modify_event(156) event info for fd 74 not
> found
> Apr 15 11:33:38  ERROR [net 433] do_write(281) failed to write to socket:
> Connection reset by peer
> Apr 15 11:33:38  ERROR [net 571] rx_work(742) failed to read data
> Apr 15 11:33:38  ERROR [net 433] send_req(319) failed to send request 16, 0:
> Connection reset by peer
> Apr 15 11:33:38  ERROR [net 433] tx_work(795) failed to send a request
> Apr 15 13:12:20  ERROR [main] modify_event(156) event info for fd 90 not
> found
> Apr 15 13:12:20  ERROR [main] modify_event(156) event info for fd 90 not
> found
> Apr 15 13:20:57  ERROR [net 8677] do_write(281) failed to write to socket:
> Connection reset by peer
> Apr 15 13:20:57  ERROR [net 8677] send_req(319) failed to send request 1, 0:
> Connection reset by peer
> Apr 15 13:20:57  ERROR [net 8677] tx_work(795) failed to send a request
> Apr 15 13:20:57  EMERG [gway 14732] add_to_lru_cache(693) PANIC: the object
> already exist
> Apr 15 13:20:57  EMERG [gway 14732] crash_handler(267) sheep exits
> unexpectedly (Aborted).
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :
> Apr 15 13:20:58  EMERG [gway 14732] sd_backtrace(817) :

The error messages indicate unknown problems. Could you add an issue
to our tracker with detailed information as much as you can provide?
https://bugs.launchpad.net/sheepdog-project

Thanks,
Hitoshi

>
> Kind regards
> Giovanni
>
> --
> sheepdog-users mailing lists
> sheepdog-users at lists.wpkg.org
> http://lists.wpkg.org/mailman/listinfo/sheepdog-users
>



More information about the sheepdog-users mailing list