[sheepdog-users] Testing snapshot-object-reclaim

Hitoshi Mitake mitake.hitoshi at gmail.com
Sun Feb 23 06:33:15 CET 2014


Hi Valerio,

On Fri, Feb 21, 2014 at 8:39 PM, Hitoshi Mitake
<mitake.hitoshi at gmail.com> wrote:
> At Fri, 21 Feb 2014 12:33:15 +0100,
> Valerio Pachera wrote:
>>
>> It doesn't seem to work yet.
>
> Yes, current branch has some problems (some bugs and lack of sparse
> object). I'll fix the issue ASAP.

Sorry for the problem of the previous implementation. I sent refined
patchset to the list and updated the branch of github. Could you try
the new one?

Thanks,
Hitoshi

>
> Thanks,
> Hitoshi
>
>>
>> root at test004:/usr/src/sheepdog# git branch
>>   master
>> * snapshot-object-reclaim
>>
>> Sheepdog daemon version 0.8.0_80_g357534c
>>
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>>   wheezy_template     0   10 GB  2.0 GB  0.0 MB 2014-02-21 11:48
>> 5ddf88      2
>>
>> root at test004:~# dog node info
>> Id      Size    Used    Avail   Use%
>>  0      233 GB  1.2 GB  232 GB    0%
>>  1      452 GB  1.6 GB  451 GB    0%
>>  2      212 GB  1016 MB 211 GB    0%
>>  3      220 GB  948 MB  219 GB    0%
>> Total   1.1 TB  4.7 GB  1.1 TB    0%
>>
>> Total virtual image size        10 GB
>>
>>
>> dog vdi snapshot wheezy_template
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>> s wheezy_template     1   10 GB  2.0 GB  0.0 MB 2014-02-21 11:48
>> 5ddf88      2
>>   wheezy_template     0   10 GB  4.7 GB  292 MB 2014-02-21 11:50
>> 5ddf89      2
>>
>> <create a big file inside the guest>
>>
>> root at test004:~# dog vdi snapshot wheezy_template
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>> s wheezy_template     1   10 GB  2.0 GB  0.0 MB 2014-02-21 11:48
>> 5ddf88      2
>> s wheezy_template     2   10 GB  4.7 GB  292 MB 2014-02-21 11:50
>> 5ddf89      2
>>   wheezy_template     0   10 GB  0.0 MB  4.9 GB 2014-02-21 12:00   5ddf8a      2
>>
>> <removed the big file from the guest>
>>
>> root at test004:~# dog vdi snapshot wheezy_template
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>> s wheezy_template     1   10 GB  2.0 GB  0.0 MB 2014-02-21 11:48
>> 5ddf88      2
>> s wheezy_template     2   10 GB  4.7 GB  292 MB 2014-02-21 11:50
>> 5ddf89      2
>> s wheezy_template     3   10 GB  4.0 MB  4.9 GB 2014-02-21 12:00
>> 5ddf8a      2
>>   wheezy_template     0   10 GB  0.0 MB  4.9 GB 2014-02-21 12:01   5ddf8b      2
>>
>> <recreate another big file insiede the guest>
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>> s wheezy_template     1   10 GB  2.0 GB  0.0 MB 2014-02-21 11:48
>> 5ddf88      2
>> s wheezy_template     2   10 GB  4.7 GB  292 MB 2014-02-21 11:50
>> 5ddf89      2
>> s wheezy_template     3   10 GB  4.0 MB  4.9 GB 2014-02-21 12:00
>> 5ddf8a      2
>>   wheezy_template     0   10 GB  4.6 GB  296 MB 2014-02-21 12:01   5ddf8b      2
>>
>> root at test004:~# dog vdi snapshot wheezy_template
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>> s wheezy_template     1   10 GB  2.0 GB  0.0 MB 2014-02-21 11:48
>> 5ddf88      2
>> s wheezy_template     2   10 GB  4.7 GB  292 MB 2014-02-21 11:50
>> 5ddf89      2
>> s wheezy_template     3   10 GB  4.0 MB  4.9 GB 2014-02-21 12:00
>> 5ddf8a      2
>> s wheezy_template     4   10 GB  4.6 GB  296 MB 2014-02-21 12:01
>> 5ddf8b      2
>>   wheezy_template     0   10 GB  0.0 MB  4.9 GB 2014-02-21 12:09   5ddf8c      2
>>
>> <remove the big file>
>>
>> root at test004:~# dog vdi snapshot wheezy_template
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>> s wheezy_template     1   10 GB  2.0 GB  0.0 MB 2014-02-21 11:48
>> 5ddf88      2
>> s wheezy_template     2   10 GB  4.7 GB  292 MB 2014-02-21 11:50
>> 5ddf89      2
>> s wheezy_template     3   10 GB  4.0 MB  4.9 GB 2014-02-21 12:00
>> 5ddf8a      2
>> s wheezy_template     4   10 GB  4.6 GB  296 MB 2014-02-21 12:01
>> 5ddf8b      2
>> s wheezy_template     5   10 GB  4.0 MB  4.9 GB 2014-02-21 12:09
>> 5ddf8c      2
>>   wheezy_template     0   10 GB  0.0 MB  4.9 GB 2014-02-21 12:10
>> 5ddf8d      2
>>
>> root at test004:~# dog node info
>> Id      Size    Used    Avail   Use%
>>  0      233 GB  10.0 GB 223 GB    4%
>>  1      452 GB  16 GB   437 GB    3%
>>  2      212 GB  9.8 GB  202 GB    4%
>>  3      220 GB  8.9 GB  211 GB    4%
>> Total   1.1 TB  44 GB   1.0 TB    3%
>>
>> Total virtual image size        10 GB
>>
>>
>> <Before removing snapshots>
>>
>> Feb 21 11:40:50   INFO [main] main(938) shutdown
>> Feb 21 11:40:50   INFO [main] zk_leave(953) leaving from cluster
>> Feb 21 11:46:32   INFO [main] md_add_disk(317) /mnt/sheep/dsk02, vdisk
>> nr 233, total disk 1
>> Feb 21 11:46:32 NOTICE [main] get_local_addr(519) found IPv4 address
>> Feb 21 11:46:32   INFO [main] send_join_request(787) IPv4
>> ip:192.168.10.4 port:7000
>> Feb 21 11:46:32 NOTICE [main] nfs_init(518) nfs server service is not compiled
>> Feb 21 11:46:32   INFO [main] check_host_env(493) Allowed open files
>> 1024000, suggested 6144000
>> Feb 21 11:46:32   INFO [main] main(931) sheepdog daemon (version
>> 0.8.0_80_g357534c) started
>> Feb 21 11:48:02   INFO [main] rx_main(775) req=0x230e220, fd=25,
>> client=::1:58578, op=NEW_VDI, data=(not string)
>> Feb 21 11:48:02   INFO [main] tx_main(827) req=0x230e220, fd=25,
>> client=::1:58578, op=NEW_VDI, result=00
>> Feb 21 11:50:50   INFO [main] rx_main(775) req=0x7f2b30000c20, fd=26,
>> client=127.0.0.1:37013, op=NEW_VDI, data=(not string)
>> Feb 21 11:50:51   INFO [main] tx_main(827) req=0x7f2b30000c20, fd=26,
>> client=127.0.0.1:37013, op=NEW_VDI, result=00
>> Feb 21 12:00:18   INFO [main] rx_main(775) req=0x7f2b20002800, fd=75,
>> client=127.0.0.1:37021, op=NEW_VDI, data=(not string)
>> Feb 21 12:00:18   INFO [main] tx_main(827) req=0x7f2b20002800, fd=75,
>> client=127.0.0.1:37021, op=NEW_VDI, result=00
>> Feb 21 12:01:02   INFO [main] rx_main(775) req=0x7f2b20002800, fd=75,
>> client=127.0.0.1:37025, op=NEW_VDI, data=(not string)
>> Feb 21 12:01:03   INFO [main] tx_main(827) req=0x7f2b20002800, fd=75,
>> client=127.0.0.1:37025, op=NEW_VDI, result=00
>> Feb 21 12:09:18   INFO [main] rx_main(775) req=0x235bd00, fd=75,
>> client=127.0.0.1:37031, op=NEW_VDI, data=(not string)
>> Feb 21 12:09:19   INFO [main] tx_main(827) req=0x235bd00, fd=75,
>> client=127.0.0.1:37031, op=NEW_VDI, result=00
>> Feb 21 12:10:00   INFO [main] rx_main(775) req=0x235c730, fd=75,
>> client=127.0.0.1:37035, op=NEW_VDI, data=(not string)
>> Feb 21 12:10:01   INFO [main] tx_main(827) req=0x235c730, fd=75,
>> client=127.0.0.1:37035, op=NEW_VDI, result=00
>>
>> <I delete all the snapshots...(it took long)>
>>
>> for n in $(seq 1 5); do dog vdi delete -s $n wheezy_template; done
>>
>> sheep.log
>> Feb 21 12:12:57   INFO [main] rx_main(775) req=0x23979b0, fd=75,
>> client=127.0.0.1:37049, op=DEL_VDI, data=(not string)
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8800000000, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000000, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000000 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 5ddf8800000001, No object found
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 5ddf8800000001, No object found
>> Feb 21 12:12:58  ERROR [io 8888] sd_remove_object(458) failed to
>> remove object 5ddf8800000001, No object found
>> Feb 21 12:12:58  ERROR [io 8888] peer_decref_object(1094) error No object found
>> Feb 21 12:12:58  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8800000001, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000001, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000001 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8800000008, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000008, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000008 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8800000009, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000009, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000009 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf880000000a, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf880000000a, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf880000000a fail, 2
>> Feb 21 12:12:58  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8800000020, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000020, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000020 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8800000021, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000021, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000021 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 5ddf8800000022, No object found
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 5ddf8800000022, No object found
>> Feb 21 12:12:58  ERROR [io 8767] sd_remove_object(458) failed to
>> remove object 5ddf8800000022, No object found
>> Feb 21 12:12:58  ERROR [io 8767] peer_decref_object(1094) error No object found
>> Feb 21 12:12:58  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8800000022, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000022, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000022 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7890] wait_forward_request(461) fail
>> 5ddf8800000023, No object found
>> Feb 21 12:12:58  ERROR [gway 7890] wait_forward_request(461) fail
>> 5ddf8800000023, No object found
>> Feb 21 12:12:58  ERROR [io 8888] sd_remove_object(458) failed to
>> remove object 5ddf8800000023, No object found
>> Feb 21 12:12:58  ERROR [io 8888] peer_decref_object(1094) error No object found
>> Feb 21 12:12:58  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8800000023, No object found
>> Feb 21 12:12:58  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8800000023, No object found
>> Feb 21 12:12:58  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8800000023 fail, 2
>> Feb 21 12:12:58  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8800000024, No object found
>> ...
>> ...
>> ...
>> Feb 21 12:21:44  ERROR [gway 7834] wait_forward_request(461) fail
>> 5ddf8b00000420, No object found
>> Feb 21 12:21:44  ERROR [gway 7834] wait_forward_request(461) fail
>> 5ddf8b00000420, No object found
>> Feb 21 12:21:44  ERROR [io 8839] sd_remove_object(458) failed to
>> remove object 5ddf8b00000420, No object found
>> Feb 21 12:21:44  ERROR [io 8839] peer_decref_object(1094) error No object found
>> Feb 21 12:21:44  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8b00000420, No object found
>> Feb 21 12:21:44  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8b00000420, No object found
>> Feb 21 12:21:44  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8b00000420 fail, 2
>> Feb 21 12:21:44  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8c00000421, No object found
>> Feb 21 12:21:44  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8c00000421, No object found
>> Feb 21 12:21:44  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8c00000421 fail, 2
>> Feb 21 12:21:48  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8b00000447, No object found
>> Feb 21 12:21:48  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8b00000447, No object found
>> Feb 21 12:21:48  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8b00000447 fail, 2
>> Feb 21 12:22:34  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8b00000600, No object found
>> Feb 21 12:22:34  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8b00000600, No object found
>> Feb 21 12:22:34  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8b00000600 fail, 2
>> Feb 21 12:22:34  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8900000601, No object found
>> Feb 21 12:22:34  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8900000601, No object found
>> Feb 21 12:22:34  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8900000601 fail, 2
>> Feb 21 12:22:44  ERROR [gway 7834] wait_forward_request(461) fail
>> 85ddf8b00000661, No object found
>> Feb 21 12:22:44  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8b00000661, No object found
>> Feb 21 12:22:44  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8b00000661 fail, 2
>> Feb 21 12:22:55  ERROR [gway 7890] wait_forward_request(461) fail
>> 85ddf8b00000800, No object found
>> Feb 21 12:22:55  ERROR [deletion] sd_dec_object_refcnt(499) failed to
>> decrement reference 85ddf8b00000800, No object found
>> Feb 21 12:22:55  ERROR [deletion] delete_vdi_work(823) discard ref
>> 5ddf8b00000800 fail, 2
>> Feb 21 12:23:09   INFO [main] tx_main(827) req=0x237bc30, fd=75,
>> client=127.0.0.1:37057, op=DEL_VDI, result=00
>>
>>
>> root at test004:~# dog vdi list
>>   Name        Id    Size    Used  Shared    Creation time   VDI id  Copies  Tag
>>   wheezy_template     0   10 GB   68 MB  4.9 GB 2014-02-21 12:10
>> 5ddf8d      2
>>
>> root at test004:~# dog node info
>> Id      Size    Used    Avail   Use%
>>  0      233 GB  9.0 GB  224 GB    3%
>>  1      452 GB  15 GB   438 GB    3%
>>  2      212 GB  9.0 GB  203 GB    4%
>>  3      220 GB  8.0 GB  212 GB    3%
>> Total   1.1 TB  41 GB   1.1 TB    3%
>>
>> Total virtual image size        10 GB
>>
>> Total used size should be no more than 20G.
>> --
>> sheepdog-users mailing lists
>> sheepdog-users at lists.wpkg.org
>> http://lists.wpkg.org/mailman/listinfo/sheepdog-users



More information about the sheepdog-users mailing list