[sheepdog-users] High cpu usage by sheep (3/5)

Hitoshi Mitake mitake.hitoshi at gmail.com
Thu Jan 16 07:06:53 CET 2014


> # perf version : 3.12
> # arch : x86_64
> # nrcpus online : 2
> # nrcpus avail : 2
> # cpudesc : Intel(R) Core(TM)2 CPU 4300 @ 1.80GHz
> # cpuid : GenuineIntel,6,15,2
> # total memory : 1529164 kB
> # cmdline : /usr/sbin/perf record -u sheepdog -asgv -o cluster.check.perf.data 
> # event : name = cycles, type = 0, config = 0x0, config1 = 0x0, config2 = 0x0, excl_usr = 0, excl_kern = 0, excl_host = 0, excl_guest = 1, precise_ip = 0, attr_mmap2 = 0, attr_mmap  = 1, attr_mmap_data = 0
> # HEADER_CPU_TOPOLOGY info available, use -I to display
> # pmu mappings: cpu = 4, software = 1, breakpoint = 5
> # ========
> #
> # Samples: 176K of event 'cycles'
> # Event count (approx.): 75671613234
> #
> # Overhead  Command
> # ........  .......
> #
>    100.00%    sheep
>               |          
>               |--63.95%-- sha1_transform_ssse3
>               |          |          
>               |           --100.00%-- 0x8a91a08a6add6798
>               |          
>               |--7.19%-- clear_page_c
>               |          __alloc_pages_nodemask
>               |          |          
>               |          |--99.84%-- handle_pte_fault
>               |          |          handle_mm_fault
>               |          |          __do_page_fault
>               |          |          do_page_fault
>               |          |          page_fault
>               |          |          |          
>               |          |          |--99.96%-- generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |           --0.04%-- [...]
>               |           --0.16%-- [...]
>               |          
>               |--7.15%-- memset
>               |          |          
>               |          |--99.98%-- mpage_readpages
>               |          |          ext4_readpages
>               |          |          __do_page_cache_readahead
>               |          |          ra_submit
>               |          |          ondemand_readahead
>               |          |          |          
>               |          |          |--95.22%-- page_cache_async_readahead
>               |          |          |          generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |          |          
>               |          |           --4.78%-- page_cache_sync_readahead
>               |          |                     generic_file_aio_read
>               |          |                     do_sync_read
>               |          |                     vfs_read
>               |          |                     sys_pread64
>               |          |                     system_call_fastpath
>               |          |                     pread64
>               |           --0.02%-- [...]
>               |          
>               |--3.55%-- copy_user_generic_string
>               |          |          
>               |          |--99.76%-- generic_file_aio_read
>               |          |          do_sync_read
>               |          |          vfs_read
>               |          |          sys_pread64
>               |          |          system_call_fastpath
>               |          |          pread64
>               |           --0.24%-- [...]
>               |          
>               |--1.74%-- page_fault
>               |          |          
>               |          |--99.64%-- generic_file_aio_read
>               |          |          do_sync_read
>               |          |          vfs_read
>               |          |          sys_pread64
>               |          |          system_call_fastpath
>               |          |          pread64
>               |           --0.36%-- [...]
>               |          
>               |--1.63%-- do_mpage_readpage
>               |          |          
>               |          |--99.62%-- mpage_readpages
>               |          |          ext4_readpages
>               |          |          __do_page_cache_readahead
>               |          |          ra_submit
>               |          |          ondemand_readahead
>               |          |          |          
>               |          |          |--94.89%-- page_cache_async_readahead
>               |          |          |          generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |          |          
>               |          |           --5.11%-- page_cache_sync_readahead
>               |          |                     generic_file_aio_read
>               |          |                     do_sync_read
>               |          |                     vfs_read
>               |          |                     sys_pread64
>               |          |                     system_call_fastpath
>               |          |                     pread64
>               |           --0.38%-- [...]
>               |          
>               |--1.11%-- handle_pte_fault
>               |          |          
>               |          |--99.30%-- handle_mm_fault
>               |          |          __do_page_fault
>               |          |          do_page_fault
>               |          |          page_fault
>               |          |          |          
>               |          |          |--99.84%-- generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |           --0.16%-- [...]
>               |          |          
>               |           --0.70%-- __do_page_fault
>               |                     do_page_fault
>               |                     page_fault
>               |                     |          
>               |                     |--93.60%-- generic_file_aio_read
>               |                     |          do_sync_read
>               |                     |          vfs_read
>               |                     |          sys_pread64
>               |                     |          system_call_fastpath
>               |                     |          pread64
>               |                     |          
>               |                      --6.40%-- 0x7fd12a5c9c2c
>               |          
>               |--0.92%-- get_page_from_freelist
>               |          |          
>               |          |--97.89%-- __alloc_pages_nodemask
>               |          |          |          
>               |          |          |--54.80%-- handle_pte_fault
>               |          |          |          handle_mm_fault
>               |          |          |          __do_page_fault
>               |          |          |          do_page_fault
>               |          |          |          page_fault
>               |          |          |          |          
>               |          |          |          |--99.76%-- generic_file_aio_read
>               |          |          |          |          do_sync_read
>               |          |          |          |          vfs_read
>               |          |          |          |          sys_pread64
>               |          |          |          |          system_call_fastpath
>               |          |          |          |          pread64
>               |          |          |           --0.24%-- [...]
>               |          |          |          
>               |          |          |--44.45%-- __do_page_cache_readahead
>               |          |          |          ra_submit
>               |          |          |          ondemand_readahead
>               |          |          |          |          
>               |          |          |          |--94.52%-- page_cache_async_readahead
>               |          |          |          |          generic_file_aio_read
>               |          |          |          |          do_sync_read
>               |          |          |          |          vfs_read
>               |          |          |          |          sys_pread64
>               |          |          |          |          system_call_fastpath
>               |          |          |          |          pread64
>               |          |          |          |          
>               |          |          |           --5.48%-- page_cache_sync_readahead
>               |          |          |                     generic_file_aio_read
>               |          |          |                     do_sync_read
>               |          |          |                     vfs_read
>               |          |          |                     sys_pread64
>               |          |          |                     system_call_fastpath
>               |          |          |                     pread64
>               |          |          |          
>               |          |          |--0.63%-- __get_free_pages
>               |          |          |          __tlb_remove_page
>               |          |          |          unmap_single_vma
>               |          |          |          unmap_vmas
>               |          |          |          unmap_region
>               |          |          |          do_munmap
>               |          |          |          vm_munmap
>               |          |          |          sys_munmap
>               |          |          |          system_call_fastpath
>               |          |          |          munmap
>               |          |          |          0x30302f6a626f2f31
>               |          |           --0.12%-- [...]
>               |          |          
>               |          |--1.26%-- __do_page_cache_readahead
>               |          |          ra_submit
>               |          |          ondemand_readahead
>               |          |          |          
>               |          |          |--84.70%-- page_cache_async_readahead
>               |          |          |          generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |          |          
>               |          |           --15.30%-- page_cache_sync_readahead
>               |          |                     generic_file_aio_read
>               |          |                     do_sync_read
>               |          |                     vfs_read
>               |          |                     sys_pread64
>               |          |                     system_call_fastpath
>               |          |                     pread64
>               |          |          
>               |           --0.85%-- handle_pte_fault
>               |                     handle_mm_fault
>               |                     __do_page_fault
>               |                     do_page_fault
>               |                     page_fault
>               |                     |          
>               |                     |--93.68%-- generic_file_aio_read
>               |                     |          do_sync_read
>               |                     |          vfs_read
>               |                     |          sys_pread64
>               |                     |          system_call_fastpath
>               |                     |          pread64
>               |                     |          
>               |                      --6.32%-- read_vdis
>               |                                0x20000000000000
>               |          
>               |--0.82%-- __rmqueue
>               |          |          
>               |          |--97.63%-- get_page_from_freelist
>               |          |          __alloc_pages_nodemask
>               |          |          |          
>               |          |          |--50.98%-- handle_pte_fault
>               |          |          |          handle_mm_fault
>               |          |          |          __do_page_fault
>               |          |          |          do_page_fault
>               |          |          |          page_fault
>               |          |          |          generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |          |          
>               |          |          |--47.31%-- __do_page_cache_readahead
>               |          |          |          ra_submit
>               |          |          |          ondemand_readahead
>               |          |          |          |          
>               |          |          |          |--98.82%-- page_cache_async_readahead
>               |          |          |          |          generic_file_aio_read
>               |          |          |          |          do_sync_read
>               |          |          |          |          vfs_read
>               |          |          |          |          sys_pread64
>               |          |          |          |          system_call_fastpath
>               |          |          |          |          pread64
>               |          |          |          |          
>               |          |          |           --1.18%-- page_cache_sync_readahead
>               |          |          |                     generic_file_aio_read
>               |          |          |                     do_sync_read
>               |          |          |                     vfs_read
>               |          |          |                     sys_pread64
>               |          |          |                     system_call_fastpath
>               |          |          |                     pread64
>               |          |          |          
>               |          |          |--1.50%-- __get_free_pages
>               |          |          |          __tlb_remove_page
>               |          |          |          |          
>               |          |          |          |--95.53%-- unmap_single_vma
>               |          |          |          |          unmap_vmas
>               |          |          |          |          unmap_region
>               |          |          |          |          do_munmap
>               |          |          |          |          vm_munmap
>               |          |          |          |          sys_munmap
>               |          |          |          |          system_call_fastpath
>               |          |          |          |          munmap
>               |          |          |          |          0x30302f6a626f2f31
>               |          |          |          |          
>               |          |          |           --4.47%-- ___pte_free_tlb
>               |          |          |                     free_pgd_range
>               |          |          |                     free_pgtables
>               |          |          |                     unmap_region
>               |          |          |                     do_munmap
>               |          |          |                     vm_munmap
>               |          |          |                     sys_munmap
>               |          |          |                     system_call_fastpath
>               |          |          |                     munmap
>               |          |          |                     0x30302f6a626f2f31
>               |          |           --0.21%-- [...]
>               |          |          
>               |           --2.37%-- __alloc_pages_nodemask
>               |                     |          
>               |                     |--51.88%-- handle_pte_fault
>               |                     |          handle_mm_fault
>               |                     |          __do_page_fault
>               |                     |          do_page_fault
>               |                     |          page_fault
>               |                     |          generic_file_aio_read
>               |                     |          do_sync_read
>               |                     |          vfs_read
>               |                     |          sys_pread64
>               |                     |          system_call_fastpath
>               |                     |          pread64
>               |                     |          
>               |                      --48.12%-- __do_page_cache_readahead
>               |                                ra_submit
>               |                                ondemand_readahead
>               |                                page_cache_async_readahead
>               |                                generic_file_aio_read
>               |                                do_sync_read
>               |                                vfs_read
>               |                                sys_pread64
>               |                                system_call_fastpath
>               |                                pread64
>               |          
>               |--0.80%-- file_read_actor
>               |          |          
>               |          |--99.22%-- generic_file_aio_read
>               |          |          do_sync_read
>               |          |          vfs_read
>               |          |          sys_pread64
>               |          |          system_call_fastpath
>               |          |          pread64
>               |          |          
>               |           --0.78%-- do_sync_read
>               |                     vfs_read
>               |                     sys_pread64
>               |                     system_call_fastpath
>               |                     pread64
>               |          
>               |--0.61%-- _raw_spin_lock
>               |          |          
>               |          |--63.57%-- handle_pte_fault
>               |          |          handle_mm_fault
>               |          |          __do_page_fault
>               |          |          do_page_fault
>               |          |          page_fault
>               |          |          generic_file_aio_read
>               |          |          do_sync_read
>               |          |          vfs_read
>               |          |          sys_pread64
>               |          |          system_call_fastpath
>               |          |          pread64
>               |          |          
>               |          |--13.97%-- ext4_es_lru_add
>               |          |          ext4_es_lookup_extent
>               |          |          ext4_map_blocks
>               |          |          _ext4_get_block
>               |          |          ext4_get_block
>               |          |          do_mpage_readpage
>               |          |          mpage_readpages
>               |          |          ext4_readpages
>               |          |          __do_page_cache_readahead
>               |          |          ra_submit
>               |          |          ondemand_readahead
>               |          |          |          
>               |          |          |--92.46%-- page_cache_async_readahead
>               |          |          |          generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |          |          
>               |          |           --7.54%-- page_cache_sync_readahead
>               |          |                     generic_file_aio_read
>               |          |                     do_sync_read
>               |          |                     vfs_read
>               |          |                     sys_pread64
>               |          |                     system_call_fastpath
>               |          |                     pread64
>               |          |          
>               |          |--5.91%-- handle_mm_fault
>               |          |          __do_page_fault
>               |          |          do_page_fault
>               |          |          page_fault
>               |          |          |          
>               |          |          |--98.28%-- generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |          |          
>               |          |           --1.72%-- 0x7f1ce3882c2c
>               |          |          
>               |          |--4.54%-- ext4_es_lookup_extent
>               |          |          ext4_map_blocks
>               |          |          _ext4_get_block
>               |          |          ext4_get_block
>               |          |          do_mpage_readpage
>               |          |          mpage_readpages
>               |          |          ext4_readpages
>               |          |          __do_page_cache_readahead
>               |          |          ra_submit
>               |          |          ondemand_readahead
>               |          |          page_cache_async_readahead
>               |          |          generic_file_aio_read
>               |          |          do_sync_read
>               |          |          vfs_read
>               |          |          sys_pread64
>               |          |          system_call_fastpath
>               |          |          pread64
>               |          |          
>               |          |--2.11%-- get_page_from_freelist
>               |          |          __alloc_pages_nodemask
>               |          |          |          
>               |          |          |--50.70%-- __do_page_cache_readahead
>               |          |          |          ra_submit
>               |          |          |          ondemand_readahead
>               |          |          |          page_cache_async_readahead
>               |          |          |          generic_file_aio_read
>               |          |          |          do_sync_read
>               |          |          |          vfs_read
>               |          |          |          sys_pread64
>               |          |          |          system_call_fastpath
>               |          |          |          pread64
>               |          |          |          
>               |          |           --49.30%-- handle_pte_fault
>               |          |                     handle_mm_fault
>               |          |                     __do_page_fault
>               |          |                     do_page_fault
>               |          |                     page_fault
>               |          |                     generic_file_aio_read
>               |          |                     do_sync_read
>               |          |                     vfs_read
>               |          |                     sys_pread64
>               |          |                     system_call_fastpath
>               |          |                     pread64
>               |          |          
>               |          |--1.20%-- free_pcppages_bulk
>               |          |          free_hot_cold_page
>               |          |          free_hot_cold_page_list
>               |          |          release_pages
>               |          |          free_pages_and_swap_cache
>               |          |          tlb_flush_mmu
>               |          |          tlb_finish_mmu
>               |          |          unmap_region
>               |          |          do_munmap
>               |          |          vm_munmap
>               |          |          sys_munmap
>               |          |          system_call_fastpath
>               |          |          munmap
>               |          |          0x30302f6a626f2f31
>               |          |          
>               |          |--1.06%-- do_futex
>               |          |          sys_futex
>               |          |          system_call_fastpath
>               |          |          pthread_cond_signal
>               |          |          |          
>               |          |          |--35.75%-- 0x7fd12bf08608
>               |          |          |          |          
>               |          |          |          |--40.12%-- 0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0e0000988
>               |          |          |          |          
>               |          |          |          |--24.21%-- 0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd0dc000988
>               |          |          |          |          
>               |          |          |          |--23.49%-- 0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          0x7fd12bf08608
>               |          |          |          |          0x7fd100000988
>               |          |          |          |          
>               |          |          |           --12.18%-- 0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |                     0x7fd12bf08608
>               |          |          |                     0x7fd0e0000a88
>               |          |          |          
>               |          |          |--29.33%-- 0x7fd12bf08188
>               |          |          |          |          
>               |          |          |          |--47.07%-- 0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40
>               |          |          |          |          0x7fd12bf08188
>               |          |          |          |          0x7fd12bf0da40



More information about the sheepdog-users mailing list