[sheepdog] [PATCH 0/3] work: implement a dynamically changing thread pool

Bastian Scholz nimrodxx at gmx.de
Thu Oct 25 13:55:20 CEST 2012


OKAY...

call me sheep-ripper...

Am 2012-10-25 10:08, schrieb MORITA Kazutaka:
> So far, I've not encountered situations where my patch shows worse
> performance.  In most cases, queue_work is called only from one
> thread, so serializing at queue_work is unlikely to be a problem.
> Another contention is between queue_work and worker_routine, but
> worker threads spend the most of time doing disk I/Os and it also
> couldn't be a problem on my environment.

Master Branch from today...

# collie vdi create test 1G
# ./vditest test -w -B 4096 -a

First try, some sheeps die and the vdis had failed objects.
After shutting down the remaining sheeps, restart all and
wait for recovery finished the test vdi was gone... (no
logs available, sorry)

Second try, the gateway process hangs and write a lot of
this to the logfile...
> Oct 25 13:47:01 [main] listen_handler(839) failed to
> accept a new connection: Too many open files

Without -a parameter it works...
First try...
# ./vditest test -w -B 4096
options: -B 4096:4096 -c writethrough -D 0:100 -o 0
          -p linear -s 1351165854 -S 0:1073741824 -T 10 -f -1
Total write throughput: 256409.6B/s (250.4K/s), IOPS 62.6/s.

After the 10th run of the same command
# ./vditest test -w -B 4096
options: -B 4096:4096 -c writethrough -D 0:100 -o 0
          -p linear -s 1351166058 -S 0:1073741824 -T 10 -f -1
Total write throughput: 1862041.6B/s (1.8M/s), IOPS 454.6/s.

And the throughput and IOPS are still increasing with each
additional test...

Any additional hints for me how to continue with testing?

# collie node list
M   Id   Host:Port         V-Nodes       Zone
-    0   10.0.1.61:7000      	 0 1023475722
-    1   10.0.1.62:7000      	 0 1040252938
-    2   10.0.1.62:7001      	64 1040252938
-    3   10.0.1.62:7002      	64 1040252938
-    4   10.0.1.62:7003      	64 1040252938
-    5   10.0.1.63:7000      	 0 1057030154
-    6   10.0.1.63:7001      	64 1057030154
-    7   10.0.1.63:7002      	64 1057030154
-    8   10.0.1.63:7003      	64 1057030154


Thanks Bastian



More information about the sheepdog mailing list