[Sheepdog] [PATCH 1/2] sheep: sheep: handle node change event first

Liu Yuan namei.unix at gmail.com
Sat Mar 31 12:31:00 CEST 2012 

On 03/31/2012 06:23 PM, MORITA Kazutaka wrote:

> Many bad effects.  For example, imagine that join messages are
> processed in the different order with other nodes.


Maybe not. I notice that every call to start_cpg_event_work() will drain
the cpg queue, So this change will assure us that confchg will be
handled for sure, despite of other requests.

We both do DD in guests and do a loop for creating new vid and deleting
that vdi during the join/leave test.

All seems good so far... look the sequence for joining 60 nodes

for one machine,
[root at kvm134018.sqa.cm4.tmp ~]# grep 'join ip' /store/data/z1i1/sheep.log
Mar 31 17:17:51 sd_join_handler(1227) join ip: 10.232.135.218, port: 7000
Mar 31 17:18:05 sd_join_handler(1227) join ip: 10.232.135.218, port: 7001
Mar 31 17:18:05 sd_join_handler(1227) join ip: 10.232.135.218, port: 7002
Mar 31 17:18:05 sd_join_handler(1227) join ip: 10.232.135.218, port: 7003
Mar 31 17:18:06 sd_join_handler(1227) join ip: 10.232.135.218, port: 7004
Mar 31 17:18:06 sd_join_handler(1227) join ip: 10.232.135.218, port: 7006
Mar 31 17:18:06 sd_join_handler(1227) join ip: 10.232.135.218, port: 7010
Mar 31 17:18:06 sd_join_handler(1227) join ip: 10.232.135.218, port: 7011
Mar 31 17:18:09 sd_join_handler(1227) join ip: 10.232.135.218, port: 7012
Mar 31 17:18:12 sd_join_handler(1227) join ip: 10.232.135.218, port: 7007
Mar 31 17:18:15 sd_join_handler(1227) join ip: 10.232.135.218, port: 7020
Mar 31 17:18:18 sd_join_handler(1227) join ip: 10.232.135.218, port: 7022
Mar 31 17:18:22 sd_join_handler(1227) join ip: 10.232.135.218, port: 7015
Mar 31 17:18:25 sd_join_handler(1227) join ip: 10.232.135.218, port: 7025
Mar 31 17:18:28 sd_join_handler(1227) join ip: 10.232.135.218, port: 7030
Mar 31 17:18:31 sd_join_handler(1227) join ip: 10.232.135.218, port: 7009
Mar 31 17:18:35 sd_join_handler(1227) join ip: 10.232.135.218, port: 7013
Mar 31 17:18:38 sd_join_handler(1227) join ip: 10.232.135.218, port: 7038
Mar 31 17:18:42 sd_join_handler(1227) join ip: 10.232.135.218, port: 7040
Mar 31 17:18:45 sd_join_handler(1227) join ip: 10.232.135.218, port: 7047
Mar 31 17:18:49 sd_join_handler(1227) join ip: 10.232.135.218, port: 7043
Mar 31 17:18:51 sd_join_handler(1227) join ip: 10.232.135.218, port: 7050
Mar 31 17:18:53 sd_join_handler(1227) join ip: 10.232.135.218, port: 7042
Mar 31 17:18:55 sd_join_handler(1227) join ip: 10.232.135.218, port: 7053
Mar 31 17:18:57 sd_join_handler(1227) join ip: 10.232.135.218, port: 7056
Mar 31 17:18:58 sd_join_handler(1227) join ip: 10.232.135.218, port: 7052
Mar 31 17:19:00 sd_join_handler(1227) join ip: 10.232.135.218, port: 7039
Mar 31 17:19:02 sd_join_handler(1227) join ip: 10.232.135.218, port: 7023
Mar 31 17:19:06 sd_join_handler(1227) join ip: 10.232.135.218, port: 7016
Mar 31 17:19:08 sd_join_handler(1227) join ip: 10.232.135.218, port: 7048
Mar 31 17:19:10 sd_join_handler(1227) join ip: 10.232.135.218, port: 7041
Mar 31 17:19:13 sd_join_handler(1227) join ip: 10.232.135.218, port: 7055
Mar 31 17:19:16 sd_join_handler(1227) join ip: 10.232.135.218, port: 7033
Mar 31 17:19:19 sd_join_handler(1227) join ip: 10.232.135.218, port: 7059
Mar 31 17:19:21 sd_join_handler(1227) join ip: 10.232.135.218, port: 7032
Mar 31 17:19:22 sd_join_handler(1227) join ip: 10.232.135.218, port: 7014
Mar 31 17:19:24 sd_join_handler(1227) join ip: 10.232.135.218, port: 7057
Mar 31 17:19:27 sd_join_handler(1227) join ip: 10.232.135.218, port: 7044
Mar 31 17:19:30 sd_join_handler(1227) join ip: 10.232.135.218, port: 7027
Mar 31 17:19:33 sd_join_handler(1227) join ip: 10.232.135.218, port: 7034
Mar 31 17:19:36 sd_join_handler(1227) join ip: 10.232.135.218, port: 7029
Mar 31 17:19:40 sd_join_handler(1227) join ip: 10.232.135.218, port: 7046
Mar 31 17:19:43 sd_join_handler(1227) join ip: 10.232.135.218, port: 7049
Mar 31 17:19:47 sd_join_handler(1227) join ip: 10.232.135.218, port: 7028
Mar 31 17:19:50 sd_join_handler(1227) join ip: 10.232.135.218, port: 7054
Mar 31 17:19:54 sd_join_handler(1227) join ip: 10.232.135.218, port: 7019
Mar 31 17:19:57 sd_join_handler(1227) join ip: 10.232.135.218, port: 7058
Mar 31 17:20:01 sd_join_handler(1227) join ip: 10.232.135.218, port: 7031
Mar 31 17:20:05 sd_join_handler(1227) join ip: 10.232.135.218, port: 7036
Mar 31 17:20:08 sd_join_handler(1227) join ip: 10.232.135.218, port: 7005
Mar 31 17:20:12 sd_join_handler(1227) join ip: 10.232.135.218, port: 7035
Mar 31 17:20:15 sd_join_handler(1227) join ip: 10.232.135.218, port: 7008
Mar 31 17:20:19 sd_join_handler(1227) join ip: 10.232.135.218, port: 7051
Mar 31 17:20:23 sd_join_handler(1227) join ip: 10.232.135.218, port: 7037
Mar 31 17:20:28 sd_join_handler(1227) join ip: 10.232.135.218, port: 7017
Mar 31 17:20:32 sd_join_handler(1227) join ip: 10.232.135.218, port: 7024
Mar 31 17:20:36 sd_join_handler(1227) join ip: 10.232.135.218, port: 7021
Mar 31 17:20:41 sd_join_handler(1227) join ip: 10.232.135.218, port: 7018
Mar 31 17:20:46 sd_join_handler(1227) join ip: 10.232.135.218, port: 7026
Mar 31 17:20:50 sd_join_handler(1227) join ip: 10.232.135.218, port: 7045

another machine:
Mar 31 17:17:51 sd_join_handler(1227) join ip: 10.232.135.218, port: 7000
Mar 31 17:17:52 sd_join_handler(1227) join ip: 10.232.135.218, port: 7001
Mar 31 17:17:54 sd_join_handler(1227) join ip: 10.232.135.218, port: 7002
Mar 31 17:17:55 sd_join_handler(1227) join ip: 10.232.135.218, port: 7003
Mar 31 17:17:58 sd_join_handler(1227) join ip: 10.232.135.218, port: 7004
Mar 31 17:18:01 sd_join_handler(1227) join ip: 10.232.135.218, port: 7006
Mar 31 17:18:04 sd_join_handler(1227) join ip: 10.232.135.218, port: 7010
Mar 31 17:18:06 sd_join_handler(1227) join ip: 10.232.135.218, port: 7011
Mar 31 17:18:09 sd_join_handler(1227) join ip: 10.232.135.218, port: 7012
Mar 31 17:18:12 sd_join_handler(1227) join ip: 10.232.135.218, port: 7007
Mar 31 17:18:15 sd_join_handler(1227) join ip: 10.232.135.218, port: 7020
Mar 31 17:18:18 sd_join_handler(1227) join ip: 10.232.135.218, port: 7022
Mar 31 17:18:21 sd_join_handler(1227) join ip: 10.232.135.218, port: 7015
Mar 31 17:18:25 sd_join_handler(1227) join ip: 10.232.135.218, port: 7025
Mar 31 17:18:28 sd_join_handler(1227) join ip: 10.232.135.218, port: 7030
Mar 31 17:18:31 sd_join_handler(1227) join ip: 10.232.135.218, port: 7009
Mar 31 17:18:35 sd_join_handler(1227) join ip: 10.232.135.218, port: 7013
Mar 31 17:18:38 sd_join_handler(1227) join ip: 10.232.135.218, port: 7038
Mar 31 17:18:42 sd_join_handler(1227) join ip: 10.232.135.218, port: 7040
Mar 31 17:18:45 sd_join_handler(1227) join ip: 10.232.135.218, port: 7047
Mar 31 17:18:48 sd_join_handler(1227) join ip: 10.232.135.218, port: 7043
Mar 31 17:18:51 sd_join_handler(1227) join ip: 10.232.135.218, port: 7050
Mar 31 17:18:53 sd_join_handler(1227) join ip: 10.232.135.218, port: 7042
Mar 31 17:18:55 sd_join_handler(1227) join ip: 10.232.135.218, port: 7053
Mar 31 17:18:56 sd_join_handler(1227) join ip: 10.232.135.218, port: 7056
Mar 31 17:18:58 sd_join_handler(1227) join ip: 10.232.135.218, port: 7052
Mar 31 17:19:00 sd_join_handler(1227) join ip: 10.232.135.218, port: 7039
Mar 31 17:19:02 sd_join_handler(1227) join ip: 10.232.135.218, port: 7023
Mar 31 17:19:06 sd_join_handler(1227) join ip: 10.232.135.218, port: 7016
Mar 31 17:19:08 sd_join_handler(1227) join ip: 10.232.135.218, port: 7048
Mar 31 17:19:10 sd_join_handler(1227) join ip: 10.232.135.218, port: 7041
Mar 31 17:19:13 sd_join_handler(1227) join ip: 10.232.135.218, port: 7055
Mar 31 17:19:16 sd_join_handler(1227) join ip: 10.232.135.218, port: 7033
Mar 31 17:19:19 sd_join_handler(1227) join ip: 10.232.135.218, port: 7059
Mar 31 17:19:21 sd_join_handler(1227) join ip: 10.232.135.218, port: 7032
Mar 31 17:19:22 sd_join_handler(1227) join ip: 10.232.135.218, port: 7014
Mar 31 17:19:24 sd_join_handler(1227) join ip: 10.232.135.218, port: 7057
Mar 31 17:19:27 sd_join_handler(1227) join ip: 10.232.135.218, port: 7044
Mar 31 17:19:30 sd_join_handler(1227) join ip: 10.232.135.218, port: 7027
Mar 31 17:19:33 sd_join_handler(1227) join ip: 10.232.135.218, port: 7034
Mar 31 17:19:36 sd_join_handler(1227) join ip: 10.232.135.218, port: 7029
Mar 31 17:19:40 sd_join_handler(1227) join ip: 10.232.135.218, port: 7046
Mar 31 17:19:43 sd_join_handler(1227) join ip: 10.232.135.218, port: 7049
Mar 31 17:19:47 sd_join_handler(1227) join ip: 10.232.135.218, port: 7028
Mar 31 17:19:50 sd_join_handler(1227) join ip: 10.232.135.218, port: 7054
Mar 31 17:19:54 sd_join_handler(1227) join ip: 10.232.135.218, port: 7019
Mar 31 17:19:57 sd_join_handler(1227) join ip: 10.232.135.218, port: 7058
Mar 31 17:20:01 sd_join_handler(1227) join ip: 10.232.135.218, port: 7031
Mar 31 17:20:04 sd_join_handler(1227) join ip: 10.232.135.218, port: 7036
Mar 31 17:20:08 sd_join_handler(1227) join ip: 10.232.135.218, port: 7005
Mar 31 17:20:12 sd_join_handler(1227) join ip: 10.232.135.218, port: 7035
Mar 31 17:20:15 sd_join_handler(1227) join ip: 10.232.135.218, port: 7008
Mar 31 17:20:19 sd_join_handler(1227) join ip: 10.232.135.218, port: 7051
Mar 31 17:20:23 sd_join_handler(1227) join ip: 10.232.135.218, port: 7037
Mar 31 17:20:28 sd_join_handler(1227) join ip: 10.232.135.218, port: 7017
Mar 31 17:20:32 sd_join_handler(1227) join ip: 10.232.135.218, port: 7024
Mar 31 17:20:36 sd_join_handler(1227) join ip: 10.232.135.218, port: 7021
Mar 31 17:20:41 sd_join_handler(1227) join ip: 10.232.135.218, port: 7018
Mar 31 17:20:45 sd_join_handler(1227) join ip: 10.232.135.218, port: 7026
Mar 31 17:20:50 sd_join_handler(1227) join ip: 10.232.135.218, port: 7045

More information about the sheepdog mailing list