thrulay-users - thrulay results over ultralight
Subject: Discussion list for thrulay, a network testing tool
List archive
- From: Yee-Ting Li <>
- To: stanislav shalunov <>
- Cc: "Connie A. Logg" <>, Les Cottrell <>,
- Subject: thrulay results over ultralight
- Date: Wed, 19 Oct 2005 15:49:11 -0700
Hi Stas,
We're running this on the machines we managed to get just shy of 4Gb/ sec on back to back. The tests shown were performed over a high speed wan (about 60ms with 10Gb/sec capability, but we don't achieve any where near this). however, the problem is not with achieving high throughput, it is related to the indication that thrulay does not appear to perform very well as we scale with the number of streams.
results are shown at the end of the email. The test is performed on dual opterons to dual opteron machines. with 2 or 4 GB of memory each. the final test shows that even if we allocate only ~26MB in thrulay for 16 streams, the results appear similar to that of ~260MB (ie swapping is not a major issue).
Cheers,
Yee.
[ytl@snv thrulay-0.8]$ thrulay 192.XXX.XXX.XXX -w 256000000 -m 1 -t 30 -i 5
# local window = 512000000B; remote window = 512000000B
# block size = 8192B
# MTU: 9000B; MSS: 8960B; Topology guess: unknown
# MTU = getsockopt(IP_MTU); MSS = getsockopt(TCP_MAXSEG)
# test duration = 30s; reporting interval = 5s
#(ID) begin, s end, s Mb/s RTT, ms: min avg max
( 0) 0.000 5.001 31.334 82.304 3405.275 4934.103
( 0) 5.001 10.001 93.968 5015.022 7633.145 9678.344
( 0) 10.001 15.001 146.852 10035.642 12392.504 14508.290
( 0) 15.001 20.001 175.368 14858.923 17195.312 19471.865
( 0) 20.001 25.000 199.296 15123.740 17989.805 20905.669
( 0) 25.000 30.001 218.963 13345.205 14168.544 15325.002
#( 0) 0.000 30.001 144.293 82.304 14260.936 20905.669
#(**) 0.000 30.001 144.293 82.304 14260.936 20905.669
[ytl@snv thrulay-0.8]$ thrulay 192.XXX.XXX.XXX-w 256000000 -m 2 -t 30 -i 5
# local window = 512000000B; remote window = 512000000B
# block size = 8192B
# MTU: 9000B; MSS: 8960B; Topology guess: unknown
# MTU = getsockopt(IP_MTU); MSS = getsockopt(TCP_MAXSEG)
# test duration = 30s; reporting interval = 5s
#(ID) begin, s end, s Mb/s RTT, ms: min avg max
( 0) 0.000 5.000 18.009 82.370 2984.384 4726.429
( 1) 0.000 5.000 47.368 82.369 2835.505 4590.677
( 0) 5.000 10.001 19.448 5089.073 7179.438 9823.732
( 1) 5.000 10.001 133.763 4923.870 6867.765 8943.002
( 0) 10.001 15.000 16.241 10751.359 12419.972 14859.050
( 1) 10.001 15.000 264.260 10694.199 12330.467 14147.612
( 0) 15.000 20.000 10.369 14938.961 18523.392 19658.211
( 1) 15.000 20.000 286.278 10356.619 12402.028 14205.270
( 0) 20.000 25.001 22.476 20002.114 21535.474 24671.093
( 1) 20.000 25.001 242.189 11788.490 12458.306 13379.274
( 0) 25.001 30.000 8.494 25035.991 27187.814 29549.737
( 1) 25.001 30.000 190.852 12804.536 13589.562 15083.760
#( 0) 0.000 30.000 15.840 82.370 13701.037 29549.737
#( 1) 0.000 30.000 194.117 82.369 11567.311 15083.760
#(**) 0.000 30.000 209.957 82.369 12634.174 29549.737
[ytl@snv thrulay-0.8]$ thrulay 192.XXX.XXX.XXX -w 256000000 -m 4 -t 30 -i 5
# local window = 512000000B; remote window = 512000000B
# block size = 8192B
# MTU: 9000B; MSS: 8960B; Topology guess: unknown
# MTU = getsockopt(IP_MTU); MSS = getsockopt(TCP_MAXSEG)
# test duration = 30s; reporting interval = 5s
#(ID) begin, s end, s Mb/s RTT, ms: min avg max
( 0) 0.000 5.062 3.651 82.462 2536.776 4966.566
( 1) 0.000 5.063 5.890 82.460 1966.491 4957.668
( 2) 0.000 5.063 2.602 82.460 2903.849 4970.751
( 3) 0.000 5.063 4.350 82.458 2202.561 5045.240
( 0) 5.062 10.327 1.954 5048.246 6589.937 8819.814
( 1) 5.062 10.327 1.954 5039.358 6581.031 8810.903
( 2) 5.062 10.327 1.656 5052.441 6715.900 8825.226
( 3) 5.062 10.327 1.954 5045.496 6620.629 10301.519
( 0) 10.327 15.399 2.778 10304.408 13093.932 14537.042
( 1) 10.327 15.399 2.778 10295.502 13085.203 14528.151
( 2) 10.327 15.400 2.674 10309.825 13057.836 14542.858
( 3) 10.327 15.400 2.778 10301.636 13111.100 14590.703
( 0) 15.399 20.051 1.057 15365.952 16088.687 17233.554
( 1) 15.399 20.051 1.057 15357.070 16124.325 19131.987
( 2) 15.399 20.051 1.057 15371.776 16150.659 20019.749
( 3) 15.399 20.051 1.057 15363.181 16142.307 20011.172
( 0) 20.051 28.446 2.131 20014.035 21926.250 24713.840
( 1) 20.051 28.446 2.131 20005.192 21934.405 28385.564
( 2) 20.051 28.446 2.131 20019.857 21951.288 28400.151
( 3) 20.051 28.446 2.131 20011.280 21942.741 28391.633
( 0) 28.446 30.201 0.784 28394.606 28609.423 28886.919
( 1) 28.446 30.201 0.784 28385.811 28627.959 28960.180
( 2) 28.446 30.201 0.784 28400.385 28698.695 30154.089
( 3) 28.446 30.201 0.784 28391.872 28690.179 30145.583
#( 0) 0.000 30.201 2.220 82.462 12080.647 28886.919
#( 1) 0.000 30.201 2.595 82.460 10484.865 28960.180
#( 2) 0.000 30.201 1.975 82.460 13172.015 30154.089
#( 3) 0.000 30.201 2.337 82.458 11515.247 30145.583
#(**) 0.000 30.201 9.127 82.458 11813.194 30154.089
[ytl@snv thrulay-0.8]$ thrulay 192.XXX.XXX.XXX -w 256000000 -m 8 -t 30 -i 5
# local window = 512000000B; remote window = 512000000B
# block size = 8192B
# MTU: 9000B; MSS: 8960B; Topology guess: unknown
# MTU = getsockopt(IP_MTU); MSS = getsockopt(TCP_MAXSEG)
# test duration = 30s; reporting interval = 5s
#(ID) begin, s end, s Mb/s RTT, ms: min avg max
( 0) 0.000 5.523 1.175 82.526 1350.336 4810.980
( 1) 0.000 5.523 0.000 0.000 0.000 0.000
( 2) 0.000 5.523 0.534 369.170 1645.646 4816.247
( 3) 0.000 5.523 0.012 943.272 943.272 943.272
( 4) 0.000 5.523 0.012 82.508 82.508 82.508
( 5) 0.000 5.523 0.119 82.509 3687.993 5521.813
( 6) 0.000 5.523 0.059 82.509 3995.956 5522.230
( 7) 0.000 5.523 0.546 364.173 1217.472 5518.478
( 0) 5.523 11.886 0.062 5513.602 5825.751 6137.881
( 1) 5.523 11.886 0.000 0.000 0.000 0.000
( 2) 5.523 11.886 0.062 5518.880 5831.028 6143.164
( 3) 5.523 11.886 0.000 0.000 0.000 0.000
( 4) 5.523 11.886 0.000 0.000 0.000 0.000
( 5) 5.523 11.886 0.062 5522.147 5847.913 6146.477
( 6) 5.523 11.886 0.062 5522.565 5848.334 6146.905
( 7) 5.523 11.886 0.062 5518.793 6891.330 11881.199
( 0) 11.886 19.612 0.127 11876.170 12320.327 13186.602
( 1) 11.886 19.612 0.008 11886.204 11886.204 11886.204
( 2) 11.886 19.612 0.127 11881.446 12325.589 13191.873
( 3) 11.886 19.612 0.127 11886.095 12635.131 17769.253
( 4) 11.886 19.612 0.127 11886.102 12641.257 17769.268
( 5) 11.886 19.612 0.127 11884.797 12762.697 19609.188
( 6) 11.886 19.612 0.127 11885.223 12773.472 19609.698
( 7) 11.886 19.612 0.127 11881.368 12785.271 19605.707
( 0) 19.612 22.867 0.020 19600.687 19600.687 19600.687
( 1) 19.612 22.867 0.000 0.000 0.000 0.000
( 2) 19.612 22.867 0.020 21957.995 21957.995 21957.995
( 3) 19.612 22.867 0.020 21962.809 21962.809 21962.809
( 4) 19.612 22.867 0.020 21962.813 21962.813 21962.813
( 5) 19.612 22.867 0.020 21961.422 21961.422 21961.422
( 6) 19.612 22.867 0.020 22864.921 22864.921 22864.921
( 7) 19.612 22.867 0.020 22860.928 22860.928 22860.928
( 0) 22.867 33.080 0.026 22856.036 22917.435 22937.916
( 1) 22.867 33.080 0.000 0.000 0.000 0.000
( 2) 22.867 33.080 0.026 22861.315 23553.470 25466.196
( 3) 22.867 33.080 0.026 22866.126 25371.822 32725.165
( 4) 22.867 33.080 0.026 22866.132 25371.829 32725.183
( 5) 22.867 33.080 0.026 22864.728 25370.422 32723.779
( 6) 22.867 33.080 0.026 22947.066 25391.370 32724.257
( 7) 22.867 33.080 0.026 22943.077 25475.621 33073.203
#( 0) 0.000 33.080 0.248 82.526 3717.705 22937.916
#( 1) 0.000 33.080 0.002 11886.204 11886.204 11886.204
#( 2) 0.000 33.080 0.141 369.170 5775.999 25466.196
#( 3) 0.000 33.080 0.042 943.272 14948.588 32725.165
#( 4) 0.000 33.080 0.042 82.508 14911.976 32725.183
#( 5) 0.000 33.080 0.071 82.509 10745.860 32723.779
#( 6) 0.000 33.080 0.061 82.509 11971.041 32724.257
#( 7) 0.000 33.080 0.143 364.173 5748.530 33073.203
#(**) 0.000 33.080 0.749 82.508 9963.238 33073.203
[ytl@snv
~]$ thrulay 192.XXX.XXX.XXX -w 26000000 -m 16 -t 30 -i 3
# local window = 52000000B; remote window = 52000000B
# block size = 8192B
# MTU: 9000B; MSS: 8960B; Topology guess: unknown
# MTU = getsockopt(IP_MTU); MSS = getsockopt(TCP_MAXSEG)
# test duration = 30s; reporting interval = 3s
#(ID) begin, s end, s Mb/s RTT, ms: min avg max
( 0) 0.000 3.001 16.468 82.519 1672.365 2158.763
( 1) 0.000 3.001 3.625 82.519 2410.128 2919.451
( 2) 0.000 3.001 0.022 82.514 82.514 82.514
( 3) 0.000 3.001 0.022 82.512 82.512 82.512
( 4) 0.000 3.001 0.000 0.000 0.000 0.000
( 5) 0.000 3.001 0.000 0.000 0.000 0.000
( 6) 0.000 3.001 0.000 0.000 0.000 0.000
( 7) 0.000 3.001 0.000 0.000 0.000 0.000
( 8) 0.000 3.001 0.000 0.000 0.000 0.000
( 9) 0.000 3.001 0.000 0.000 0.000 0.000
(10) 0.000 3.001 0.000 0.000 0.000 0.000
(11) 0.000 3.001 0.000 0.000 0.000 0.000
(12) 0.000 3.001 0.022 82.488 82.488 82.488
(13) 0.000 3.001 0.175 2090.879 2500.113 2663.752
(14) 0.000 3.001 0.000 0.000 0.000 0.000
(15) 0.000 3.001 1.005 927.519 1618.400 2023.615
( 0) 3.001 6.000 13.043 3072.934 4672.785 5697.818
( 1) 3.001 6.000 3.583 2996.064 4319.520 5909.284
( 2) 3.001 6.000 0.000 0.000 0.000 0.000
( 3) 3.001 6.000 0.000 0.000 0.000 0.000
( 4) 3.001 6.000 0.000 0.000 0.000 0.000
( 5) 3.001 6.000 0.000 0.000 0.000 0.000
( 6) 3.001 6.000 0.000 0.000 0.000 0.000
( 7) 3.001 6.000 0.000 0.000 0.000 0.000
( 8) 3.001 6.000 0.000 0.000 0.000 0.000
( 9) 3.001 6.000 0.000 0.000 0.000 0.000
(10) 3.001 6.000 0.000 0.000 0.000 0.000
(11) 3.001 6.000 0.000 0.000 0.000 0.000
(12) 3.001 6.000 0.000 0.000 0.000 0.000
(13) 3.001 6.000 1.005 3031.626 4823.333 5920.084
(14) 3.001 6.000 0.022 4386.591 4386.591 4386.591
(15) 3.001 6.000 0.000 0.000 0.000 0.000
( 0) 6.000 9.001 16.512 6053.678 7728.811 8575.121
( 1) 6.000 9.001 2.359 5989.638 6982.996 8213.786
( 2) 6.000 9.001 0.000 0.000 0.000 0.000
( 3) 6.000 9.001 0.000 0.000 0.000 0.000
( 4) 6.000 9.001 0.000 0.000 0.000 0.000
( 5) 6.000 9.001 0.000 0.000 0.000 0.000
( 6) 6.000 9.001 0.000 0.000 0.000 0.000
( 7) 6.000 9.001 0.000 0.000 0.000 0.000
( 8) 6.000 9.001 0.000 0.000 0.000 0.000
( 9) 6.000 9.001 0.000 0.000 0.000 0.000
(10) 6.000 9.001 0.000 0.000 0.000 0.000
(11) 6.000 9.001 0.000 0.000 0.000 0.000
(12) 6.000 9.001 0.000 0.000 0.000 0.000
(13) 6.000 9.001 2.359 5999.476 6934.621 7533.314
(14) 6.000 9.001 0.000 0.000 0.000 0.000
(15) 6.000 9.001 0.000 0.000 0.000 0.000
( 0) 9.001 12.001 5.812 8643.968 9862.863 10965.874
( 1) 9.001 12.001 0.000 0.000 0.000 0.000
( 2) 9.001 12.001 0.000 0.000 0.000 0.000
( 3) 9.001 12.001 0.000 0.000 0.000 0.000
( 4) 9.001 12.001 0.000 0.000 0.000 0.000
( 5) 9.001 12.001 0.000 0.000 0.000 0.000
( 6) 9.001 12.001 0.000 0.000 0.000 0.000
( 7) 9.001 12.001 0.000 0.000 0.000 0.000
( 8) 9.001 12.001 0.000 0.000 0.000 0.000
( 9) 9.001 12.001 0.000 0.000 0.000 0.000
(10) 9.001 12.001 0.000 0.000 0.000 0.000
(11) 9.001 12.001 0.000 0.000 0.000 0.000
(12) 9.001 12.001 0.000 0.000 0.000 0.000
(13) 9.001 12.001 0.218 11841.615 11842.419 11843.180
(14) 9.001 12.001 0.000 0.000 0.000 0.000
(15) 9.001 12.001 4.479 10846.569 10915.807 11336.311
( 0) 12.001 15.000 1.202 11890.476 13021.221 14247.355
( 1) 12.001 15.000 0.000 0.000 0.000 0.000
( 2) 12.001 15.000 0.000 0.000 0.000 0.000
( 3) 12.001 15.000 0.000 0.000 0.000 0.000
( 4) 12.001 15.000 0.000 0.000 0.000 0.000
( 5) 12.001 15.000 0.000 0.000 0.000 0.000
( 6) 12.001 15.000 0.000 0.000 0.000 0.000
( 7) 12.001 15.000 0.000 0.000 0.000 0.000
( 8) 12.001 15.000 0.000 0.000 0.000 0.000
( 9) 12.001 15.000 0.000 0.000 0.000 0.000
(10) 12.001 15.000 0.000 0.000 0.000 0.000
(11) 12.001 15.000 0.000 0.000 0.000 0.000
(12) 12.001 15.000 0.000 0.000 0.000 0.000
(13) 12.001 15.000 0.000 0.000 0.000 0.000
(14) 12.001 15.000 0.000 0.000 0.000 0.000
(15) 12.001 15.000 0.568 11980.664 12109.202 12388.428
( 0) 15.000 18.001 2.381 14611.904 15915.072 17481.205
( 1) 15.000 18.001 14.021 16737.152 16852.421 17490.456
( 2) 15.000 18.001 0.000 0.000 0.000 0.000
( 3) 15.000 18.001 0.000 0.000 0.000 0.000
( 4) 15.000 18.001 0.000 0.000 0.000 0.000
( 5) 15.000 18.001 0.000 0.000 0.000 0.000
( 6) 15.000 18.001 0.000 0.000 0.000 0.000
( 7) 15.000 18.001 0.000 0.000 0.000 0.000
( 8) 15.000 18.001 0.000 0.000 0.000 0.000
( 9) 15.000 18.001 0.000 0.000 0.000 0.000
(10) 15.000 18.001 0.000 0.000 0.000 0.000
(11) 15.000 18.001 0.000 0.000 0.000 0.000
(12) 15.000 18.001 0.000 0.000 0.000 0.000
(13) 15.000 18.001 0.000 0.000 0.000 0.000
(14) 15.000 18.001 0.000 0.000 0.000 0.000
(15) 15.000 18.001 0.000 0.000 0.000 0.000
( 0) 18.001 21.001 1.944 17562.896 18935.268 20006.235
( 1) 18.001 21.001 0.000 0.000 0.000 0.000
( 2) 18.001 21.001 6.270 18182.862 18457.265 20861.114
( 3) 18.001 21.001 0.000 0.000 0.000 0.000
( 4) 18.001 21.001 0.000 0.000 0.000 0.000
( 5) 18.001 21.001 0.022 18162.096 18162.096 18162.096
( 6) 18.001 21.001 0.000 0.000 0.000 0.000
( 7) 18.001 21.001 0.000 0.000 0.000 0.000
( 8) 18.001 21.001 0.000 0.000 0.000 0.000
( 9) 18.001 21.001 0.000 0.000 0.000 0.000
(10) 18.001 21.001 0.000 0.000 0.000 0.000
(11) 18.001 21.001 0.000 0.000 0.000 0.000
(12) 18.001 21.001 0.000 0.000 0.000 0.000
(13) 18.001 21.001 0.000 0.000 0.000 0.000
(14) 18.001 21.001 4.501 18243.788 19243.310 20657.113
(15) 18.001 21.001 0.000 0.000 0.000 0.000
( 0) 21.001 24.000 1.660 20951.267 21240.922 23233.936
( 1) 21.001 24.000 3.102 21812.746 21881.816 22034.815
( 2) 21.001 24.000 3.714 21225.749 22838.378 23854.609
( 3) 21.001 24.000 0.000 0.000 0.000 0.000
( 4) 21.001 24.000 0.000 0.000 0.000 0.000
( 5) 21.001 24.000 0.000 0.000 0.000 0.000
( 6) 21.001 24.000 0.000 0.000 0.000 0.000
( 7) 21.001 24.000 0.000 0.000 0.000 0.000
( 8) 21.001 24.000 0.000 0.000 0.000 0.000
( 9) 21.001 24.000 0.000 0.000 0.000 0.000
(10) 21.001 24.000 0.000 0.000 0.000 0.000
(11) 21.001 24.000 0.000 0.000 0.000 0.000
(12) 21.001 24.000 0.000 0.000 0.000 0.000
(13) 21.001 24.000 0.000 0.000 0.000 0.000
(14) 21.001 24.000 2.447 21021.837 22092.579 23733.983
(15) 21.001 24.000 7.734 21211.058 21455.231 23434.460
( 0) 24.000 27.000 0.634 25606.585 25609.061 25611.508
( 1) 24.000 27.000 1.311 24097.949 24440.796 26637.146
( 2) 24.000 27.000 3.386 23934.700 25839.992 26840.098
( 3) 24.000 27.000 0.000 0.000 0.000 0.000
( 4) 24.000 27.000 0.000 0.000 0.000 0.000
( 5) 24.000 27.000 0.000 0.000 0.000 0.000
( 6) 24.000 27.000 0.000 0.000 0.000 0.000
( 7) 24.000 27.000 0.000 0.000 0.000 0.000
( 8) 24.000 27.000 0.000 0.000 0.000 0.000
( 9) 24.000 27.000 0.000 0.000 0.000 0.000
(10) 24.000 27.000 0.000 0.000 0.000 0.000
(11) 24.000 27.000 0.000 0.000 0.000 0.000
(12) 24.000 27.000 0.000 0.000 0.000 0.000
(13) 24.000 27.000 0.000 0.000 0.000 0.000
(14) 24.000 27.000 2.622 24663.867 25847.151 26514.053
(15) 24.000 27.000 0.830 24360.211 25215.055 25977.010
( 0) 27.000 30.001 0.000 0.000 0.000 0.000
( 1) 27.000 30.001 0.480 28971.051 28972.940 28974.792
( 2) 27.000 30.001 0.415 26920.556 28002.374 28976.196
( 3) 27.000 30.001 0.000 0.000 0.000 0.000
( 4) 27.000 30.001 0.000 0.000 0.000 0.000
( 5) 27.000 30.001 0.000 0.000 0.000 0.000
( 6) 27.000 30.001 0.000 0.000 0.000 0.000
( 7) 27.000 30.001 0.000 0.000 0.000 0.000
( 8) 27.000 30.001 0.000 0.000 0.000 0.000
( 9) 27.000 30.001 0.000 0.000 0.000 0.000
(10) 27.000 30.001 0.000 0.000 0.000 0.000
(11) 27.000 30.001 0.000 0.000 0.000 0.000
(12) 27.000 30.001 0.000 0.000 0.000 0.000
(13) 27.000 30.001 0.000 0.000 0.000 0.000
(14) 27.000 30.001 0.218 28567.551 28568.360 28569.167
(15) 27.000 30.001 2.097 27754.866 28890.057 29734.764
#( 0) 0.000 30.001 5.966 82.519 6960.908 25611.508
#( 1) 0.000 30.001 2.849 82.519 13721.603 28974.792
#( 2) 0.000 30.001 1.381 82.514 21704.250 28976.196
#( 3) 0.000 30.001 0.002 82.512 82.512 82.512
#( 4) 0.000 0.000 0.000 0.000 0.000 0.000
#( 5) 0.000 30.001 0.002 18162.096 18162.096 18162.096
#( 6) 0.000 0.000 0.000 0.000 0.000 0.000
#( 7) 0.000 0.000 0.000 0.000 0.000 0.000
#( 8) 0.000 0.000 0.000 0.000 0.000 0.000
#( 9) 0.000 0.000 0.000 0.000 0.000 0.000
#(10) 0.000 0.000 0.000 0.000 0.000 0.000
#(11) 0.000 0.000 0.000 0.000 0.000 0.000
#(12) 0.000 30.001 0.002 82.488 82.488 82.488
#(13) 0.000 30.001 0.376 2090.879 6449.055 11843.180
#(14) 0.000 30.001 0.981 4386.591 21893.583 28569.167
#(15) 0.000 30.001 1.671 927.519 18240.255 29734.764
#(**) 0.000 30.001 13.229 82.488 6706.047 29734.764
- thrulay results over ultralight, Yee-Ting Li, 10/19/2005
- Re: thrulay results over ultralight, stanislav shalunov, 10/19/2005
Archive powered by MHonArc 2.6.16.