Broadband Speedtesters

[#1]

Consumerchoices ran speedtests today using 10 different speedtesters.  Their results can be seen at:
http://blog.consumerchoices.co.uk/2008/06/25/broadband-speed-testers-who-do-you-trust/
Interestingly, a similar figure was achieved from 8 testers.  Of the 2 that were out of line one was 'my broadband speed'.
You'd expect some differences but why the big variation with the 2 that were out of line?

[#2]

I can't see how you can draw any meaningful conclusions from that test. The speed tests were not carried out simultaneously and we all know that connection speeds can vary over time on a broadband line.
It's perfectly possible that all the returned results were accurate speeds.

[#3]

The values are not out of line with what I would expect. The two very low ones I would suggest are `not accurate` due to over loaded servers. But the others show an accuracy of about 10%.
As he goes on to say single readings should not be taken as representative, the average of at least ten readings over a period of time would be far more accurate.
But I do not like his suggested protocol;

Quote

In order for this to be a worthy, empirical test, I’d have to isolate each speed tester tool, and take a reading every minute for fifteen minutes using just that tool (thus providing me with 15 separate readings across a quarter-hour period for each speed tester).

I would go with one reading from each tester sequentially, repeated at least ten times, and average the result. (The more reading the better.)
Chilly

[#4]

Regardless of the measurement method - its impossible to 'isolate' a speedtester. Whatever you try to do whilst connecting over the interwebs will be affected by what other folks are doing on the 'net. There are always going to be shared links somewhere in between.
To follow his theory to its conclusion - if you *could* isolate the speedtester, the only way you could do it would be to remove the fluffy internet connection between you and it, and use a dedicated link.
Clearly this then makes the whole thing useless...

[#5]

I also note from the dubious report, that he didnt immediately go back and check the too low throughput items
As an ex experimental tester, that is what I would have to do.  When testing vehicle performance, we always did ten runs of each parameter and took the average

I also found that on some speed testers that allowed you to select "ping" targets that it had a drastic effect on answers

[#6]

I'm afraid mathematically what he did was meaningless.
Might as well have thrown a dice or just made up the numbers. 

[#7]

At least I am happy with mine even if not up to Sauces standard
Test1 comprises of Best Effort Test:  -provides background information.
    Your DSL connection rate: 8096 kbps(DOWN-STREAM),  448 kbps(UP-STREAM)
    IP profile for your line is - 7000 kbps
    Actual IP throughput achieved during the test was - 6059 kbps
Date  Download Speed  Upload Speed 
Today 08:53         6335 kbps (792kB/s) 381 kbps (47.6kB/s)
Yesterday 07:55 6353 kbps (794kB/s) 381 kbps (47.6kB/s)
Jun 25, 19:13         6065 kbps (758kB/s) 379 kbps (47.4kB/s)
Jun 25, 14:37         6249 kbps (781kB/s) 373 kbps (46.6kB/s)

[#8]

just done a test with Broadband Genie.
What a load of rubbish  it took all of 5 secs to do the "test"

Quote

Your speed test result: 1.3 Mb According to BT wholesale, your line should be able to support a 6.3 Mbps ADSL connection via ADSL max The following services are available to you: ADSL MAX Virgin Media cable Be Broadband LLU You are connected to the Braintree telephone exchange You are approximately 808 metres from the exchange (straight line distance)

[#9]

and the fastest one  result - faster than the line can support 

Quote

Broadband Expert Speed Test Results: Your Download Speed: 6.54 Mbps PlusNet Average: 2.28mb Your Upload Speed: 379 Kbps PlusNet Average: 375kb Your local exchange is Braintree, judging by your distance from this exchange, you should be able to achieve up to 6Mbps on your line.

[#10]

I've always found the Tiscali one particularly reliable. Just did a "one-shot" and got:

Your current bandwidth reading is: 132.13 Mbps
which means you can download at 16.52 MB/sec. from our servers.
28.8 kbps dial-up 
33.6 kbps dial-up 
53.3 kbps dial-up 
56 kbps ISDN 
128 kbps ISDN 
150 kbps DSL 
256 kbps DSL 
512 kbps DSL 
135300.1 kbps YOU 


Note: This test may not reflect the true speed of your connection 

[#11]

Pierre, Just tried the speedtest you used.  The engine is the same one used by PN.  Normally, the best download I get from mybroadbandspeed.com is very slightly lower at about 5.45 Mb.  Can't remember getting  5.54 Mb before. Just used the PN version again and getting 5.44 Mb.

Broadband Expert Speed Test Results:

Your Download Speed: 5.54 Mbps
PlusNet Average: 2.28mb
Your Upload Speed: 368 Kbps
PlusNet Average: 375kb
Your local exchange is Ongar, judging by your distance from this exchange, you should be able to achieve up to 6Mbps on your line.