topic Quality and Experience Testing in Plusnet Feedback

Quality and Experience Testing

dave — Thu, 26 Apr 2012 16:14:39 GMT

Hi all,
We're currently looking at the experience that our customers get across the whole end to end network from the Internet through to your home. We've got tests, reports and probes that look at different aspects of performance but they don't substitute for what you guys in the forum see and say.
We're expecting a busy night on Monday because of the Manchester derby. Last Tuesday we saw 12% of our network capacity being used by people watching/listening to Barcelona v Chelsea and 13% on Sunday lunchtime for Manchester Utd v Everton and the Bahrain Grand Prix. Monday could beat these.
Therefore we want to see how everything performs. There was a thread with some reports of performance issues on Tuesday which didn't correlate against any of the monitoring we have in place; we suspect the slow downs were localised rather than on the global network.
What we want to see then is for a group of users to run some tests and let us know what they see, particularly between about 7:30pm and 10pm on Monday.
Useful tests include but not limited to, the Thinkbroadband latency test: http://www.thinkbroadband.com/ping speedtests, or just the experience you see on loading pages, streaming, gaming etc.
If you can help us and provide the results it would be really appreciated, let us know if you've any questions.

Re: Quality and Experience Testing

pierre_pierre — Thu, 26 Apr 2012 16:36:15 GMT

I am on a samknow monitor
recent results below, it does checks as per clip 2

Re: Quality and Experience Testing

198kHz — Thu, 26 Apr 2012 17:28:12 GMT

Aye, I could give that a go on Monday - i certainly shan't be watching any sport.
Results posted to this thread?

Re: Quality and Experience Testing

cobcottageonlin — Fri, 27 Apr 2012 11:40:15 GMT

"Useful tests include but not limited to, the Thinkbroadband latency test, or just the experience you see on loading pages, streaming, gaming etc."
Doesn't sound like much of a Quality test to me. Can you not ask for something a little more specific?

Re: Quality and Experience Testing

w23 — Fri, 27 Apr 2012 12:48:38 GMT

I'm sure that my son will give me some 'quality feedback' if his gaming starts to lag.

Re: Quality and Experience Testing

Anotherone — Mon, 30 Apr 2012 08:02:58 GMT

Quote from: cobcottageonline
"Useful tests include but not limited to, the Thinkbroadband latency test, or just the experience you see on loading pages, streaming, gaming etc."
Doesn't sound like much of a Quality test to me. Can you not ask for something a little more specific?

I'm sorry, I don't agree with you. Users with technical ability will run various tests. Users who aren't technically able don't want to be confused or put off by a lot of technical requirements that they don't understand.
If a user reports "All my web pages took about twice as long to load" or "Browsing to .......... kept timing out every other time I tried" then that is still useful Experience testing.

Re: Quality and Experience Testing

dvorak — Mon, 30 Apr 2012 09:18:11 GMT

Well I'll be trying to use sky go to watch the match as I did on Tuesday when I had quite a lot of slow down.
Will see how it performs tonight. Hopefully better

Re: Quality and Experience Testing

Chris — Mon, 30 Apr 2012 16:19:01 GMT

Thanks for offering to help all. There are a few specific tests we'd like you to try both during and either before/after the football.
We'd like to try and keep the results in a similar format to make things easier, so please see my example below for what we're after.

Time of test: XX.XXpm
Gateway: http://users.plus.net/@gateway_custom?debug-ip=yes ; (only copy and paste the part under 'Array')
Link to TBB meter: http://www.thinkbroadband.com/ping/share/97513ce343193ba926e29e340d0388c8.html
Speedtest results: http://www.thinkbroadband.com/speedtest/broadband.html
iPlayer diagnostic results: http://www.bbc.co.uk/iplayer/diagnostics
Streaming (does it play smoothly or buffer?):
Also please feel free to give general feedback on your Internet experience this evening.

Re: Quality and Experience Testing

Anotherone — Mon, 30 Apr 2012 17:02:27 GMT

OK, to kick this off, @1758
You are using a debugging mode - and checking IP 87.113.236.xxx (if you need that I can PM it) 20CN Market 1.
Array
(
[0] => 1 vl7.sec.ptb-gw4.plus.net (212.159.3.25) 0.584 ms
[1] => 2 vl421.pih-gw3.plus.net (212.159.1.171) 0.573 ms
[2] => 3 gi1-1.ptn-gw01.plus.net (212.159.1.178) 11.468 ms
[3] => 4 ae3.ptw-cr01.plus.net (195.166.129.32) 11.341 ms
[4] => 5 ae1.pcl-cr01.plus.net (195.166.129.1) 11.717 ms
[5] => 6 po2.pcl-gw01.plus.net (195.166.129.41) 11.711 ms
[6] => 7 te2-1-230.pcl-gw02.plus.net (84.92.6.61) 11.740 ms
[7] => 8 gi13-1-2-232.pcl-ag02.plus.net (84.92.6.51) 21.568 ms
[8] => 9 *
)
You are currently connected to the gateway known as pcl-ag02.
This is located in City Lifeline House.
Can you tell me what the * at [8] => 9 means?

Re: Quality and Experience Testing

houlton23 — Mon, 30 Apr 2012 17:09:46 GMT

At ~ 18:05
[0] => 1 vl7.sec.ptb-gw4.plus.net (212.159.3.25) 0.642 ms
[1] => 2 vl427.pih-gw3.plus.net (212.159.1.123) 0.558 ms
[2] => 3 gi1-1.ptn-gw01.plus.net (212.159.1.178) 11.330 ms
[3] => 4 po4.ptn-gw02.plus.net (212.159.1.139) 11.585 ms
[4] => 5 po6.ptw-gw01.plus.net (212.159.1.136) 11.837 ms
[5] => 6 gi13-0-1.121.ptw-ag01.plus.net (84.92.6.105) 15.687 ms
[6] => 7 *********.plus.com (212.159.***.***) 25.076 ms
TBB: http://www.thinkbroadband.com/ping/share-large/e1354dc06af7bda1c4cf47b923148568.png

Re: Quality and Experience Testing

Chris — Mon, 30 Apr 2012 17:25:36 GMT

Time of test: 6.20pm
[0] => 1 vl7.sec.ptb-gw4.plus.net (212.159.3.25) 0.545 ms
[1] => 2 vl427.pih-gw3.plus.net (212.159.1.123) 0.569 ms
[2] => 3 gi1-1.ptn-gw01.plus.net (212.159.1.178) 18.826 ms
[3] => 4 gi11-0-0-321.ptn-ag03.plus.net (84.92.2.56) 12.465 ms
[4] => 5 XXXXX.plus.com (80.229.250.XXX) 31.699 ms
http://www.thinkbroadband.com/ping/share/97513ce343193ba926e29e340d0388c8.html

Re: Quality and Experience Testing

dvorak — Mon, 30 Apr 2012 17:29:44 GMT

Pre-match:
Array
(
[0] => 1 vl7.sec.ptb-gw4.plus.net (212.159.3.25) 0.661 ms
[1] => 2 vl421.pih-gw3.plus.net (212.159.1.171) 0.580 ms
[2] => 3 gi1-1.ptn-gw01.plus.net (212.159.1.178) 11.337 ms
[3] => 4 84.93.252.253.broadband.plus.dyn.plus.net (84.93.252.253) 11.470 ms
[4] => 5 gi15-0-0-342.ptn-ag03.plus.net (84.93.253.50) 17.080 ms
[5] => 6 My house 26.082 ms
)
You are currently connected to the gateway known as ptn-ag03.
my latency graph at tbb is borked as i had ping turned off

Streaming Sky sports 1 on sky go is fine, all done wirelessly.
Also note: all the same apps and other users running as last week, so valid like for like tests.

Re: Quality and Experience Testing

Chris — Mon, 30 Apr 2012 19:05:30 GMT

Time of test:8.05pm
Same gateway and same TBB link

Re: Quality and Experience Testing

dvorak — Mon, 30 Apr 2012 19:10:21 GMT

after 10 minutes, looking much better than last Tuesday - sky go is working for a start!
gateway as before

Re: Quality and Experience Testing

ffox — Mon, 30 Apr 2012 19:19:54 GMT

During match.
Array
(
[0] => 1 vl7.sec.ptb-gw4.plus.net (212.159.3.25) 0.567 ms
[1] => 2 vl421.pih-gw3.plus.net (212.159.1.171) 0.568 ms
[2] => 3 gi1-1.ptn-gw01.plus.net (212.159.1.178) 67.059 ms
[3] => 4 ae3.ptw-cr01.plus.net (195.166.129.32) 16.952 ms
[4] => 5 ae2.ptw-cr02.plus.net (195.166.129.5) 11.466 ms
[5] => 6 ae1.pcl-cr02.plus.net (195.166.129.3) 17.717 ms
[6] => 7 po2.pcl-gw02.plus.net (195.166.129.43) 17.590 ms
[7] => 8 gi15-1-1-452.pcl-ag04.plus.net (84.93.255.146) 14.218 ms
[8] => 9 end point 21.329 ms
)
You are currently connected to the gateway known as pcl-ag04.
http://www.thinkbroadband.com/ping/share-large/c144c7c792d48dfdc1d2ac332cdc8a68.png
(Ping is usually ~15 ms and speed ~75Mbps)

Streaming is poor quality with a fair bit of buffering.
adie:green removed ip address of user

Re: Quality and Experience Testing

Moncrieffe500 — Mon, 30 Apr 2012 19:22:09 GMT

im getting time out pages on both google chrome and internet explorer and very slow speeds durring the game, and if im lucky enough i can just be able to sign in and click on skysports 1 and its buffering every 5 seconds or so

Re: Quality and Experience Testing

houlton23 — Mon, 30 Apr 2012 19:26:34 GMT

Throughput has dropped, not sure what is going on with upstream tonight though.
[0] => 1 vl7.sec.ptb-gw4.plus.net (212.159.3.25) 0.533 ms
[1] => 2 vl427.pih-gw3.plus.net (212.159.1.123) 0.562 ms
[2] => 3 gi1-1.ptn-gw01.plus.net (212.159.1.178) 12.937 ms
[3] => 4 po4.ptn-gw02.plus.net (212.159.1.139) 12.208 ms
[4] => 5 po6.ptw-gw01.plus.net (212.159.1.136) 11.840 ms
[5] => 6 gi13-0-1.121.ptw-ag01.plus.net (84.92.6.105) 12.340 ms
[6] => 7 xxxxxx.plus.com (212.159.xxx.xxx) 28.330 ms
TBB: (Noticeable latency increase ~ 8pm)
http://www.thinkbroadband.com/ping/share-large/e1354dc06af7bda1c4cf47b923148568.png
Streaming speeds also look unhealthy:

Re: Quality and Experience Testing

Moncrieffe500 — Mon, 30 Apr 2012 19:28:53 GMT

people must laugh as soon as they see my download and upload speeds lol i could GREET! lol

Re: Quality and Experience Testing

Moncrieffe500 — Mon, 30 Apr 2012 19:40:15 GMT

Re: Quality and Experience Testing

Pettitto — Mon, 30 Apr 2012 19:42:03 GMT

Time: 20:40
[0] => 1 vl7.sec.ptb-gw4.plus.net (212.159.3.25) 0.547 ms
[1] => 2 vl427.pih-gw3.plus.net (212.159.1.123) 0.569 ms
[2] => 3 gi1-1.ptn-gw01.plus.net (212.159.1.178) 11.245 ms
[3] => 4 ae3.ptw-cr01.plus.net (195.166.129.32) 11.324 ms
[4] => 5 ae1.pcl-cr01.plus.net (195.166.129.1) 11.588 ms
[5] => 6 po2.pcl-gw01.plus.net (195.166.129.41) 13.675 ms
[6] => 7 gi11-1-2-631.pcl-ag06.plus.net (84.93.254.144) 13.087 ms
[7] => 8 *
[8] => 9 *
You are currently connected to the gateway known as pcl-ag06.
This is located in City Lifeline House.

Quite normal. doesn't appear to have impacted my speeds.