topic Re: Akamai v6 - peering issue? in IPv6 Trial

Akamai v6 - peering issue?

AndyH — Tue, 29 Apr 2014 12:33:39 GMT

I am getting a lot of Facebook images that aren't loading at the moment and they are delivered/hosted by Akamai (address fbcdn-profile-a.akamaihd.net).
A traceroute shows exactly the same issue as with www.java.com (traceroute seems to go no further than PN's network):

Quote
traceroute6: Warning: a2047.dspl.akamai.net has multiple addresses; using 2a02:26f0:5a::173e:3531
traceroute6 to a2047.dspl.akamai.net (2a02:26f0:5a::173e:3531) from 2a02:16c8:2000:1100:ed61:xxxx:xxxx:xxxx, 64 hops max, 12 byte packets
1 2a02:16c8:2000:1100:xxxx:xxxx:xxxx:xxxx 0.376 ms 0.410 ms 0.330 ms
2 2a02:16c8:0:1::16 6.601 ms 6.363 ms 5.997 ms
3 2a02:16c8:1:2::19 4.591 ms 4.706 ms 4.409 ms
4 2a02:16c8::d 4.647 ms 4.575 ms 6.129 ms
5 2a02:16c8:1:2::8 4.629 ms 4.576 ms 4.989 ms
6 * * *
7 * * *
6 * * *
7 * * *
8 * * *
9 * * *
10 * * *

A traceroute from Hurricane's LG works perfectly fine:

Quote
core1.lon1.he.net> traceroute ipv6 2a02:26f0:5a::173e:356a numeric
Target 2a02:26f0:5a::173e:356a
Hop Packet 1 Packet 2 Packet 3 Hostname
1 10 ms 11 ms <1 ms 10ge3-1.core1.lon2.he.net (2001:470:0:2cd::1)
2 9 ms <1 ms <1 ms ge-2-1-0-zpr1.lnt.cw.net (2001:7f8:4::4f9:1)
3 <1 ms <1 ms <1 ms so-0-1-0-r1-IPv6.de.cw.net (2001:5000:0:1::1)
4 11 ms 2 ms 1 ms akamai-gw2.lns.cw.net (2001:5000:1100:9::2)
5 <1 ms <1 ms <1 ms 2a02:26f0:5a::173e:3531

Quote
core1.lon2.he.net> traceroute ipv6 2a02:26f0:5a::173e:356a numeric
Target 2a02:26f0:5a::173e:356a
Hop Packet 1 Packet 2 Packet 3 Hostname
1 13 ms <1 ms <1 ms ge-2-1-0-zpr1.lnt.cw.net (2001:7f8:4::4f9:1)
2 1 ms 1 ms 1 ms so-0-1-0-r1-IPv6.de.cw.net (2001:5000:0:1::1)
3 1 ms 1 ms 1 ms akamai-gw2.lns.cw.net (2001:5000:1100:9::2)
4 <1 ms <1 ms <1 ms 2a02:26f0:5a::173e:3531

The strange thing is that if I ping6 akamai-gw2.lns.cw.net (2001:5000:1100:9::2) and then immediately afterwards do a traceroute to a2047.dspl.akamai.net (2a02:26f0:5a::173e:3531), it works fine:

Quote
$ traceroute6 fbcdn-profile-a.akamaihd.net
traceroute6: Warning: a2047.dspl.akamai.net has multiple addresses; using 2a02:26f0:5a::173e:3531
traceroute6 to a2047.dspl.akamai.net (2a02:26f0:5a::173e:3531) from 2a02:16c8:2000:1100:xxxx:xxxx:xxxx:xxxx, 64 hops max, 12 byte packets
1 2a02:16c8:2000:1100:xxxx:xxxx:xxxx:xxxx 0.443 ms 0.393 ms 0.336 ms
2 2a02:16c8:0:1::16 128.809 ms 88.936 ms 57.786 ms
3 2a02:16c8:1:2::19 4.883 ms 4.462 ms 4.632 ms
4 2a02:16c8::d 5.034 ms 4.693 ms 4.671 ms
5 2a02:16c8:1:2::8 4.291 ms 4.044 ms 4.420 ms
6 lonap.he.net 4.609 ms 11.987 ms 4.885 ms
7 10ge3-1.core1.lon2.he.net 15.629 ms 4.191 ms 4.699 ms
8 ge-2-1-0-zpr1.lnt.cw.net 4.680 ms 4.639 ms 4.636 ms
9 so-0-1-0-r1-ipv6.de.cw.net 5.188 ms 9.314 ms 7.206 ms
10 akamai-gw2.lns.cw.net 5.511 ms 5.589 ms 5.252 ms
11 2a02:26f0:5a::173e:3531 4.961 ms 5.037 ms 4.885 ms

Any thoughts?

Re: Akamai v6 - peering issue?

Kelly — Tue, 29 Apr 2014 13:11:17 GMT

Might be something wrong on our side here. We've flagged it over to Paul to have a look.

Re: Akamai v6 - peering issue?

AndyH — Tue, 29 Apr 2014 13:21:58 GMT

Perfect. Thanks.

Re: Akamai v6 - peering issue?

chrcoluk — Tue, 29 Apr 2014 13:44:56 GMT

yeah I had akamai slow loading/timeouts on another site also.

Re: Akamai v6 - peering issue?

paulmh5 — Tue, 29 Apr 2014 16:13:06 GMT

I've made some changes to stop traffic going over the Akamai PNI links. Hopefully this will be a bit more stable while they have a look at what's going on.

Re: Akamai v6 - peering issue?

AndyH — Tue, 29 Apr 2014 16:38:56 GMT

Working for me fine now - thanks.

Re: Akamai v6 - peering issue?

jelv — Tue, 29 Apr 2014 16:41:53 GMT

@paulmh5
Thanks for fixing http://community.plus.net/forum/index.php/topic,126295.0.html as well.

Re: Akamai v6 - peering issue?

paulmh5 — Fri, 06 Jun 2014 15:21:21 GMT

Fingers crossed Akamai have sorted the issue on their side now so I've enabled the PNIs again. Let me know if you see issues with it.

Re: Akamai v6 - peering issue?

jelv — Mon, 09 Jun 2014 08:18:38 GMT

Paul,
www.java.com gives "The server at www.java.com is taking too long to respond." over IPv6!

Re: Akamai v6 - peering issue?

paulmh5 — Tue, 10 Jun 2014 06:06:56 GMT

Odd, its working ok for me this morning. Everything else working for you over v6(Facebook etc..)?

Re: Akamai v6 - peering issue?

jelv — Tue, 10 Jun 2014 07:23:33 GMT

I can access IPv6 only sites such as http://loopsofzen.co.uk/.
Firefox is accessing some sites (e.g. http://www.internetsociety.org/blog/tech-matters/2014/02/google-ipv6-traffic-passes-3-deployment-rate-accelerates-0) via IPv6 (I'm using the 4or6 add-on) - although it's doing it's usual of fast fall back to IPv4 on others.
Tracert:

C:\Users\John>tracert -6 www.java.com
Tracing route to www.java.com [2a02:26f0:26:3:8e00::1ba3]
over a maximum of 30 hops:
  1    <1 ms     1 ms     1 ms  dsldevice.lan [2a02:16c8:<removed>]
  2    21 ms    21 ms    20 ms  2a02:16c8:0:1::17
  3    21 ms    20 ms    20 ms  2a02:16c8:1:2::17
  4    22 ms    20 ms    20 ms  2a02:16c8::c
  5    20 ms    20 ms    20 ms  2a02:16c8:1:2::6
  6    23 ms    24 ms    24 ms  40ge1-3.core1.lon2.he.net [2001:7f8:4::1b1b:1]
  7     *        *        *     Request timed out.
 ...
 19     *        *        *     Request timed out.
 20     *     Destination host unreachable.
Trace complete.

http://ipv6.google.com/ works.
I'm seeing the issue on both pcl and ptw gateways.

Re: Akamai v6 - peering issue?

jelv — Wed, 11 Jun 2014 19:36:46 GMT

I can't access http://ipv6.google.com/ at the moment.

Re: Akamai v6 - peering issue?

paulmh5 — Wed, 11 Jun 2014 21:17:59 GMT

Both are still working fine for me.
Have you moved to one of the new BNGs? These will give you a pool address rather than a static if you have that in any fixed config that may cause you a problem. Failing that I'd suggest checking your MTU size as a few people have had issues with that and some v6 services.

Re: Akamai v6 - peering issue?

jelv — Wed, 11 Jun 2014 22:05:58 GMT

I'm not on a bng (does IPSEC go to bng's?).
I've not touched anything to do with MTU - so why would Google suddenly stop working? (I can tracert to it)

Re: Akamai v6 - peering issue?

bobpullen — Thu, 19 Jun 2014 16:39:00 GMT

Anyone else having problems with Facebook images again?
java.com is OK, Facebook just seems a bit iffy from my desktop

Re: Akamai v6 - peering issue?

brueton — Thu, 19 Jun 2014 17:00:06 GMT

All OK for me.

Re: Akamai v6 - peering issue?

AndyH — Mon, 29 Dec 2014 08:40:56 GMT

Just wondering if anyone is having issues with Akamai over v6 again? I am having issues with Facebook/Instagram images timing out again.

Re: Akamai v6 - peering issue?

chrcoluk — Mon, 29 Dec 2014 12:07:45 GMT

can you post some direct url's here so can test?

Re: Akamai v6 - peering issue?

AndyH — Mon, 29 Dec 2014 12:29:24 GMT

Try http://photos-g.ak.instagram.com/hphotos-ak-xaf1/t51.2885-15/10899153_873421292713054_1539817145_n.jpg
The images are loading (eventually), but they are taking forever:

I'm on pcl-bng02 - if I disable v6, then I have no issues with any CDN hosted images.

Re: Akamai v6 - peering issue?

jelv — Mon, 29 Dec 2014 13:00:00 GMT

I put

photos-g.ak.instagram.com       2a02:26f0:c8::17c0:a2e1

in my hosts file as then able to access the image in Firefox via v6. I'm on ptw-ag03