O Canada! > Canadian > Bell Canada > [Internet] Service outage downtown toronto?

reply to ns1225

Re: [Internet] Service outage downtown toronto?

Microsoft Windows [Version 6.1.7601]
Copyright (c) 2009 Microsoft Corporation.  All rights reserved.
 
C:\Users\Danny>tracert 199.107.24.244
 
Tracing route to 199.107.24.244 over a maximum of 30 hops
 
  1    <1 ms    <1 ms    <1 ms  monreseau.home [192.168.2.1]
  2     5 ms     4 ms     5 ms  bas1-hamilton01_lo0_SYMP.net.bell.ca [64.230.200
.194]
  3     5 ms     4 ms     4 ms  dis15-hamilton14_5-1-0_100.net.bell.ca [64.230.5
9.88]
  4    17 ms    17 ms    17 ms  bx5-chicagodt_xe1-0-0-0.net.bell.ca [64.230.186.
242]
  5    18 ms    18 ms    18 ms  12.249.212.9
  6    32 ms    34 ms    33 ms  cr1.cgcil.ip.att.net [12.122.99.22]
  7    34 ms    35 ms    34 ms  cr1.cl2oh.ip.att.net [12.122.2.206]
  8    33 ms    34 ms    31 ms  cr2.cl2oh.ip.att.net [12.122.2.126]
  9    35 ms    33 ms    35 ms  cr2.phlpa.ip.att.net [12.122.2.210]
 10    31 ms    31 ms    31 ms  gar1.pitpa.ip.att.net [12.122.107.85]
 11    38 ms    35 ms    38 ms  12-122-254-242.attens.net [12.122.254.242]
 12    36 ms    38 ms    35 ms  mdf001c7613r0004-gig-12-1.nyc3.attens.net [63.24
0.65.14]
 13     *        *        *     Request timed out.
 14     *        *        *     Request timed out.
 15     *
 

Everybody relax. I am home sympatico customer. They (Bell) have core issue. Routing loops, dead routes advertizement to peers, etc.
No valid exits from AS577 (bell). Issue begin 2012-08-08 14:xx EST . Conditions change but BGP is still out of order. Shoot those network designers and engineers. Now everybody start laughing about 99.999% network availability article on Cisco web site. Just today brought it down 100 times from 5 nines to 3 nines for us here in GTA, GTA West and some QC.

Anybody with good eyesight can see the same router/interface twice in the traceroute?

[root@localhost ~]# traceroute -A netsuite.com
traceroute to netsuite.com (167.216.129.12), 30 hops max, 60 byte packets
1 bas1-cooksville17_lo0_SYMP.net.bell.ca (64.230.197.56) [AS577] 22.091 ms 22.972 ms 23.117 ms
2 dis7-toronto01_Vlan144.net.bell.ca (64.230.202.17) [AS577] 20.921 ms 21.004 ms 20.601 ms
3 * * bx5-chicagodt_xe6-0-0.net.bell.ca (64.230.186.86) [AS577] 35.986 ms
4 newcore2-chicagocp_xe3-1-1.net.bell.ca (64.230.186.89) [AS577] 34.379 ms newcore2-chicagocp_xe3-1-0.net.bell.ca (64.230.186.85) [AS577] 34.390 ms core2-chicago23_GE5-1-0.net.bell.ca (64.230.186.245) [AS577] 32.344 ms
5 core3-toronto47_POS0-2-0-0.net.bell.ca (64.230.186.125) [AS577] 35.028 ms newcore3-toronto12_POS0-6-0-0.net.bell.ca (64.230.147.165) [AS577] 34.046 ms newcore4-toronto12_POS0-6-0-0.net.bell.ca (64.230.147.173) [AS577] 36.656 ms
6 bx4-toronto12_so-0-0-0.net.bell.ca (64.230.158.22) [AS577] 32.573 ms bx4-toronto12_so-1-1-0-0.net.bell.ca (64.230.138.114) [AS577] 32.746 ms bx4-toronto12_so-2-0-0-0.net.bell.ca (64.230.138.126) [AS577] 31.130 ms
7 core4-toronto12_POS10-0-0.net.bell.ca (64.230.158.25) [AS577] 46.275 ms newcore3-toronto12_POS0-9-1-0.net.bell.ca (64.230.152.233) [AS577] 42.250 ms 89.404 ms
8 newcore2-chicago23_so2-0-0.net.bell.ca (64.230.147.174) [AS577] 45.463 ms 45.574 ms 43.729 ms
9 bx5-chicagodt_xe-0-0-3_0.net.bell.ca (64.230.186.106) [AS577] 43.903 ms * *
10 core2-chicago23_GE5-1-0.net.bell.ca (64.230.186.245) [AS577] 68.840 ms newcore1-chicagocp_xe-4-0-0_0.net.bell.ca (64.230.186.105) [AS577] 45.184 ms core2-chicago23_GE5-1-0.net.bell.ca (64.230.186.245) [AS577] 68.929 ms
11 core4-toronto47_POS0-2-0-0.net.bell.ca (64.230.186.117) [AS577] 47.921 ms newcore4-toronto12_POS0-6-0-0.net.bell.ca (64.230.147.173) [AS577] 47.606 ms core3-toronto47_POS0-2-0-0.net.bell.ca (64.230.186.125) [AS577] 47.700 ms
12 bx4-toronto12_so-2-0-0-0.net.bell.ca (64.230.138.126) [AS577] 45.104 ms bx4-toronto12_so-0-0-0.net.bell.ca (64.230.158.22) [AS577] 40.907 ms bx4-toronto12_so-1-1-0-0.net.bell.ca (64.230.138.114) [AS577] 47.150 ms
13 newcore3-toronto12_POS0-9-1-0.net.bell.ca (64.230.152.233) [AS577] 57.398 ms core4-toronto12_POS10-0-0.net.bell.ca (64.230.158.25) [AS577] 80.450 ms newcore3-toronto12_POS0-9-1-0.net.bell.ca (64.230.152.233) [AS577] 57.138 ms
14 newcore2-chicago23_so2-0-0.net.bell.ca (64.230.147.174) [AS577] 55.089 ms newcore1-chicago23_so2-0-0.net.bell.ca (64.230.147.166) [AS577] 54.903 ms 57.737 ms
15 * bx5-chicagodt_xe6-0-0.net.bell.ca (64.230.186.86) [AS577] 53.109 ms 54.635 ms
16 core1-chicago23_GE8-1-0.net.bell.ca (64.230.186.241) [AS577] 57.180 ms 52.909 ms newcore1-chicagocp_xe3-1-0.net.bell.ca (64.230.186.77) [AS577] 54.966 ms
17 core4-toronto47_POS0-2-0-0.net.bell.ca (64.230.186.117) [AS577] 56.167 ms core3-toronto47_POS0-2-0-0.net.bell.ca (64.230.186.125) [AS577] 58.777 ms newcore4-toronto12_POS0-6-0-0.net.bell.ca (64.230.147.173) [AS577] 58.822 ms
18 bx4-toronto12_so-1-1-0-0.net.bell.ca (64.230.138.114) [AS577] 58.440 ms bx4-toronto12_so-2-0-0-0.net.bell.ca (64.230.138.126) [AS577] 57.638 ms 55.711 ms
19 newcore3-toronto12_POS0-9-1-0.net.bell.ca (64.230.152.233) [AS577] 68.786 ms core4-toronto12_POS10-0-0.net.bell.ca (64.230.158.25) [AS577] 72.675 ms newcore3-toronto12_POS0-9-1-0.net.bell.ca (64.230.152.233) [AS577] 61.698 ms
20 newcore2-chicago23_so2-0-0.net.bell.ca (64.230.147.174) [AS577] 67.651 ms newcore1-chicago23_so2-0-0.net.bell.ca (64.230.147.166) [AS577] 62.683 ms 61.140 ms
21 * * bx5-chicagodt_xe3-1-0-0.net.bell.ca (64.230.186.246) [AS577] 68.873 ms
22 newcore1-chicagocp_xe3-1-0.net.bell.ca (64.230.186.77) [AS577] 97.206 ms newcore2-chicagocp_xe3-1-0.net.bell.ca (64.230.186.85) [AS577] 75.756 ms newcore1-chicagocp_xe3-1-1.net.bell.ca (64.230.186.81) [AS577] 91.669 ms
23 newcore3-toronto12_POS0-6-0-0.net.bell.ca (64.230.147.165) [AS577] 63.376 ms core4-toronto47_POS0-2-0-0.net.bell.ca (64.230.186.117) [AS577] 71.214 ms 68.905 ms
24 bx4-toronto12_so-1-1-0-0.net.bell.ca (64.230.138.114) [AS577] 69.463 ms 70.131 ms bx4-toronto12_so-0-0-0.net.bell.ca (64.230.158.22) [AS577] 61.383 ms
25 newcore3-toronto12_POS0-9-1-0.net.bell.ca (64.230.152.233) [AS577] 75.963 ms core4-toronto12_POS10-0-0.net.bell.ca (64.230.158.25) [AS577] 88.234 ms 86.558 ms
26 newcore1-chicago23_so2-0-0.net.bell.ca (64.230.147.166) [AS577] 79.111 ms 79.737 ms newcore2-chicago23_so2-0-0.net.bell.ca (64.230.147.174) [AS577] 86.221 ms
27 * * *
28 newcore1-chicagocp_xe3-1-1.net.bell.ca (64.230.186.81) [AS577] 81.901 ms newcore1-chicagocp_xe3-1-0.net.bell.ca (64.230.186.77) [AS577] 82.010 ms newcore2-chicagocp_xe-4-0-0_0.net.bell.ca (64.230.186.109) [AS577] 88.821 ms
29 newcore3-toronto12_POS0-6-0-0.net.bell.ca (64.230.147.165) [AS577] 74.955 ms 76.384 ms core3-toronto47_POS0-2-0-0.net.bell.ca (64.230.186.125) [AS577] 82.947 ms
30 bx4-toronto12_so-1-0-0.net.bell.ca (64.230.158.26) [AS577] 85.575 ms bx4-toronto12_so-1-1-0-0.net.bell.ca (64.230.138.114) [AS577] 82.072 ms 79.211 ms