syoder
join:2008-02-11
Syracuse, IN
2 edits | Embarq network congestion, latency and packet loss in INWe've been having major problems with high latency, packet loss and low download speeds in the evenings here in Northern Indiana. It happens Sunday through Thursday starting at around 7:00 PM and ending at around 10:00 PM. The problem really started after new years and has been getting progressively worse.
The problem is not with my router or my first hop as the traceroute below shows. The latency starts at the 2nd hop into Embarq's network. It looks like a congestion problem or a bad QoS/shaping setup in Embarq's core. The reason I say bad QoS setup is Embarq says they don't have a congestion problem which they should know about if it existed.
So far I haven't been able to get anyone from Embarq to acknowledge there is a problem and one manager would not even call 300 ms latency a problem.
Here is a sample traceroute to google when the latency was starting to get bad:
Matt's traceroute [v0.54]
timmy Thu Feb 14 16:11:12 20 08
Keys: D - Display mode R - Restart statistics Q - Quit
Packets Pings
Hostname %Loss Rcv Snt Last Best Avg Wors t
1. 172.20.0.2 0% 487 487 0 0 0 1
2. 71.1.32.1 0% 487 487 10 6 9 3 6
3. 71.0.195.249 4% 470 487 393 299 412 62 8
4. 160.81.255.137 1% 484 487 342 195 291 36 1
5. 144.232.14.61 2% 479 487 370 202 300 49 8
6. 144.232.20.155 5% 466 487 331 182 306 52 5
7. 160.81.98.34 2% 478 487 326 192 310 40 1
8. 209.85.130.12 2% 478 487 299 202 321 50 0
9. 209.85.248.221 3% 474 487 277 198 313 49 7
10. 66.249.94.133 3% 475 487 274 221 305 46 3
11. 72.14.232.74 4% 470 486 296 214 304 37 4
12. 64.233.167.104 4% 469 486 300 213 301 38 1
And here is a trace to my router coming from a QWest looking glass site showing the problem between the same 2 routers:
Traceroute to 71.1.34.71 from chi-engr-01.inet.qwest.net
--------------------------------------------------------------------------------
traceroute: Warning: ckecksums disabled
traceroute to 71.1.34.71 (71.1.34.71), 30 hops max, 40 byte packets
1 205.171.20.193 (205.171.20.193) 1.150 ms 1.416 ms 0.531 ms
2 205.171.20.129 (205.171.20.129) 0.709 ms 1.218 ms 1.386 ms
3 67.14.8.206 (67.14.8.206) 0.759 ms 1.308 ms 0.772 ms
4 205.171.139.150 (205.171.139.150) 0.946 ms 1.285 ms 0.839 ms
5 sl-st20-chi-15-0-0.sprintlink.net (144.232.18.245) 0.720 ms 0.708 ms 0.705 ms
6 sl-bb20-chi-12-0.sprintlink.net (144.232.20.2) 1.295 ms 1.314 ms 1.260 ms
7 sl-bb22-chi-14-0.sprintlink.net (144.232.26.6) 1.221 ms 3.200 ms 1.179 ms
8 sl-bb20-roa-8-0-0.sprintlink.net (144.232.18.37) 4.192 ms 4.224 ms 4.219 ms
9 sl-gw10-roa-9-0.sprintlink.net (144.232.0.6) 4.319 ms 4.256 ms 5.052 ms
10 sl-sprintwrbm-27-0.sprintlink.net (160.81.95.38) 19.764 ms 19.913 ms 19.706 ms
11 oh-71-0-195-238.sta.embarqhsd.net (71.0.195.238) 234.536 ms 223.803 ms 226.975 ms
12 oh-71-1-34-71.dhcp.embarqhsd.net (71.1.34.71) 242.445 ms 250.557 ms 240.006 ms
| |
|
 staggerbite
join:2006-07-30
Avilla, IN
| Re: Embarq network congestion, latency and packet loss in IN Same thing is happening to me. I also live in North East Indiana... | |
|
embarq_cesar
join:2007-12-19
Carlisle, PA
| Hello staggerbite,
The problem has been detected as an outage in your area. We received enough complaints from the same area reporting the same problem. The outage was posted in our board last night 2/14/2008 9:55:05 PM. As of right now there is no estimated time of repair. I submitted a ticket on your phone number and when the outage is cleared you will receive an automated call advising you that the problem has been resolved. When you get the call, please turn your modem, router and pc off for a minute and then back on.
I will be looking at this issue and provide more details as the outage board is being monitor 24x7.
Please accept my apologies and I hope to give you the good news very soon.
Thanks
Cesar L
Embarq Customer Support
smnp.cesar.l@embarq.com
For additional support and live chat please visit www.myembarq.com/contact_us.php or call 1877-646-3282
Voice | Data | Internet | Wireless | Entertainment | |
|
 | syoder
join:2008-02-11
Syracuse, IN
| Re: Embarq network congestion, latency and packet loss in IN I'm glad someone from Embarq will verify this as an Embarq network problem. It's been very difficult to convince the phone techs that the problem is not mine. I understand 99% of their tech support calls are on the customer side but in this case it's really easy from the traces to see where the problem lies.
There's no way Embarq can roll out 10 meg service in this region when the core can't support the current 1.5 - 3 meg speeds.
Hopefully they'll figure out if it's a DDoS attack or (more likely) just lack of bandwidth between 2 hops and increase the bandwidth between those hops. | |
|
lman
join:2006-10-23
Plymouth, IN | I'm in Plymouth, IN and contacted Embarq about the same problems and they said there was no problem on their end and indicated I might have a problem with dsl filters. Hopefully this will be fixed soon. | |
|
| 
indyman1963
@embarqhsd.net
| Re: Embarq network congestion, latency and packet loss in IN Hello, it is not your dsl filters, there is a outage in indiana and they still working on it is what tech support is telling me, i live in plymouth indiana and i am down to as little as 90 k at times early mornings are fine, but get towards evening it will drop like a rock. | |
|
d_ketterer
@embarqhsd.net | I am in Whiteland IN and am experiencing the slowness issue as well. I hope they get it corrected soon. It's kind of hard to run an IT business with a slow internet connection. | |
|
|
Pat Mac
@embarqhsd.net | Re: Embarq network congestion, latency and packet loss in IN I'm in Bargersville and I cannot put my finger on a pattern of slowdowns. It seems to me that it occurs in late afternoon but sometimes lasts all evening | |
|
userequal
join:2007-04-03
Lapel, IN
| I've been having problems in Lapel,IN. Not sure what the deal is. My upload started suffering now the download. I attached a phone with filter to see if I could hear static on the line and found out I don't even have a dialtone. Not sure how long it's been that way. I never wanted the voice line anyhow. | |
|
|
maximus1969
@embarqhsd.net | Re: Embarq network congestion, latency and packet loss in IN I also live in Lapel, IN and have had horrible d/l speeds, it seems that today it is better but every speed test I do is diff from the last? I thought dsl was supposed to be more consistant? | |
|
| |
maximus1969
@embarqhsd.net
| Re: Embarq network congestion, latency and packet loss in IN said by maximus1969 :
I also live in Lapel, IN and have had horrible d/l speeds, it seems that today it is better but every speed test I do is diff from the last? I thought dsl was supposed to be more consistant?
My package is supposed to be 5000 d/l 768 up
I just ran 5 speed test and they ranged from 3500 d/l all the way down to 1700...hard to play online games like this | |
|
| | userequal
join:2007-04-03
Lapel, IN
1 edit | It is "consistantly" bad. Wish we had something other than Embarq and Longview Cable around here. | |
|
| | | servon23
join:2007-08-27
Lapel, IN
1 edit |  Re: Embarq network congestion, latency and packet loss in IN
Tracing route to google.com [64.233.167.99]
over a maximum of 30 hops:
1 1 ms 1 ms 1 ms DD-WRT [192.168.1.1]
2 33 ms 33 ms 33 ms oh-71-50-240-1.dhcp.embarqhsd.net [71.50.240.1]
3 128 ms 203 ms 199 ms oh-71-0-195-237.sta.embarqhsd.net [71.0.195.237]
4 78 ms 77 ms 78 ms sl-gw21-roa-10-1-0.sprintlink.net [144.232.149.9
3]
5 78 ms 79 ms 77 ms sl-bb20-roa-11-0-0.sprintlink.net [144.232.17.19
3]
6 78 ms 77 ms 77 ms sl-bb22-chi-4-0-0.sprintlink.net [144.232.18.36]
7 79 ms 78 ms 78 ms sl-st21-chi-13-0-0.sprintlink.net [144.232.20.91
]
8 78 ms 78 ms 78 ms 144.223.241.54
9 79 ms 78 ms 79 ms 209.85.250.237
10 79 ms 80 ms 79 ms 66.249.94.133
11 79 ms 88 ms 90 ms 72.14.232.74
12 80 ms 82 ms 80 ms py-in-f99.google.com [64.233.167.99]
Trace complete. | |
|
Gardman
join:2008-02-15
Plymouth, IN | I also live in Plymouth and have been experiencing these same issues. Hope this gets corrected soon! | |
|
ajcollins
join:2006-11-26
Plymouth, IN
| I just got off the phone with a tech that said that a case was filed yesterday. He said it's strange because the case says the whole state is having problems but there have not been any updates to the case nor is there any details as to what exactly is wrong. According to Embarq's own speed test, I'm currently getting 116 kbps down and 345 kbps up on the 5 MBPS service. | |
|
George574
join:2005-04-09
Leesburg, IN | Yeah I also live in Northern Indiana in the Leesburg area and i have also been experiencing this problem currently iam on the phone with embarq and have been waiting for about 20 mins now... | |
|
ericvervalin
join:2004-10-26
Fort Wayne, IN
| I'm just west of Fort Wayne... and from what the lady I talked to said was that Embarq's network all comes in or out of plymouth for this area. I'm getting the same speeds / issues too.. pings that were 70 are 300 +.. sucks for gaming..  | |
|
fatty
Premium
join:2008-01-06
Cromwell, IN | same thing in cromwell In. | |
|
|
| syoder
join:2008-02-11
Syracuse, IN
| Re: Embarq network congestion, latency and packet loss in INThe latency is still bad across the same 2nd hop router. Arguably it's a bit better now with around 200 ms average latency to most sites 15 hops out.
VoIP gets a little choppy at times and WoW latency is still over 500 ms making it unplayable.
It's been 24 hours now -- time to call Embarq again.
Trace to google:
Matt's traceroute [v0.42]
Scott-Home Tue May 28 08:27:17 2002
Keys: D - Display mode R - Restart statistics Q - Quit
Packets Pings
Hostname %Loss Rcv Snt Last Best Avg Worst
1. 71.1.32.1 0% 87 87 16 6 11 63
2. 71.0.195.237 3% 85 87 164 87 189 416
3. 144.232.149.93 3% 85 87 188 104 194 238
4. 144.232.17.193 0% 87 87 180 103 192 257
5. 144.232.18.36 0% 87 87 189 108 195 249
6. 144.232.20.21 3% 85 87 185 104 195 244
7. 144.223.241.54 2% 86 87 180 102 195 247
8. 216.239.48.154 2% 86 87 184 110 199 255
9. 66.249.95.120 3% 85 87 195 117 199 255
10. 64.233.175.26 0% 87 87 198 121 205 260
11. 72.14.232.70 21% 68 87 160 129 202 258
12. 64.233.167.99 26% 64 87 186 124 203 274
Scott-Home:/usr/local/sand# mtr www.google.com -n
| |
|
lman
join:2006-10-23
Plymouth, IN | I still have a very low speed connection. I was thinking about upgrading to a higher speed, but I can't even get the speed I'm supposed to have now. | |
|
staggerbite
join:2006-07-30
Avilla, IN
| This is getting sort of ridiculous. 3rd day in a row that my high speed internet has been going as fast as dial up. Last night before I went to bed, speeds were normal. This morning it's still super slow. Can't wait until I got another high speed internet option in my area. | |
|
| syoder
join:2008-02-11
Syracuse, IN
| Re: Embarq network congestion, latency and packet loss in IN Dialup would be better for gaming right now than Embarq DSL at any speed. I've seriously considered getting a cheap dialup account to be able to play WoW until they Embarq upgrades their network.
I wish they had competition here - I'd switch in a heartbeat but we have no other real options. | |
|
HSFreek
join:2006-09-21
Indiana | I live in the Corunna Indiana area and things have been sloooooww for the last 2 or 3 days.
Hopefully it will be fixed soon. | |
|
Stactik
@embarqhsd.net
| I currently live in Remington, Indiana -- And our internet has been extremely sluggish for around 3-4 days now. while we pay for 5.0 DSL-- The service we are recieving is that of Dial Up.. and its extremely frustrating.. I cant even really stand to do some of the things online that I love doing, I hope they fix this soon... I've called for the past couple days (except today, sunday) and there's still no "estimate" as to when they'll have it fixed... Hopefully someone is actually working on this, rather then just being lazy..  | |
|
staggerbite
join:2006-07-30
Avilla, IN | I'll give you an estimate. Wednesday... Since they probably get the weekend off and they will get Monday off (Presidents Day). Tuesday they will fool around with it and then Wednesday, almost a week after the problem, they will get it fixed. | |
|
|
ALPHAxDOG
Premium
join:2007-10-09
Rising Sun, IN
| 
Packet_Loss |
| |
|
| lordlitwicki
join:2006-10-05
Plymouth, IN
3 edits | Re: Embarq network congestion, latency and packet loss in IN I also live in Plymouth IN and it's weird cause I have a 5meg connection and it seems around 1am until about 10am everything runs at like 5mb/s. But than the rest of the day I get barely 100-300 kb/s. This has been going on since Thursday night like you all have been reporting. Runing a Visual Trace route we are being run through one of two Ohio Servers on hop 3 and both have extremely high latency. They are 71.0.195.249 and 71.0.195.237. I'm going to run another trace in an hour or so when it seems speeds are back to normal... | |
|
| | lordlitwicki
join:2006-10-05
Plymouth, IN
| Re: Embarq network congestion, latency and packet loss in IN Speeds are back to what they should be and it's really odd I am still being routed through the Ohio Server 71.0.195.249 but the high latency is ALL gone. So it's not network re-routing causing the latency. It just seems around 1AM the latency has been gone "magically" every night as if someone flipped a switch than in the morning it returns and is there all day. You can almost set a clock to it... | |
|
staggerbite
join:2006-07-30
Avilla, IN | Yeah you noticed that yesterday before I went to bed. Now today before I got bed everything is fine. Maybe its some large server or something that shuts down at a certain time and then turns back on in the morning? | |
|
| syoder
join:2008-02-11
Syracuse, IN | Re: Embarq network congestion, latency and packet loss in IN Well the latency was back to normal for a few hours this morning. Now it's back to over 200 ms. Still waiting... | |
|
| | lordlitwicki
join:2006-10-05
Plymouth, IN | Re: Embarq network congestion, latency and packet loss in IN Same here in Plymouth, back to the slow speeds as of about 10AM it really is like someone is flipping a switch during the day. | |
|
| | | syoder
join:2008-02-11
Syracuse, IN | Re: Embarq network congestion, latency and packet loss in IN I still think it's related to traffic and usage. It's worse in the evenings and weekends (prime time for residential customers).
Also a lot of schools are out today due to Presidents' Day - more P2P traffic. | |
|
staggerbite
join:2006-07-30
Avilla, IN
1 edit | 
I got my bandwidth back. The ping is still high though... 3:30PM
Take that back... Super slow again. 4:31 | |
|
|
|
|
