Charter, Cox Comcast Tops PC Magazine Speed Rankings
As Mag Turns to Ookla to Shore up Test Issues
For several years now PC Magazine has been conducting a somewhat controversial ranking of broadband ISPs by speed, using the PC Magazine Surfspeed
application. Criticism over the years has grown about the magazine's methodology, and their decision to rank ISPs based on browsing speed
in the age of 100 Mbps connections and Internet video. In 2007, many of our readers took issue with the magazine's results
, noting the findings listed ISPs in incorrect states, and even managed to confuse gigabit and kilobit measurements.
Last year, popular speed measuring site Ookla was pointedly critical of the magazine's methodology
, stating the PC Mag test didn't represent the performance of an ISP or a modern web browsing experience
...the test happens in serial using two connections at a time, but modern web browsers go well beyond this old HTTP limitation. For example Firefox 3 and Internet Explorer 8 default to six parallel connections to a host when retrieving content. PC Magazine claims that they are trying to represent the speed of an actual web browsing experience, but apparently it is not a modern one. Ignoring that issue the test could still be used to compare rudimentary web browsing performance, but does that really represent the performance of an ISP? No.
PC Magazine was listening, and this year finally changed their measuring methodology -- by hiring Ookla to do it for them
In previous years, our tests focused on browsing download speeds. However, with video streaming and massive uploads/downloads becoming the norm, we realized we needed to change our methodology. We listened to your feedback and turned our attention to Ookla, a leader in broadband testing and Web-based network diagnostic applications, and its popular (and proven) product Speedtest.net. Speedtest.net is almost the de facto standard for testing connection speeds. Ookla set us up with our own PCMag branded version of the test.
As a result, this year's tests look considerably different
, with Comcast, Cox and Charter all tying for top honors based on 58,300 tests completed from May 6, 2011 until July 29, 2011 at pcmag.speedtest.net. Verizon, who normally dominated PC Mag's charts courtesy of FiOS, falls slightly this year because Ookla averages both FiOS and slower DSL customers into a single score. The magazine's test also breaks down ISP speed by region
, fastest business ISPs
, as well as fastest ISPs by state, city and globally
You can find this year's PC Mag test methodology detailed here
, and you can compare the results to Ookla's Net Index website
Santa Rosa, CA
Sonic.net Where's Sonic's gigabit service?
·Time Warner Cable
Re: Where is At&t? They're not grabbing the top 5% of all users, but taking an 'average' of all users.
AT&T's Uverse internet starts out with 3Mbps/1Mbps and charges extra. If they add in the ADSL users, many never make it past 3Mbps (2.4Mbps after ATM overhead).
TWC (and most cable providers) first bundle in +10Mbps/1Mbps (they'll charge more for a 1.5Mbps if you wanted to downgrade in a bundle!), 'then' they add on 'Boost' to fluff the numbers with a 20-30Mbps download rate for the first 10-20 seconds.
Eg. My '10/1Mbps package'
said by pcmag :
Who scored the lowest? Folks in Alabama, South Carolina and Mississippi appear to stumble thanks to AT&T South (formerly Bellsouth). All had an index of well below 5.0 (Alabama's AT&T speed is the lowest on the chart, with an index of 2.56.). The District of Columbia comes close, with Verizon getting an index score of 3.19 (despite the fact that FiOS is available in D.C.).
| |spewakR.I.P DadkinsPremiumReviews:
Elk Grove, CA
Re: Where is At&t?
said by en103:I didn't think so:
They're not grabbing the top 5% of all users, but taking an 'average' of all users.
The weekend is here, grab a can of beer!
Re: DSL users brinigng down VZ
this study is worthless
but what can you expect from PCrag magazine...
had they used the test results from the FCC & Sam knows to get a true accurate picture this so called study from PCrag would be quite different.
speedtest.net is unable to distinguish between DSL and Fiber?
these test results are inaccurate IMHO. Thought VZ used different IP blocks for DSL & Fiber?
| |said by houkouonchi:Or maybe Verizon needs to get off its ass and deploy more FiOS.
The reason VZ is so low on that has to be because its including both FIOS and DSL users... too bad they couldn't separate them.
| |BHNtechXpertBHN StaffPremium,VIP
Saint Petersburg, FL
PC Mag had it right...Oookla had it wrong... I'll catch all sorts of hell for this but I know I'm right and it needs to be said. PC Mag had the general idea right to begin with, Ookla was wrong and they have always been wrong.
First of all the online user experience should NOT be measured by web browsing alone because being online is far more than just surfing nowadays.
There are two major types of measurements that should be made when you are benchmarking the quality of your internet connection.
1) Application Speed and Quality - The absolute maximum speed and quality of service obtainable through a single socket test. This is important because streaming, voip and similar applications in most cases are NOT multi-socket but are in fact single socket. That said this form of testing is critical in evaluating the real quality of an internet connection because for example if your subscribed tier is 40/5 and your single socket application test results rates you at 5/1 with a QoS of 37% you are going to have serious problems with certain applications.
This happens a lot with certain providers and yet very few benchmarking sites help users diagnose these issues when this is what people should be looking at. For most windows based systems the above referenced connection will top out somewhere around 12-15/4.8 with a QoS of not less than 90% when running a single socket TCP test to be considered a good connection. There are ways to improve this depending on your operating system, distance between test site and obviously the quality of your network connection.
2) Capacity - This is more like the traditional speed tests which first calibrate based on connection speed, determining at what datarate the connections starts to drop packets and then open a specific number of sockets based on the calibration speed for the duration of the test. This test should ideally also measure QoS (or the connections ability to maintain a steady datarate for the duration of the test). This is the test that essentially behaves like modern browsers would.
It's critically important to know the results of both tests before making an evaluation of the connection quality and Ookla doesn't offer you both of these tests so any results they provided PC Mag would have been only marginally useful.
PC Mag was on the right track to begin with...they just did an awful job of explaining it to the public and press who apparently hassled them over it and apparently caved this year to the pressure...sad really because they had an opportunity to properly educate the public on internet connection benchmarking and blew it.
Ookla is a bad choice. Ookla's Speedtest.net is not accurate and tends to give extra high speed readings which is why a lot of companies like Qwest use it. It would give me a speed of 1600k on my1500k DSL line that was only running about 640k. It gives insanely high readings on Virgin Mobile too. Speed.io is more accurate.
| |BHNtechXpertBHN StaffPremium,VIP
Saint Petersburg, FL
Re: Ookla is a bad choice.
said by ArizonaSteve:I agree with your Oookla statement however speed.io is far from being an accurate or reliable test. Yea its looks fancy but in my tests with multiple connections and providers Speed.io was an epic fail....sorry!
Ookla's Speedtest.net is not accurate and tends to give extra high speed readings which is why a lot of companies like Qwest use it. It would give me a speed of 1600k on my1500k DSL line that was only running about 640k. It gives insanely high readings on Virgin Mobile too. Speed.io is more accurate.
Speed.io is an excellent example of the ad farm speed test proliferation that has poluted the net recently adding further confusion to consumers. Lots of ads...worthless test.
~All truth goes through three phases. First, it is ridiculed. Second, it is violently opposed. Third, it is accepted as self-evident. - Einstein~