republican-creole
site Search:


 
   
story category
Google Hijacking 404 Pages?
There's money in them thar 404s...
by Karl Bode Tuesday 12-Feb-2008 tags: business · software · networking
As we've been discussing, a vast majority of ISPs these days have hijacked DNS functionality by replacing traditional page-not-found errors with their own customized search portals. This turns mistyped URLs into a revenue stream by directing their attention toward ad partners. Because this is something that only annoys more technical users (who say it disrupts the functionality of certain tools), most ISP marketing departments disregard the complaints of these users (and in some cases their own networking staff).

Click for full size
In somewhat related news, some webmasters this morning are annoyed by the fact that the latest version of the Google Toolbar replaces the custom 404 page from the website you're on with a Google version. Webmasters in turn fear that this will direct users away from the website they're currently browsing.

The “new” 404 error page ‘conveniently’ includes a Google search box and if used by a visitor will drive the visitor away from your website. Even worse - the search box is pre-populated with data from the initial URL query on your website. Imagine a situation where kind of sensitive data is send to Google that way.

Additional webmaster discussion can be found at the DigitalPoint forums, though there is some indication that this is all much ado about nothing.

view: topics flat text 
Post a:
page: 1 · 2
jc100

join:2002-04-10

Drum roll to stupidity

And you'd be running a spyware laden toolbar why? Anyone using these toolbars deserve what they get... My god... COMMON SENSE PEOPLE!!

BF69
Premium
join:2004-07-28
Camden, TN

Re: Drum roll to stupidity

said by jc100:

And you'd be running a spyware laden toolbar why? Anyone using these toolbars deserve what they get... My god... COMMON SENSE PEOPLE!!
It does NOT have spyware on it. Lucky Google won't bother to sue you.

I've used MANY MANY spyware programs and NONE have had google toolbar come up as spyware. hmmmmmmmm. google must be paying them off.

swhx7
Premium
join:2006-07-23
Elbonia

Re: Drum roll to stupidity

It reports the user's web activity data to Google. That's spyware according to some definitions.

It is done with permission, and is removable, and some people therefore exclude it from the "spyware" category, because deception or hard-to-remove is part of their criteria for spyware.

But there is no legal rule forcing anyone to use one definition rather than the other. Both are reasonable. Therefore Google would have no grounds for a suit. Google actually has to insist on a more lenient definition in order to deny that its toolbar is spyware.

Jerm

join:2000-04-10
Richland, WA
kudos:2

DHRacer
Fire Survivor

join:2000-10-10
Lake Arrowhead, CA

Re: Drum roll to stupidity

What's really scary is that I've seen computers with about half that many toolbars, but that's still too many.

patcat88

join:2002-04-05
Jamaica, NY
kudos:1

Re: Drum roll to stupidity

I have a friend who loves Bonzi Buddy........... says its cute

Beyond hope for me.
FrankO
Best Day Ever
Premium
join:2007-08-16
Toledo, OH
All those toolbars - is that for real??
--
Make a Great Day!

antdude
A Ninja Ant
Premium,VIP
join:2001-03-25
kudos:2
Reviews:
·RoadRunner Cable

Re: Drum roll to stupidity

said by FrankO:

All those toolbars - is that for real??
Probably on computer illiterates.

fdasf

@comcast.net
Hahaha... thats hilarious, look at all those toolbars. You are actually missing the AOL toolbar and the MSN toolbar

Rogue Wolf
Ate Your Homework, And Framed The Dog

join:2003-08-12
Troy, NY

Re: Drum roll to stupidity

The Alexia toolbar probably ate them. Look at the way it's eyeing that eBay toolbar....

Dude111
An Awesome Dude
Premium
join:2003-08-04
USA
kudos:10

Re: Drum roll to stupidity

Only people that dont know anything about computers are confused by SEARCH BARS/ADDRESS BARS.......
threetrolls

join:2003-04-19
Bellevue, WA
Thanks for the laugh.

What happens when there is no space for the web page? Does something explode? Here is a link to a few toolbars you don't have. I say go for it.

»en.wikipedia.org/wiki/Toolbar

roc5955
Premium
join:2005-11-26
Rosendale, NY
OMG!!! You like a little browser with your toolbars, huh?
--
"Understanding is a three-edged sword."
cornelius785

join:2006-10-26
Worcester, MA
since i've had no problems using the internet without tool bars for ~10 years, i don't see why i should ever install one. if people are getting annoyed from what google tool bar is doing, then UNINSTALL it. you may not have control on what your ISP is doing, but you have the control uninstall software that is on your own computer that is altering whatever.

en102
Canadian, eh?

join:2001-01-26
Valencia, CA

Re: Drum roll to stupidity

I agree... I get almost every app attempting to 'add' a toolbar on my browser. Why ? Well obviously they make money somehow. If its not from reselling the info collected by your surfing habits, its through ads or selling the info collected by you using their toolbar's associated search engine. Nobody does this just as a basic enhancement... its all about money.
--
Canada = Hollywood North

Dogfather
Premium
join:2007-12-26
Laguna Hills, CA

Tough

Users CHOOSE to run Google toolbar just as they would choose to run AV software, script blockers or ad blockers.

IOW, this isn't Google's doing or an ISP's doing.

This is a CHOICE by the user.

Sabre
Di relung hatiku bernyanyi bidadari

join:2005-05-17

Re: Tough

This is entirely true.

However, bear in mind that the Google toolbar comes pre-checked with a LOT of common software. While forced opt-out software is indeed a choice, it's the kind of loaded choice that often seems like foistware.

Is it a choice? Yes, but it often doesn't feel that way.
--
With all its sham, drudgery, and broken dreams, it is still a beautiful world.

Save American Soccer - Stop the MLS!

Dogfather
Premium
join:2007-12-26
Laguna Hills, CA

Re: Tough

Still the user's call.

If the USER doesn't like it, the USER can uninstall it.

Sabre
Di relung hatiku bernyanyi bidadari

join:2005-05-17

Re: Tough

Absolutely. I can't disagree with you at all on that. I merely don't like the precedent of opt-outs in general (I'd rather see it as opt-in). Legally, certainly Google isn't doing anything wrong, though I think it's a bit touchy ethically. (And in their defence, they're better at advertising its presence in a bundle than a lot of other companies are.)

Dogfather
Premium
join:2007-12-26
Laguna Hills, CA

Re: Tough

Me neither, especially when they're hidden like we saw with Real Players selections. Real Networks would have a sliding window and the visible components were all unchecked but if you slid down you would find all the spam components checked.

en102
Canadian, eh?

join:2001-01-26
Valencia, CA

Re: Tough

I personally dislike that style as well.
While not illegal, somewhat misleading by design.
--
Canada = Hollywood North

Romney2012
Defeat Obama 2012-Chg we can believe in
Premium
join:2002-03-03
USA
kudos:4
said by Dogfather:

Still the user's call.

If the USER doesn't like it, the USER can uninstall it.
I agree, it is a choice to uninstall it. But there is a problem. Google is now, BY DEFAULT, being installed somewhat sneakily(just like scumware companies do) with other products.

And I find it very amusing that others are defending this practice. The very same people who did and would be screaming bloody murder when Verizon or Comcast did the same exact thing.
--
Internet News
My BLOG
My Web Page

S_engineer
Premium
join:2007-05-16
Chicago, IL

Re: Tough

Does anybody remember the stink over Webroots decision to declassify 180 solutions as adware or malware?
Now does everyone see how this practice has become more prevelant on the web, even with the "Internet defenders" like google.
Take it even further TK, why is this in anyway acceptable when the NSA eavsdropping is not?

Malware and click stream data mining is ok as long as it's for marketing purposes, but use it to try and prevent disaster and look out!

Priorities people.
--
"There is no such thing as public opinion. There is only published opinion."....Winston Churchill
openbox9

join:2004-01-26
Alexandria, VA
kudos:2
You should realize that the Zealots around here believe that Google can do no wrong. Obviously this effort is Google's attempt to save the Internet, one tool bar at a time.
darbacour

join:2005-04-13
Los Angeles, CA
said by Sabre:

This is entirely true.

However, bear in mind that the Google toolbar comes pre-checked with a LOT of common software. While forced opt-out software is indeed a choice, it's the kind of loaded choice that often seems like foistware.

Is it a choice? Yes, but it often doesn't feel that way.
Absolutely TRUE.

A few years ago, I had a CrapCast tech accidentally install the Google toolbar when he updated my Java to run a speed-test at DSL Reports.

Damn I was hot until I realized Java updates always come with the wonderful offer of a stupid Google toolbar pre-checked and being a CrapCast tech I couldn't possibly expect him to be smart enough to uncheck it.

swhx7
Premium
join:2006-07-23
Elbonia
Having 404's replaced isn't a choice on the part of the user unless the toolbar tells the user that's what it's going to do. If the user doesn't realize that the site's own 404 is being intercepted and suppressed, then Google is interfering in the user's communications in a deceptive way.

Sabre
Di relung hatiku bernyanyi bidadari

join:2005-05-17

Google needs to step back

I've been growing more and more annoyed with Google and their toolbar over the past several months. It keeps showing up, pre-checked, in an ever larger number of software installs (Java and Flash Player come to mind immediately). I've been uninstalling it from our work computers on sight - usually after it hard-locks IE while running in the background looking for an update.
Now this. Google's getting so big and powerful that they're starting to forget a little of the user-friendliness and unobtrusiveness that drove so many people to them in the first place. Google, you have always had a good thing going. Step back before you ruin it.
--
With all its sham, drudgery, and broken dreams, it is still a beautiful world.

Save American Soccer - Stop the MLS!

BF69
Premium
join:2004-07-28
Camden, TN

Re: Google needs to step back

said by Sabre:

I've been growing more and more annoyed with Google and their toolbar over the past several months. It keeps showing up, pre-checked, in an ever larger number of software installs (Java and Flash Player come to mind immediately). I've been uninstalling it from our work computers on sight - usually after it hard-locks IE while running in the background looking for an update.
Now this. Google's getting so big and powerful that they're starting to forget a little of the user-friendliness and unobtrusiveness that drove so many people to them in the first place. Google, you have always had a good thing going. Step back before you ruin it.
I get yahoo toolbar coming up pre-checked in more and more things. CCleaner, Adobe Acrobat are 2 examples.

INT0CABLE
BANNED
Premium
join:2007-10-22
Bronx, NY

is this why?

i havent seen a 404 page error in years? eventhough im a shabby typer?

Nightfall
My Goal Is To Deny Yours
Premium,MVM
join:2001-08-03
Grand Rapids, MI

Easy fix

Uninstall google toolbar
Problem solved

Raptor
Not a Dumptruck

join:2001-10-21
London, ON

Re: Easy fix

Such a complex and technical fix. I think we should go on and on about how terrible this is instead

PhoenixDown
-- Wants FIOS
Premium
join:2003-06-08
Fresh Meadows, NY
kudos:1

Re: Easy fix

The issue is that the website could have customized 404 pages to help direct traffic back to the site and the google toolbar is essentially hijacking their page which is certainly not cool

KoolMoe
Aw Man
Premium
join:2001-02-14
Annapolis, MD

Re: Easy fix

Exactly. My company site has custom 404 pages. A user mistypes or an old link is clicked, a nicely formatted 404 page results within our website design, along with a company site search box and other information.
Anyone who circumvents a visitor from seeing that is playing unfair, IMO, if not outright sneaky and illegal.
KM
wentlanc
You Can't Fix Dumb..

join:2003-07-30
Maineville, OH

Re: Easy fix

Someone else suggested using a .htaccess file to redirect back to the home page. I then suggested redirecting to a valid page which will give a 200 response, but tell the user that their request could not be fulfilled.
openbox9

join:2004-01-26
Alexandria, VA
kudos:2
No different than going on and on about changing your DNS servers when ISPs implement such tactics.

battleop

join:2005-09-28
00000

This is a BETA feature.

I just downloaded the Google Toolbar to a VMWare box to see if it's really doing this. With the current version of the tool bar I went to a url that does not exist on one of our websites and got the 404 error page I expected. Then I installed the version 5 beta and went to the same url and got the Google generated 404 error.

nklb
Premium
join:2000-11-17
Ann Arbor, MI
kudos:2

The article is confused...

said by dslreports article :
As we've been discussing, a vast majority of ISPs these days have hijacked DNS functionality by replacing traditional 404 page not found error pages with their own customized search portals. This turns mistyped URLs into a revenue stream by directing their attention toward ad partners.
Um, those are two completely separate concepts.

If you are unable to resolve a domain name, DNS doesn't return a "404" error. It simply returns a response that the domain name doesn't exist.

404 errors are returned by a web server when a specific page doesn't exist.

If you type a domain that doesn't exist, there is no web server to return a 404!
--
for all your Linux questions
jp10558
Premium
join:2005-06-24
Willseyville, NY

Slight Modification should be made

I've been using Proxomitron to replace 404 pages for, boy, 7 years now. And it just make's it look matrix like. Google makes it a little more useful.

However, there seems to be one major difference with the filters I use. If the site does return a customized 404 error page, I see that, but if it's just whatever the browser would generate, I get the "cool" 404 page. Now, it seems to me that most sites are not generating custom 404, so maybe this doesn't work like I think it does (that is, sites are creating page not found pages, but not sending a 404 error code?). If that's the case, sites can do the same for google if they care.

If it's in the prox filter, then google ought to default to that with an option for users to do what it is doing now.
--
Opera 9.23(Build 8808); Windows XP Pro SP2;Athlon 64 X2 4600+; 2.5GB PC3200 DDR; 1M/128k DSL; NOD32(Version 2.5.25); Outpost Pro 3;Proxomitron 4.5j Grypen 5/23/07(Opera mod),GPG ID:0x0A1C6EE3

odreian615

join:2006-01-18
Chicago, IL

But it does nothing wrong

Google does nothing wrong
wentlanc
You Can't Fix Dumb..

join:2003-07-30
Maineville, OH

Just like AdBlockers

This is the choice of the user. The web developer can be as pissed as they want to, but what I choose to put on my machine to customize MY internet is my choice.

Just like ad blockers. Developers are pissed about them too because less people may click on their ads to help pay for the site. I've never clicked one, and I don't intend to, so I removed them completely to save the bandwidth, and my eyeballs. I'm allowed to customize my experience on the internet, right?

Every company out there is looking to gain from ads. From web developers, all the way up to DNS providers. (See Neustar below) Ultimately, it is the end users choice to determine what they WANT to see on their desktop. And all content providers are looking to get their ads in front of the user by any means possible.

»biz.yahoo.com/prnews/071211/netu···tml?.v=1

»www.dnsadvantage.com/

See 6 replies to this post

compugeek
I love making my own beer.
Premium
join:2002-07-30
Pickerington, OH

I just installed it

It does do 404 and DNS redirection. But if you look in the page they give you there is a link on why am I seeing this that will take you to another page to disable the feature. So to me this is a none issue.

Geek
--
»www.itsnewtoyou.biz

Jameson
Premium
join:2004-05-28
Fallbrook, CA
kudos:1

I dont see any advertisments

So whats the problem?

laserjobs
Premium
join:2004-05-02
Las Vegas, NV

Not great google

This actually pisses me off that I ended up spending time designing a nice 404 error page for my site visitors to get them back on the right track. As far as I am concerned, Google is performing a man in the middle attack on my website trying to deliver a 404 error page.
--

Vote for Ron Paul in the Republican Primaries
dlewis23

join:2005-04-18
Boca Raton, FL

Re: Not great google

Thats exactly how I feel. I had made a really nice 404 page for my site.

Well I'll fix google, I'm putting in a .htaccess that puts users back to the home page with the 404 code on any link that doesn't work,
wentlanc
You Can't Fix Dumb..

join:2003-07-30
Maineville, OH

Re: Not great google

And that's exactly what a responsible web developer should do. I applaud you for not whining about it, but taking action that resolves the issue. Heck, put them to a page that returns a 200, but still says that their content was unavailable.

Simple NON-problems require simple solutions.

NetFixer
Freedom is NOT free
Premium
join:2004-06-24
The 'Boro
Reviews:
·Vonage
·Cingular Wireless
·Comcast
·AT&T Southeast

Re: Not great google

For the code challenged webmasters out there, here is a sample of the .htaccess code that will definitely bypass the new Google toolbar 404 redirection hijack. I just installed the Google beta toolbar in question, and on my web sites and others that do similar internal 404 redirection (including dslreports.com) the new Google toolbar had no effect.

ErrorDocument 401 /noaccess.html
ErrorDocument 403 /noaccess.html
ErrorDocument 404 /notfound.html
 
 

--
We can never have enough of nature.
We need to witness our own limits transgressed, and some life pasturing freely where we never wander.
Test your firewall.
ATHF

join:2004-12-20
00000

google

google should just release DNS servers

if they are the keepers of the internet
they be a good dns provider
patcat88

join:2002-04-05
Jamaica, NY
kudos:1

Re: google

I hope thats sarcasm.

Jason Levine
Premium
join:2001-07-13
USA

I need to test this...

My work site is all one big customized 404 error page. It uses the customized 404 error page, along with the URL requested, to figure out what content the user wanted and to display it for them. If this interferes with custom 404 error pages, this might interfere with my entire website. It looks like I'll need to set up the Google Toolbar (in a sandbox, of course), to see what, if anything, it does.
--
-Jason Levine
Support a children's charity. Buy a calendar. Shooting For A Cause
Jason's Toolbox | PCQandA.com

sbrook
Premium,Mod
join:2001-12-14
Ottawa
kudos:4
Reviews:
·TekSavvy Cable
·Rogers Hi-Speed

DNS polluters

Then there's the offshore DNS polluters who register all manner of garbage names like gogogogogogogog.com and then redirect them all to their fake search engine (munky.com is one example) that you at first think is a legit link, but soon realize that you find yourself on a click through.

Strange that the fake search engine operator and their registrar are located someplace like the Cayman Islands with the same identical address.

Jason Levine
Premium
join:2001-07-13
USA

Re: I need to test this...

Ok, thanks to SandboxIE I was able to install the Google Toolbar Beta without *really* installing it on my system. I had some trouble getting the toolbar to hijack my bad URLs at first, until I turned on the "Browse by name in the address bar" option. After that, Google would replace:

»www.pcqanda.com/This/URL/Does/Not/Exist/

with a Google search page (with the search form populated with "pc q This URL Does Not Exist").

However, navigating to my work's website at:

»www.nehealth.com/Medical_Care/SAM/

worked just fine.

It looks like this is slightly overblown. First of all, this is a beta, not a final release feature (yet). Secondly, it appears to keep the feature off by default.

It's not the best feature Google's thought up, but it doesn't appear to be overtly evil either. (And definitely not as bad as the ISP/Verisign mistyped domain name ad pages.)
--
-Jason Levine
Support a children's charity. Buy a calendar. Shooting For A Cause
Jason's Toolbox | PCQandA.com

NetFixer
Freedom is NOT free
Premium
join:2004-06-24
The 'Boro
Reviews:
·Vonage
·Cingular Wireless
·Comcast
·AT&T Southeast
All you need to do is to include lines similar to the code below in the .htaccess file (assuming your work site can use a .htaccess file) to redirect without producing a 404 error.

ErrorDocument 401 /noaccess.html
ErrorDocument 403 /noaccess.html
ErrorDocument 404 /notfound.html
 
 

I just installed the Google beta toolbar in question, and on my web site and other sites (including dslreports.com) that use similar methods to handle url redirection, the Google toolbar did not redirect to its own 404 page.

--
We can never have enough of nature.
We need to witness our own limits transgressed, and some life pasturing freely where we never wander.
Test your firewall.

Jason Levine
Premium
join:2001-07-13
USA

Re: I need to test this...

Actually, my work's website runs on IIS so we don't use .htaccess. It's quite simple to do in IIS, actually. Simply set a custom 404 page (e.g. 404Processor.asp) in the site's Error Pages tab. Then have that page look at the query string that it is given and do something based on that. In the case of my site, it parses it out to determine which page the user wants to see then pulls content from the database.
--
-Jason Levine
Support a children's charity. Buy a calendar. Shooting For A Cause
Jason's Toolbox | PCQandA.com

quetwo
That VoIP Guy
Premium
join:2004-09-04
East Lansing, MI

Do no evil?

Heh. Sure. Whatever you say.

joako
Premium
join:2000-09-07
/dev/null
kudos:5

Old news?

Microsoft Internet Explorer has been doing this for YEARS.
--
09:F9:11:02:9D:74:E3:5B:D8:41:56:C5:63:56:88:C0

NOCMan
MacChatter
Premium
join:2004-09-30
Colorado Springs, CO

The irony

IIRC Google sued because people were trying to do that to them and now they're doing it to others.

So now webmasters will sue Google for overwriting webpages.

Worse is some sites have reporting links on 404's so they can be notified of problems. Course those with "Toolbars" installed are most likely not the types to help fix a webpage.
--
Mac Chatter
»www.macchatter.net

Smith6612
Premium,MVM
join:2008-02-01
North Tonawanda, NY
kudos:21

Doesn't bother me...

Another reason why I don't use Google software on any of my computers.

Dude111
An Awesome Dude
Premium
join:2003-08-04
USA
kudos:10

1 edit

 

Certain ISPs are doing this also......

You enter an invalid URL and you get a custom search page FROM THE ISP (Some of them allow you to OPT OUT luckily!)

Monday, 04-Jun 11:22:32 Terms of Use & Privacy | feedback | contact | Hosting by nac.net - DSL,Hosting & Co-lo
over 12.5 years online © 1999-2012 dslreports.com.