Robots.txt - Webmasters and Developers

Author	All Replies
Bobcat Premium join:2001-02-04	reply to state Re: Robots.txt They should just use: User-agent: * Disallow: / and be done with it. -- "I truly am not that concerned about him." Pres. Bush on Osama bin Laden, March 13, 2002
Bobcat Premium join:2001-02-04	to forum · permalink · 2005-02-08 12:16:09 ·
rjackson Premium,Mod join:2002-04-02 Ringgold, GA kudos:1	No kidding. »/robots.txt is also an interesting read too.
	to forum · permalink · 2005-02-08 12:26:42 ·
johnnyboyct join:2003-06-11 New Britain, CT	reply to johnnyboyct lol that is funny
johnnyboyct join:2003-06-11 New Britain, CT	to forum · permalink · 2005-02-08 19:08:42 ·
Bobcat Premium join:2001-02-04 Reviews: ·Verizon Online DSL ·Optimum Online ·EarthLink	reply to rjackson said by rjackson: No kidding. »/robots.txt is also an interesting read too. Yeah, but don't try to go to the /secret/ directory listed there.
	to forum · permalink · 2005-02-08 20:28:56 ·

OS and Software > Webmasters and Developers > Robots.txt