Dreamhost has a ton of info on how to be invisible to spiders and the like. If you don't want anybody --except you-- being able to access your files, then you should configure .htaccess to your needs.
Dreamhost has a ton of info on how to be invisible to spiders and the like. If you don't want anybody --except you-- being able to access your files, then you should configure .htaccess to your needs.