robots.txt help
How do I disallow Google Image search from indexing my images but otherwise allow Google and others to index all of my pages text-wise? What I wrote in my current robots.txt file must be wrong because many months later and I'm still getting tons of referral traffic from Google Images. I find this disturbing because I don't want creeps finding photos of my children when searching for unrelated stuff - which keeps happening.
Bonus points if you can tell me how to accomplish the two tasks above (disallow Google images while allowing all other traffic) and also disallow one single directory too, which we'll call /thisfolder/
Thanks a ton for the help.
teammatt3 posted this at 17:41 — 16th April 2008.
He has: 2,102 posts
Joined: Sep 2003
I think this might do it:
User-agent: Googlebot-Image
Disallow: /
And for the bonus points:
User-agent: Googlebot-Image
Disallow: /thisfolder/
I've heard reports of Google not following robots.txt so that could be the problem.
Useful Links:
http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=40364
http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=35308
saeedvt posted this at 10:53 — 21st April 2008.
They have: 1 posts
Joined: Apr 2008
thank you
Want to join the discussion? Create an account or log in if you already have one. Joining is fast, free and painless! We’ll even whisk you back here when you’ve finished.