Robots.txt query
Hi,
Does the robots.txt
User-agent: *
Disallow:
Disallow: /login.asp
also dissallow URLs like
domain.com/login.asp?register=Y
and
domain.com/login.asp?someotherstring
and so on?
Hi,
Does the robots.txt
User-agent: *
Disallow:
Disallow: /login.asp
also dissallow URLs like
domain.com/login.asp?register=Y
and
domain.com/login.asp?someotherstring
and so on?
internetking posted this at 17:58 — 30th November 2006.
They have: 36 posts
Joined: Sep 2006
google has a great tutorial on this
Want to join the discussion? Create an account or log in if you already have one. Joining is fast, free and painless! We’ll even whisk you back here when you’ve finished.