|
Excluding
Sites from Google
Since
WSU is using Google as its main on-site search engine, people are
finding that their test sites are also included in the index. Not
necessarily a good thing.
If
you have test sites, or sites you want excluded from Google (and
other search engines), you should check to see if this site is already
in Google. Type a likely search term/phrase into the search field
on the left-hand side of this page and click the Search button.
Scroll through the results to see if your test site appears.
If
so (or even if not), you should add a robots.txt file to
your site. To exclude the entire site from search engines, you simply
create a text file named robots.txt, with two lines:
User-agent:
*
Disallow: /
Save
the file and place it in your site's root directory.
To
selectively exclude files and folders, you can follow the instructions
at http://www.robotstxt.org/wc/norobots.html.
If
your site is already in Google, and you desperately want it removed,
follow the instructions at http://www.google.com/remove.html.
This *should* expedite your request.
Good
luck!
|
