Ok so here is the url for that page on google that talks about the google bots.
http://www.google.com/webmasters/remove.html
Ok so it is my understanding that if you do not want the be listed on google (or any other search engine) all you need is a little wee bit code on your site.
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
It seems to me their webmasters can't be that stupid, so am I missing something? Here is a google page outlining different ways block content from googles crawler bots. Most of it seems quite simple.

Chowhound
Comic Vine
GameFAQs
GameSpot
Giant Bomb
TechRepublic