# Do not spider pending links until recipicated User-agent: Googlebot Disallow: /linkpage # Do not spider pending links until recipicated User-agent: MSNBot Disallow: /linkpage # Do not spider pending links until recipicated User-agent: Inktomi Slurp Disallow: /linkpage # Do not spider pending links until recipicated User-agent: MSIECrawler Disallow: /linkpage # Do not spider pending links until recipicated User-agent: AskJeeves Disallow: /linkpage # Disallow ia_archiver User-agent: ia_archiver Disallow: /