User-agent: * Disallow: /random.php User-agent: msnbot Crawl-delay: 2 Disallow: /random.php