User-agent: * # directed to all spiders obeying convention Disallow: /cgi-local/ Disallow: /intranet/