User-agent: * # folders & pages not to be entered Disallow: /cgi-bin/ Disallow: /Library/