#allow every robot to traverse all of the directoryies User-agent: NPBot Disallow: / User-agent:12.148.209.198 Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /inc/