-
So something like this would allow googlebot and slurp into all directories except the ones listed as "Disallow" and all other agents would not be allowed anywhere:
User-agent: googlebot
Disallow: /forums/classifieds
Disallow: /cgi-bin/
Disallow: /data/
Disallow: /download/
Disallow: /facebook/
Disallow: /generator/
Disallow: /include/
Disallow: /reference/library/images
Disallow: /temp/
Disallow: /test/
Disallow: /upload/
Disallow: /webstats/
Sitemap: http://www.teambuick.com/sitemap.xml
User-agent: Slurp
Disallow: /forums/classifieds
Disallow: /cgi-bin/
Disallow: /data/
Disallow: /download/
Disallow: /facebook/
Disallow: /generator/
Disallow: /include/
Disallow: /moderators/
Disallow: /openx/
Disallow: /reference/library/images
Disallow: /temp/
Disallow: /test/
Disallow: /upload/
Disallow: /webstats/
Sitemap: http://www.teambuick.com/sitemap.xml
User-agent: *
Disallow: /
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules