Hi James,
The robots.txt of one of my client website is like -
User-agent: Googlebot
Allow: /
User-agent: Slurp
Allow: /
Type: Posts; User: H_T
Hi James,
The robots.txt of one of my client website is like -
User-agent: Googlebot
Allow: /
User-agent: Slurp
Allow: /