Yes, this looks like a solution that should work.
Yes, this looks like a solution that should work.
Have no fear,
GlowHost is Here!
It's important to know that "bad" bots do not always honor the instructions that you have in the robots.txt - You may end up having to ban those IPs directly.
"Good" bots like Slurp and googlebot will honor your instructions.
Send your friends and site visitors to GlowHost and get $125 plus bonus!
GlowHost Affiliate Program | Read our Blog | Follow us on X |
I have added this to my htaccess, but I am getting this error:
[Sat Sep 19 06:34:08 2015] [alert] [client 217.73.208.152] /home/teambuic/public_html/.htaccess: Invalid command 'User-agent:', perhaps misspelled or defined by a module not included in the server configuration
I don't think it is related to spelling.
It also brought the site down with a 500 error.
OPPS figured it out![]()
Nice to hear that!![]()
Have no fear,
GlowHost is Here!
Just to ask, what was the problem in this exact issue?
Have no fear,
GlowHost is Here!