Me? I use the bad_bots .htaccess code and robots.txt too, but the items I mentioned previously are on top of those measures. I don't want BOTs I don't know about or have yet to be invented from harvesting our forum's data, which is where Show First Post Only to Guest comes in. It limits what all unregistered users and BOTs can see.
p.s. Google's hitting our forum up again with crawl requests, averaging about 10x what the typically do over the past eight days. I can see some rather dramatic percentage upticks in OK (200) pages too. So, maybe they fired the 13 y.o programmers who were still carrying around nursery blankets and finally replaced them with educated programmers who can tie their shoe laces.
p.s. Google's hitting our forum up again with crawl requests, averaging about 10x what the typically do over the past eight days. I can see some rather dramatic percentage upticks in OK (200) pages too. So, maybe they fired the 13 y.o programmers who were still carrying around nursery blankets and finally replaced them with educated programmers who can tie their shoe laces.
Statistics: Posted by SQLnovice — Sun May 19, 2024 6:01 am