#132490 - keldon - Wed Jun 27, 2007 8:09 am
#132509 - SimonB - Wed Jun 27, 2007 11:03 am
Thanks. I will look into these idiots and set some bans.
Simon
#132512 - SimonB - Wed Jun 27, 2007 11:24 am
Well, at least they seem to be willing to fix their problems...
"Thank you for your email.
I checked your complaint and noticed that our crawler doesnt crawl your forum anymore. My guess is that either that when it crawled your forum either the robots.txt wasn't there or there was a bug in our system and we apologize if that is the case.
Your content will be removed very soon as our system will delete older post that weren't indexed again. In the meantime I disabled the preview feature for your board.
Thank you"
Either it only took them a few minutes to reply to my e-mail form on their website, or they have a standard mail they send automatically to everyone ;)
The robots.txt has disallowed bots from crawling the forum for years...
#132513 - keldon - Wed Jun 27, 2007 11:37 am
Well they do run bots; maybe it just evaluated your email and this is an automated response ^_^ And what sort of bug ignores a robots.txt anyway?
#132516 - tepples - Wed Jun 27, 2007 12:40 pm
Why is such a restrictive robots.txt in place anyway? Specifically, why is Google blocked when phpBB's internal search is an extreme inconvenience?
_________________
-- Where is he?
-- Who?
-- You know, the human.
-- I think he moved to Tilwick.