I have changed my robots.txt and for Googlebot I have the following setting in Google Webmaster Tools according to this instruction.
0.02 requests per second (50 seconds between visits)
|The crawlrate in Google Webmaster Tools (in Dutch)|
May be Google thinks this makes no sense, and may be they are right. I will change this setting to 0.2 (actual 0.198) requests per second and hope that Googlebot respect this setting.
Note: I will keep the setting in robots.txt the same for this moment (Crawl-delay: 50) for other bots.
I am pretty sure that Googlebot is visiting ZOMDir.com. The IP addresses used by this bot are for example:
Verifying these adresses give via Reverse DNS Lookup results like this:
188.8.131.52 resolves to
Top Level Domain: "googlebot.com"
Country IP Address: UNITED STATES
The only hope I have at this moment is that someone wrote that it can take weeks before Googlebot is following your instructions. I hope that that person was wrong ...