swim|bike|run
« murphy's law | Main | mastic »

 
April 16, 2007
Google the pest

I don't look at the hit logs for this site that often, but last week I was surprised by what I saw. In short, there were hundreds of hits daily from Google search engines, particularly Google Images. The hit log looked very similar to what you see when someone is hot linking images from your site. I tried removing the images that were getting hit by Google Images once every other minute, but the hits continued despite that the images were no longer there. I asked myself if it really mattered whether or not people came across the site using Google as a search engine, and the answer is no. So I blocked Google and Google Images from crawling my site using a robots.txt file. (Here is how to do that.) I don't know what the bandwidth limitations are for this site in particular, but I don't like the site getting bombed with useless hits.


Posted by megabeth at April 16, 2007 10:05 AM
 
Comments

 
Post a comment




Remember Me?