Paging Robert Scoble: Tell msnbot to Calm Down

I’m posting this note with Robert Scoble‘s name in it in order to get some attention from Microsoft about the behavior of their RSS bot, msnbot.

Over the past week, the bot has hit my site over 27k times for about 38mb of bandwidth. The bot is almost exclusively hitting RSS feeds. However, most of the feeds it is getting on my site are for individual entries, which allow people to track comments. Each feed is getting hit about 100x a week. I would think that is a big waste of effort for older entries that get few comments. Once a day should be plenty.

So, Robert, when you see this in one of your ego notifications, please pass the word to whoever manages msnbot to chill out a bit on the hits. I love to be indexed but not at such a heavy load which is wasting my bandwidth and MS’s. If the load goes much higher I might ban the bot for poor manners.

Advertisements

One thought on “Paging Robert Scoble: Tell msnbot to Calm Down

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s