After seeing the way MSN crawled my last post, I just realized why Microsoft could never do good in Search Engine Market :)

I wonder why MSN would crawler same page from two different machines. I wonder if a single page can be divided further for crawling. Checkout the screenshots below :)

Why Google Wins

A few minutes later. Three Microsoft machines were crawling the same page :P

MSN Crawler Pawned

I have conformed using ARIN that all these IPs belong to Microsoft :D

Related Posts

{ 1 comment… read it below or add one }

1 Bharat July 29, 2009 at 10:16 PM

You are pwning so many things nowadays.. You shud rename urself “The Pwner!” . Note exclamation is in the name.

Reply

Leave a Comment

You can use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong> <pre lang="" line="" escaped="" highlight="">

Previous post:

Next post: