After seeing the way MSN crawled my last post, I just realized why Microsoft could never do good in Search Engine Market
I wonder why MSN would crawler same page from two different machines. I wonder if a single page can be divided further for crawling. Checkout the screenshots below
A few minutes [...]
