Pawned – Tech Stuff https://gofedora.com How Tos, Tutorials, Tips and Tricks Thu, 18 Jun 2015 14:17:41 +0000 en-US hourly 1 https://wordpress.org/?v=4.9.4 MSN Crawlers Pawned https://gofedora.com/msn-crawlers-pawned/ https://gofedora.com/msn-crawlers-pawned/#comments Wed, 29 Jul 2009 12:15:17 +0000 http://gofedora.com/?p=658 … →]]> After seeing the way MSN crawled my last post, I just realized why Microsoft could never do good in Search Engine Market 🙂

I wonder why MSN would crawler same page from two different machines. I wonder if a single page can be divided further for crawling. Checkout the screenshots below 🙂

Why Google Wins

A few minutes later. Three Microsoft machines were crawling the same page 😛

MSN Crawler Pawned

I have conformed using ARIN that all these IPs belong to Microsoft 😀

]]> https://gofedora.com/msn-crawlers-pawned/feed/ 1