Posts tagged as:

Search Engine

MSN Crawlers Pawned

July 29, 2009

After seeing the way MSN crawled my last post, I just realized why Microsoft could never do good in Search Engine Market I wonder why MSN would crawler same page from two different machines. I wonder if a single page can be divided further for crawling. Checkout the screenshots below A few minutes later. Three [...]

Read the full article →

Google is Fastest

November 13, 2008

While testing a piece of code for my squid plugin, I ended up changing permissions of /tmp/ directory to 0755. A few minutes later (after making changes to the code), I tried committing it to fedorapeople.org and got this error 1 2 3 4 5 6 [project@bordeaux youtube_cache]$ git push –all ssh://kulbirsaini@fedorapeople.org/~kulbirsaini/public_git/youtube_cache.git Enter passphrase for [...]

Read the full article →