Posts tagged as:

Search Engine

MSN Crawlers Pawned

July 29, 2009
MSN Crawler (MSN Search)

After seeing the way MSN crawled my last post, I just realized why Microsoft could never do good in Search Engine Market
I wonder why MSN would crawler same page from two different machines. I wonder if a single page can be divided further for crawling. Checkout the screenshots below

A few minutes [...]

Read the full article →

Google is Fastest

November 13, 2008

While testing a piece of code for my squid plugin, I ended up changing permissions of /tmp/ directory to 0755. A few minutes later (after making changes to the code), I tried committing it to fedorapeople.org and got this error

1
2
3
4
5
6
[project@bordeaux youtube_cache]$ git push –all ssh://kulbirsaini@fedorapeople.org/~kulbirsaini/public_git/youtube_cache.git
Enter passphrase for key ‘/home2/Studies/project/.ssh/id_rsa’:
ssh_control_listener bind(): Permission denied
fatal: The remote end [...]

Read the full article →