msnbot
msnbot is a web-crawling robot (type of internet bot), deployed by Microsoft to supply Bing. It collects documents from the web to build a searchable index for the MSN Search engine, which went into beta in 2004, and had full public release in 2005. It performs the same function as Google's Googlebot, and Yahoo!'s slurp.
A typical user agent string for msnbot is "msnbot/1.1 (+http://search.msn.com/msnbot.htm)". This appears in the web server logs to tell the webmaster who is requesting a file. Each webmaster is able to use the included agent identifier, "msnbot", to deny or allow access to their site (by default access is allowed). If they don't want to grant access they can use the Robots Exclusion Standard to block it (relying on the assumed good behaviour of msnbot), or use other server specific means (relying on the web server to do the blocking).
MSNBOT 2.0
The last week of November 2009 saw the official retirement of MSNBOT/1.1. Replacing it with msnbot/2.0b.[1]
References
- ↑ MSNBOT 1.1 is retired http://www.bing.com/community/blogs/webmaster/archive/2009/11/04/msnbot-1-1-is-retired.aspx
External links
Stub icon | This World Wide Web-related article is a stub. You can help Wikipedia by expanding it. |
If you like SEOmastering Site, you can support it by - BTC: bc1qppjcl3c2cyjazy6lepmrv3fh6ke9mxs7zpfky0 , TRC20 and more...