Microsofts MSNBot Supports Robots.txt Delay Command

Home :: robots :: MSNBot

Microsofts MSNBot Supports Robots.txt Delay Command

long ask for by webmasters is a new "robots delay" command: "...it allows you to specify via robots.txt an amount of time (in seconds) that MSNBot should wait before retrieving another page from that host. "...
Read more...

TRY POSTAMI FREE FLASH GAMES! CLICK HERE!

Other News for MSNBot

View products for MSNBot now!

· [2006-05-05] -- Links: 5-4-2006
· [2006-04-15] -- MSN Search Scientists Develop New Powerful Robot- MSNBOT
· [2005-11-24] -- Maxing Out
· [2005-02-22] -- That msnbot...
· [2004-12-15] -- MSNBot - Searching for ways to make Redmond rise again
· [2004-07-29] -- Msnbot - The dumbest bot in town
· [2004-07-25] -- My apologies to msnbot.
· [2004-07-03] -- A Hungry Bot Behind Web Traffic Surge
· [2004-06-27] -- Microsofts MSNBot Supports Robots.txt Delay Command
· [2004-05-20] -- MSNBot on a Rampage!
· [2004-02-05] -- Microsoft prepara su nuevo buscador
· [2004-01-28] -- Most popular weblog?
· [2004-01-08] -- Lustaság fél egészség
· [2003-11-19] -- When is a Bot Not a Newsbot?

Next

websites and blogs tools

Microsofts MSNBot Supports Robots.txt Delay Command