#==================================== # # Edit by Ben-Ja http://net4me.ru # On Wed Mar 12 12:46:36 2008 # #==================================== # All robots will spider the domain User-agent: * Disallow: User-agent: MSNBot Crawl-delay: 120 Disallow: