In just over a weeks time The Open kicks off at Muirfield but it seems that the official website has not quite got the whole “open” sentiment right just yet. At the moment the site is blocking search engines from crawling the site via the following robots.txt file: Sitemap: http://www.theopen.com/sitemap.xml User-agent: * User-agent: * Disallow:
Source: http://www.branded3.com/blogs/the-open-at-muirfield-not-open-to-search-engines/
more info here more info here more info here more info here more info here more info here more info here
No hay comentarios:
Publicar un comentario