Bootstrap/robots.txt

mirror of https://github.com/twbs/bootstrap.git synced 2024-12-10 22:24:19 +01:00
# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow:
Sitemap: https://getbootstrap.com/sitemap.xml
merge in v3.2.0 changes; nuke a dupe _gh_pages dir 2014-06-26 18:46:59 +02:00			`# www.robotstxt.org/`

			`# Allow crawling of all content`
			`User-agent: *`
			`Disallow:`
v4 beta2 2017-10-19 21:22:00 +02:00			`Sitemap: https://getbootstrap.com/sitemap.xml`