Bootstrap/robots.txt

mirror of https://github.com/twbs/bootstrap.git synced 2025-01-23 15:52:21 +01:00
# www.robotstxt.org
# Allow crawling of all content
User-agent: *
Disallow:
Sitemap: https://getbootstrap.com/sitemap.xml
Add v5.0.0-beta1 docs. (#32256) 2020-12-07 18:28:07 +02:00			`# www.robotstxt.org`
merge in v3.2.0 changes; nuke a dupe _gh_pages dir 2014-06-26 09:46:59 -07:00			`# Allow crawling of all content`
			`User-agent: *`
			`Disallow:`
v4 beta2 2017-10-19 12:22:00 -07:00			`Sitemap: https://getbootstrap.com/sitemap.xml`