0
0
mirror of https://github.com/twbs/bootstrap.git synced 2024-12-12 00:08:59 +01:00
Bootstrap/site/layouts/robots.txt
XhmikosR d95d30029f Switch to Hugo.
No more Ruby dependency and most important more than 10 times less build time (at least on Windows)!
2019-03-13 19:22:59 +02:00

9 lines
234 B
Plaintext

# www.robotstxt.org
{{ if (eq (getenv "HUGO_ENV") "production") -}}
# Allow crawling of all content
{{- end }}
User-agent: *
Disallow:{{ if (ne (getenv "HUGO_ENV") "production") }} /{{ end }}
Sitemap: {{ .Site.BaseURL }}/sitemap.xml