fuzzyworld

fuzzyworld-tools / files / server / site / robots.txt

robots.txt

129 B · history · blame

1# Browse pages are static; crawl freely. Git data is for `git clone`, not for indexing.
2User-agent: *
3Disallow: /*.git/
4Allow: /