fuzzyworld-tools / files / server / site / robots.txt
robots.txt
| 1 | # Browse pages are static; crawl freely. Git data is for `git clone`, not for indexing. |
| 2 | User-agent: * |
| 3 | Disallow: /*.git/ |
| 4 | Allow: / |
fuzzyworld-tools / files / server / site / robots.txt
| 1 | # Browse pages are static; crawl freely. Git data is for `git clone`, not for indexing. |
| 2 | User-agent: * |
| 3 | Disallow: /*.git/ |
| 4 | Allow: / |