urosm
/
ikiwiki
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
ikiwiki/doc/robots.txt

3 lines
37 B
Plaintext
Raw Normal View History

add a robots.txt Yahoo! has been pounding on ikiwiki.cgi again. While I'd prefer ikiwiki to generate sites that avoided robots hitting it in other ways, I'm adding a robots.txt, at least temporarily.
2008-11-11 00:08:09 +01:00
User-Agent: *
Disallow: /ikiwiki.cgi