# robots.txt - corz.org - updated: 22-12-08 # User-agent: ShopWiki Disallow: / User-agent: ia_archiver Crawl-delay: 20 User-agent: * Disallow: /img/ Disallow: /public/avatars/ Disallow: /public/images/smileys