# robots.txt zu http://www.heimsath.org #Directories that should not be indexed User-agent: * Disallow: /includes/ Disallow: /daten/ Disallow: /log/ Disallow: /cgi-bin/ # all that bots that we dont want to index our pages User-agent: Fasterfox User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy # Internet Archiver Wayback Machine #User-agent: ia_archiver # # digg mirror # User-agent: duggmirror Disallow:/ # Falls eine sitemap.xml erzeugt wurde #Sitemap: http://nuechter-wintergaerten.de/sitemap.xml