# http://beispiel.de/robots.txt #alles verbieten fuer scooter #User-agent: scooter #Disallow: / User-agent: wget Disallow: / #User-agent: wget #User-agent: webzip #Disallow: User-agent: * Disallow: /cgi-bin/ Disallow: /data/ /inside/ /inside/abibuch/ /family/ Disallow: /inc/ /counter/ /counter/administration/ /counter/stats/