User-agent: * Disallow: /cgi-bin/ Disallow: /scgi-bin/ Disallow: /text/ Disallow: /edit/ Disallow: /edit_files/ # updated 2009-07-18 (disallow rtestprob links)