User-agent: *
Disallow: *.pl 
Disallow: *.css
Disallow: *.log
Disallow: *.txt
Disallow: *.dat