User-Agent: *
Disallow: /themes/
Disallow: /templates/
Disallow: /files/

User-Agent: W3C-checklink
Allow: *