User-agent: *
Disallow: /stats/
Disallow: /data/
Disallow: /images/
Disallow: /portfolio/
Disallow: /Portfolio/
allow: /crawler.asp