User-agent: * 
Disallow: /admin/ 
Disallow: /dev/
Disallow: /blog/
Disallow: /blog2/
Disallow: /web_scrape/