User-Agent: MJ12bot
Disallow:   /
User-agent: *
Disallow: /aws
Disallow: /cgi
Disallow: /web