User-Agent: * Disallow: /site.aspx Disallow: /api/ User-agent: MJ12bot Disallow: /