Site Go Live checklist
- In file robots.txt verify deny rules is not exists
*
Disallow: /*
- In masterpage verify deny attrubute not exists
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
Disallow: /*
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">