Site Go Live checklist
- In file robots.txt verify deny rules is not exists
Disallow: /
- ]]]
- In masterpage verify deny attrubute not exists
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
Disallow: /
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">