Site Go Live checklist
- In file robots.txt verify deny rules is not exists * Disallow: /*
- In masterpage verify deny attrubute not exists
[codelang=xml| ]
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">