Joined: Jun 2017
Posts: 4
Likes Received: 0
It is better not index instruction in robots.txt file
Joined: Feb 2017
Posts: 90
Likes Received: 0
By using webmaster tool, we can easily index or noindex the URL's with the help of robot file where we can tell crawlers to index which urls.
Joined: Dec 2016
Posts: 86
Likes Received: 1
Add the meta-element robots to the source code of the page which is not supposed to appear in the index and set the value to NOINDEX.
By adding the following to the source code of a page, it will be removed from the index:
<meta name="robots" content="noindex">
![[-]](https://seomotionz.com/themes/cerulean/collapse.png "[-]")