11-28-2017, 05:01 AM
Robots.txt is file which is very important for a website, as there are having many important files and web pages which we don t want to crawl in Google and don t want that users can enter in these page.
To exclude this pages from crawling from Google, we use or create the robot.txt file in SEO.
To exclude this pages from crawling from Google, we use or create the robot.txt file in SEO.
![[-]](https://seomotionz.com/themes/cerulean/collapse.png "[-]")
