+- SEO MotionZ Forum (https://seomotionz.com)
+-- Forum: Search Engine Optimization (https://seomotionz.com/forumdisplay.php?fid=7)
+--- Forum: SEO General (https://seomotionz.com/forumdisplay.php?fid=22)
+--- Thread: What is robots.txt? (/showthread.php?tid=3646)
Pages:
1
2
Re: What is robots.txt? - aliceta - 04-10-2018
The robots exclusion standard, also known as the robots exclusion protocol or simply robots.txt, is a standard used by websites to communicate with web crawlers and other web robots. The standard specifies how to inform the web robot about which areas of the website should not be processed or scanned.
Re: What is robots.txt? - Techila - 04-10-2018
According to my opinion it is one of the text file which will instruct the google for indexing and fetching.