Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
Is it necessary to use Robots.txt file?
#5
The robots exclusion protocol (REP), or robots.txt is a text file webmasters create to instruct robots (typically Google, bing or yahoo search engine robots) how to crawl and index pages on their website.


Messages In This Thread

Forum Jump:


Users browsing this thread: 1 Guest(s)