Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
Is it necessary to use Robots.txt file?
#5
The robots exclusion protocol (REP), or robots.txt is a text file webmasters create to instruct robots (typically Google, bing or yahoo search engine robots) how to crawl and index pages on their website.


Messages In This Thread

Forum Jump:


Users browsing this thread: 1 Guest(s)
[-]
Ad

[-]
Top Articles
100+ Social Bookmarking Sites List
55+ Image Submission Sites List

[-]
Recent Posts
Test
Posteddiamondhead — 08:15 AM
Test
thanksmybb_tester — 07:09 AM
Test
I am testing againanush — 03:34 AM
Test
I'm a tester testing again Third test No bug here, just slow Test second Tester yes ...mybb_tester — 04:41 PM
Google SERP Changes & Algorithm Updates - June 2024
@"ani2002"#3608 Don't invest money on untested Google adwords campaigns. Chec...ani2002 — 02:53 PM

[-]
Follow us on Facebook