Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
Is it necessary to use Robots.txt file?
#8
It is not necessary to use Robots.txt file, But sometime we need to tell crawler which are the pages needs to be indexed and which is not, In that case It is necessary to use Robots.txt file to guide crawler.


Messages In This Thread

Forum Jump:


Users browsing this thread: 1 Guest(s)
[-]
Ad

[-]
Top Articles
100+ Social Bookmarking Sites List
55+ Image Submission Sites List

[-]
Recent Posts
Hostrime - All in One Thread
Discuss anything and everything about Hostrime. Reviews, reactions, feedback everything i...Host — 01:46 PM
How to contact QuickBooks Error Support Number: Your Comprehensive Gui...
QuickBooks is a powerful accounting software used by businesses of all sizes. However, li...Hartikpandya003 — 01:35 PM
Contabo Cloud Storage Server is just slow !!
If everything is looking good at your end then you might wanna contact your hosting pro...adam23 — 04:43 AM
ClickDealer - Join the Leaders of Affiliate Marketing!
We are proud to announce that ClickDealer is a General Sponsor for Conversion Conf 2024 i...ClickDealer — 03:54 PM
Google SERP Changes & Algorithm Updates - June 2024
How is the traffic from adwords now? Are they converting?abhirupb — 02:51 PM

[-]
Follow us on Facebook