Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
Is robots.txt file enough to block some pages from Search Engines?
#1
Is robots.txt file enough to block some pages from Search Engines? I mean from crawling and indexing.
Reply
#2
No its not enough. Its best that you block them through .htaccess file.
[-] The following 2 users Like ksmith29's post:
  • danni, lammao
Reply
#3
(10-24-2019, 05:52 AM)lammao Wrote: Is robots.txt file enough to block some pages from Search Engines? I mean from crawling and indexing.

Robots.text file only tells search engines or suggest some might say that it can or cannot crawl & index any page. It doesn't necessarily blocks them. .htaccess file is the best option for you as @ksmith29 suggested.
[-] The following 1 user Likes danni's post:
  • lammao
Reply
#4
Can anyone provide me the code for htaccess file?
Reply
#5
Follow this article. https://help.dreamhost.com/hc/en-us/arti...ccess-file-
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)
[-]
Sponsored

[-]
Recent Posts
Backlinking
Search engine optimization is a long-term advertising strategy with higher ROI opportunit...Digimart — 05:19 PM
Google SERP Changes & Algorithm Updates - November 2019
SEMrush is reporting over 3 in News niche today. It would have been due to this. Anywa...elliekushn — 04:28 PM
Google SERP Changes & Algorithm Updates - November 2019
I haven't given much of any thoughts regarding this updates. Because there so many in t...mediadrug — 04:14 PM
Which ad extenstion should be good for a forum?
I am starting a new forum with phpbb. As I am new any kind of site business so I don't ...steveposter — 08:24 AM
Link Diversity, is that really important?
supaul is suggesting to make some tier 2 links from web2.0.  Do you know about tier ...Autofresh.in — 06:15 AM

[-]
Follow us on Facebook