Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
Is robots.txt file enough to block some pages from Search Engines?
#1
Is robots.txt file enough to block some pages from Search Engines? I mean from crawling and indexing.
Reply
#2
No its not enough. Its best that you block them through .htaccess file.
Reply
[-] The following 2 users Like ksmith29's post:
  • danni, lammao
#3
(10-24-2019, 05:52 AM)lammao Wrote: Is robots.txt file enough to block some pages from Search Engines? I mean from crawling and indexing.

Robots.text file only tells search engines or suggest some might say that it can or cannot crawl & index any page. It doesn't necessarily blocks them. .htaccess file is the best option for you as @ksmith29 suggested.
Reply
[-] The following 1 user Likes danni's post:
  • lammao
#4
Can anyone provide me the code for htaccess file?
Reply
#5
Follow this article. https://help.dreamhost.com/hc/en-us/arti...ccess-file-
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)
[-]
Sponsored

[-]
Recent Posts
Can more than one attribute be present in one link?
No-opener goes with all of them. But if you want to add no-follow to ugc or sponsored alo...Ametuniversity — 02:57 PM
Google November Core Algorithm Updates, Is Google going to replace li...
I read the post in seroundtable. It basically explains how a link works and how can we st...Ametuniversity — 02:57 PM
Google News: Sites don't need to apply to be in the News
I can't think of anything here. I don't know whether it is good or bad for publishers. He...Ametuniversity — 02:56 PM
Since 1st March 2020, Google will use no-follow links to rank?
Yes its the debacle of ugc, sponsored, nofollow . Basically Google will classify links ac...Ametuniversity — 02:56 PM
Does black hat techniques really affect on the website rankings?
The truth is every now and then more or less everybody does something which can be classi...Ametuniversity — 02:55 PM

[-]
Follow us on Facebook