Thread Rating:
  • 0 Vote(s) - 0 Average
Share Thread:
Is robots.txt file enough to block some pages from Search Engines?
#1
Is robots.txt file enough to block some pages from Search Engines? I mean from crawling and indexing.
Reply
#2
No its not enough. Its best that you block them through .htaccess file.
Reply
[-] The following 2 users Like ksmith29's post:
  • danni, lammao
#3
(10-24-2019, 05:52 AM)lammao Wrote: Is robots.txt file enough to block some pages from Search Engines? I mean from crawling and indexing.

Robots.text file only tells search engines or suggest some might say that it can or cannot crawl & index any page. It doesn't necessarily blocks them. .htaccess file is the best option for you as @ksmith29 suggested.
Reply
[-] The following 1 user Likes danni's post:
  • lammao
#4
Can anyone provide me the code for htaccess file?
Reply
#5
Follow this article. https://help.dreamhost.com/hc/en-us/arti...ccess-file-
Reply


Forum Jump:


Users browsing this thread: 1 Guest(s)
[-]
Sponsored

[-]
Recent Posts
The most significant benefits of Consuming Ultrasonic Keto!
It is safe to say that you are burnt out on hauling around additional fat? What's more...themorty67 — 08:22 AM
Some Great Benefits of Using Balanced Slim Keto Diet Pillls:
Balanced Slim Keto Benefits seeks to help you manage your unwanted weight through prom...themorty67 — 08:16 AM
Ecocel Eco OBD2 Reviews And Complaints!
EcoCel has gotten something such in the market that can effectively gather the mileage...dermicellab — 05:51 AM
Which Effective Ingredients Used In Dermicell Formula?
Dermicell will cause smooth skin to thicken the epidermis, pores further expand, oil r...dermicellab — 05:45 AM
Google SERP Changes & Algorithm Updates - June 2021
C'mon man we were just started recovering. This week. And again BOOM !! Every ...Kang — 03:25 PM

[-]
Follow us on Facebook