01-08-2018, 08:08 AM
Robots.txt is better. Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
█ Cheapest VPS | $1 VPS Hosting
█ Cheap Dedicated Servers | Free Setup and IPMI | Unmetered Bandwidth
█ Cheap Dedicated Servers | Free Setup and IPMI | Unmetered Bandwidth