03-27-2018, 02:43 AM
I think its necessary to use Robots.txt file for those module that is not needed to be index and this is to have a smooth crawling index process within the website.
Users browsing this thread: 1 Guest(s) |
|