+- SEO MotionZ Forum (https://seomotionz.com)
+-- Forum: Search Engine Optimization (https://seomotionz.com/forumdisplay.php?fid=7)
+--- Forum: SEO General (https://seomotionz.com/forumdisplay.php?fid=22)
+--- Thread: Robots.txt file and 301 redirect issue (/showthread.php?tid=4626)
Robots.txt file and 301 redirect issue - brad21 - 10-18-2018
Here is an issue. The www version of the site is blocked through robots.txt file for the search engines. Now, if any actual user end up landing in the www versions then they are 301 redirected to the non-www version of the site.
Now the site has gained some good links but they are on the www version. So, here is my query, will the search engines be able to index those backlinks?
Re: Robots.txt file and 301 redirect issue - frank - 10-18-2018
Change your robots.txt file that will be the first thing for you to do. Search engines can't crawl and index if they can't see the 301 redirects.
Re: Robots.txt file and 301 redirect issue - danni - 10-20-2018
Make them non-index but crawable.
Re: Robots.txt file and 301 redirect issue - amarnathsmm - 01-10-2019
use canonical url.