+- SEO MotionZ Forum (https://seomotionz.com)
+-- Forum: Search Engine Optimization (https://seomotionz.com/forumdisplay.php?fid=7)
+--- Forum: SEO General (https://seomotionz.com/forumdisplay.php?fid=22)
+--- Thread: Crawling (/showthread.php?tid=3683)
Crawling - ThomosGrye - 03-13-2018
My website was built with Angular JS 1 (not a wordpress site). When i posted some website posts within same day. So ,When ever i checked my website on Google SERP (site:example.com), identified some of pages are crawled within 24hrs and some of pages within 1 week and some of pages with in 1 month and some of pages not cralwed . My Question is why this was happened?
Re: Crawling - Paul - 03-13-2018
It happens in our site too. Google bots crawl as they like. And are you sure that your sitemap is not blocking those urls to crawl?
Re: Crawling - blackmagicbaba - 03-13-2018
I think it depends upon the google crawler as well as you should check your sitemap too.
Re: Crawling - andreausa - 03-19-2018
Crawling basically means following a path. Crawling means following a link and “crawling” around a website. When bots come to that website or to any page, they follow other linked pages also on that website.
Re: Crawling - jane21august - 03-22-2018
Be patient the Google crawlers will definitely crawl all your site sooner or later. It is what they are made for to crawl your webpages.
Re: Crawling - zeus - 03-24-2018
andreausa Wrote:Crawling basically means following a path. Crawling means following a link and “crawling” around a website. When bots come to that website or to any page, they follow other linked pages also on that website.
Do you even read what OP asked?
Re: Crawling - rachana - 03-26-2018
Crawling is the process by which search engines discover updated content on the web, such as new sites or pages, changes to existing sites, and dead links.
Re: Crawling - DivyaShravani - 03-28-2018
A search engine crawler is a program or automated script that browses the World Wide Web in a methodical manner in order to provide up to date data to the particular search engine. crawlers have a hard times crawling the web on occasion because the Internet has three main characteristics that make it harder to continually keep the index up to date
Re: Crawling - brunagari - 04-20-2018
In the SEO world, crawling means following your links and “crawling” around your website. When bots come to your website (any page), they follow other linked pages also on your website.