SEO MotionZ Forum

Full Version: Crawling
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
My website was built with Angular JS 1 (not a wordpress site). When i posted some website posts within same day. So ,When ever i checked my website on Google SERP (site:example.com), identified some of pages are crawled within 24hrs and some of pages within 1 week and some of pages with in 1 month and some of pages not cralwed . My Question is why this was happened?
It happens in our site too. Google bots crawl as they like. And are you sure that your sitemap is not blocking those urls to crawl?
I think it depends upon the google crawler as well as you should check your sitemap too.
Crawling basically means following a path. Crawling means following a link and “crawling” around a website. When bots come to that website or to any page, they follow other linked pages also on that website.
Be patient the Google crawlers will definitely crawl all your site sooner or later. It is what they are made for to crawl your webpages.
andreausa Wrote:Crawling basically means following a path. Crawling means following a link and “crawling” around a website. When bots come to that website or to any page, they follow other linked pages also on that website.

Do you even read what OP asked?
Crawling is the process by which search engines discover updated content on the web, such as new sites or pages, changes to existing sites, and dead links.
A search engine crawler is a program or automated script that browses the World Wide Web in a methodical manner in order to provide up to date data to the particular search engine. crawlers have a hard times crawling the web on occasion because the Internet has three main characteristics that make it harder to continually keep the index up to date
In the SEO world, crawling means following your links and “crawling” around your website. When bots come to your website (any page), they follow other linked pages also on your website.