How to check Crawl Stats for By Googlebot type in Google search console

The Crawl Stats report displays data from Google's crawling of your website. For example, how many requests were made and when, what your server response was, and whether or not there were any availability issues. This report can be used to determine whether Google encounters any serving problems while scanning your site.

This report is intended for advanced users only. If your site has fewer than 1,000 pages, you shouldn't need to use this report or be concerned about this level of crawling detail.

Before utilizing this report, you should be aware of the following information:

1. The extended version of how Google Search works.

2. Topics for advanced users, mainly crawling and indexing, and sitemaps.

3. Several issues with managing site access, including robots.txt blocking.

4. Here's a guide on managing and debugging your crawl budget if you have a huge site (hundreds of thousands of pages).

The user agent that was used to make the crawl request. Google has several user agents that crawl for various purposes and exhibit erratic behaviors.

Googlebot type values that could be used:

1. Smartphone: Googlebot smartphone

2. Desktop: Googlebot desktop

3. Image: Googlebot image. If the image is loaded as a page resource, the Googlebot type is Page resource load rather than Image load.

4. Video: Googlebot video. If the video is loaded as a page resource, the Googlebot type is Page resource load rather than Video load.

5. Page resource load: A secondary fetch for your page's resources. Before attempting to index a page, Google scans it and retrieves vital connected resources such as photos or CSS files. These resource requests are made by the user agent.

6. AdsBot: One of the AdsBot crawlers is AdsBot. If you're experiencing an increase in these requests, you may have recently added several new Dynamic Search Ads targets to your site. See Why did my crawl rate increase? Every two weeks, AdsBot crawls URLs.

7. StoreBot: StoreBot is a product search crawler.

8. Other agent types: A Google crawler that is not defined here.

Your primary crawler should handle the vast majority of your crawl requests. Check the user agent type if you are seeing crawling spikes. See Why did my crawl rate jump if the spikes appear to be caused by the AdsBot crawler.

Contact US

If You want to Increase website visibility and traffic to your website.

Contact Us for SEO services:-

Email: info@getsetseo.com

Contact: 7530817898

Please Don't Forget to Like, Share & Subscribe

►Subscribe: https://www.youtube.com/@dilshaddilahmad

► Facebook: https://www.facebook.com/profile.php?...

► Twitter : https://twitter.com/GetSet_Seo

► Instagram: https://www.instagram.com/getset_seo/

► LinkedIn: https://www.linkedin.com/in/GetSetSeo

► Youtube: https://www.youtube.com/channel/UCipb...

► Website: https://getsetseo.com/