How fast can Google crawl your website? You can find out in the Google Search Console Crawl Stats reports using the average response time.
To access Crawl Stats, open up your website in Google Search Console. Then go to Settings, then under Crawling click Open Report. In the graph, you will see “average response time”.
Average response time shows the average time it took Google to load all of the files they were crawling on your website. Google has said that Googlebot may have trouble crawling a website when the response time is closer to 1,000 milliseconds (1 second). Other sources say it should be between 100-200 milliseconds for optimal crawling.
In reviewing websites I have access to in Google Search Console, the average is around 500 milliseconds. About a quarter of websites I have access to have an average response time greater than 750 milliseconds.
What is your website’s average response time? A lot of websites likely have room to improve. By improving this, you can make your website load faster for Googlebot and ensure that Googlebot is able to more effectively crawl your website.