Google announced it is changing the user agent name of the current GoogleBot in December. We knew this was coming when Google launched the new Evergreen GoogleBot. Google didn't change the user agent ...

Google updated their Googlebot Developers Support Page to reflect that Google is now able to try downloading pages via the latest HTTP/2 protocol. This is effective November 2020. The Googlebot ...

Google announced that starting in November 2020 it may begin to crawl some sites over HTTP/2. Google wrote "today we're announcing that starting mid November 2020, Googlebot will support crawling over ...

Google has added two new crawlers to the Googlebot family of web crawlers: Google said these two new crawlers are versions of GoogleOther optimized for fetching image and video bytes. GoogleOther was ...

As expected, Google removed the crawl rate setting tool within Google Search Console. Last November, Google told us they would deprecate the crawl rate limiter legacy tool within Google Search Console ...

With the Google’s Mobile Update coming in hot, are you sure you’re auditing the mobile content Googlebot is seeing? Not just content, but directives and annotations can change depending on the ...

In December 2011 Google announced that it now has a smartphone Googlebot-Mobile. Historically, Googlebot-Mobile has concerned itself only with mobile sites designed for feature phones, so this is a ...