Google's common crawlers

DRANK

Google crawlers discover and scan websites. This overview will help you understand the common Google crawlers including the Googlebot user agent.