Googlebot is Google’s web crawling robot, which finds and retrieves pages on the web and hands them off to the Google indexer. Google doesn't accept payment to crawl a site more frequently, and we keep the search side of our business separate from our revenue-generating AdWords service...As Googlebot visits each of these websites it detects links on each page and adds them to its list of pages to crawl.