The wonderful world of the "Goog" - Part 1
So how does Google deliver up those search results at the drop of a hat?
The first step is called ‘Crawling’. Google tells us that “Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index.” Basically they use huge computers to look at (or crawl) pages on the web. The program that does this is called Googlebot (often referred to as a robot, bot or spider), and it uses complex computer programs to determine which sites to crawl, how often, and how many pages to fetch from each site.