Google Bot A web crawler that crawls your site, discovers new content, follows links and adds data to the index.