Explain how Googlebot works?
- Googlebot is Google’s search bot that crawls the web and creates an index. It’s also known as a spider. The bot crawls every page it’s allowed access to, and adds it to the index where it can be accessed and returned by users’ search queries.
- Googlebot uses sitemaps and databases of links discovered during previous crawls to determine where to go next. Whenever the crawler finds new links on a site, it adds them to the list of pages to visit next.
- The Googlebot systematically crawls the web, discovering websites, gathering information on those websites, and indexing that information to be returned in searching.