Web Spider

Search engines use spiders to crawl linked pages of a website to index them and determine their rankings in regards to search terms.