A search engine bot that indexes web pages and then visits subsequent pages linked from the initial page. This process allows for the rapid indexing of a large number of web pages. (Also called Robot, Bot, Spider)
« Back to Dictionary Index
Menu