Spider
WebDynamic™ Web Glossary
A computer program that travels the Internet to locate such resources as Web documents. It indexes the documents in a database, which is then searched using a search engine. A spider can also be referred to as a robot or wanderer. Each search engine uses a spider to build its database.