我们的志愿者还没有将这篇文章翻译为 中文 (简体)。加入我们帮助完成翻译！
A web crawler is a program, often called a bot or robot, which systematically browses the Web to collect data from webpages. Typically search engines use crawlers to build indexes.
Learn more
- Web crawler on Wikipedia