Entrepositive

TERM

web crawlers

A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web and that is typically operated by search engines for the purpose of Web indexing.

Read more on Wikipedia.

Sign up here to Get the Gist™.

Updates are sent out when new content is available.

Hello!

Login to your account