An automated program that scans websites. The name reflects how the software “crawls” through the code, which is why they are sometimes also referred to as “spiders.” See also “Bots.”
An automated piece of software that scans websites. The name reflects how the software “crawls” through the code, which is why they are sometimes also referred to as “spiders”. Crawlers are used by Google to find new content and to evaluate the quality of webpages for their index.
Source: HSMAI CHDM Study Guide
Contact Us
Send us an email for any queries you have about HSMAI Academy and we'll get back to you as soon as possible.
