Why spiders...?

Can someone please tell me why spiders are necessary? There always seems to be 3 spiders lurking around. I'm wondering why? Thanks.

A spider is a program that automatically fetches Web pages. Spiders are used to feed pages to search engines. It's called a spider because it crawls over the Web. Another term for these programs is webcrawler.

Because most Web pages contain links to other pages, a spider can start almost anywhere. As soon as it sees a link to another page, it goes off and fetches it.

Hope this helps.

As far as I can recall from my days as a computer network admin, you WANT spiders to find your sites...in fact, some web designers used to have to pay (maybe they still do?) the big search engines (like Google) to include their web sites in any related search results. I know that you used to (maybe you still do?) have to insert specialized coding at the very beginning of the first page of your web site in order for the spiders to find you. In the case of sites that sell products, it's a very good thing to be found by a spider, because it drives more people to the site...advertisers are more inclined to pay for space on a site that will be found by spiders.

Correct on all counts, Eagle...

Okay, thanks. So a spider is part of the mechanics involved in
computer technology, if I understand you're answers correctly.
I misinterpreted the category. Thank you for clearing that up.
Appreciate it!