Separate names with a comma.
Discussion in 'Search Engine Optimization' started by phptraingtesting, Nov 27, 2013.
Can anyone tell me what is the difference between Spiders and Crawlers?
Crawler just crawl your website and spider index your website in search engine database
All are same crawler,spider,robots.They help search engine to index your webpage.
There are lots of them. You just need to know important ones (sent by google) and allow them.
Spider is Bot Of Google And Crawler is Noting but fetching the Data From the Resource for the Queries we Input In Google...
Spiders,Crawlers, or Google Bots are just programs the search engines use to index the content found on the World Wide Web.
Crawling is the process of fetching all the web pages linked to a website. This task is performed by a software program, called a crawler or a spider ( or Google bot, as is the case with Google). So crawler and spider both are same.
Priyanka is right crawler gather the Info required by the user and Spider indexed that data...
Pretty much they are the same. They both gather pages that are linked to your site. That's it.
Spider: is a program which on a certain time go and read a webpage like a user ( it means it is something like a browser).
Crawler: is the manager of spider.it read the links and says to spider when, where and how deep goes into a website.
Here's another definition of it:
Spider - creates a text-based summary of content (of a site) and an address for each page.
Crawler - a program that follows all links on each page within the site automatically.