Spiders and Crawlers

Discussion in 'Search Engine Optimization' started by phptraingtesting, Nov 27, 2013.

  1. phptraingtesting

    phptraingtesting
    uix_expand uix_collapse
    New Member

    Joined:
    Nov 9, 2013
    Messages:
    18
    Likes Received:
    0
    Can anyone tell me what is the difference between Spiders and Crawlers?
     
  2. Priyanka Sharma

    Priyanka Sharma
    uix_expand uix_collapse
    Member

    Joined:
    Feb 4, 2013
    Messages:
    120
    Likes Received:
    3
    Crawler just crawl your website and spider index your website in search engine database
     
  3. spyindiaanu

    spyindiaanu
    uix_expand uix_collapse
    Member

    Joined:
    Oct 3, 2013
    Messages:
    136
    Likes Received:
    4
    All are same crawler,spider,robots.They help search engine to index your webpage.
     
  4. AJKpeter

    AJKpeter
    uix_expand uix_collapse
    Member

    Joined:
    Nov 14, 2011
    Messages:
    390
    Likes Received:
    7
    There are lots of them. You just need to know important ones (sent by google) and allow them.
     
  5. carlbaker

    carlbaker
    uix_expand uix_collapse
    Member

    Joined:
    Oct 3, 2013
    Messages:
    95
    Likes Received:
    8
    Spider is Bot Of Google And Crawler is Noting but fetching the Data From the Resource for the Queries we Input In Google...
     
  6. jaysh4922

    jaysh4922
    uix_expand uix_collapse
    Member

    Joined:
    Dec 3, 2012
    Messages:
    143
    Likes Received:
    6
    Spiders,Crawlers, or Google Bots are just programs the search engines use to index the content found on the World Wide Web.
     
  7. spyindiarvind

    spyindiarvind
    uix_expand uix_collapse
    Member

    Joined:
    Oct 9, 2013
    Messages:
    62
    Likes Received:
    1
    Crawling is the process of fetching all the web pages linked to a website. This task is performed by a software program, called a crawler or a spider ( or Google bot, as is the case with Google). So crawler and spider both are same.
     
  8. hamishcode

    hamishcode
    uix_expand uix_collapse
    Member

    Joined:
    Oct 8, 2013
    Messages:
    99
    Likes Received:
    3
    Priyanka is right crawler gather the Info required by the user and Spider indexed that data...
     
  9. ReviewsThatStick

    ReviewsThatStick
    uix_expand uix_collapse
    Member

    Joined:
    Dec 9, 2013
    Messages:
    104
    Likes Received:
    3
    Pretty much they are the same. They both gather pages that are linked to your site. That's it.
     
  10. epicresearch

    epicresearch
    uix_expand uix_collapse
    Banned

    Joined:
    Nov 30, 2013
    Messages:
    80
    Likes Received:
    2
    Spider: is a program which on a certain time go and read a webpage like a user ( it means it is something like a browser).
    Crawler: is the manager of spider.it read the links and says to spider when, where and how deep goes into a website.
     
  11. ReviewsThatStick

    ReviewsThatStick
    uix_expand uix_collapse
    Member

    Joined:
    Dec 9, 2013
    Messages:
    104
    Likes Received:
    3
    Here's another definition of it:

    Spider - creates a text-based summary of content (of a site) and an address for each page.
    Crawler - a program that follows all links on each page within the site automatically.
     

Share This Page