1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Basic concepts

Discussion in 'Search Engine Optimization (SEO)' started by kajal.pillai22, Nov 9, 2011.

  1. kajal.pillai22

    kajal.pillai22 Banned

    Joined:
    Aug 19, 2011
    Messages:
    16
    Likes Received:
    0
    Trophy Points:
    0
    Occupation:
    Developer
    Location:
    chennai
    Home Page:
    Basic concepts

    ==>> Search engines
    Before we start talking about search engine optimization we need to understand how search engines work. Basically, each search engine consists of 3 parts:

    1. The Crawler (or the spider). This part of a search engine is a simple robot that downloads pages of a website and crawls them for links. Then, it opens and downloads each of those links to crawl (spider) them too. The crawler visits websites periodically to find the changes in their content and modify their rankings accordingly. Depending on the quality of a website and the frequency of its content updates this may happen from say once per month up to several times a day for a high popularity news sites.

    The crawler does not rank websites itself. Instead, it simply passes all crawled websites to another search engine module called the indexer.

    2. The Indexer. This module stores all the pages crawled by the spider in a large database called the index. Think of it as the index in a paper book: you find a word and see which pages mention this word. The index is not static, it updates every time the crawler finds a new page or re-crawls the one already presented in the index. Since the volume of the index is very large it often takes time to commit all the changes into the database. So one may say that a website has been crawled, but not yet indexed.

    Once the website with all its content is added to the index, the third part of the search engine begins to work.

    3. The ranker (or search engine software). This part interacts with user and asks for a search query. Then it sifts millions of indexed pages and finds all of them that are relevant to that query. The results get sorted by relevance and finally are shown to a user.

    What is relevance and how would one determine if a page is more or less relevant to a query? Here comes the tricky part - the ranking factors...
     
  2. Click SSL

    Click SSL New Member

    Joined:
    Mar 8, 2010
    Messages:
    215
    Likes Received:
    5
    Trophy Points:
    0
    Location:
    Newark, DE, USA
    Home Page:
    It is well said. To get informed about search engine is as same important as to get informed about search engine optimization.
     
  3. Apoorva

    Apoorva New Member

    Joined:
    Nov 15, 2011
    Messages:
    111
    Likes Received:
    0
    Trophy Points:
    0
    Hi,
    Very nice write up.
    I always noticed that most of the people are confused by the terms crawling and indexing, you have explained both of them in very simple language.
    Keep it up the good work.
     
  4. TM-Ali

    TM-Ali New Member

    Joined:
    Oct 19, 2011
    Messages:
    27
    Likes Received:
    4
    Trophy Points:
    0
    I am little bit confuse with your explanation. You have mentioned that Ranker (Search Engine Software) will modify & decide ranking of web page then how crawler can modify their ranking?
     
  5. jhonden

    jhonden New Member

    Joined:
    Sep 13, 2011
    Messages:
    190
    Likes Received:
    4
    Trophy Points:
    0
    You have provided such a important fact on paper in the simplest of words. Hands off to you. really glad to read it and to know it also in simple way. It brushed my existing knowledge.
     
  6. Apoorva

    Apoorva New Member

    Joined:
    Nov 15, 2011
    Messages:
    111
    Likes Received:
    0
    Trophy Points:
    0
    Hi,
    The Ranking modified by the crawler is the Page rank (or ranking) decides the relevancy of content on the website.
    And the Ranking modified by the ranker is the SERP ranking which consults both the crawler and indexer to show the results for the submitted query.

    I think you get the point now.:)
     
  7. designfirm

    designfirm New Member

    Joined:
    Jan 5, 2012
    Messages:
    10
    Likes Received:
    0
    Trophy Points:
    0
    Nice post. Thanks for sharing.........
     
  8. adoncia

    adoncia New Member

    Joined:
    Jan 2, 2012
    Messages:
    22
    Likes Received:
    0
    Trophy Points:
    0
    Good one..
     

Share This Page