robot.txt and disallow google bot

Discussion in 'Search Engine Optimization (SEO)' started by msi_333, Sep 29, 2009.

  1. msi_333

    msi_333 New Member

    Joined:
    May 29, 2007
    Messages:
    22
    Likes Received:
    0
    Trophy Points:
    0
    I have added an seo tool to my forums , and it asked me to added the following robot.txt ,does this robot ok . does it have any problems with bots . am just want to make sure . :confused:
    it was just upgrading to the currently used one . in goal to avoid duplicate content on my site was the need to add robot.txt .i want to ask too . does duplicate content in the same website domain cause problems with google .
    Code:
    User-agent: *
    Allow: /
    
    Disallow: /viewtopic.php
    Disallow: /viewforum.php
    Disallow: /index.php?
    Disallow: /posting.php
    Disallow: /search.php?
    Disallow: /ucp.php
    Disallow: /mcp.php
    Disallow: /post
     
  2. shabbir

    shabbir Administrator Staff Member

    Joined:
    Jul 12, 2004
    Messages:
    15,375
    Likes Received:
    388
    Trophy Points:
    83
    Its robots.txt and robot.txt
     
  3. urminenow

    urminenow New Member

    Joined:
    Oct 6, 2009
    Messages:
    5
    Likes Received:
    0
    Trophy Points:
    0
    Home Page:
    http://www.orderultramonline.ca/
    thanks for sharing..
     

Share This Page

  1. This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
    By continuing to use this site, you are consenting to our use of cookies.
    Dismiss Notice