1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

robot.txt and disallow google bot

Discussion in 'Search Engine Optimization (SEO)' started by msi_333, Sep 29, 2009.

  1. msi_333

    msi_333 New Member

    Joined:
    May 29, 2007
    Messages:
    22
    Likes Received:
    0
    Trophy Points:
    0
    I have added an seo tool to my forums , and it asked me to added the following robot.txt ,does this robot ok . does it have any problems with bots . am just want to make sure . :confused:
    it was just upgrading to the currently used one . in goal to avoid duplicate content on my site was the need to add robot.txt .i want to ask too . does duplicate content in the same website domain cause problems with google .
    Code:
    User-agent: *
    Allow: /
    
    Disallow: /viewtopic.php
    Disallow: /viewforum.php
    Disallow: /index.php?
    Disallow: /posting.php
    Disallow: /search.php?
    Disallow: /ucp.php
    Disallow: /mcp.php
    Disallow: /post
     
  2. shabbir

    shabbir Administrator Staff Member

    Joined:
    Jul 12, 2004
    Messages:
    15,283
    Likes Received:
    364
    Trophy Points:
    83
    Its robots.txt and robot.txt
     
  3. urminenow

    urminenow New Member

    Joined:
    Oct 6, 2009
    Messages:
    5
    Likes Received:
    0
    Trophy Points:
    0
    Home Page:
    thanks for sharing..
     

Share This Page