I have added an seo tool to my forums , and it asked me to added the following robot.txt ,does this robot ok . does it have any problems with bots . am just want to make sure . it was just upgrading to the currently used one . in goal to avoid duplicate content on my site was the need to add robot.txt .i want to ask too . does duplicate content in the same website domain cause problems with google .
Duplicate content will always be problematic. With robots.txt file you can block the path which is duplicated.
If you have duplicate content in same domain, then it will cause problem. Make use of robots.txt file to block them.
The rel=canonical element, often called the “canonical link”, is an HTML element that helps webmasters prevent duplicate content issues.