|
Go to Google Webmaster Tools, click on Health from the menu on the left and then click on Blocked URL's from the dropdown menu.
This will show you how your robots.txt file is currently affecting your site, and you can test different variations of it to see what they do.
|