Question Webmaster tools access denied

[crete]

In webmaster tools I'm getting crawl errors under access denied. I'm wondering is DBSEO sitemap submitter submitting things that are disallowed in my robots.txt? Why else would it be doing this? You can see here there are a lot of pages submitted that are not indexed.... could it be they are disallowed?

 

[Fillip H.]

First of all, the DBSEO Sitemap has no idea what the robots.txt file says. You must manually exclude certain elements from the sitemap build process if you don't want certain parts of your forums indexed.

Secondly, 403 Access Denied and 404 Not Found errors in GWT are good - it means that prior to installation, search engines were crawling your "no permissions" error pages, and they will no longer be doing so. Please disregard any such warnings.

 

[Fillip H.]

As this ticket has received no further replies, I'll close it. If you have any further issues or questions, please feel free to start a new support ticket. Thanks!