Wordpress Issue: Warnings – Url blocked by robots.txt

by Oscar

One day in Google Webmasters I was getting lots of warnings about a URL blocked by robots.txt. Here is the message I get.

Some of the links on this page are affiliate links. I receive a commission (at no extra cost to you) if you make a purchase after clicking on one of these affiliate links. This helps support the free content for the community on this website. Please read our Affiliate Link Policy for more information.

Warnings Url blocked by robots.txt Sitemap contains urls which are blocked by robots.txt. Sitemap: blog.oscarliang.net/post-sitemap.xml Value: https://oscarliang.com/wp-includes/js/tinymce/plugins/wordpress/img/trans.gif

Clearly this trans.gif image file is blocked from google crawlers. But that’s correct, we should be blocking wp-includes folder. The question is, why the hell is google trying to access this image? The only reason could be this image is visible to google, probably in some posts?

Indeed this image was somehow inserted into posts/pages, after removing it, I don’t get the warning anymore. Here is a simple fix, Go to your All posts, search for trans.gif, or whatever image causes the problem. You will find all the posts that have this image inserted (in my case it was just one post). Do the same for pages.

 

Leave a Comment

By using this form, you agree with the storage and handling of your data by this website. Note that all comments are held for moderation before appearing.