Want to make sure that your feeds are not indexed by Google and other compliant search engines? Add the following code to the channel element of your XML-based (RSS, etc.) feeds:
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
Here is an example of how I use this tag for Perishable Press feeds (vertical spacing added for emphasis):
<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:dc="http://purl.org/dc/elements/1.1/" version="2.0">
<channel>
<title>Perishable Press</title>
<link>http://perishablepress.com/press</link>
<description>Digital Design and Dialogue ~</description>
<pubDate>Mon, 29 Oct 2007 21:38:24</pubDate>
<language>en</language>
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
<image>
<link>http://perishablepress.com/</link>
<url>http://perishablepress.com/logos/perishable-press.jpeg</url>
<title>Perishable Press</title>
</image>
<item>
<title>Welcome to Perishable Press</title>
<link>http://perishablepress.com/</link>
<dc:creator>Perishable</dc:creator>
<dc:subject>WordPress</dc:subject>
.
.
.
Of course, other meta elements may be added as well, including this one that disallows Yahoo! Pipes from processing your feed:
<meta xmlns="http://pipes.yahoo.com" name="pipes" content="noprocess" />
While we’re at it, what are some other useful meta elements to add to XML/RSS feeds?
15 Responses
Michael – May 29, 2008 •
Thanks for the hint with the noindex. So far I’ve had the problem that Google indexes my feed and displays it in the results instead of the correct subpage. Totally weird. I hope the additional noindex-code will solve this problem.
Perishable – May 31, 2008 •
Yes, it should definitely solve the problem. If not, there are other ways of keeping your feed (or any other content) out of the search-engine results. In the past, I have employed the following techniques:
•
nofollowall local references to the feed URL• restricting feed access via the
robots.txtfile• redirect feed-requests from Google et al to the home page
And of course, adding the
noindexdirective directly to your feeds is another excellent technique. Hopefully, Google will get will get the picture and begin indexing the correct subpages instead of your feed. Let us know how it goes!Peter – March 25, 2013 •
How I add this code into wordpress feed?
thanks