Latest TweetsAbout the “Warning! WordPress Encrypts User Cookies” Error digwp.com/2018/11/warning-word… #WordPress
Perishable Press
Found 1 matching result
Page 1 of 1

Taking Advantage of the X-Robots Tag

Controlling the spidering, indexing and caching of your (X)HTML-based web pages is possible with meta robots directives such as these: <meta name=”googlebot” content=”index,archive,follow,noodp”/> <meta name=”robots” content=”all,index,follow”/> <meta name=”msnbot” content=”all,index,follow”/> I use these directives here at Perishable Press and they continue to serve me well for controlling how the “big bots”1 crawl and represent my (X)HTML-based […] Continue »