Unexplained Crawl Behavior Involving Tagged Query Strings

I need your help! I am losing my mind trying to solve another baffling mystery. For the past three or four months, I have been recording many 404 Errors generated from msnbot, Yahoo-Slurp, and other spider crawls. These errors result from invalid requests for URLs containing query strings such as the following: https://perishablepress.com/press/page/2/?tag=spam https://perishablepress.com/press/page/3/?tag=code https://perishablepress.com/press/page/2/?tag=email https://perishablepress.com/press/page/2/?tag=xhtml https://perishablepress.com/press/page/4/?tag=notes https://perishablepress.com/press/page/2/?tag=flash https://perishablepress.com/press/page/2/?tag=links https://perishablepress.com/press/page/3/?tag=theme https://perishablepress.com/press/page/2/?tag=press ..plus hundreds and hundreds more 1. The URL pattern is always the same: a different page number followed by a query string containing one of the tags used here at Perishable Press, for example: “/?tag=something”. The problem is that there are […] Read more »