About the Robots Exclusion Standard 1: The robots exclusion standard or robots.txt protocol is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website. The information specifying the parts that should not be accessed is specified in a file called robots.txt in the top-level directory of the website. Notes on the robots.txt Rules: Rules of specificity apply, not inheritance. Always include a blank line between rules. Note also [...] • Read more »
Perishable Press
WordPress, Web Design, Code & Tutorials
- Viewing the last of 3 pages
- View newer posts →
- Visit the Archives
Praise and Criticism
praise & criticism Hello Google, i have been using the google homepage (google.com) as my personal internet start page for several years now. i have emailed before with praise for the page’s very simple & elegant design asthetics. however, i am occasionally annoyed with the periodic advertising frequenting the page. For example, today i discovered the return of the pesky “google toolbar” advertisement. yuck. (strictly speaking of the start page) i realize that i am scrutinizing a [...] • Read more »