Sam Bauers wrote: > This is all standard practice for search engines, why not WP's own > search as well? Because WordPress isn't a spider. It doesn't crawl your site, generating a search index as it goes — blocking pages from WP search via robots.txt just doesn't make sense.