[wp-trac] [WordPress Trac] #11918: do_robots() Enhancement

[WordPress Trac]

#11918: do_robots() Enhancement
--------------------------+-------------------------------------------------
 Reporter:  miqrogroove   |       Owner:     
     Type:  enhancement   |      Status:  new
 Priority:  normal        |   Milestone:  3.0
Component:  Optimization  |     Version:     
 Severity:  normal        |    Keywords:     
--------------------------+-------------------------------------------------
 do_robots(), in wp-includes/functions.php, is currently responsible for
 handling robots.txt requests for sites that do not have a robots.txt file.

 The default rules are quite lame.  All it does is allow or disallow the
 entire site based on the privacy setting.

 There should be default rules such as

 {{{
 Disallow: /?s=
 Disallow: /search/
 Disallow: /wp-includes/
 Disallow: *?replytocom
 }}}

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/11918>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software