[wp-trac] [WordPress Trac] #11918: do_robots() Enhancement

[WordPress Trac]

#11918: do_robots() Enhancement
--------------------------+-------------------------------------------------
 Reporter:  miqrogroove   |       Owner:     
     Type:  enhancement   |      Status:  new
 Priority:  normal        |   Milestone:  3.0
Component:  Optimization  |     Version:     
 Severity:  normal        |    Keywords:     
--------------------------+-------------------------------------------------
Changes (by sirzooro):

 * cc: sirzooro (added)


Comment:

 I do not think we should exclude search URLs  here - for me this looks as
 a plugin area. Last 2 rules can be added. I would also add rule to exclude
 /wp-admin/. It will be also good to exclude /wp-content/ (at least plugin
 dir), but some plugins may provide files which should be indexed (although
 I do not know any at this moment), so this is not a good candidate.

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/11918#comment:1>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software