[wp-trac] [WordPress Trac] #23070: Generated robots.txt file with privacy on should have Allow: /robots.txt

[WordPress Trac]

#23070: Generated robots.txt file with privacy on should have Allow: /robots.txt
-------------------------+------------------------------
 Reporter:  iamfriendly  |       Owner:
     Type:  enhancement  |      Status:  new
 Priority:  normal       |   Milestone:  Awaiting Review
Component:  General      |     Version:
 Severity:  normal       |  Resolution:
 Keywords:               |
-------------------------+------------------------------

Comment (by iamfriendly):

 Setting an expires header sounds like an excellent idea. But then you get
 into the realm of what value to set. Also, setting the Allow: /robots.txt
 line negates the need for the expire header and it also gives the user the
 option to refresh it whenever they need.

 Perhaps a combination of both is the way forward.

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/23070#comment:6>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software