[wp-trac] [WordPress Trac] #23070: Generated robots.txt file with privacy on should have Allow: /robots.txt

WordPress Trac noreply at wordpress.org
Fri Dec 28 20:15:32 UTC 2012


#23070: Generated robots.txt file with privacy on should have Allow: /robots.txt
-------------------------+------------------------------
 Reporter:  iamfriendly  |       Owner:
     Type:  enhancement  |      Status:  new
 Priority:  normal       |   Milestone:  Awaiting Review
Component:  General      |     Version:
 Severity:  normal       |  Resolution:
 Keywords:               |
-------------------------+------------------------------

Comment (by miqrogroove):

 Replying to [ticket:23070 iamfriendly]:
 > Am I missing a trick?

 You are, in the sense that Google respects any Expires header that you set
 on your robots.txt file and will discard cached copies after that
 interval.  Fetch as Google being unable to retrieve robots.txt is a Google
 bug, not a WordPress bug.

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/23070#comment:3>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software


More information about the wp-trac mailing list