[wp-trac] [WordPress Trac] #23070: Generated robots.txt file with privacy on should have Allow: /robots.txt

[WordPress Trac]

#23070: Generated robots.txt file with privacy on should have Allow: /robots.txt
-------------------------+------------------------------
 Reporter:  iamfriendly  |       Owner:
     Type:  enhancement  |      Status:  new
 Priority:  normal       |   Milestone:  Awaiting Review
Component:  General      |     Version:
 Severity:  normal       |  Resolution:
 Keywords:               |
-------------------------+------------------------------

Comment (by iamfriendly):

 I think my main point has been missed (mainly by me not explaining
 properly).

 People 'playing' with the fetch as google tool in GWT is useless if G has
 already crawled your site and you have privacy on. Adding a plugin to the
 site after G has crawled your site, likewise. You'd need to activate that
 plugin before activating privacy and considering you're asked what you'd
 like to do during the install procedure (w.r.t privacy), sometimes you
 don't have that option.

 Adding this one line to the private robots.txt file could potentially
 prevent people from 2 days' worth of headaches. All I'm suggesting is that
 I know this is an edge case, but if it's an easy fix, and won't have any
 security concerns or performance issues etc. then why not?

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/23070#comment:8>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software