[wp-trac] [WordPress Trac] #23070: Generated robots.txt file with privacy on should have Allow: /robots.txt

[WordPress Trac]

#23070: Generated robots.txt file with privacy on should have Allow: /robots.txt
-------------------------+----------------------
 Reporter:  iamfriendly  |       Owner:
     Type:  enhancement  |      Status:  closed
 Priority:  normal       |   Milestone:
Component:  General      |     Version:
 Severity:  normal       |  Resolution:  wontfix
 Keywords:               |
-------------------------+----------------------
Changes (by joostdevalk):

 * status:  reopened => closed
 * resolution:   => wontfix


Comment:

 That's just nonsense Marko. In fact, this line would be in direct
 violation of the [http://www.robotstxt.org/norobots-rfc.txt RFC ] (see
 point 3.2.2):

   The /robots.txt URL is always allowed, and must not appear in the
 Allow/Disallow rules.

 If other search engines are doing things wrong, feel free to comment with
 what they're doing wrong, I'll either explain or contact the search
 engine.

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/23070#comment:14>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software