[wp-trac] [WordPress Trac] #6891: Do not add trailing slash to the robots.txt URL

[WordPress Trac]

#6891: Do not add trailing slash to the robots.txt URL
----------------------+-----------------------------------------------------
 Reporter:  thenlich  |       Owner:  anonymous
     Type:  defect    |      Status:  new      
 Priority:  normal    |   Milestone:           
Component:  General   |     Version:  2.5.1    
 Severity:  normal    |    Keywords:           
----------------------+-----------------------------------------------------
 The /robots.txt is redirected to /robots.txt/ if configured. This is in
 violation of the robot exclusion standard, which specifies

 This file must be accessible via HTTP on the local URL "/robots.txt".

 It is also not network nice because it generates extra traffic for the
 additional request after redirection.

-- 
Ticket URL: <http://trac.wordpress.org/ticket/6891>
WordPress Trac <http://trac.wordpress.org/>
WordPress blogging software