[wp-trac] [WordPress Trac] #14069: do_robots() ignores charset setting

[WordPress Trac]

#14069: do_robots() ignores charset setting
--------------------------+-------------------------------------------------
 Reporter:  hakre         |       Owner:                
     Type:  defect (bug)  |      Status:  new           
 Priority:  normal        |   Milestone:  Future Release
Component:  Charset       |     Version:                
 Severity:  normal        |    Keywords:  has-patch     
--------------------------+-------------------------------------------------
Changes (by ocean90):

  * milestone:  Unassigned => Future Release


Comment:

 What happens when a user choose a charset which isn't the right charset
 for a robots.txt?[[BR]]
 For example I found
 [http://www.bing.com/community/blogs/webmaster/archive/2009/11/05/robots-
 speaking-many-languages.aspx this]:

 {{{
 To ensure that the search engine bots can read the directives
 for blocking or allowing content to be indexed in robots.txt file
 (not just with Bing, but all of them), save the file using one
 of the following compatible encoding formats:
  ASCII
  ISO-8859-1
  UTF-8
  Windows-1252
 }}}
 I'm not the *charset king* like you, but I want to mention this here,
 maybe you can give me an answer.

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/14069#comment:3>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software