[wp-trac] [WordPress Trac] #18841: Sites with default permalinks do not return 'robots.txt'

[WordPress Trac]

#18841: Sites with default permalinks do not return 'robots.txt'
--------------------------------------------+------------------------------
 Reporter:  mbijon                          |       Owner:
     Type:  defect (bug)                    |      Status:  new
 Priority:  normal                          |   Milestone:  Awaiting Review
Component:  Permalinks                      |     Version:  3.3
 Severity:  minor                           |  Resolution:
 Keywords:  2nd-opinion dev-feedback close  |
--------------------------------------------+------------------------------
Changes (by nacin):

 * keywords:  2nd-opinion dev-feedback => 2nd-opinion dev-feedback close
 * severity:  major => minor


Comment:

 Replying to [comment:8 mbijon]:
 > Based on feedback here & several other permalinks tasks, .htaccess is a
 minor landmine. Using that looks to be an overly-complicated solution.
 >
 > Instead, would anyone be opposed to the 'noindex' meta tag being used on
 all pages as an alternative to a missing robots.txt (only when the default
 permalinks are on)?
 >
 > @nacin's patch in #19251 could be extended into a simple fix for this.

 We already do this.

 While sites with default permalinks do not return robots.txt, the site can
 be crawled correctly. Lowering severity, suggesting close.

-- 
Ticket URL: <http://core.trac.wordpress.org/ticket/18841#comment:9>
WordPress Trac <http://core.trac.wordpress.org/>
WordPress blogging software