[wp-trac] [WordPress Trac] #33156: Allow admin-ajax crawling

[WordPress Trac]

#33156: Allow admin-ajax crawling
-----------------------------------+-----------------------------
 Reporter:  joostdevalk            |       Owner:  SergeyBiryukov
     Type:  enhancement            |      Status:  closed
 Priority:  normal                 |   Milestone:  4.4
Component:  General                |     Version:
 Severity:  normal                 |  Resolution:  fixed
 Keywords:  2nd-opinion has-patch  |     Focuses:
-----------------------------------+-----------------------------

Comment (by rdela):

 Opened a [https://core.trac.wordpress.org/ticket/35819 new ticket about
 order].

 Replying to [comment:17 Hube2]:
 > Didn't know if I should start a new ticket or not and couldn't find one
 covers it. The order that WP is outputting the allow/disallow rules
 > {{{
 > Disallow: /wp-admin/
 > Allow: /wp-admin/admin-ajax.php
 > }}}
 > may not compatible with all crawlers. To be comparable with all crawlers
 the order of these rules needs to be reversed.
 >
 > See:
 https://en.wikipedia.org/wiki/Robots_exclusion_standard#Allow_directive.
 >
 > I can't find any information that contradicts what is presented in the
 wiki article.

--
Ticket URL: <https://core.trac.wordpress.org/ticket/33156#comment:18>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform