[wp-trac] [WordPress Trac] #33156: Allow admin-ajax crawling
WordPress Trac
noreply at wordpress.org
Mon Dec 28 03:01:30 UTC 2015
#33156: Allow admin-ajax crawling
-----------------------------------+-----------------------------
Reporter: joostdevalk | Owner: SergeyBiryukov
Type: enhancement | Status: closed
Priority: normal | Milestone: 4.4
Component: General | Version:
Severity: normal | Resolution: fixed
Keywords: 2nd-opinion has-patch | Focuses:
-----------------------------------+-----------------------------
Comment (by Hube2):
Didn't know if I should start a new ticket or not and couldn't find one
covers it. The order that WP is outputting the allow/disallow rules
{{{
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
}}}
may not compatible with all crawlers. To be comparable with all crawlers
the order of these rules needs to be reversed.
See:
https://en.wikipedia.org/wiki/Robots_exclusion_standard#Allow_directive.
I can't find any information that contradicts what is presented in the
wiki article.
--
Ticket URL: <https://core.trac.wordpress.org/ticket/33156#comment:17>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform
More information about the wp-trac
mailing list