[wp-trac] [WordPress Trac] #33156: Allow admin-ajax crawling

[WordPress Trac]

#33156: Allow admin-ajax crawling
-------------------------+-----------------------------
 Reporter:  joostdevalk  |      Owner:
     Type:  enhancement  |     Status:  new
 Priority:  normal       |  Milestone:  Awaiting Review
Component:  General      |    Version:
 Severity:  normal       |   Keywords:  needs-patch
  Focuses:               |
-------------------------+-----------------------------
 As plugins are using admin-ajax.php on the frontend, we should add


 {{{
 Allow: /admin/admin-ajax.php
 }}}

 To the default robots.txt to prevent Google from sending out million of
 emails, see this article: [https://www.seroundtable.com/google-warning-
 googlebot-css-js-20665.html]

--
Ticket URL: <https://core.trac.wordpress.org/ticket/33156>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform