[wp-trac] [WordPress Trac] #36390: Disallow /wp-json/ crawling

[WordPress Trac]

#36390: Disallow /wp-json/ crawling
----------------------------+------------------------------
 Reporter:  SergeyBiryukov  |       Owner:
     Type:  defect (bug)    |      Status:  new
 Priority:  normal          |   Milestone:  Awaiting Review
Component:  REST API        |     Version:  4.4
 Severity:  normal          |  Resolution:
 Keywords:                  |     Focuses:
----------------------------+------------------------------

Comment (by peterwilsoncc):

 Google, etc, need to crawl it for sites loading content via the API using
 JavaScript. This prevents it from being included in robots.txt.

 Perhaps an `X-Robots-Tag: noindex` header on the API end-points to prevent
 the duplicate content penalties.

--
Ticket URL: <https://core.trac.wordpress.org/ticket/36390#comment:4>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform