[wp-meta] [Making WordPress.org] #6413: Robots.txt blocking Search Engines from getting plugin descrpition

[Making WordPress.org]

#6413: Robots.txt blocking Search Engines from getting plugin descrpition
------------------------------+---------------------
 Reporter:  digamberpradhan   |       Owner:  dd32
     Type:  defect (bug)      |      Status:  closed
 Priority:  high              |   Milestone:
Component:  Plugin Directory  |  Resolution:  fixed
 Keywords:  needs-patch       |
------------------------------+---------------------
Changes (by dd32):

 * status:  accepted => closed
 * resolution:   => fixed


Comment:

 In [changeset:"11979" 11979]:
 {{{
 #!CommitTicketReference repository="" revision="11979"
 WordPress.org Robots.txt: Correctly limit `/plugins/search/*` crawl
 limiting.

 In [11722] I added blocking for the `plugins/search` endpoint, however, I
 did so by not including a trailing slash.
 The result of this is that the rule has blocked access to plugins whose
 slugs begin with `search` (i.e. `/plugins/search-*/`).

 By adding a trailing slash here, it correctly applies the Disallow rule to
 `/plugins/search/*` instead.

 Props digamberpradhan for noticing/reporting the issue.
 See #5323.
 Fixes #6413.
 }}}

-- 
Ticket URL: <https://meta.trac.wordpress.org/ticket/6413#comment:3>
Making WordPress.org <https://meta.trac.wordpress.org/>
Making WordPress.org