[wp-meta] [Making WordPress.org] #4136: Remove lines from robots.txt

[Making WordPress.org]

#4136: Remove lines from robots.txt
-------------------------+--------------------
 Reporter:  joostdevalk  |      Owner:  (none)
     Type:  enhancement  |     Status:  new
 Priority:  normal       |  Milestone:
Component:  General      |   Keywords:  seo
-------------------------+--------------------
 Can we please remove these lines from our robots.txt:

 {{{
 Disallow: /support/search.php
 Disallow: /extend/plugins/search.php
 Disallow: /plugins/search.php
 Disallow: /extend/themes/search.php
 Disallow: /themes/search.php
 }}}

 All of these redirect to URLs that have been noindexed. Right now, all of
 these have URLs that are in the index, but don't have content, which is
 worse than not being in the index.

-- 
Ticket URL: <https://meta.trac.wordpress.org/ticket/4136>
Making WordPress.org <https://meta.trac.wordpress.org/>
Making WordPress.org