[wp-meta] [Making WordPress.org] #4136: Remove lines from robots.txt

Making WordPress.org noreply at wordpress.org
Thu Jan 31 21:08:53 UTC 2019

#4136: Remove lines from robots.txt
 Reporter:  joostdevalk  |      Owner:  (none)
     Type:  enhancement  |     Status:  new
 Priority:  normal       |  Milestone:
Component:  General      |   Keywords:  seo
 Can we please remove these lines from our robots.txt:

 Disallow: /support/search.php
 Disallow: /extend/plugins/search.php
 Disallow: /plugins/search.php
 Disallow: /extend/themes/search.php
 Disallow: /themes/search.php

 All of these redirect to URLs that have been noindexed. Right now, all of
 these have URLs that are in the index, but don't have content, which is
 worse than not being in the index.

Ticket URL: <https://meta.trac.wordpress.org/ticket/4136>
Making WordPress.org <https://meta.trac.wordpress.org/>
Making WordPress.org

More information about the wp-meta mailing list