[wp-trac] [WordPress Trac] #43590: Search Engine Visibility option does not work as intended

[WordPress Trac]

#43590: Search Engine Visibility option does not work as intended
---------------------------------------------+-----------------------------
 Reporter:  mamaedler                        |       Owner:  donmhico
     Type:  defect (bug)                     |      Status:  closed
 Priority:  normal                           |   Milestone:  5.3
Component:  General                          |     Version:  2.1
 Severity:  normal                           |  Resolution:  fixed
 Keywords:  has-patch has-unit-tests commit  |     Focuses:  administration
---------------------------------------------+-----------------------------
Changes (by peterwilsoncc):

 * status:  assigned => closed
 * resolution:   => fixed


Comment:

 In [changeset:"45928" 45928]:
 {{{
 #!CommitTicketReference repository="" revision="45928"
 #43590: Use robots meta tag to better discourage search engines.

 This changes the "discourage search engines" option to output a `noindex,
 nofollow` robots meta tag. `Disallow: /` is removed from the `robots.txt`
 to allow search engines to discover they are requested not to index the
 site.

 Disallowing search engines from accessing a site in the `robots.txt` file
 can result in search engines listing a site with a fragment (a listing
 without content).

 Props donmhico, jonoaldersonwp.
 Fixes #43590.
 }}}

-- 
Ticket URL: <https://core.trac.wordpress.org/ticket/43590#comment:16>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform