[wp-trac] [WordPress Trac] #28604: Change default robots.txt

[WordPress Trac]

#28604: Change default robots.txt
-------------------------+------------------------------------
 Reporter:  joostdevalk  |      Owner:
     Type:  enhancement  |     Status:  new
 Priority:  normal       |  Milestone:  Awaiting Review
Component:  General      |    Version:  trunk
 Severity:  normal       |   Keywords:  has-patch dev-feedback
  Focuses:               |
-------------------------+------------------------------------
 In [https://www.youtube.com/watch?v=B9BWbruCiDc this (2 years old) public
 service announcement] Matt Cutts asks for websites to allow Google to
 spider CSS and JS.

 Recently I've ran into pretty severe ranking problems for two sites that
 were robots.txt blocking their CSS, [https://yoast.com/google-panda-
 robots-css-js/ I've written about that here]. As more and more JS and CSS
 gets included in and from /wp-includes/js/ and /wp-includes/css/, I think
 it's wise if we decide to unblock the wp-includes directory.

--
Ticket URL: <https://core.trac.wordpress.org/ticket/28604>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform