[wp-meta] [Making WordPress.org] #5938: Add an x-robots-tag header to md5/sha1 etc file URLs

[Making WordPress.org]

#5938: Add an x-robots-tag header to md5/sha1 etc file URLs
--------------------------------+---------------------
 Reporter:  jonoaldersonwp      |       Owner:  (none)
     Type:  defect              |      Status:  closed
 Priority:  lowest              |   Milestone:
Component:  WordPress.org Site  |  Resolution:  fixed
 Keywords:  seo                 |
--------------------------------+---------------------
Changes (by dd32):

 * status:  new => closed
 * resolution:   => fixed
 * component:  General => WordPress.org Site


Comment:

 Added.

 {{{
 $ curl -Is https://wordpress.org/wordpress-5.6.3.zip.sha1 | grep -i 'x
 -robots-tag'
 x-robots-tag: noindex, follow

 $ curl -Is https://wordpress.org/wordpress-5.6.3.zip | grep -i 'x-robots-
 tag'
 // No output

 $ curl -Is https://downloads.wordpress.org/release/en_AU/latest.zip.sha1 |
 grep -i 'x-robots-tag'
 x-robots-tag: noindex, follow

 $ curl -Is https://br.wordpress.org/wordpress-4.7-pt_BR.zip.md5 | grep -i
 'x-robots-tag'
 x-robots-tag: noindex, follow
 }}}

 Plugins have a `.json` checksum file that I haven't added it to, but
 they're served with the proper content-type headers and aren't linked to..
 so I think those should be fine?

-- 
Ticket URL: <https://meta.trac.wordpress.org/ticket/5938#comment:3>
Making WordPress.org <https://meta.trac.wordpress.org/>
Making WordPress.org