[wp-trac] [WordPress Trac] #31092: travis-ci builds skip lots of tests due to environment configuration

[WordPress Trac]

#31092: travis-ci builds skip lots of tests due to environment configuration
------------------------------+----------------------------
 Reporter:  boonebgorges      |      Owner:
     Type:  defect (bug)      |     Status:  new
 Priority:  normal            |  Milestone:  Future Release
Component:  Build/Test Tools  |    Version:
 Severity:  normal            |   Keywords:  needs-patch
  Focuses:                    |
------------------------------+----------------------------
 See #30284.

 travis-ci builds (eg https://travis-
 ci.org/aaronjorbin/develop.wordpress/jobs/47713725) are skipping a bunch
 of tests. I haven't yet looked into it in detail, but I'm guessing it's a
 combination of the following:

 - Missing image-related PHP extensions (gd, exif)
 - ru_RU system domain must be installed (`Tests_DB::test_locale_floats()`)
 - MySQL versions don't support utf8mb4
 - WordPress Importer plugin not available

 Ideally, the only tests skipped in CI are those that depend on *WordPress*
 configurations, and we run separate builds for each relevant config. In
 the case of our current tests, the only WP config that matters is
 multisite, and we're already running separate multisite tests, so we
 should expect to see that some tests are skipped on MS, and others skipped
 on non-MS. All OS, PHP, MySQL, and webserver-related skips should be
 eliminated.

 Anyone who's interested in chasing this down, here's how I'd go about it:
 - Fork https://github.com/aaronjorbin/develop.wordpress and set it up to
 run on Travis.
 - Modify the build so that it runs `phpunit -v`. I think you should be
 able to do just by changing the `script` command in .travis.yml
 - Check in and push up. The first Travis run should give you a full report
 of what's being skipped, and why
 - Start hacking at the `before_script` section as necessary to get the
 necessary prerequisites installed. http://docs.travis-
 ci.com/user/languages/php/#PHP-installation and the following sections
 should be a good starting point.

--
Ticket URL: <https://core.trac.wordpress.org/ticket/31092>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform