[wp-trac] [WordPress Trac] #60127: Fix the Performance Testing workflow in the 6.4 branch

[WordPress Trac]

#60127: Fix the Performance Testing workflow in the 6.4 branch
------------------------------+--------------------------
 Reporter:  joemcgill         |       Owner:  (none)
     Type:  task (blessed)    |      Status:  new
 Priority:  normal            |   Milestone:  6.5
Component:  Build/Test Tools  |     Version:  trunk
 Severity:  normal            |  Resolution:
 Keywords:  needs-patch       |     Focuses:  performance
------------------------------+--------------------------

Comment (by drzezfuq55):

 To address the failing "Run baseline performance tests" step in the
 Performance Testing workflow on the 6.4 branch since revision [57198], we
 can consider the following solutions:

 1. **Update Baseline Test Version:**
    - Instead of using a fixed version (e.g., 6.1.1) for baseline tests,
 update it to match the major version of WordPress being tested (e.g.,
 6.4).
    - This ensures that baseline tests are conducted against a version of
 WordPress that aligns with the branch being tested, providing more
 accurate performance comparisons.

 2. **Adjust PHP Version:**
    - Set the PHP version used for performance tests to the current
 recommended version, rather than the latest version.
    - This ensures compatibility with the WordPress version being tested
 and avoids potential issues with PHP versions that may not be fully
 supported.

 3. **Use Independent Environments:**
    - Instead of changing the WordPress version on the same installation
 between tests, run benchmarks using independent environments.
    - This approach provides a more controlled testing environment and
 avoids potential conflicts or inconsistencies between different versions
 of WordPress on the same installation.

 ### Implementation:

 To implement these solutions:

 - Update the workflow configuration file (e.g., GitHub Actions workflow
 file) to dynamically set the baseline version to match the current major
 version of WordPress.
 - Specify the recommended PHP version for performance tests.
 - Utilize separate environments or containers for running benchmarks to
 ensure isolation and consistency.

 ### Benefits:

 - **Improved Accuracy:** Baseline tests are conducted against the same
 major version of WordPress being tested, providing more relevant
 performance comparisons.
 - **Enhanced Compatibility:** Performance tests are conducted using PHP
 versions that are recommended and supported by the WordPress ecosystem.
 - **Consistent Results:** Running benchmarks in independent environments
 reduces potential interference and ensures consistent testing conditions.

 By implementing these adjustments, we can resolve the failing Performance
 Testing workflow on the 6.4 branch and ensure more accurate and reliable
 performance testing results for WordPress.

-- 
Ticket URL: <https://core.trac.wordpress.org/ticket/60127#comment:10>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform