[wp-trac] [WordPress Trac] #34693: Add browser-based testing and automated acceptance tests (BrowserStack)

[WordPress Trac]

#34693: Add browser-based testing and automated acceptance tests (BrowserStack)
------------------------------+-----------------------------
 Reporter:  westonruter       |       Owner:  jonathanbardo
     Type:  enhancement       |      Status:  assigned
 Priority:  normal            |   Milestone:  Future Release
Component:  Build/Test Tools  |     Version:
 Severity:  normal            |  Resolution:
 Keywords:  needs-patch       |     Focuses:
------------------------------+-----------------------------

Comment (by rahul286):

 Replying to [comment:9 moreauf]:
 > Access to internals in acceptance tests is quite important to set up
 fixtures. Say I want to test how some plugin's search box reacts. First I
 want to insert thousands of items and I definitely don't want my
 acceptance test to insert them "by hand".

 Totally agree with you. We moved to CodeCeption a few months back and
 currently using it on our projects for acceptance tests.

 Replying to [comment:6 westonruter]:
 > Replying to [comment:5 rahul286]:
 > > Whichever project we use to automate acceptance testing, I believe we
 will need another tool for test case management. Any suggestions on this?
 >
 > Beyond just committing the acceptance testing scripts to the repo? Do
 you mean a tool for facilitating the development of the tests, like
 recording macros?

 Sorry for delayed reply. I was referring to something like TestRail
 [http://www.gurock.com/testrail/] or Moztrap
 [https://moztrap.readthedocs.io/]. A place to manage test cases themselves
 in text format. People then try to automate test cases written inside
 test-case management tool.

 This will separate the process of creating test cases and automating them.

 Also, a tool such as TestRail can record every test-run. So may be we can
 run acceptance test cases with each SVN commit and record results in a
 central place. This part may be skipped by sending logs to trac or
 somewhere.

 But I believe we will still need a test case management tool.

--
Ticket URL: <https://core.trac.wordpress.org/ticket/34693#comment:10>
WordPress Trac <https://core.trac.wordpress.org/>
WordPress publishing platform