Problem/Motivation
We have a dedicated runner for performance tests, tagged with 'performance-test-runner', if we add that tag to performance tests, they should hopefully match up.
Steps to reproduce
Proposed resolution
Tag the performance test job with a tag, this tag matches the performance test runner tag.
Additionally fixes webdriver error handling.
Merge request link
Remaining tasks
User interface changes
API changes
Data model changes
Release notes snippet
Issue fork drupal-3415296
Show commands
Start within a Git clone of the project using the version control instructions.
Or, if you do not have SSH keys set up on git.drupalcode.org:
- 3415296-use-a-dedicated
changes, plain diff MR !6211
Comments
Comment #4
catchGreen test run with the performance job schedule condition removed: https://git.drupalcode.org/project/drupal/-/jobs/687936.
Comment #5
catchComment #6
smustgrave commentedCould the IS be updated for why change to core/tests/Drupal/FunctionalJavascriptTests/WebDriverCurlService.php was needed? Assuming for title this was going to be a pipeline only fix.
Comment #7
catchIt might need splitting to its own issue - it fixes things so that if chromedriver produces an error, we get the error message instead of a cryptic type error from PHP. Update the issue summary for now.
Comment #8
smustgrave commentedThanks for updating, will lean on your expertise on this one too. Maybe a follow up should be made though for testing that chromedriver errors are properly captured, or is that overkill?
Comment #9
catchNot a huge fan of testing the test framework - in this case the phpstan baseline needed to be updated, so we wouldn't be able to regress in this specific way again.
Comment #10
longwaveGoing to open a followup to see if we can remove sudo from all tests, I don't think we need it on GitLab, and it makes the CI config more complicated.
I think it's fine to fix the WebDriverCurlService bug here, PHPStan was telling us there was an issue already so no need for a specific test.
Backported to 10.2.x to keep things in sync.
Committed and pushed b35de78f74 to 11.x and e48f905814 to 10.2.x. Thanks!