Temporarily skip failing tests [#3267124]

Problem/Motivation

Layout Builder's FunctionalJavascript tests are consistently failing today on entirely unrelated patches:

https://www.drupal.org/pift-ci-job/2329991
https://www.drupal.org/pift-ci-job/2330001
https://www.drupal.org/pift-ci-job/2330007
https://www.drupal.org/pift-ci-job/2330008
https://www.drupal.org/pift-ci-job/2330029
https://www.drupal.org/pift-ci-job/2330033
https://www.drupal.org/pift-ci-job/2330034

Steps to reproduce

Proposed resolution

Add skips at the failure points for now.
Open a followup to investigate and revert.

Remaining tasks

User interface changes

API changes

Data model changes

Release notes snippet

Comment	File	Size	Author
#2	3267124-2.patch	3.54 KB	longwave
#2	9.4.x: PHP 8.0 & MySQL 5.7 29,537 pass

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

Comment #1

1 March 2022 at 12:13

longwave created an issue. See original summary.

Comment #2

longwave

he/him

English

CreditAttribution: longwave at Full Fat Things commented 1 March 2022 at 12:14

Status:

Active

» Needs review

File	Size
3267124-2.patch	3.54 KB
9.4.x: PHP 8.0 & MySQL 5.7 29,537 pass

Comment #3

catch

he/him

English

CreditAttribution: catch at Third and Grove commented 1 March 2022 at 12:17

I think we could probably unskip once #3208793: Update Chrome container to use newer version is done, and then see what happens from there.

Comment #4

alexpott

he/they

English

🇪🇺🌍

CreditAttribution: alexpott at Acro Commerce, Thunder commented 1 March 2022 at 17:06

Status:

Needs review

» Reviewed & tested by the community

Okay - I'm not madly keen but the random fails are really disruptive. Let's revert once #3208793: Update Chrome container to use newer version lands.

Comment #5

1 March 2022 at 22:00

catch committed 6e73953 on 10.0.x

Issue #3267124 by longwave, alexpott: Temporarily skip failing tests

catch committed 64d811c on 9.4.x

Issue #3267124 by longwave, alexpott: Temporarily skip failing tests

(...

Comment #6

catch

he/him

English

CreditAttribution: catch at Third and Grove commented 1 March 2022 at 22:03

Status:	Reviewed & tested by the community	» Fixed
Related issues:		+#3267247: [meta] Fix and re-enable tests skipped for random failures

Committed/pushed to 10.0.x and cherry-picked to 9.4.x, thanks!

We can backport this to 9.3.x if we really need to, but most tests are against the two development branches and 9.3.x is in freeze today, so just marking fixed for now.

Follow-up here: #3267247: [meta] Fix and re-enable tests skipped for random failures

Comment #7

xjm

she/her

English

CreditAttribution: xjm at Acquia commented 6 March 2022 at 09:23

Issue tags:

+Random test failure

Unfortunately they all still have moderate to high fail rates following the Chromedriver update.

Comment #8

11 March 2022 at 16:55

xjm committed 3e37843 on 9.3.x authored by catch

Issue #3267124 by longwave, alexpott: Temporarily skip failing tests

(...

Comment #9

11 March 2022 at 16:56

xjm committed 4496349 on 9.2.x authored by catch

Issue #3267124 by longwave, alexpott: Temporarily skip failing tests

(...

Comment #10

xjm

she/her

English

CreditAttribution: xjm at Acquia commented 11 March 2022 at 17:01

Version:

9.4.x-dev

» 9.2.x-dev

Backported to 9.3.x and 9.2.x. Random fails are a huge frustration for private security tests, so we should always backport these fixes to the security-covered branch.

I checked over the list to make sure none of these tests were already fixed in other commits. Only CKE5 MediaLibraryTest and AjaxTest are already fixed.