All of the Metatag daily tests have been stuck in a "queued" state for several weeks on both branches. Any idea what might be going on?

https://www.drupal.org/pift-ci-job/462629

Thanks.

Comments

DamienMcKenna created an issue. See original summary.

DamienMcKenna’s picture

DamienMcKenna
Location NH, USA
CreditAttribution: DamienMcKenna at Mediacurrent commented

This also seems to affect individual patches, e.g. #2813429: Missing tests for mobile meta tags was stuck in a "Queued" state too.

drumm’s picture

drumm
he/him
Location NY, US
CreditAttribution: drumm at Drupal Association commented
Assigned: Unassigned » drumm

Those jobs were sent to Jenkins, but corresponding results were never found. I'll requeue them.

DamienMcKenna’s picture

DamienMcKenna
Location NH, USA
CreditAttribution: DamienMcKenna at Mediacurrent commented

Thanks. Might there be an underlying problem there, because I see this for some other projects too?

drumm’s picture

drumm
he/him
Location NY, US
CreditAttribution: drumm at Drupal Association commented

Yes, the times seem to correspond to maintenance windows. Mixologic is doing more correlation to check for any other patterns.

Once the immediate issue is cleaned up, I'll move this to the PIFT queue to requeue anything stuck longer than 12 hours, the maximum unplanned maintenance window, I hope. And see if there are any improvements to the page to explain this more completely.

DamienMcKenna’s picture

DamienMcKenna
Location NH, USA
CreditAttribution: DamienMcKenna at Mediacurrent commented

Thank you again!

drumm’s picture

drumm
he/him
Location NY, US
CreditAttribution: drumm at Drupal Association commented
Title: Metatag daily branch tests stuck in "Queued" state » Re-request tests stuck for 12h
Project: DrupalCI: Drupal.org Testing Infrastructure » Project issue file test
Version: » 7.x-3.x-dev
Component: Unexplained Failures/Support » Code
Assigned: drumm » Unassigned
Category: Support request » Task

All stuck tests have been tested now.

drumm’s picture

drumm
he/him
Location NY, US
CreditAttribution: drumm at Drupal Association commented
Assigned: Unassigned » drumm

We made some other improvements which should be able to handle starting up to 100 jobs a minute. The crons to send, fetch, and parse jobs are now separate, so one of those being slow now won’t block up the other two. In the ~week that’s been running, there has only been one stuck job.

  • drumm committed 5361b66 on 7.x-3.x 
    Issue #2813439: Re-request tests stuck for 12h
drumm’s picture

drumm
he/him
Location NY, US
CreditAttribution: drumm at Drupal Association commented
Status: Active » Fixed
Issue tags: +needs drupal.org deployment
drumm’s picture

drumm
he/him
Location NY, US
CreditAttribution: drumm at Drupal Association commented
Issue tags: -needs drupal.org deployment

This has been deployed.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.