This is happening on the D8 branch right now:

Nope.

It's misleading if you're not paying attention because it *looks* like everything is hunky-dory and it's not.
http://drupal.org/node/999004#comment-4457962 was the culprit this time.

Comments

boombatower’s picture

Something we will need to think about since projects can use bot to check for syntax and non-applicable patches without the need for tests.

catch’s picture

webchick beat me to it, subscribing.

webchick’s picture

Could we maybe count the number of tests we had going in, and if the number of passes + fails + exceptions < total, throw some sort of visual indication of that?

boombatower’s picture

Seems reasonable, since one shouldn't have a testcase with nothing in it...or makes little sense.

rfay’s picture

Just saw this happen in testing... and it was the case where the testbot times out or is otherwise reset. I think we might handle that case wrong.

rfay’s picture

In studying this, I saw one where we were getting the "mysql server has gone away" and that was the cause.

I increased the max_allowed_puppet in my.cnf in puppet to 32MB from 16MB. We'll see if it has an impact.

rfay’s picture

Please post a link to the test any time this happens.

It looks to me like the primary problem is in simpletest, PIFR or the testbot configuration. It seems that when there are serious exceptions or database problems, the testbot bails and this is the result. This was happening in #1192680: Testbot fills up /tmpfs partition and was resolved when the exceptions were resolved.

rfay’s picture

There are actually a fair number of cases where testing is enabled (on a per-project basis) but any given branch may not have tests. I wonder what the right response is in this case? We've now seen

1. Inappropriate "0 tests pass" green, where the testbot failed in one way or another to do the right thing.
2. Branches that have no tests.

Any other cases?

rfay’s picture

rfay’s picture

Status:Active» Closed (duplicate)