Making critical because without this we can't do #2206501: Remove dependency on Drush from test reviews.

The introduction of the parent-free test runner did not test the --list command which only prints out a list of tests and then exits.

With the attached patch running php ./core/scripts/run-tests.sh --url http://drupal8.core/ --all --list produces the expected output ofhttps://privatepaste.com/73ee188e3f.

The relevant code from PIFR is:

    // Get test info for use by test_info_parse().
    if (!$this->exec(PIFR_CLIENT_PHP . ' ./' . $run_tests . ' --php ' . PIFR_CLIENT_PHP . ' --url ' . $url . ' ' . $test_list . ' --list')) {
      $this->set_error(array('@reason' => t('failed attempting to get list of tests from run-tests.sh')));
      return;
    }

Once committed this will work with sun's patch on #2206501: Remove dependency on Drush from test reviews. It works against HEAD atm because at this point a parent site exists. And committing this patch will not break HEAD.

The patch works by moving the --list processing above simpletest_script_setup_database(TRUE);.

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

Status: Needs review » Needs work

The last submitted patch, d8.run-tests.patch, failed testing.

alexpott’s picture

Status: Needs work » Needs review
FileSize
377 bytes

An even simpler fix... wtf, testbot.

alexpott’s picture

The --clean and --list commands don't work together anyways - they both use exit; - oh run-tests.sh what happened to the single responsibility principle?

Status: Needs review » Needs work

The last submitted patch, 2: 2421335.2.patch, failed testing.

alexpott queued d8.run-tests.patch for re-testing.

The last submitted patch, d8.run-tests.patch, failed testing.

alexpott’s picture

FileSize
1.11 KB

So the bot #2753 seemingly still had #2206501: Remove dependency on Drush from test reviews applied which was a good thing because it allowed me to find out another bug in that patch. But this also means the patch in #0 is good to go. Re-uploading.

Berdir’s picture

Note: I manually disabled #2753.

alexpott’s picture

Status: Needs work » Needs review
Berdir’s picture

Status: Needs review » Reviewed & tested by the community

I've confirmed manually that this works, patch just moves the existing code up, looks fine and unblocks #2206501: Remove dependency on Drush from test reviews.

alexpott’s picture

This is critical because not having a dependency on Drush for testbots to work will help us get to 0 criticals faster.

  • catch committed 77a6a26 on 8.0.x
    Issue #2421335 by alexpott: Using run-tests.sh with the --list option...
catch’s picture

Status: Reviewed & tested by the community » Fixed

Committed/pushed to 8.0.x, thanks!

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.