The automated tests are broken in 7.x. I suspect this is mainly due to a missing test dependency on date. Rolling a patch real quick to test my theory.

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

bdragon created an issue. See original summary.

bdragon’s picture

Status: Active » Needs review
FileSize
450 bytes

Let's see if this makes the testbot happier.

Status: Needs review » Needs work

The last submitted patch, 2: 2763209-fix-testing-hopefully.patch, failed testing.

bdragon’s picture

Ahh, as per #2692407: Test_dependencies are downloaded before applying patches, rather than after the dependencies aren't recalculated for patches.

Temporarily adding another patch to probe if the testbot gets past the first error if we just don't try and enable modules the testbot has not downloaded...

bdragon’s picture

FileSize
67 bytes

bleh, I think the test blacklist tripped over the patch name..

bdragon’s picture

Status: Needs work » Needs review

Or maybe I just forgot to reset the status.

bdragon’s picture

The last submitted patch, 4: 2763209-do_not_commit_testing_without_dependency.patch, failed testing.

bdragon’s picture

Assigned: bdragon » Unassigned

OK, it obviously didn't make all the tests pass, nor did I expect it to, but it did get past the whole "enabling modules" bit, so yeah, #2763209-2: Fix 7.x branch tests is at least part of the solution.

Once the .info change is in git, the branch tests will start having the required modules available during testing.

Stevel’s picture

Status: Needs review » Needs work

We should also add the modules to the 'dependencies' key in the getInfo() module, so it doesn't break with missing dependencies when testing locally.

Stevel’s picture

FileSize
4.84 KB

Updated patch

Stevel’s picture

Status: Needs work » Needs review

And back to Needs Review...

Status: Needs review » Needs work

The last submitted patch, 11: 2763209-fix-tests-11.patch, failed testing.

Stevel’s picture

Status: Needs work » Needs review

The patch fails because there are no tests found to be executed: test_dependencies[] is not added until after dependencies are downloaded by the testbot, and the tests are skipped because date is not installed. I believe it is ready to commit though, so back to 'Needs review'.

jlockhart’s picture

Issue tags: +fastrack
joseph.olstad’s picture

@Stevel, you've fixed tests for other modules in the past, great work.

Would be nice if someone would step up to maintain this project.

jkopel’s picture

@joseph.olstad I do not want to sound defensive, but there ARE people trying to maintain this module, we are just busy.
Please read the bottom of the project page to understand the circumstance.
As always, we welcome assistance from anyone in the community, and we appreciate all the efforts so far.

joseph.olstad’s picture

Yes other maintainers have died of cancer and the project lives on.
Like media.
If stevel says this is ready for commit it should be committed . Chicken and the egg here. Stevel has fixed other projects tests and has a good reputation. His explanation makes sense.

Hoping a maintainer can step up here.

jlockhart’s picture

I believe the next step here is to get community review. @joseph.olstad if you can take the time to do that that would be great, I'll also take a look later this week when I have time. If we can get the community to step up and get this RTBC then I'm sure the hard working maintainers will happily commit it.

rlhawk’s picture

Status: Needs review » Reviewed & tested by the community

This looks like an improvement. I'm going to commit the patch and see how the tests do.

  • rlhawk committed a2ec1fe on 7.x-3.x authored by Stevel
    Issue #2763209 by bdragon, Stevel: Fix 7.x branch tests
    
joseph.olstad’s picture

Thanks!
seems to be an improvement.
php 5.3 seems to have better results in the automated tests
5.6 gets stuck on setUp and that is the most important step. php 5.3 gets past setUp without error.

klausi’s picture

Status: Reviewed & tested by the community » Needs work

Tests are still failing, so this needs work?

klausi’s picture

Status: Needs work » Needs review
FileSize
400 bytes

I see that we are missing Features as test dependency because the bef_test_content module depends on it. Then the 2 remaining test fails are fixed for me.

Status: Needs review » Needs work

The last submitted patch, 24: bef-2763209-24.patch, failed testing. View results

klausi’s picture

Status: Needs work » Needs review

Hm, looking at https://dispatcher.drupalci.org/job/drupal_d7/111060/console is seems DrupalCI downloads test dependencies before fetching/applying the patch, so Features module is not downloaded, so we have the same test fails.

I guess we have to commit this blindly and then check again if DrupalCI picks it up?

rlhawk’s picture

Status: Needs review » Reviewed & tested by the community

That sounds good. I'll commit the patch and we'll see if that fixes the tests.

  • rlhawk committed d90858e on 7.x-3.x authored by klausi
    Issue #2763209 by klausi: Fix 7.x branch tests
    
klausi’s picture

Status: Reviewed & tested by the community » Needs review
FileSize
3.08 KB

OK, that is progress ... down to a couple of test fails in BEF_TestLinks.

I fixed the obvious ones with the URL encoding. Now 1 fail remains where the test expects a "?status_1=0" URL, but the query is omitted for the filter. Maybe that is a new feature in the module, we need to check if that is intentional.

Status: Needs review » Needs work

The last submitted patch, 29: bef-2763209-29.patch, failed testing. View results

klausi’s picture

Hrmpf, that did not help - somehow the testbot still shows the same test fails as the dev branch.

How can we find out why the XPath expression fails on the testbot but not locally for me?

And the tests are broken on PHP 7.2, but It seems like a Views issue.

klausi’s picture

Status: Needs work » Needs review
FileSize
5.36 KB

OK, since I'm not sure how those assertions should be changed I have disabled them for now. The important thing here is to get the branch to pass the tests again, so that other patches can be tested. We can enable the assertions again in a new issue for BEF Links.

klausi’s picture

Passing tests, yay!

I think we can commit this now and then open a new issue about fixing the assertions for BEF Links.

joseph.olstad’s picture

Status: Needs review » Reviewed & tested by the community

nice, thanks Klausi!

  • rlhawk committed 8156a06 on 7.x-3.x authored by bdragon
    Issue #2763209 by bdragon, klausi, Stevel: Fix 7.x branch tests
    
  • rlhawk committed 833ccc1 on 7.x-3.x authored by klausi
    Issue #2763209 by bdragon, klausi, Stevel: Fix 7.x branch tests
    
  • rlhawk committed f4781ba on 7.x-3.x authored by Stevel
    Issue #2763209 by bdragon, klausi, Stevel: Fix 7.x branch tests
    
rlhawk’s picture

Status: Reviewed & tested by the community » Fixed

Thanks, everyone.

joseph.olstad’s picture

there were three commit messages above, maybe some gaffe there?

hmm, project automated tests still need work for php 7.2.x and php 5.3.x it looks like

rlhawk’s picture

I wanted to give author credit to everyone who helped produce the final patch that got committed, hence the three commits.

klausi’s picture

The tests are failing because the Views security release uses short array syntax, which is a test dependency. So we need to wait on the next Views release, see #3039953: PHP 5.3.x fix for syntax changes Views 3.21. Then the branch should also pass on PHP 7, the errors there are related to #2810431: Parameter 3 to views_ui_build_form_state() expected to be a reference, value given in views_ui_ajax_form() (also not released yet).

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.

joseph.olstad’s picture

@rlhawk can you set the issue test default to something other than php 5.3.x ?
and add commit tests for php 7.0.x , 7.1.x , 7.2.x (supported by core) and php 7.3.x (soon supported in core)

currently php 5.3.x is the issue default automated test, I recommend something higher than that for the default. Currently the lowest zend supported release is php 7.1.x.

Thanks