Problem/Motivation

The Automated Functional Testing pipeline fans out over one job per feature folder, and each matrix job builds its own HTML/PDF report from its own suite's JSON. There is no combined report: reading a run means opening fourteen artifact sets. Varbase Project solves this with a dedicated Create reports job that merges every matrix job's cucumber JSON into one HTML + PDF report.

Steps to reproduce

Open any pipeline on the 1.0.x branch: the test stage is the last stage, and no job publishes a merged report.

Proposed resolution

  • Add a report stage with a Create reports job mirroring Varbase Project's: dependencies pulls the artifacts from every test matrix job without gating on their success, jq merges the per-suite cucumber JSONs, and the harness's report generator builds one combined HTML + PDF, kept for 30 days.

Remaining tasks

  • ✅ File an issue
  • ❌ Addition/Change/Update/Fix
  • ➖ Testing to ensure no regression
  • ➖ Automated unit testing coverage
  • ❌ Automated functional testing coverage
  • ➖ UX/UI designer responsibilities
  • ➖ Readability
  • ➖ Accessibility
  • ➖ Performance
  • ➖ Security
  • ❌ Developer Documentation
  • ➖ User Guide Documentation
  • ❌ Reviewed by human
  • ❌ Code review by maintainers
  • ➖ Full testing and approval
  • ➖ Credit contributors
  • ➖ Review with the product owner
  • ❌ Release notes snippet
  • ✅ Release educare-1.0.0-alpha2

User interface changes

  • N/A

API changes

  • N/A

Data model changes

  • N/A

Release notes snippet

  • The testing pipeline now publishes one combined HTML + PDF report per run.

Issue fork educare-3616081

Command icon Show commands

Start within a Git clone of the project using the version control instructions.

Or, if you do not have SSH keys set up on git.drupalcode.org:

Comments

rajab natshah created an issue. See original summary.

  • rajab natshah committed d17de0ea on 1.0.x
    ci: #3616081 Merge the per-suite test reports into one Create reports...
rajab natshah’s picture

Assigned: Unassigned » josebc
Issue summary: View changes
Status: Active » Needs review
Issue tags: +educare-1.0.0-alpha2
rajab natshah’s picture

Assigned: josebc » mohammed j. razem
rajab natshah’s picture

Assigned: mohammed j. razem » Unassigned
Status: Needs review » Fixed

Now that this issue is closed, review the contribution record.

As a contributor, attribute any organization that helped you, or if you volunteered your own time.

Maintainers, credit people who helped resolve this issue.