Historical Reporting

Once you've captured multiple runs for the same job, you can start doing historical trending of your accessibility results. 

1. Click the "View Historical Report" button at the top of the Job overview page.
   
2. The first time you do this, you will need to process the results.
   
    
   • Date range - The dates of the runs you want to process. Since results take a while to process, you may want to focus on a more narrow time window.
   • Skip Interval - If you perform frequent scans (e.g. daily), you may find it useful to skip some of the results when processing historical reports.
     • This will allow you specify longer time windows in the date range above but not have to process every single data point, if your goal is to see general trending over long periods of time.
     • This value allows you to specify how many runs you wish to skip in between each data point.
     • Regardless of skip intervals, the first and last run will always be included in the report.
     • For example, if you have 10 runs in total for a particular job, and you set your skip interval to 3, the historical report will include runs 1, 5, 9 and 10.
3. The historical report is broken into sections:
   • Reprocess Data button
     This can be used anytime you want to reprocess the results as it won't happen automatically after new scans occur.
     
      
   • Result filtering
     • Filter by URL
       
       By default the report shows an aggregation of all scanned URLs overtime. However you can filter by URL if you want to investigate a specific URL. This uses an autocomplete box, so just start typing until you can drill down the URL you're looking for.
        
     • Filter by Accessibility Standard
       
       By default the report shows all accessibility standards that apply to a particular job. However you can filter down by specific standards, if you wish for more granular results.
        
     • Filter by Pass/Fail Status
       
       By default the report shows passing and failing URLs in the Passing/Failing URLs chart. However, if you are only interested passing URLs or failing URLs overtime, you can toggle the respective checkbox to turn it off in the chart.

       Note that due to the nature of what this filter does, it only shows up when investigating all scanned URLs, not specific URLs.

   • Report Overview
     
     • Date Range
       Shows the date range for the report results
     • Standards
       Shows a list of the standards used in the report
     • URLs included in the report
       When not filtering by URL, this will show a list of all of the URLs in the respective scan.

       Note that if more than 50 URLs are present in a job, it will be collapsed and you must click a button to expand the list.

   • Pass/Failing URL Chart
     
     This shows a total number of URLs that are passing/failing specific rules in the respective standards over time. 
     • It is specifically important to realize that stricter rulesets don't inherit their less-strict counterparts.
     • For example, if you want WCAG 2.1 AA full compliance, if you only look at the the WCAG 2.1 Level AA guideline, it will not include for any violations against WCAG 2.1A, WCAG 2A or WCAG 2AA guidelines. It only will check for violations of rules that are tagged with wcag21aa. Instead you should include investigate results across all four guidelines. 
        
   • Distinct Rule Violation Chart
     
     This shows a total number of distinct rule violations over time.
     • As it's focused only on distinct rules, this means if the same rule is violated multiple times (e.g., multiple images are missing alt tags), it will only count once.
        
   • Total Violations Chart
     
     This shows a total number of cumulative rule violations over time.
     • As it's the cumulative, this means if the same rule is violated multiple times (e.g., multiple images are missing alt tags), it will count for every single instance that is missing the alt tag. 
   • Distinct Rules Needing Review
     
     This shows a total number of distinct rules needing review over time.
     • As it's focused only on distinct rules, this means if the same rule is in question multiple times (e.g., multiple videos not containing captions), it will only count once.
   • Total Elements Needing Review
     
     This shows a total number of cumulative elements needing review over time.
     • As it's the cumulative, this means if the same rule is in question multiple times (e.g., multiple videos not containing captions), it will count for every single instance that is missing the caption.