The document describes a 7-minute accessibility assessment and rating system for apps. It involves launching an app, exploring core tasks and screens using a screen reader, identifying accessibility issues, and assigning a rating from 1 to 5 stars based on issue severity. The rating and a brief summary are provided without a full issue list. The process requires accessibility testing experience but can be completed quickly with minimal resources.
8. full assessment 7 minute assessment
output
rating
list of every issue
rating
few word summary
no issue list
skill needed intermediate advanced or expert
time days minutes
cost significant minimal
9. 7 minute assessment output is only a rating,
with a few sentence summary.
No list of issues.
11. Advanced skills in WCAG conformance testing:
• screen reader testing experience
• colour contrast testing
• assessing severity or user impact of issues
Understand rating system and severity/user impact scales
Ability to imagine another user's experience
Login details and test data, if necessary
24. Blocks: total? task? with workaround?
Annoyances
Trivial and technical non-conformance
User context influences impact
25. Severity User impact of issue Examples
1 Crash or total block
Cannot log in
Inaccessible CAPTCHA
No screens reads in screen reader
2 Cannot complete core task
Unlabelled items - no context
No captions on video
Items don't work in screen reader
Severe colour contrast/use colour
3
User may experience difficulty,
confusion, irritation but issue
would not prevent a user from
completing a task
Unlabelled control, clear in context
Items read twice
Error presentment non-fatal issues
Minor colour contrast
4
Minor inconvenience or
Technical non-conformance
with no user impact
Spelling mistakes in alt text or
captions (meaning preserved)
30. Rating
Level of
accessibility
Tolerance for issues
5 star Very high
No Severity 1 or 2.
Some minor impact issues may exist.
No issues prevent user completing a core task.
Low incidence of issues.
4 star High
No Severity 1 or 2.
Some minor impact issues may exist.
No issues prevent user completing core task.
Users could get through tasks, despite annoyances.
3 star Moderate
No Severity 1. May contain Severity 2.
Issues may prevent users completing non-core tasks.
Users experience many annoyances, confusion.
Lack of attention to detail across the application.
2 star Low
Issues will prevent users completing core tasks.
Poor overall accessibility quality.
1 star Very low Severe issues and overall inattention to accessibility.
31. You could modify the degree of
tolerance for your own scale.
The point is to have a rating scale
that a non-specialist will understand.
32. Assign rating, write summary
⋆ ⋆ ⋆ ⋆ ⋆
"Five stars. Very accessible.
Unlabelled button on home screen.
Minor colour contrast issues"
38. Not a substitute for full testing
Subjective, yes, but imagine other
users
No list of issues
Requires accessibility experience
Can use ratings to summarize full
assessments too
39. “What do you think?
Could you use this?
What would you change?”
ɳ