Usability Testing


ethodStage in ProcessUsers NeededAdvantagesDisadvantages
Traditional TestingIterative design, formative evlauation, final testing3 +Time consuming and expensive
Heuristic evaluationCompetitive analysis, final testingNoneFinds individual usability problems. Can address expert user issues.Does not involve real users, so does not find "suprises" relating to their needs.
Performance measures10 +Hard numbers. Results are easy to compareDoes not find individual usability problems.
Thinking aloudIterative design, formative evaluation3-5Pinpoints user misconseptions. InexpensiveUnnatural for users. Hard for expert users to verbalize.
ObservationTask analysis, follow up studies3 +Ecological validity; reveals users' real tasks. Suggests functions and features.Appointments hard to set up, No experimenter control
SurveysTask analysis, follow-up studies30 +Finds subjective user preferences. Easy to repeatPilot work needed (to prevent misunderstandings).
InterviewsTask analysis5Flexible, in-depth attitude and experience probing.Time consuming. Hard to analyze and compare
Focus groupsTask analysis, user involvement6-9 per groupSpontaneous reactions and group dynamics.Hard to analyze. Low validity
Logging actual product useFinal testing, follow-up studies20 +Finds highly used (or unused) features. Can run continuously.Analysis programs needed for huge mass of data. Violation of users' privacy
User feedbackFollow-up studiesunlimitedTracks changes in user requirements and viewsOrganization needed to handle responses