Jeff Sauro • October 1, 2006
Sample Size from an estimate of Problem Occurrence (p)
If the probability of detecting a UI problem is known in advance, use this portion of the calculator to estimate the total number of users needed to uncover on average the specified percentage of problems (e.g. 90%). The calculator is based on the binomial probability formula.
Estimate Problem Occurrence (p) then Sample
Size
This portion of the calculator first builds
an estimate of the probability of detecting a UI problem (from sample
data). It then produces an estimate of the number of users needed
to discover the specified percent of total problems. It uses the GoodTuring
and Normalization procedure as outlined by Lewis (2001)
and further discussed in (Turner, Lewis & Nielsen
2006).



3 Days of HandsOn Training on UX Methods, Metrics and Analysis
Denver: Aug. 1719 2016
Controlling for Brand Attitudes in UX Studies
15 Mobile UX Facts and Insights for 2016
What five users can tell you that 5000 cannot
How common are usability problems?
97 Things to Know about Usability
Does better usability increase customer loyalty?
A Brief History of the Magic Number 5 in Usability Testing
Confidence Interval Calculator for a Completion Rate
Nine misconceptions about statistics and usability
How to Conduct a Usability test on a Mobile Device
Why you only need to test with five users (explained)
The Five Most Influential Papers in Usability
8 Ways to Show Design Changes Improved the User Experience
Should you use 5 or 7 point scales?
Customer Analytics for Dummies A guidebook for measuring the customer experience Buy on Amazon  
Quantifying the User Experience: Practical Statistics for User Research The most comprehensive statistical resource for UX Professionals Buy on Amazon  
Excel & R Companion to Quantifying the User Experience Detailed Steps to Solve over 100 Examples and Exercises in the Excel Calculator and R Buy on Amazon  Download  
A Practical Guide to the System Usability Scale Background, Benchmarks & Best Practices for the most popular usability questionnaire Buy on Amazon  Download  
A Practical Guide to Measuring Usability 72 Answers to the Most Common Questions about Quantifying the Usability of Websites and Software Buy on Amazon  Download 