UsabilityMethods: For cardsorting, 20 is enough.

Q: How many participants do we need for our cardsort?

Tullis and Woods conducted a real data simulation study to determine the practically optimal number of participants need for cardsorting.

First they collected data from a large set of users–168 people to be exact. Then they ran cardsort “studies” of different sizes by randomly drawing data for individual participants from the larger data set. Since it was all mathematical–based on similarity scores within data pairs and sets– it was easy (sort of) to “run the studies” enough times to understand the average variation that occurrs in the groups of different sizes.
Based on their simulations, Tullis & Woods concluded cardsorting studies with just 20-30 participants are robust and predictive.

Tullis, T., and Wood, L. (2004), “How Many Users Are Enough for a Card-Sorting Study?” Proceedings UPA’2004 (Minneapolis, MN, June 7-11, 2004).

1 comment so far

  1. […] Straub aka “DriveBy” points out Tom Tullis and Larry Wood’s research, How Many Users Are Enough for a Card-Sorting […]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


Get every new post delivered to your Inbox.

%d bloggers like this: