Hurry! Our Biggest Sale of the Year is On - Contact us to lock in prices and more
Skip to content

Card Sorting: What is it, and how can it Benefit your Study?

Updated:

With Userlytics’ Card Sorting capability, you can ensure the information architecture of your digital asset is clear, intuitive, and leads your customers to where they’re trying to go. With a more direct website layout, you can increase your conversions, retain customers, and boost business.

What is Card Sorting?

Card Sorting is a popular tool for exploring the “Mental Model” of your study participants as they search for information, products or solutions on your digital asset. The information you gain from your Card Sorting activity metrics will allow you to optimize the Information Architecture (IA) of your websites, mobile apps, desktop applications and prototypes.

Three benefits to incorporating Card Sorting into your user experience study are:

  • Ensures you have a coherent information architecture that matches the mental models and expectations of your users and customers.
  • Optimizes the accessibility and ease of discovery of your menus and navigation paths.
  • Explores whether the names of categories and products are understandable and match your user and customer expectations.

How Do I Create a Card Sorting Activity in my User Experience Study?

To create a Card Sorting activity within your user experience study, go to your Userlytics dashboard and either click an existing study to add the activity, or select the “Create New Study” optionTo create a Tree Testing task within your user experience test, go to your Userlytics dashboard. Click on “Create New Test” if you are building out a new test.

Userlytics Card Sorting - create new study
Userlytics Card Sorting - Choose Study

Once you have entered the study builder, click “Card Sorting” on the left-hand side of the screen where the study activities and questions appear.

Userlytics Card Sorting - Side menu

After selecting “Card Sorting” from the activity choices, click on the activity from within the various activities and questions on your UX study to begin building it out.

When building out your Card Sorting activity, first, you will have to customize the text your participants will see.

Userlytics Card Sorting - Activities/Questions flow

Then, you will have to design the sort type for the Categories your participants will be selecting from. You have the option of choosing from the following three options: “Open,” “Closed,” or “Hybrid.”

  • Open: Participants create and name their own categories.
  • Closed: You predetermine the categories participants will choose from.
  • Hybrid: Predetermine some categories, and participants can also create their own.

If you choose the “Open” Card Sorting method, you will designate the Card names, and allow participants to create their own Category Names. If you select either the Closed or Hybrid sort options, you will designate names to both the Cards and the Categories.

Userlytics Card Sorting - Cards and Categories

How Do I Interpret Metrics from my Card Sorting Activity?

After your participants have completed your user experience study, you can go into your dashboard and view and interpret the results of their Card Sorting activity. First, find the “Metrics” option on your Userlytics dashboard under the study you are trying to analyze.

Userlytics Dashboard displaying the Metrics section and activities.

The first tab of results is the Cards tab, which provides an overview of how participants categorized each card in your study. You’ll see a sortable table that displays all cards and the different categories participants used and how often. 

  1. Cards

Cards sorted into fewer categories with high agreement indicate clear, intuitive groupings. Cards sorted into many different categories suggest confusion or ambiguity in labeling, signaling opportunities to refine your content structure.

Below the cards overview, access each participant’s complete sorting choices, time spent, and video recording to understand their reasoning and decision-making process. 

Screenshot of the Card Sorting activity view in the Userlytics dashboard, showing the Cards tab.
A list of cards such as Laptop, Books, Car, Mobile, Scarves, and Gloves is displayed, each with the number of times it was sorted and the categories it was placed into (e.g., Accessories, Technology, Science). The interface includes tabs for Categories, Result Matrix, Dendogram, Similarity Matrix, and Recommendation, with participant filtering and search options at the bottom.

2. Categories 

The Categories tab shows which cards were placed in each category. Categories can be created by participants, predefined by researchers in the Study Builder, or a combination of both. 

Each category row displays the total number of cards it contains and lists all cards sorted into that category with their frequency counts (e.g., “4 (15)” means card “4” was placed in this category by 15 participants). Below, view individual participant responses and completion times to explore how each person organized the cards.

Screenshot of the Card Sorting activity in the Userlytics dashboard, displaying the Categories tab.
A table lists categories such as Accessories, Computer, Technology, Science, Clothes, and Culture, along with the number of cards each contains and the cards most frequently sorted into them (e.g., Laptop, Books, Car, Mobile). Below, a participant list includes users, their response view buttons, and time spent on the activity.

3. Result Matrix 

The Result Matrix displays a color-coded heatmap showing how many participants sorted each card into each category. Rows represent cards, columns represent categories, and the intensity of the purple color indicates frequency:

  • Dark purple – First option with the most responses (highest agreement)
  • Medium purple – Second option with more answers (moderate agreement)
  • Light purple – Third option with fewer answers (lower agreement)

The numbers inside each cell show exactly how many participants placed that specific card in that category. This visualization quickly reveals strong patterns of agreement (dark cells with high numbers) and areas of confusion (cards spread across multiple categories with low numbers).

Screenshot of the Card Sorting activity in the Userlytics dashboard, showing the Result Matrix tab.
A heatmap table displays how participants grouped cards like Laptops, Books, Car, Mobile, Mouse, Tablet, and Gloves into categories such as Accessories, Computer, Technology, Education, Science, Animal, and Clothes.
The cells are shaded in varying shades of purple to indicate frequency, with darker tones representing higher sorting frequency.

4. Dendrogram 

A brand new visualization that shows a hierarchical tree visualization that reveals how cards cluster together based on participant sorting patterns. Cards that were frequently grouped together appear closer in the tree structure, with branches showing the strength of their relationships.

Screenshot of the Card Sorting activity in the Userlytics dashboard, displaying the Dendrogram tab.
A hierarchical dendrogram visualization appears, showing relationships between cards such as Falcon, Lion, Bobcat, Bear, Wolf, Coyote, Sheep, Rabbit, Cow, and Marmot. The chart uses purple connecting lines to represent grouping similarities based on participant responses. The left panel lists study sections including Metrics, Sessions, and Annotations.

This powerful visualization helps you identify natural groupings and understand which cards participants consistently associate with one another. The horizontal distance between branches indicates how strongly related the cards are, while the shorter distances mean stronger associations. Use this view to discover logical category structures that align with user mental models.

5. Similarity Matrix

The Similarity Matrix is a color-coded grid that shows how frequently participants grouped pairs of cards together. 

Each cell displays the percentage of participants who sorted both cards into the same category. Darker purple cells indicate stronger agreement, meaning most participants grouped those cards together, while lighter cells show weaker associations. 

Screenshot of the Card Sorting activity in the Userlytics dashboard, showing the Similarity Matrix tab.
A triangular heatmap displays the similarity percentages between cards such as Laptop, Books, Car, Mobile, Scarves, Gloves, Tablet, Mouse, Microphone, and Socks.
The cells are shaded from light to dark purple to represent the degree of similarity, with higher percentages like 83% and 100% in darker shades. The left panel shows study navigation options including Metrics, Sessions, and Annotations.

This matrix helps you identify which cards have strong natural relationships in users’ minds (high percentages) and which cards don’t clearly belong together (low percentages). Use this data to validate potential category groupings and spot cards that consistently cluster together across participants.

6. Recommendation 

The Recommendation tab provides smart, data-driven category suggestions based on participant sorting patterns. Cards are automatically tagged as Recommended (green indicators) when there’s strong agreement among participants about their category placement.

At the top, you’ll see a summary showing the total number of cards and categories, along with a count of recommended cards. Use the “Show empty categories” toggle to view or hide categories with no card assignments. This intelligent analysis helps you quickly identify which category structures have strong user consensus, making it easier to finalize your information architecture with confidence.​

Screenshot of the Card Sorting activity in the Userlytics dashboard, showing the Recommendation tab.
The interface displays two automatically suggested groups: Numbers and Letters. Each category contains six cards — Numbers include 1 to 6, and Letters include A to F — all marked with green dots indicating recommended groupings. The panel on the left shows study navigation options such as Metrics, Sessions, and Annotations, and a participant list appears at the bottom showing response time details.

When you hover over icons or indicators in the Recommendation tab, small black tooltips appear to explain their meaning. 

For example, hovering over the Recommended tag displays the message “Based on users’ feedback, these are the cards we suggest including in this category.” 

This indicates that there is strong participant agreement on where each card belongs. Another tooltip appears near the category toggle, stating “All categories are displayed,” confirming that all available categories are currently visible. 

Screenshot of the Card Sorting activity in the Userlytics dashboard, showing the Recommendation tab.
The interface displays three automatically generated suggested categories based on participant feedback: My booking with two cards, Book & Prepare with two cards, and Accessories with one card. Each card is marked with a green dot indicating a recommended placement.
A tooltip explains that recommendations are based on user feedback and data analysis. The left panel lists study sections such as Metrics, Sessions, and Annotations, while the bottom section shows participant details with category counts and time spent.

The following view shows the Recommendation tab in a more typical scenario where cards have mixed classification statuses. The system automatically tags each card based on participant sorting behavior. Cards marked with a yellow indicator are tagged as Needs Review, suggesting that user responses were inconsistent or unclear. When hovering over the yellow tag, a tooltip appears that reads: “User responses suggest that these cards are unclear. It may be worth considering a different category or renaming the card.” This helps users understand why certain cards may require attention or adjustments.

Screenshot of the Card Sorting activity in the Userlytics dashboard, displaying the Recommendation tab.
Three categories are shown: Book & Prepare with three cards, My booking with four cards, and Accessories, which is empty and labeled Empty Category.
Green dots mark recommended cards, while yellow dots mark cards that Need Review. A tooltip explains that unclear cards may need renaming or reassignment to a different category. The left panel lists study navigation items like Metrics, Sessions, and Annotations, while the participant list with time spent is visible at the bottom.

At the top, a summary shows the total number of cards and categories, along with a count of cards under each status. The Show empty categories toggle is on, so even empty categories (like “Accessories”) are displayed. This provides a complete overview of all possible categories, helping users see both assigned and unassigned cards in one place.

The following view shows the Recommendation tab with all three card statuses: Recommended (green), Needs Review (yellow), and Uncategorized (red). These tags indicate how consistently participants sorted each card.

Hovering over each label displays a tooltip explaining its meaning. For example, the Uncategorized tooltip says the system couldn’t place those cards into any category due to low participant agreement.

At the top, you’ll see the total number of cards and categories, along with counts for each status. Through the Show empty categories toggle you can see all categories being displayed, including the empty ones.

Screenshot of the Card Sorting activity in the Userlytics dashboard, showing the Recommendation tab.
The display includes several categorized groups — Book & Prepare, My booking, Accessories, Clothes, Technology, and Uncategorized.
Each category contains cards labeled numerically (e.g., Card 01–Card 06) with colored status indicators: green for Recommended, yellow for Needs Review, and red for Uncategorized. A tooltip explains that uncategorized cards lack user consensus. The left sidebar lists navigation options like Metrics, Sessions, and Annotations, and participant details are visible at the bottom.

Only 6 cards are shown per category. If you want to see all cards per category, click on the “Show More” button and all cards corresponding to a category will appear.

Screenshot of the Card Sorting activity in the Userlytics dashboard, under the Recommendation tab.
The screen displays seven categories—Book & Prepare, My booking, Accessories, Clothes, Technology, and Uncategorized. Each contains a list of cards labeled numerically (e.g., Card 01–Card 10) marked with color indicators: green for Recommended, yellow for Needs Review, and red for Uncategorized.
A red arrow at the bottom right points to a “Show Less” button. The left panel lists navigation options like Metrics, Sessions, and Annotations, while participant information is visible at the bottom.

Lastly, this view shows the Recommendation tab when all cards are classified as Uncategorized (red). This means the system was unable to assign any cards to a category due to low participant agreement. The tooltip explains: “The system was unable to place these cards into any category due to a lack of user consensus.”

Screenshot of the Card Sorting activity in the Userlytics dashboard under the Recommendation tab.
The screen shows that all 40 cards have been grouped into a single Uncategorized section, marked with red icons. A toggle labeled Show empty categories is set to off. The participant list at the bottom displays names, number of categories created, and time spent per participant. The left sidebar contains navigation options such as Metrics, Sessions, and Annotations, and the header shows filters for Demographics, Screener, and Participants.

This scenario typically indicates that participants sorted the cards

Didn’t find what you were searching for?

Related posts:

Clients
October 6, 2025

What kind of files can be uploaded for remote user testing?

Learn what kind of files you can upload for remote user testing. Find out which image formats and mobile apps are supported.
Clients
October 6, 2025

What are Matrix Questions, and How Can I Add Them to my Study?

Help Center: Discover how to use matrix questions to collect organized feedback and compare responses efficiently in your UX studies with Userlytics.
Clients
October 6, 2025

What are Matrix Questions, and How Can I Add Them to my Study?

Help Center: Discover how to use matrix questions to gather structured user feedback efficiently in your UX studies with Userlytics.
Clients
October 6, 2025

Tree Testing

Help Center: Discover how tree testing helps you assess the clarity of your website’s navigation and information hierarchy with Userlytics.

Ready to Elevate Your UX Game?