Skip to content
Gallery
User Tools Comparison
Summary
Main View
Detailed View
More
Share
Explore

icon picker
Summary

Laura Tian
Last edited 448 days ago by Laura Tian

Background

To help us make an informed decision about the user research tools, I have created a user research service comparison. In this comparison, we will review the most popular user research tools available today, highlighting their strengths and weaknesses, pricing, and key features.
Research Question
What service or combination of services should we use to conduct user research?
⁠

Method

I compared 14 user research services that offered qualitative user testing tools (e.g, interview recording and analysis, card sorting), quantitative user testing tools (e.g., surveys), user panels, or a combination thereof. I spoke with representatives and account executives from many of the vendors and compared the services on:
maintenance

Tool Range

Unmoderated usability testing
Moderated usability testing
In-product intercepts/feedback
Surveys
conference-call

User Panel

Large B2B panel with active participants
Verified participants (based on social media)
Bonus points for CRE screening questions built-in
stack-of-money

Pricing

Ideally cost efficient
Flexible plans (e.g., no min. terms)
checked

Misc. Requirements

SSO

Assumptions Table

Price comparison utilized key assumptions about frequency of testing, and the number of participants per study for approximately ~300 participants/year based on qualitative testing needs (below).
Cost pp (without tools)
Duration (Months)
Participants per project
Projects per month
Moderated tests
Unmoderated Tests
Minimum Seats
1
$150.00
12
5
5
60%
40%
5
There are no rows in this table
⁠
estimate
Annual cost of participant incentives without additional services/panels
⁠
$45,000.00
⁠
⁠
⁠

Results

Proposed Solutions
Tools
Participant Pool
~Annual Tool Cost USD
Total Cost USD
Verdict
1
Existing
Manual recruitment
$0.00
$45,000.00
Most economical but no features, more manual work and more data inconsistency.
2
⁠
Userlytics
⁠
⁠
Userlytics
$3,960.00
$48,960.00
Userlytics offers the best price for a panel and qualitative research tools.
3
⁠
Sprig
⁠
⁠
⁠
User Interviews
⁠
⁠
$18,680.00
$63,680.00
User Interviews offers CRE Portfolio Managers as a screener option, but they would need to be supplemented with a usability tool such as Sprig.
4
⁠
Loop11
⁠
⁠
⁠
User Interviews
⁠
⁠
$18,876.00
$63,876.00
User Interviews offers CRE Portfolio Managers as a screener option, but they would need to be supplemented with a usability tool such as Loop11.
5
UserTesting/User Zoom
UserTesting/User Zoom
$41,022.00
$86,022.00
Most widely used in the industry but extremely costly. This quote only includes 3 seats.
There are no rows in this table
⁠
Note
Annual Tool Cost reflects the value of the cost of the service after subtracting approximate recruitment fees. Where recruitment fee breakdowns are unavailable, recruitment fees are estimated based on manual recruitment fee costs ($45,000 USD).


Want to print your doc?
This is not the way.
Try clicking the ⋯ next to your doc name or using a keyboard shortcut (
CtrlP
) instead.