Skip to content

Moderated Tests on a UX platform VS Zoom

 By Userlytics
 Dec 16, 2021

Moderated Tests on a UX platform VS Zoom

Are you thinking about doing some user testing on your website, app or prototype? Are you currently weighing up the different options available to you? Should you use a free video-conferencing tool or a paid user testing platform? What are the differences between these options? These are all valid questions that will be answered for you in this blog post, giving you some clarity on what tool is best suited for your user testing needs.

Confused businesswoman trying to make a decision

As the pandemic has unfolded, many things have been forced to go virtual, including connecting with people. As a result, more and more UX testing platforms and options have become available to brands looking to connect with their current and future customers. These options mainly fall into two cohorts: (1) Free video conferencing tools, and (2) paid specialist user testing platforms. Whether you will benefit from a paid UX testing platform depends on your objectives, the scale and speed at which you want your study completed, and your desired output from the study.

Below, we’ll go over each of these factors, and determine why using a remote UX testing tool offers more benefits than using video conferencing tools like Zoom.

1. Objectives of your study:

Getting stakeholders to buy-in on an idea/concept

A common UX testing objective is to come up with a great product solution that your stakeholders will buy into. However, oftentimes, your team members will have different opinions on how to best solve a product issue. In these instances, having your teammates listen in while a UX study is taking place is a great way for them to hear firsthand what your target customer’s pain points are.

One benefit of using a user testing platform like Userlytics is that it permits invisible’” observers on moderated tests that cannot be seen or heard by test participants. This is important as it means teammates can gain valuable customer insights they might not otherwise get if the test participant could see and hear them.

A private team chat box can also be used by these “invisible” observers to share participant question ideas with the moderator. This feature ensures that you can get what you need out of a moderated UX study as the conversation evolves without having to schedule a follow-up session.

Quantitative data

Although conversational feedback is a great way to gain insights during a UX study, sometimes, words alone aren’t enough. If quantitative data is important to you, using a UX research platform might be best for your needs.

Remote UX research platforms contain various native UX exercises and tools to help brands gain the quantitative insights they need. By conducting studies via a UX research platform, you can take advantage of tools like card sorting, tree testing, and survey questions, and more during your test session. These can help prioritize ideas that are discussed during the conversation, enabling you to also add some data points to your insights.

Card sorting exercise from Userlytics platform

2. Scale and speed of your study:

Recruitment of participants

Your insights are only as good as the person providing them. If you don’t have a group of willing participants that fit your criteria on standby ready to talk to you, you are not alone. Finding people to take part in your UX study and ensuring a diverse representation of both demographics and psychographics requires a large pool of users to be able to select from.  

User testing platforms have an already established database of respondents to select from. For example, the Userlytics database spans over 150 countries and is 1,200,000 participants large, with more than 15 languages spoken by participants. So whatever your requirements are, they can almost always be found in such databases. And if your target audience is extremely specific, Userlytics can personally recruit the perfect participants for your test.

Furthermore, recruiting users from an already established user base means that these people are familiar with how user testing works and what is required of them, so there is no time wasted on explaining how the session and/or platform works.

Organization of interviews

Oftentimes, the time and effort it takes to organize a user testing study is underestimated. The size of your study will also dictate how much effort is needed in the preparation stages of your UX study. Contacting participants, scheduling sessions, reminding participants of their session times, allocating participant incentives, determining how to deal with participant no-shows… The list of organizational priorities goes on. If your study requires more than a handful of users the organization of it can end up taking just as much time as the actual study sessions themselves. 

Remote UX testing platforms allow for easy date/time scheduling with participants. For example, Userlytics’ has an easy scheduling calendar for moderated sessions that enables you to quickly schedule a meeting time that suits both you and the participant. This precise scheduling, accompanied by email reminders and incentives sent out via the platform, decreases the likelihood of no-shows, which can be very time consuming and frustrating for all involved. Lastly, because UX research platforms are made specifically for moderated testing, they typically result in fewer system crashes and disruptions during remote tests. And if an issue does occur, there is often a team on standby to help you resolve the issue as soon as possible.

3. The desired output of your study:

Making an impact with your insights

A key benefit of user testing platforms is their ability to record conversations. According to Forbes, viewers retain 95% of a message when they watch it on a video compared to 10% when reading it in a text. So presenting your findings using a combination of video and text can create an impactful report that will leave a lasting impression on the recipients. 

To make your study metrics more impactful, Userlytics offers time-stamped notes that can be quickly converted to highlight reels, which are short video clips of key moments within your studies. These videos can be exported and embedded in any reporting materials you send to teammates and stakeholders.

Easily quoting the user’s words

Remaining impartial and excluding any bias when reporting your insights is vital to any good piece of research. While you may be able to record remote testing sessions on a tool like Zoom, compiling quotes from your test participants may be a tedious process that requires you to rewatch the session several times.

Using a remote UX testing platform can save you a lot of time in this area. Many remote testing platforms like Userlytics offer automated transcriptions of your test sessions. With this tool, you can easily pull key quotes from your sessions and present them in your reports.

In Conclusion

While many brands can successfully complete remote UX studies via Zoom, using a specialist user testing platform offers customised tools that can elevate your study sessions and provide you with better, more tangible insights. Whether you should use a free tool or a specialist user testing platform depends on what you want to achieve, how quickly you want to achieve it and how you want to present your insights back to your teammates and stakeholders.

Some of the major benefits of using a remote UX testing platform like Userlytics are access to a global panel of test participants that can be filtered to match your target customer, native quantitative testing metrics, and easy reporting tools like automated AI transcriptions and highlight reels. By using these tools, you can elevate your UX testing and draw even better insights to improve your customer experience. Schedule a free Userlytics demo to see how its moderated testing platform can help your business conduct better remote usability tests.

Didn’t find what you were searching for?

Related posts

Things to be Thankful for: Advantages of Professional Peer Support in UX Research Thanksgiving is a time to reflect on all the things we are thankful for. As user researchers, we are thankful for the ability to connect with our peers and
2022 has been a busy and exciting time at Userlytics. We’ve launched several new features and capabilities, including sentiment analysis, accessibility testing, the ULX score, and VR testing. These newly implemented tools were designed to enhance your experience and provide you with
As staples of nearly all research conducted today, many people think they know about the differences between qualitative (qual) and quantitative (quant) testing. However, in the context of user research, these two methodologies are often used interchangeably. So how does one know
Understanding what democratizing user research means is not as simple as searching for the definition online, or asking a colleague for a quick summary. In a general sense, the universal definition is “providing all stakeholders with access to user insight and UX
It's no secret that a good website or app user experience is crucial for boosting sales. In an offline location such as a store or restaurant, being physically present may keep a prospect even if the experience is subpar. But in an
For many researchers working in UX, quantitative data analysis can cause a lot of anxiety. UX researchers provide interpretations that can impact businesses with said data, which can be an overwhelming amount of pressure. There are many reasons UX researchers are often
As a UX researcher or designer, it's important to have a clear understanding of your target customer before beginning a remote UX study. This helps you make informed decisions about what to test, how to test it, and who to target your
If you’re a UX researcher, you probably already know how important it is to carefully consider every step of a research plan: You need to make sure you understand the problem space, choose the most suitable research methods, identify and recruit the
In remote user experience and usability testing, there are a variety of factors that contribute to valuable, authentic user data that can be used to improve your brand’s user and customer experience. Among those factors are the quality and authenticity of the
If you visited a complex website and found everything you were looking for with ease, it was unlikely a coincidence. A well-designed website structure is often the result of careful user research and testing, following information architecture principles and best practices. So
While remote user experience testing significantly enhances researchers' ability to reach test participants, these participants’ technical skills and access to technology can often vary greatly. Therefore, it is important to design and administer remote tests that facilitate participants' varying technical skills and
Userlytics prides itself in being a truly global platform. With over one million panel testers in over 150 countries, we are happy to say that we are able to find and test your target customers, wherever they may be. With the inception
In today’s highly digital world, cybersecurity is of the utmost importance when running day to day business operations. As usability testing grows in popularity, so does the need to choose a UX platform that values your company's privacy and security. But how
Userlytics makes user experience testing easy, efficient and fun with its state-of-the-art no-download web recorder. This revolutionary user experience testing recorder allows participants to jump right into usability tests directly with a simple click of a button; this means you can more
Moderated testing is a great opportunity to get thorough and instant feedback from users all around the world. This type of testing involves a live, online interview where you are face-to-face with your users via webcam, asking them questions, guiding them through
Researching the ins and outs of your business is integral to setting your company up for success. Increasingly, fine-tuning and improving your customers’ brand experience has become one of the top priorities for businesses. With customer expectations being at an all-time high,
Are you a UX researcher who mainly conducts in-person studies and you’re looking for some online alternatives to get you through this unusual period of lockdown and social distancing? Or perhaps you’re someone who is starting their path down UX enlightenment, looking
INTRODUCTION Given the current world health and associated economic crisis, Userlytics ran a qualitative moderated ("Live Conversations") user experience study with participants in the US to determine how respondents’ online shopping behavior has changed as a result of the pandemic. The following
Imagine a scenario where a user is shopping online and stumbles across a product she likes, but the product’s description doesn’t tell her everything she needs to know before making a purchase (strike 1). To find out more, the user decides to
The Best and Worst UX in the Travel Industry Finding the best flight deals online can be an exhilarating experience. Almost every booking site today promises the lowest fares available and, in some cases, even a price match guarantee. With such a
Last November 18th our CEO was interviewed by Ditsa Keren, of Website Planet; Here are some excerpts from the interview: “If we take a step back and think about how software has evolved over the past 15 years, the cost and time
Designers are prone to falling into the trap of cluttering their interfaces. Limitations of space often push them to the wall, and they find themselves trying to fit everything they can into a tiny usable space. The unique problem that the modern
How Can Bad UX Influence Your Conversion Funnel? Source: Shengjun Shi Regardless of whether you sell a product, offer a service or run a blog, any visitor comes to your site with simple goals like consuming or gathering more information. The user experience

Let’s work together on your next UX study.

Create positive user experiences and keep customers loyal to your product and brand.

Analytics tells you what,
Userlytics tells you WHY.