The Research on
Conversational Research

A research-on-research involving 2,006 participants exploring the issues with traditional
surveys and how a conversational research approach might address those problems.

Traditional research is in crisis

Participants are tuning out, data quality is under pressure, and survey fraud is increasing.
5 %
average survey response rate today — a major drop from 40% in 1997
Conversational research was introduced to address these pain points. But does it work?

How the research was conducted

Reach3 Insights ran a parallel study using the same topic and questions but with two different methods.

Group 1
Traditional Survey

1,001 participants in total

Received a traditional, email-based online survey

Group 2
Conversational Survey

1,005 participants in total

Received a chat-link, mobile-first experience using Rival’s conversational platform

Testimonial Quotes

“We wanted to validate how far conversational methods have come, and what that evolution means for researchers today. Inside this report, you’ll find practical insights and best practices that anyone can use to improve how they engage with participants and elevate the quality of the insights they gather.”

Jennifer Reid

Jennifer Reid, Co-CEO and Chief Methodologist, Rival Group

Jennifer Reid

What is conversational research?

Conversational research is research that is more natural, more human, and ultimately more effective. It’s defined by 3 key ingredients. 

The Channel

Distributed via mobile-first channels like SMS

The Tone

A more human approach that mimics how people communicate and doesn't feel like a chore

The Design

A chat-like interface that feels natural and organic — similar to today's popular mobile messaging platforms
Container

More thoughtful, more robust open-ends

When people respond via a conversational survey, they say more.

2.5x
longer responses using a chat-like conversational survey
5x
longer responses with Smart AI Probe, a tool that generates contextual follow-up questions
8x
longer when participants responded by video

And the quality is better. Using our proprietary Thoughtfulness Score (a metric that evaluates depth, relevance, clarity, emotional tone and overall value of a response), we quantified the quality of the open-ends from both groups. 

Thoughtfulness Score (out of 10)

  • 3.69
    Traditional
    Open Ends
  • 4.95
    Rival
    open-ends
  • 6.21
    Rival text open-ends
    with AI probing 
  • 6.70
    Rival video
    responses 

A better experience — for everyone

When it comes to the participant experience, conversational research won among all age groups. This is not just a “Gen Z thing” — it’s the new way of reaching modern consumers. 

Not just a Gen Z thing

People from across all age groups agree conversational research is better.
Engaging
0%
Traditional
0%
Chat-based
Enjoyable
0%
Traditional
0%
Chat-based
Easy
0%
Traditional
0%
Chat-based

What about quant? 

Single- and multi-select questions were remarkably consistent across both methods. The data points showed small, statistically insignificant differences, suggesting that a conversational format does not distort core measures. It preserves data integrity while providing a better respondent experience (and richer outputs).

quant

What do participants think?

Testimonial Quotes

“I like it and it’s not like I’m just filling out a quiz in the back of a school classroom. It’s like I’m actually having a conversation.” 

– US, 18–24, She/her

Testimonial Quotes

“It felt like just a regular text conversation. That made me feel more invested in it and I felt comfortable, like I was texting a friend.”

– Canada, 25-34, She/her, Facebook

Testimonial Quotes

“It feels more like a conversation.  Questions pop up more quickly than having to wait for the page to change, and the format of the questions does not change.”

– US, 45–54, He/him

Get deeper insights faster.

Discover how why mobile-first, conversational approach is the modern way of engaging consumers and the fastest way to getting high-quality insights.