Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors

Watched but Not Convinced: How a B2B SaaS Company Used IDIs and Video Analytics to Find Out Why Its Animated Explainer Videos Were Getting Views but Not Driving Trial Sign-Ups

Watched but Not Convinced: How a B2B SaaS Company Used IDIs and Video Analytics to Find Out Why Its Animated Explainer Videos Were Getting Views but Not Driving Trial Sign-Ups

Executive Snapshot

Client

B2B SaaS Platform Provider, United Kingdom

Situation/Challenge

The client had invested in a series of animated explainer videos produced by a specialist marketing animation agency, placing them on its product pages, LinkedIn, and in outbound sales email sequences. The videos were generating strong view counts and above-average watch-through rates. Trial sign-ups from pages featuring the videos, however, were not materially better than from the same pages before the videos were added. The marketing team disagreed about whether this was a targeting problem, a message problem, or a video production problem, and the agency was confident the creative was strong.

Objective

Conduct structured IDIs with prospective buyers who had watched the videos but had not signed up for a trial, paired with video engagement analytics examining drop-off points, replay behaviour, and click-through patterns across each video in the series.

Constancy Researchers Solution

Primary Research & VoC through In-Depth Interviews (IDIs) combined with Data Analytics & Business Intelligence, 33 IDIs with prospective B2B buyers who had watched at least one video but had not converted to trial, paired with analytics examining drop-off, replay, and post-video click behaviour across the full video series.

Impact

IDIs revealed that prospective buyers found the videos visually engaging but described them as explaining what the product did without helping them understand whether it applied to their specific workflow context. Analytics confirmed that the highest replay and drop-off activity concentrated around the forty-second mark in two videos, where the product demonstration shifted from a generic use case to a specific one that many viewers did not recognise as relevant to their own situation.

Client Outcome

The agency was briefed to produce a segmented video series with industry-specific use case demonstrations replacing the generic workflow, and trial conversion from video-adjacent pages improved measurably within two campaign cycles.

The Situation / Challenge

A high watch-through rate on an explainer video is a promising signal but not a conversion guarantee. It tells you that the video held attention long enough for the viewer to reach the end.

The client’s marketing team had been reading the watch-through data as evidence of creative quality and assuming the conversion gap was a targeting or call-to-action problem. The production agency was naturally reluctant to accept that the creative itself might be part of the issue.

The further complication was that the client served five distinct industry verticals, and the animated videos had been produced with a generic workflow demonstration that was designed to be broadly applicable. Nobody had tested whether broadly applicable was actually the same as personally relevant when a procurement manager in healthcare logistics was watching the same video as a finance director in professional services.

Key Challenges

  • No direct research into what prospective buyers were thinking while watching the videos and why they did not convert to trial.
  • No video engagement analytics examining where viewers were dropping off, replaying, or abandoning before the call to action.
  • A marketing team attributing the conversion gap to targeting and call-to-action issues without evidence to rule out a content relevance problem.
  • Generic workflow demonstrations that had not been tested for relevance across the client’s five industry verticals.
  • A production agency confident in creative quality without independent viewer research to validate that confidence.
  • Marketing leadership pressure to improve trial conversion before the next campaign budget committed to further video production.

A B2B explainer video that explains a product without making the viewer feel that the product explains their situation is doing only half the job. Broad applicability and personal relevance are not the same thing, and a viewer who finishes a video knowing what a product does but unsure whether it fits their world is not closer to a trial sign-up than before they started watching.

Constancy Researchers Solution

Constancy Researchers ran the IDIs and the analytics workstream simultaneously rather than in sequence, using early IDI findings to sharpen the hypotheses the analytics were testing and early analytics patterns to focus the IDI questioning on the specific moments in each video that the data was flagging as friction points.

In-Depth Interviews (IDIs) with Prospective Buyers Who Watched but Did Not Convert
  • Conducted 33 structured IDIs with prospective B2B buyers who had watched at least one video but had not started a trial, recruited across all five verticals, what they understood about the product after watching, and what information would have moved them toward a trial.
  • Found that buyers across verticals described the videos as clear and professional but consistently said the workflow shown did not look like theirs, and they had been left uncertain whether the product was designed for companies like them or for a different type of operation entirely.
Video Drop-Off & Replay Analytics
  • Analysed view completion, drop-off, and replay behaviour across all videos in the series at five-second interval resolution.
  • Found that drop-off and replay activity concentrated most heavily around the forty-second point in two of the three main videos.
Industry Vertical Relevance Gap Analysis
  • Cross-tabulated IDI findings and drop-off data by vertical to identify whether the relevance gap was uniform or concentrated.
  • Found that healthcare and public sector viewers showed the largest relevance disconnect.
Segmented Video Brief Development
  • Developed a creative brief for a segmented series replacing the generic demonstration with industry-specific use cases for the three highest-volume verticals, incorporating the specific workflow language, compliance context, and outcome framing that IDI participants in each vertical had described as what they needed to see before a trial felt relevant.
  • Specified that each segmented video maintain the same production quality and format as the existing series to preserve creative consistency, while replacing only the use case content layer.
Post-Video Journey Optimisation
  • Analysed click behaviour in the ten seconds following video completion.

The engagement gave the marketing team a specific content change and a post-video page optimisation, rather than a choice between blaming the targeting, the call to action, or the agency.

Impact

  • IDIs confirmed the relevance gap was the primary conversion barrier, with buyers finding the generic workflow demonstration unrecognisable as their own.
  • Analytics identified the forty-second workflow transition as the precise moment where drop-off and replay activity concentrated most heavily.
  • Healthcare and public sector verticals showed the largest relevance disconnect, with professional services showing the smallest.
  • Post-video click analysis revealed that non-converters were seeking vertical-specific social proof that the page journey was not providing.
  • A segmented video brief was developed for the three highest-volume verticals with industry-specific use case demonstrations.
  • Post-video pages were updated to surface vertical-relevant case studies aligned to each segmented video.
  • The segmented video series was produced and deployed by the existing agency within the established visual production framework.
  • Trial conversion from video-adjacent pages improved measurably within two campaign cycles of the segmented series going live.

Client Outcome

Conversion Improvement

Trial conversion from video-adjacent pages improved measurably within two campaign cycles of the segmented series being deployed.

Root Cause Identified

The relevance gap, not targeting or call-to-action design, was confirmed as the primary conversion barrier through IDI evidence.

Segmented Video Series

Industry-specific use case demonstrations for the three highest-volume verticals replaced the single generic workflow demonstration.

Friction Point Resolved

The forty-second workflow transition, identified as the primary drop-off and replay moment, was redesigned with vertical-specific content.

Social Proof Pathway

Post-video page journeys were updated to surface vertical-relevant case studies for non-converting viewers seeking industry-specific proof.

Agency Brief Sharpened

The production agency received a specific segmentation brief informed by IDI findings rather than a vague request to make the videos more relevant.

Vertical Prioritisation

Healthcare, public sector, and the highest-volume third vertical were prioritised for segmented production, maximising conversion impact per production investment.

Internal Alignment

The marketing team and production agency aligned around a shared, evidence-based diagnosis rather than continuing to advocate their respective positions.

Market Positioning

The company was repositioned as a B2B marketer that validates animated content against viewer decision behaviour rather than equating watch-through rates with message effectiveness.

Looking to unlock new growth opportunities with data-driven insights?

Connect Now

Case Studies

Learn how our success stories power data-driven growth across industries

Speak with an Analyst

    Download TOC

      Request a Sample Report