Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors

Trained But Not Changed: How a Logistics Company Used Market Research and IDIs to Find Out Whether Its VR Safety Programme Was Actually Altering Behaviour on the Warehouse Floor

Trained But Not Changed: How a Logistics Company Used Market Research and IDIs to Find Out Whether Its VR Safety Programme Was Actually Altering Behaviour on the Warehouse Floor

Executive Snapshot

Client

Third-Party Logistics Operator, Netherlands & Belgium

Situation/Challenge

The client had deployed a virtual reality safety training programme across six warehouse sites, driven by a specific target to reduce forklift-related near-miss incidents. Twelve months on, completion rates were high and post-training assessment scores were strong, but near-miss incident data had not moved in the expected direction. The safety team was confident the training was working but could not explain the incident data.

Objective

Commission a market research report benchmarking immersive training outcomes across comparable logistics operations, then conduct structured IDIs with warehouse operatives who had completed the VR programme to understand what they actually remembered and applied from it.

Constancy Researchers Solution

Market Research Reports combined with Primary Research & VoC through In-Depth Interviews (IDIs), a Global Immersive Training Effectiveness Market Report benchmarking behaviour change outcomes, paired with 30 IDIs with warehouse operatives across three sites.

Impact

Market research showed that training completion rates and assessment scores are poor proxies for behavioural change in high-task-pressure environments. IDIs revealed operatives remembered the VR scenarios vividly but described specific site layout and operational pressure factors that made applying the training's guidance feel impractical in their actual day-to-day context.

Client Outcome

The client redesigned two training scenarios to reflect the actual site layouts and operational pressures of its warehouses, and supplemented VR training with short in-situ coaching sessions in the live environment, after which near-miss incident data showed a measurable decline across four of the six sites within three months.

The Situation / Challenge

Virtual reality safety training has a well-documented ability to improve knowledge retention compared to classroom-based alternatives, because the immersive format creates an emotional engagement and spatial memory that slides and safety videos do not. What it shares with most training formats, however, is a vulnerability to the transfer gap, the often large distance between what an operative learns in a training environment and what they actually do when back in a fast-moving, pressure-filled operational context.

The client’s safety leadership had invested in the VR programme with a specific outcome in mind, a measurable reduction in forklift-related near-miss incidents. The completion rates and knowledge assessment results looked excellent.

Without direct evidence from the operatives who had completed the training about what they actually retained and what they found applicable in their real working context, the company risked continuing a programme that was performing well by the metrics it was measuring while missing the metric that actually mattered.

Key Challenges

  • No market benchmarking establishing whether completion rates and assessment scores were reliable predictors of behaviour change in high-pressure logistics environments.
  • No direct feedback from trained operatives about what they retained from the VR scenarios and which elements they found applicable in their real working context.
  • Incident data not moving in the expected direction despite strong training completion and assessment outcomes.
  • A safety team attributing the gap to implementation issues rather than examining whether the training content matched the real operational environment.
  • No structured way to distinguish between a training design problem and a site-level implementation problem.
  • Leadership pressure to demonstrate measurable safety improvement from the VR investment before the annual safety audit.

Training completion rates and post-session assessment scores measure what people knew immediately after a training session, not what they do six weeks later in a busy warehouse. Understanding the transfer gap between training memory and operational behaviour requires asking the people who did the training what they actually remember and what gets in the way of applying it.

Constancy Researchers Solution

Constancy Researchers paired market benchmarking of immersive training outcomes with direct IDIs among warehouse operatives who had completed the VR programme, checking both whether the client’s results were typical and what the specific transfer barriers were in its own operational context.

Global Immersive Training Effectiveness Market Report
  • Delivered a market research report benchmarking immersive training effectiveness across comparable logistics, manufacturing, and warehouse environments, examining the relationship between completion.
  • Found that in high-task-pressure environments, training completion rates and assessment scores showed limited correlation with measured behaviour change, particularly when training.
In-Depth Interviews (IDIs) with Trained Warehouse Operatives
  • Conducted 30 structured IDIs with warehouse operatives across three sites who had completed the VR safety programme, exploring what they remembered.
  • Found that operatives described the VR scenarios vividly, but consistently identified a disconnect between the generic warehouse layout in the training and their actual site conditions.
Operational Context Transfer Barrier Analysis
  • Analysed the site layout and operational pressure factors operatives described as barriers, mapping these against the VR scenario content to find where training guidance diverged from real conditions.
  • Identified two scenario types, intersection approach procedure and pedestrian zone priority, where the divergence between training guidance and actual site conditions.
Training Content Redesign Recommendations
  • Recommended redesigning the two scenario types to incorporate the actual spatial layouts, pedestrian flow patterns, and time pressure conditions of the client’s own warehouses.
  • Recommended supplementing the VR programme with short in-situ coaching sessions in the live warehouse, reinforcing training guidance in the actual physical context where it needed to apply.
Outcome Measurement Framework Redesign
  • Identified that the existing outcome measurement framework tracked completion and assessment scores but not observed behaviour change, and built a behavioural.
  • Delivered a revised measurement framework tracking near-miss incident rates by site alongside direct supervisor observation data, giving the safety team leading.

The engagement gave the safety team what twelve months of completion data had not, a concrete explanation of the transfer gap and a specific set of content and context changes designed to close it.

Impact

  • Market benchmarking confirmed completion rates and assessment scores were poor proxies for behaviour change in high-pressure
  • Operative IDIs identified a persistent disconnect between the VR scenario geometry and the actual layout of
  • Two specific scenario types were identified where training-to-reality divergence was large enough to create behavioural uncertainty
  • Both scenario types were redesigned with site-specific layouts, pedestrian flow patterns, and operational pressure conditions.
  • In-situ coaching sessions were introduced to reinforce VR training guidance in the live warehouse environment.
  • A supervisor behavioural observation checklist was introduced as a leading indicator alongside lagging incident counts.
  • Near-miss incident data showed a measurable decline across four of the six sites within three months
  • The safety team gained a transfer gap diagnostic framework applicable to future training programme design.

Client Outcome

Incident Reduction

Near-miss incident data showed a measurable decline across four of the six sites within.

Transfer Gap Closed

Redesigned scenario content replaced generic warehouse geometry with site-specific layouts, closing the disconnect operatives.

In-Situ Reinforcement

Short coaching sessions in the live warehouse environment supplemented VR training with contextual reinforcement.

Measurement Upgrade

Supervisor behavioural observation checklists added a leading indicator of behaviour change alongside the lagging.

Metric Clarity

The team gained an understanding of why completion rates and assessment scores had not.

Operative Insight

Direct feedback from trained operatives gave safety leadership the specific operational context barriers that no post-session survey had surfaced.

Benchmark Context

Market benchmarking confirmed the transfer gap challenge was typical for high-pressure logistics environments rather than a sign of programme failure unique to the client.

Diagnostic Capability

The transfer gap diagnostic approach was retained as a framework for evaluating future training programme design before deployment.

Market Positioning

The logistics operator was repositioned as a safety training investor that measures behaviour change rather than training completion.

Looking to unlock new growth opportunities with data-driven insights?

Connect Now

Case Studies

Learn how our success stories power data-driven growth across industries

Speak with an Analyst

    Download TOC

      Request a Sample Report