Twitter
Facebook
Linked In
RSS
Login or Register
New to InternetRetailing?
Register Now
Internet Retailing
You are in: > Home > Themes

This is your 1 complimentary article for this month

Become a member for unlimited and immediate access.


Register
Already a member? Log in here

WEBINAR OVERVIEW How to create your retail A/B testing framework in 30 minutes

Linked InTwitterFacebookeCard
Stephen Pavlovich and Kyle Hearnshaw of Conversion.com led the webinar
Stephen Pavlovich and Kyle Hearnshaw of Conversion.com led the webinar
Sharelines

WEBINAR OVERVIEW How to create your retail A/B testing framework in 30 minutes

Conversion.com’s Stephen Pavlovich (founder and chief executive) and Kyle Hearnshaw (head of conversion strategy) joined InternetRetailing for a recent webinar, How to create your retail A/B testing framework in 30 minutes. Here’s a bulletpoint overview of what they covered.

 

Stephen Pavlovich, chief executive of conversion.com, opened the webinar with an introduction to the company, and by explaining how having a framework for testing means companies are more likely to be testing strategically and not tactically. “When you do so the value of your testing increases over time,” he said. “The more experiments you run the more insights you get and the more impact on your programme.”

 

Four ways to find out if you’re testing tactically or strategically

  1. What do you focus on? Where does each experiment start? Start with the solution? Probably thinking tactically. Start by thinking about the problem? Eg how do we increase our returns rate? Thinking strategically.
  2. Where do experiment ideas come from? Tactical: best practice, competitor research , heuristics. Strategic: data and insight approach to testing.
  3. How do you plan your experiments? Short term or long term?
  4. How do other teams manage experimentation? In a tactical world, all teams have own approach. Not much data being shared. Often convoluted. Strategic approach: common framework or approach – even if areas focused on are different.

 

How to create a retail A/B framework in 30 mins or less

  1. Define goals and KPIs: important to set clear experimentation goals.
  2. Sketch KPI tree to show what matters: what we can influence. Two or three is plenty. Tips include: focus on binomial metrics (that can be expressed as a %) and have a primary metric and a guardrail metric.
  3. Audiences and areas: Kyle Hearnshaw, head of conversion strategy, then went on to address how the make up of audience and the areas we cover affect conversion rates. It’s important to know who you’re trying to influence. Take five minutes to map audiences: ask questions to find which audience should look at. eg. Which are converting the least, have best/worse conversion rates? These might include segments such as devices and product interest. For each, identify high opportunity areas. Look across the whole customer lifecycle. Mapping the experience, working out how to affect KPIs.
  4. Levers: previous research/data can suggest what conversion levers should be: barriers and motivations. Looking for evidence of levers to then go on and validate. List potential levers – and refine it. Validate quickly through a minimum viable experiment. Iterative approach to testing rapidly redefines our set of levers: “we started off with a list of 8 to 10 and want to get down to the ones that show the most value.”
  5. This completes the core framework (downloadable printable available through the webinar). To do more: run new research to gather more evidence for levers; run ideation sessions to refine minimum viable experiments.

The webinar finished with a lively Q&A session.

 

Click here to find out more about our upcoming and previous webinars.

 

 

 

 

Linked InTwitterFacebookeCard
Add New Comment
You must be logged in to comment.

The InternetRetailing Newsletter

A curated update containing news analysis, reports, podcasts and opinion - completely free and delivered three times weekly

Become a Member

Create your own public-facing profile
Gain access to all Top500 research
Personalise your experience on IR.net
Internet Retailing
We are the magazine, portal and research source for European ecommerce and multichannel retail, hosting the board-level conversation for retailers, pureplays and brands across all of our platforms. Join the conversation.

© InternetRetailing Media

Latest Tweet

Internet Retailing
Tamebay
eDelivery
Twitter
Facebook
Linked In
Youtube
RSS
RSS
Youtube
Google
Linked In
Facebook
Twitter