SlideShare a Scribd company logo
#Searchlove @Chrisdayley
Powerful A/B
Testing User
Insights
dayleyconversion.com
/searchlove
#Searchlove @Chrisdayley
So What?
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
What to
do?
#Searchlove @Chrisdayley
2013 Non-Keyword Ranking Factors
2015 Non-Keyword Ranking Factors
Chris Dayley Searchlove Boston - Powerful A/B Testing User Insights
#Searchlove @Chrisdayley
“Not my problem,
my designers
just suck”
Designers
#Searchlove @Chrisdayley
Onsite metrics can no
longer be considered
“SOMEONE ELSE’S
PROBLEM”
Bad or even mediocre design
is becoming less & less tolerable.
#Searchlove @Chrisdayley
Wasting Traffic?
#Searchlove @Chrisdayley
So do you need
to start doing
CRO now?
#Searchlove @Chrisdayley
1
Gain Insights
About Your
Audience
2
Move the
Needle
3
Easy Content
Test
4
Test
Results
#Searchlove @Chrisdayley
Gaining Insights
About Your
Audience
#Searchlove @Chrisdayley
Getting analytical
#Searchlove @Chrisdayley
Focus groups
User recording
sessions
User testing
feedback
Eye-tracking
sessions
Polls / surveys
Heatmaps
Analytics
#Searchlove @Chrisdayley
Surveys & Polls
#Searchlove @Chrisdayley
For User
Experience
It`s a load-o-crap
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
http://hbs.me/1QleHnI
90-95% of purchase
decisions occur in
the subconscious
mind
Surveys & polls
get the
rationalization
out of people
#Searchlove @Chrisdayley
Focus
groups?
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
http://bit.ly/1qD4oX2
#Searchlove @Chrisdayley
The Hawthorne Effect:
People behave
differently because
they are
being observed
WASTE OF
TIME!!
Focus groups
Polls
Surveys
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
85%15%
#Searchlove @Chrisdayley
$$ & time
#Searchlove @Chrisdayley
User recording
sessions
User Testing
Feedback
Eye-tracking
sessions
Heatmaps
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
Where are
people clicking?
How far are
people scrolling?
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
Bookings
+31%
Moving the
Needle
#Searchlove @Chrisdayley
Bounce rates are only bad
for certain pages.
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
Bad Bounce
Rates
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
Bounce Rates
48%
Product Views
410%
#Searchlove @Chrisdayley
Don’t overload users with content
#Searchlove @Chrisdayley
#Searchlove @Chrisdayley
Content & UX should
be given equal
planning time.
#Searchlove @Chrisdayley
Big
Changes
=
Big
Impact
#Searchlove @Chrisdayley
Minor changes
#Searchlove @Chrisdayley
Who do you optimize for?
#Searchlove @Chrisdayley
@chrisdayley
@chrisdayley
@chrisdayley
8.1%
Funnel Entrance
#Searchlove @Chrisdayley
Failed tests are equally as
important as successful tests.
You just learned what your
audience doesn't like.
#Searchlove @Chrisdayley
@chrisdayley
8.1%
Funnel Entrance
72%
@chrisdayley
12.3%
Funnel Entrance
@chrisdayley
Content Test
#Searchlove @Chrisdayley
How much content
does the audience
want from an article?
#Searchlove @Chrisdayley
Is it different on mobile & desktop?
#Searchlove @Chrisdayley
=
?
Tools
#Searchlove @Chrisdayley
3 Variations:
Short (< 500 words)
Medium (500-1,000 words)
Long (>1,000 words)
#Searchlove @Chrisdayley
64.9%
1750 Words1055 Words542 Words
76.7%45.5%
TOP
1:30
TOP
3:49
TOP
4:47
#Searchlove @Chrisdayley
542 Words 1055 Words 1750 Words
76.9% 62.2% 44.4%
TOP
3:36
TOP
4:37
TOP
2:01
#Searchlove @Chrisdayley
Mobile Winner
83.1%
Desktop Winner
DONATIONS
28.4%
DONATIONS
Test Results
#Searchlove @Chrisdayley
Original V1
V2 V3
146.2%
-46.6%
Form Completion
V3 – Winner!
#Searchlove @Chrisdayley
So What?
#Searchlove @Chrisdayley

More Related Content

Chris Dayley Searchlove Boston - Powerful A/B Testing User Insights