Australia Blog
News and rising stars from YouTube Australia
Look Inside a 1,024 Recipe Multivariate Experiment
Friday, 14 August 2009
Do small changes make a big difference? In the world of landing page testing, they certainly can. A few weeks ago, we ran one of the largest multivariate experiments ever: a 1,024 recipe experiment on 100% of our US-English homepage. Utilizing
Google Website Optimizer
, we made small changes to three sections on our homepage (see below), with the goal of increasing the number of people who signed up for an account. The results were impressive: the new page performed
15.7% better
than the original, resulting in thousands more sign-ups and personalized views to the homepage every day.
Below is a screenshot of the homepage before the test and the three sections we focused on:
And here are examples of various fonts, messages, and colors we tested:
Section 1:
(The words "Sign Up" were put in all caps)
Section 2:
(We placed these bubble messages to the left of the word "Sign Up")
Section 3:
(We experimented with these different banners in that area)
Can you guess which combination of elements performed the best?
(humming "Jeopardy" music)
If you guessed the Original "Sign Up" Font (section 1) + Red Bubble "Sign Up" (section 2) + White "Don't Just Watch, Participate" box (section 3), you win!
Winning Page:
While we could have hypothesized which elements result in greater conversions (for example, the color red is more eye-catching), multivariate testing reveals and proves the combinatorial impact of different configurations. Running tests like this also help guide our design process: instead of relying on our own ideas and intuition, you have a big part in steering us in the right direction. In fact, we plan on incorporating many of these elements in future evolutions of our homepage.
Curtis Lee, Product Marketing Manager, recently watched
"KFC Freestyle Delonte West."
P.S. If you need assistance running tests on your website, there are many Google Website Optimizer
authorized consultants
who can help. Special thanks to
VKI Studios
who assisted on ours.
Labels
accessibility
2
australia
3
birthday
2
captioning
1
channels
1
citizen reporting
1
comments
1
competition
6
cooking
1
creativity
6
creators
1
design
2
fashion
1
festival
1
fitness
1
frontrow
1
google+
1
homepage
1
howto
1
improvements
1
IPL
4
journalism
1
life in a day
3
live
3
livestreaming
2
mapmysummer
1
music
12
music moderator katy perry
1
musicians wanted
1
nextup
1
nonprofit
1
partner program
1
playlists
1
product update
4
promoted videos
1
ratings
1
safety
2
SBS sport cycling
1
science and technology
2
sessions
2
sport
2
summer
6
sydney
1
symphony
8
tropfest
1
updates
1
vidcon
1
vivid
1
vlogger
1
your film festival
1
YouTube
24
YouTube Australia Blog
255
YouTube insights
2
youtube music
2
YouTube Partners
2
YouTube Partnerships
2
Archive
2014
January
YouTube Nation: Discover Something Great, Every Day
2013
May
March
2012
December
November
October
September
August
July
June
May
April
March
February
January
2011
December
November
October
September
August
July
June
May
April
March
February
January
2010
December
November
October
August
July
June
May
April
March
February
January
2009
December
November
October
September
August
July
June
May
April
March
February
January
2008
December
November
October
September
August
July
June
May
April
March
February
January
2007
December
November
Feed
YouTube
on
Follow @youtube
Follow
Learn more in the
YouTube Help Center
.