Australia Blog
News and rising stars from YouTube Australia
Automatic Captions in YouTube
Friday, 20 November 2009
Accessibility of online video is an important challenge that Google and YouTube are committed to. Our US colleagues have announced exciting advances in captioning on YouTube and it's great to see the University of New South Wales is a partner for the initial roll-out of this new feature.
Ishtar Vij, Policy Team, Google Australia & New Zealand
The rest of this blog is cross-posted from the
Official Google Blog
Since we first
announced captions
in Google Video and YouTube, we've introduced multiple caption tracks, improved search functionality and even automatic translation. Each of these features has had great personal significance to me, not only because I helped to design them, but also because I'm deaf. Today, I'm in Washington, D.C. to announce what I consider the most important and exciting milestone yet: machine-generated automatic captions.
Since the original launch of captions in our products, we’ve been happy to see growth in the number of captioned videos on our services, which now number in the hundreds of thousands. This suggests that more and more people are becoming aware of how useful captions can be. As we’ve explained in the past, captions not only help the deaf and hearing impaired, but with
machine translation
, they also enable people around the world to access video content in any of 51 languages. Captions can also
improve search
and even enable users to jump to the exact parts of the videos they're looking for.
However, like everything YouTube does, captions face a tremendous challenge of scale. Every minute, 20 hours of video are uploaded. How can we expect every video owner to spend the time and effort necessary to add captions to their videos? Even with all of the captioning support already available on YouTube, the majority of user-generated video content online is still inaccessible to people like me.
To help address this challenge, we've combined Google's automatic speech recognition (ASR) technology with the YouTube caption system to offer automatic captions, or auto-caps for short. Auto-caps use the same voice recognition algorithms in
Google Voice
to automatically generate captions for video. The captions will not always be perfect (check out the video below for an amusing example), but even when they're off, they can still be helpful—and the technology will continue to improve with time.
In addition to automatic captions, we’re also launching automatic caption timing, or auto-timing, to make it significantly easier to create captions manually. With auto-timing, you no longer need to have special expertise to create your own captions in YouTube. All you need to do is create a simple text file with all the words in the video and we’ll use Google’s ASR technology to figure out when the words are spoken and create captions for your video. This should significantly lower the barriers for video owners who want to add captions, but who don’t have the time or resources to create professional caption tracks.
To learn more about how to use auto-caps and auto-timing, check out this short video and our
help center article
:
You should see both features available in English by the end of the week. For our initial launch, auto-caps are only visible on a handful of partner channels (list below*). Because auto-caps are not perfect, we want to make sure we get feedback from both viewers and video owners before we roll them out more broadly. Auto-timing, on the other hand, is rolling out globally for all English-language videos on YouTube. We hope to expand these features for other channels and languages in the future. Please send us your
feedback
to help make that happen.
Today I'm more hopeful than ever that we'll achieve our long-term goal of making videos universally accessible. Even with its flaws, I see the addition of automatic captioning as a huge step forward.
*
Partners for the initial launch of auto-caps:
UC Berkeley
,
Stanford
,
MIT
,
Yale
,
UCLA
,
Duke
,
UCTV
,
Columbia
,
PBS
,
National Geographic
,
Demand Media
,
UNSW
and most
Google
&
YouTube
channels.
Posted by Ken Harrenstien, Software Engineer
Labels
accessibility
2
australia
3
birthday
2
captioning
1
channels
1
citizen reporting
1
comments
1
competition
6
cooking
1
creativity
6
creators
1
design
2
fashion
1
festival
1
fitness
1
frontrow
1
google+
1
homepage
1
howto
1
improvements
1
IPL
4
journalism
1
life in a day
3
live
3
livestreaming
2
mapmysummer
1
music
12
music moderator katy perry
1
musicians wanted
1
nextup
1
nonprofit
1
partner program
1
playlists
1
product update
4
promoted videos
1
ratings
1
safety
2
SBS sport cycling
1
science and technology
2
sessions
2
sport
2
summer
6
sydney
1
symphony
8
tropfest
1
updates
1
vidcon
1
vivid
1
vlogger
1
your film festival
1
YouTube
24
YouTube Australia Blog
255
YouTube insights
2
youtube music
2
YouTube Partners
2
YouTube Partnerships
2
Archive
2014
January
2013
May
March
2012
December
November
October
September
August
July
June
May
April
March
February
January
2011
December
November
October
September
August
July
June
May
April
March
February
January
2010
December
November
October
August
July
June
May
April
March
February
January
2009
December
November
Automatic Captions in YouTube
How We Think About Social
1080p HD Is Coming to YouTube
October
September
August
July
June
May
April
March
February
January
2008
December
November
October
September
August
July
June
May
April
March
February
January
2007
December
November
Feed
YouTube
on
Follow @youtube
Follow
Learn more in the
YouTube Help Center
.