Captions
Captions (also known as Subtitles when they are used to transcribe one language into another), are visual, textual cues for the hearing impaired, or to supplement fuzzy, unclear or non-standard slang language. The text is usually timed to the speech, conversation, musical performance or other audio track. [1]
Contents
Specifications
Several formats exist for Closed Captioning and are listed below.
W3C
- W3C -- WAI guidelines - Captions/Subtitles: https://www.w3.org/WAI/media/av/captions/
WebVTT
The main use of Web Video Text Tracks (WebVTT) format is for marking up external text track resources in connection with the HTML5 <track> element. WebVTT files provide captions or subtitles for video content, and also text video descriptions as specified in Media Accessibility User Requirements (MAUR)[2], chapters for content navigation, and more generally any form of metadata that is time-aligned with audio or video content.
Example:
WEBVTT Region: id=fred width=40% lines=3 regionanchor=0%,100% viewportanchor=10%,90% scroll=up Region: id=bill width=40% lines=3 regionanchor=100%,100% viewportanchor=90%,90% scroll=up 00:00:00.000 --> 00:00:20.000 region:fred align:left <v Fred>Hi, my name is Fred 00:00:02.500 --> 00:00:22.500 region:bill align:right <v Bill>Hi, I'm Bill 00:00:05.000 --> 00:00:25.000 region:fred align:left <v Fred>Would you like to get a coffee? 00:00:07.500 --> 00:00:27.500 region:bill align:right <v Bill>Sure! I've only had one today. 00:00:10.000 --> 00:00:30.000 region:fred align:left <v Fred>This is my fourth! 00:00:12.500 --> 00:00:32.500 region:fred align:left <v Fred>OK, let's go.
The above example shows two regions containing rollup captions for two different speakers. Fred's cues scroll up in a region in the left half of the video, Bill's cues scroll up in a region on the right half of the video. Fred's first cue disappears at 12.5sec even though it is defined until 20sec because its region is limited to 3 lines and at 12.5sec a fourth cue appears.
- WebVTT - The Web Video Text Tracks Format: http://dev.w3.org/html5/webvtt/ (final HTML5 spec for Subtitles/Captions... replacing SRT, TTXT, TTML, DFXP, STMPE and other legacy Subtitle/Caption formats)
- WebVTT validator: http://quuz.org/webvtt/
- WebVTT (on MDN): https://developer.mozilla.org/en-US/docs/Web/API/Web_Video_Text_Tracks_Format
- HTML5 Video Subtitling and WebVTT: http://html5doctor.com/video-subtitling-and-webvtt/
- HTML5 Video with SRT Subtitles (via JavaScript): http://www.storiesinflight.com/js_videosub/
- HTML5 Video player with DXFP 1.0 support DEMO:
- TTXT Format Documentation: http://gpac.wp.mines-telecom.fr/mp4box/ttxt-format-documentation/
- TTML 2.0: https://dvcs.w3.org/hg/ttml/raw-file/default/ttml2/spec/ttml2.html
- TextTrackList: https://developer.mozilla.org/en-US/docs/Web/API/TextTrackList
- HTMLMediaElement.textTracks: https://developer.mozilla.org/en-US/docs/Web/API/HTMLMediaElement/textTracks
Timed-Text standard
The original standard for cueing a piece of multimedia's accompanying text on a timeline.
- W3C Timed-Text (TT) Format: http://www.w3.org/AudioVideo/TT (commonly used for web Media Players and Web Applications)
Example:
<tt xmlns="http://www.w3.org/2006/10/ttaf1"> <body> <div xml:id="captions"> <p begin="00:08" end="00:10">- Nothing is going on.</p> <p begin="00:10" end="00:12.5">You liar!</p> <p begin="00:13" end="00:15">Are you?</p> <p begin="00:17" end="00:20">Violet, please!<br/>- I am not your babe!</p> <p begin="00:24" end="00:29">You stupid cow,<br/>look what you gone and done now, ay.</p> <p begin="00:34" end="00:36">Vi, please.<br/>- Leave me alone!</p> <p begin="00:36" end="00:38.5">- We need to talk.<br/>- Jason, are you deaf?!</p> <p begin="00:41" end="00:43">What's going on?</p> <p begin="00:43" end="00:45">Get out there and try to salvage this!</p> </div> </body> </tt>
DFXP
Distribution Format Exchange Profile (DFXP), an adopted standard which was combined with Timed-Text to create a final standard for Closed Captioning on the World Wide Web.
- W3C Timed-Text (TT) DFXP Specification: http://www.w3.org/TR/ttaf1-dfxp
Example:
<body region="subtitleArea"> <div> <p xml:id="subtitle1" begin="0.76s" end="3.45s"> It seems a paradox, does it not, </p> <p xml:id="subtitle2" begin="5.0s" end="10.0s"> that the image formed on<br/> the Retina should be inverted? </p> <p xml:id="subtitle3" begin="10.0s" end="16.0s" style="s2"> It is puzzling, why is it<br/> we do not see things upside-down? </p> <p xml:id="subtitle4" begin="17.2s" end="23.0s"> You have never heard the Theory,<br/> then, that the Brain also is inverted? </p> <p xml:id="subtitle5" begin="23.0s" end="27.0s" style="s2"> No indeed! What a beautiful fact! </p> <p xml:id="subtitle6a" begin="28.0s" end="34.6s" style="s2Left"> But how is it proved? </p> <p xml:id="subtitle6b" begin="28.0s" end="34.6s" style="s1Right"> Thus: what we call </p> <p xml:id="subtitle7" begin="34.6s" end="45.0s" style="s1Right"> the vertex of the Brain<br/> is really its base </p> <p xml:id="subtitle8" begin="45.0s" end="52.0s" style="s1Right"> and what we call its base<br/> is really its vertex, </p> <p xml:id="subtitle9a" begin="53.5s" end="58.7s"> it is simply a question of nomenclature. </p> <p xml:id="subtitle9b" begin="53.5s" end="58.7s" style="s2"> How truly delightful! </p> </div> </body>
SRT
- SRT (SubRip) Subtitles: http://srt-subtitles.com/ (commonly used for DVD players and Desktop Applications)
Example:
1 00:02:17,440 --> 00:02:20,375 Senator, we're making our final approach into Coruscant. 2 00:02:20,476 --> 00:02:22,501 Very good, Lieutenant.
Discussion
- Controlling of Captioning (Sub-titling): http://www.jeroenwijering.com/?thread=8218
- Captions forms: http://www.jeroenwijering.com/?thread=5728
- Captions in XSPF playlist: http://www.jeroenwijering.com/?thread=10153
- JW Media Player discussion on Captions (Subtitle Exporter): http://www.jeroenwijering.com/?thread=10888
- JW Media Player discussion on Captions (Live Captioning): http://www.jeroenwijering.com/?thread=10870
- JW Media Player discussion on Captions (Playlists): http://www.jeroenwijering.com/?thread=9819
- JW Media Player discussion on Captions (Linked Playlists Example): http://www.jeroenwijering.com/?thread=9885
- JW Media Player discussion on Captions (XML TT Captions old format DFXP conversion to latest W3C TT): http://www.jeroenwijering.com/?thread=8830
EXAMPLES
- Multilingual Sub-titles (JW player Captions for subtitling): http://tools.webmasterei.com/test
- Multi-lingual Sub-title (using captions) maker: http://tools.webmasterei.com/subtitlemaker/
- In-Depth Look At YouTube Closed Captions, SEO and YouTube Indexing:
- ANNOTATION (captions underneath player) from Wes Andersen's great JW Media player example gallery: http://home5.inet.tele.dk/nyboe/flash/mediaplayer/annotationdisplay.htm
Tools
- SubRip - automatically extract approximated subtitles from your DVDs (tries to copy physical text from the screen, so videos must have subtitles already): http://zuggy.wz.cz/ [4]
- DXFP 1.0 Test Suite: http://www.w3.org/2008/12/dfxp-testsuite/web-framework/START.html (has examples/unit tests for Adobe Flash (default) Media Player, JW Player 4.x, HTML5 Player, NCAM Player 3.x)
- Microsoft Stream automatically creates closed captions for videos: https://support.microsoft.com/en-us/office/microsoft-stream-automatically-creates-closed-captions-for-videos-8d6ac353-9ff2-4e2b-bca1-329499455308
[5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15]
Resources
- Project ReadOn (allows you to request captions/sub-titles for specific videos, BY URL): http://www.projectreadon.com/
- YouTube Developers Guide - Data API Protocol – Captions: http://code.google.com/intl/en/apis/youtube/2.0/developers_guide_protocol_captions.html
- google-video-captions : http://code.google.com/p/google-video-captions/
- W3C Timed-Text (TT) DFXP Specification:: http://www.w3.org/TR/ttaf1-dfxp
- W3C Timed-Text (TT) Specification: http://www.w3.org/AudioVideo/timetext.html
Tutorials
- Delivering Meaning (and aiding Content Discovery) with Previews on Web: https://netflixtechblog.com/delivering-meaning-with-previews-on-web-3cedc0341b9e
- The HTML5 video specification's chosen Closed Captions & Subtitles format is SRT (initially labelled as "WebSRT" during the adoption phase, now in maturity it has been renamed as "WebVTT"). This format was chosen over other popular formats such as TimedText (DFXP).
- WebVTT versus TTML: XML considered harmful for web captions?: www.balisage.net/Proceedings/vol10/html/Tai01/BalisageVol10-Tai01.html#d177146e34
- Timed Text Markup Language (TTML) 1.0: https://www.w3.org/TR/ttaf1-dfxp/
External Links
- wikipedia: Closed captioning (CC)
- wikipedia: Timed Text
- History of Closed Captioning: https://www.ncicap.org/history-of-cc[16][17][18]
- The Ultimate Guide to Closed Captioning: https://www.3playmedia.com/learn/popular-topics/closed-captioning/#cost
- FCC advisory for Closed Captions: http://www.fcc.gov/cgb/consumerfacts/closedcaption.html
- Museum of Broadcast Communications (Closed Captions): http://www.museum.tv/archives/etv/C/htmlC/closedcaptio/closedcaptio.htm
- Captions.org (the online non-profit Captions resource): http://www.captions.org/
- Captionate (Commercial captioning for FLV and other rich media files): http://www.buraks.com/captionate/
- Subtitle Horse (caption converter): http://subtitle-horse.org
- Cisqo Demo using JW Player for Closed Captioning: http://www.cisco.com/en/US/products/ps8463/index.html
- SRT to SSA Converter: http://www.mydigitallife.info/2008/01/01/converters-to-convert-srt-subtitles-to-ssa/
- Transcribing Videos by Hand vs. Automated Transcription Tools: http://www.reelseo.com/transcribing-videos-automated-transcription/
- Google Rolls Out Automated Captioning For YouTube Videos : http://www.reelseo.com/google-rolls-automated-captioning/
- YouTube Enables Auto-Captioning For All Videos – As Expected: http://www.reelseo.com/youtube-enables-autocaptioning-videos/
- How to Add YouTube Closed Captions, Subtitles & Translations: http://www.reelseo.com/closed-captions-youtube/
- FCC Expands Closed Captioning Rules to Web Clips: http://blog.dotsub.com/2014/08/10/fcc-expands-closed-captioning-rules-to-web-clips/ (web clips of TV & Movies now also need Closed Captions)
- Speedy Speech: http://blog.dotsub.com/2014/08/10/speedy-speech/
- How Writing Closed Captions Turned Me off TV For Good: https://electricliterature.com/how-writing-closed-captions-turned-me-off-tv-for-good-dd38c39929df
- Publishers Sue Audible, Seek To Block Captioning Feature: https://www.mediapost.com/publications/article/339689/publishers-sue-audible-seek-to-block-captioning-f.html
- On-Device Captioning with Live Caption: https://ai.googleblog.com/2019/10/on-device-captioning-with-live-caption.html
- If it has audio, now it can have captions (with newest offerings in Google's Pixel line of Android devices): https://blog.google/products/android/live-caption/
- Live Video Captioning Will Change Google Search Optimization: https://www.mediapost.com/publications/article/351438/live-video-captioning-will-change-google-search-op.html
- Deaf YouTubers call out crappy captions with #NoMoreCraptions movement: https://mashable.com/2016/11/11/youtube-closed-captioning-nomorecraptions/
- Captions Habit Bleeds From Mobile Video Into TV, Laptops: https://www.mediapost.com/publications/article/364745/captions-habit-bleeds-from-mobile-video-into-tv-l.html
- Windows 11 Is Getting "Live Captions" for All Audio Content: https://www.howtogeek.com/786919/windows-11-is-getting-live-captions-for-all-audio-content/
References
- ↑ wikipedia:Closed_Captioning
- ↑ Media Accessibility User Requirements (MAUR) - specification: http://www.w3.org/TR/media-accessibility-reqs/
- ↑ Web Video Text Tracks (WebVTT) format -- <track> embedded ClosedCaption and/or Subtitle file: https://developer.mozilla.org/en-US/docs/Web/HTML/Element/track
- ↑ wikipedia: SubRip
- ↑ Edit the transcript for your video in Microsoft Stream: https://docs.microsoft.com/en-us/stream/portal-edit-transcripts
- ↑ Change closed caption settings: https://support.microsoft.com/en-us/windows/change-closed-caption-settings-135c465b-8cfd-3bac-9baf-4af74bc0069a
- ↑ Add subtitles or captions to your Microsoft Stream video: https://docs.microsoft.com/en-us/stream/portal-add-subtitles-captions
- ↑ Generate automatic captions and a transcript for your Microsoft Stream videos: https://docs.microsoft.com/en-us/stream/portal-autogenerate-captions
- ↑ Find a spoken word or phrase in Microsoft Stream videos: https://docs.microsoft.com/en-us/stream/portal-use-deep-search
- ↑ Adding Closed Captions to Microsoft Stream Videos (via CaptionSync tool): https://support.automaticsync.com/hc/en-us/articles/115005422806-Adding-Closed-Captions-to-Microsoft-Stream-Videos
- ↑ How to Add Closed Captions to MS Stream Videos (via "3-play media" tool): https://www.3playmedia.com/learn/how-to-guides/how-to-add-captions-subtitles-in-ms-stream/
- ↑ Microsoft Stream – An Easy Way to Make Accurate Video Captions: https://blogs.perficient.com/2017/07/03/microsoft-stream-easy-way-to-make-accurate-video-captions/
- ↑ Microsoft Community support -- Updated help article - Turning on Autogenerate a caption file and exporting from Microsoft Stream – HLS Show Me How: https://techcommunity.microsoft.com/t5/healthcare-and-life-sciences/updated-turning-on-autogenerate-a-caption-file-and-exporting/ba-p/1434202
- ↑ Problems with Autogenerating Captions: https://techcommunity.microsoft.com/t5/microsoft-stream-forum/problems-with-autogenerating-captions/m-p/328815
- ↑ Closed Caption is gone after i download the video: https://techcommunity.microsoft.com/t5/microsoft-stream-forum/closed-caption-is-gone-after-i-download-the-video/m-p/1400224
- ↑ The History of Closed Captioning: https://closedcapserv.com/blog/the-history-of-closed-captioning/
- ↑ Time Magazine - Closed Captioning history: https://time.com/5797491/closed-captioning-captions-history/
- ↑ How Deaf Advocates Won the Battle for Closed Captioning: https://time.com/5797491/closed-captioning-captions-history/