j^, the author of many cool open video related projects (including the Theora transcoder ffmpeg2theora) has written a jQuery based library to extract and show subtitles while a
<video> is being played.
The jquery.srt page has details and a demo. Embedding code looks like:
SRT is a common subtitle format and with this solution you can easily add subtitles to your HTML 5 videos.