technology

Subtitle adjustment results

Nick — Sun, 06 May 2007 18:28:15 -0400

Here, I will show a few example screenshots from the original subtitled MKV file of Toki wo Kakeru Shoujo from roxfan (Played and captured screenshots using Media Player Classic) and the output from our 46" Samsung DLP Widescreen TV using my repositioned version of the roxfan script (Using the highly technical process of playing the movie on the TV and capturing screenshots using a digital camera). The widescreen TV was using an older version of my original adjustments (The "TV" subtitles were actually placed too low; I had fixed that in the attached file, but didn't get pics of it).

Here's a good example of how much left and right screen space is lost from the overscan:

Original

Adjusted

As you can see, the subtitle was forced to two lines as a result of a lost of only 6.5% of screen space on each horizontal side (Though this gives 13% total lost area in the horizontal space). Truthfully, this one came extremely close on the original output to the screen (I think the "Y" was halfway cut off), but I found it much more comfortable to read when it was forced to two lines.

The following is an even better example:

Original

Adjusted

As you should be able to see, the left florescent light on the ceiling is completely off-screen, and so is the very right column of window panes and Kousuke's shoulder. Chiaki's chair also almost disappears. The original subtitle position would have almost worked except letters that extend below the basline ("p", "q", "j", or "g", for some examples) would have been cut off at the bottom of the screen. Though, comparing these two screens, it seems that there's not much cut off at the top of the screen (but still some).

Here's an example of a song being translated (with the original Japanese words being shown):

Original

Adjusted

In this case, the original subtitle positions would have had "wake" and "I was" nearly completely cut off, and the first line would have had the very tops of the letters on the edge of the screen. As it is, even the adjusted lyrics ran right on the left side of the screen. A bit more padding on the left and right sides might have been a good idea.

From what I understand, most professional broadcasters and video producers assume a certain amount of overscan (It seems the numbers used are available on this Wikipedia page.). It would be nice if more fansub groups would also follow the same numbers, but if they continue to release MKVs with soft-subs, it will always be possible to adjust the margins of the subtitles for ourselves.

Toki wo Kakeru Shoujo - Subtitle file adjusted for overscan on widescreen TV

Nick — Sun, 06 May 2007 16:18:48 -0400

Well, I had managed to show off Toki wo Kakeru Shoujo (using roxfan's subs) to a few people using my housemate's 46-inch Samsung DLP widescreen (I forget the exact model at the moment). Now, this wasn't as easily as simply following the directions on my MKV to AVI guide as the Samsung TV has between 5% to 10% overscan, and subtitles and the karaoke would lie halfway off of the screen, making it difficult to read the dialog. In the past, with hard-subs in AVI files and many fansub groups that do not position their subtitles to adjust for this (This is not meant to be a slight against any fansub group, as they doing the much harder job of translating and timing these subtitles in the first place at no cost to us), there would be nothing I could do other than slightly windowboxing the video as to make sure the subtitles appear properly on screen. Now, though, thanks to MKVs with their soft-subs, I can at least do something about it when converting it to an XviD AVI file to play on the big screen.

In the case of Toki wo Kakeru Shoujo, I am able to adjust the margins in the .ASS file to account for this overscan issue. It's not all that difficult, as I bascially made sure the minimum vertical margins are around 30 pixels from the bottom or 20 from the top, and the horizontal margins are at least 50 pixels on each site (This is according to the original 768x432 raw MKV dimensions, not the smaller video dimensions used by roxfan). These numbers were determined via a good amount trial and error (and about 4-5 DVDs wasted burning the resulting file and playing it on the TV). As I can determine, our TV has a 4.6% top overscan, 7% bottom overscan, and 6.5% left and right overscan. Truthfully, the bottom margin could actually be smaller (probably at the 4.6% mark), but I liked to have the dialog subtitles a small distance from the bottom edge of the screen, instead of being right on top of it.

The result, though, is nicely easy to read subtitles when watching the film on the Samsung DLP. I think some parts, like the credits at the start of the movie, the English translations are slightly adjusted to the left or right than when they were originally, but nothing too bad.

For those interested, I'm attaching the subtitle file to this post (right-click and choose "Save As" to download it). Hopefully, others will find it useful.

UPDATE: I have screenshots highlighting why it was necessary to reposition the subtitles.

UPDATE 2: I've attached the fonts used with this subtitle file. You may have to install them on your computer for the subtitles to display correctly.

Anime on Joost

Nick — Sat, 05 May 2007 00:41:04 -0400

I would normally put this kind of post in my other blog, but since it does relate to anime, I'd figure it would be of more interest here.

I was recently invited into the Joost beta and am pretty impressed with how it's setup. Created by the people that created Skype, Joost is a very ambitious project to provide paid-by-ads Internet TV. The setup is broken up into different "channels", which include several programs that can be played on demand. For example, there is a Ren and Stimpy channel, which I can pick an available Ren and Stimpy episode to watch (which I was doing yesterday). While the program is playing, at certain points (Usually at the appropriate spot in the program), the client will play a 30 second commercial, then continue on with the program. Some of the channels available are listed here. Click on the "More channels..." link at the bottom to get a larger list of what channels are available and in what region they are available.

Granted, there could be more content, but since it's still in a beta, it's probably best to wait till the system goes live before criticizing it on that respects.

What's interesting is that it includes the Gong channel, a European anime channel. Technically, I should not be able to get this channel as I'm in the U.S. so it will be unfortunate if it really becomes unavailable to me due to licensing restrictions (which are set by the content providers). In that case, it would be very good if The Anime Network partners with Joost to provide anime content for North America.

Joost - Watching Ikki Tousen

The quality isn't too bad. There's a fair amount of artifacting, but the bandwidth required isn't too much as it's using the h264 codec to stream with.

Here's what the interface looks like:

Fairly easy to understand.

This is what choosing a program from the Gong channel looks like:

Here is what is currently available on Gong:

Ikki Tousen
Gun Frontier
Saiyuki
Cosmo - Warrior Zero

Only the first eight episodes of each anime series is available. Sure, these aren't great series, and only the English dub is available, but I like the potential this will offer.

Now to continue with Ikki Tousen... (Don't worry, I already know what I'm getting into)

MKV (H.264 codec) to AVI (XviD codec) conversion

Nick — Sat, 03 Mar 2007 19:23:44 -0500

Note as of Jan 16, 2010: It's been several years since I've had to convert video using the methods in this article. A couple years ago, I had purchased a Popcorn Hour A-110 set top box which can play MKV files with H.264 video and any of a large number of audio codecs (and with 720p or 1080p resolution, too). Asking for help from me on any aspects of this guide will be pretty fruitless as I haven't had to deal with converting video files in such a long time.

Really, I won't be providing support for this guide, though I'll leave it up as it still seems useful to people. You'll be much better off going to an audio/video codec and conversion tools site.

As I promised earlier, I will post about how to convert an MKV container file with an H.264 encoded video and AC-3 encoded audio to an AVI container file with an XviD encoded video and, optionally, 2-channel MP3 encoded audio.

The MKV format makes a very good distibuting format, with the ability to have multiple audio streams and multiple subtitling streams, combined with the H.264 codec for high quality video. Unfortuntely, if you're like me, you have a DVD player that isn't able to play such files but can play XviD or DivX encoded video in AVI files (like my OPPO OPDV971H Player ) hooked up to a big-screen and an home theater audio system, but would wish to watch (or invite others to watch) that greatest and latest video that you've found on the internet, that's only available as an MKV file!

(I may have some errors in here. Feel free to comment to help with details or ask questions)

UPDATE: AllToAvi

I was recently made aware the AllToAvi project. I haven't checked it out yet, but if it works like I think it does, then much of the following steps aren't necessary... . Still, I'll keep all of it up until I am able to confirm this.

UPDATE (Oct 2, 2007): Here's an alternate tutorial to convert a H.264 encoded MKV file to and AVI file using AllToAvi.

Programs Needed

These were installed and run on a Windows XP Home system. Yes, I am a Linux freak, but I am too used to windows for this process. There's also several commercial programs that seem able to do this, like Stoik Video Converter or All to AVI, but I'm sticking with freeware or open source tools in this guide.

VirtualDubMod
VobSub
MKVtoolnix
MKVExtractGUI v. 1.6.4 (If that site is down doesn't work, try downloading it from here)
avc2avi 1. There's a version with a GUI available here (Link comes from here, so check there out if the direct link doesn't work).
H.264 and XviD VFW Codecs (These should both be usable through the Combined Community Codec Pack but, for some reason, I use the XviD Encoder from this installer instead for encoding XviD. You can also use any Codec Pack that includes the FFDShow VFW Codec)
AC3ACM (Optional, to decode AC3 in VirtualDubMod)
LameACM (Optional, to encode to MP3 in VirtualDubMod)

Install and Setup

Though a few of the tools and codecs that I've pointed to above have self-installers that will set everything up for you, the others require that you install them into your operating system.

The first example is VirtualDubMod. When I downloaded the file VirtualDubMod_1_5_10_2_All_inclusive.zip, all you get are the actual files instead of the normal install executable, so I extract all the files in it to "C:\Program Files\VirtualDubMod". When the VobSub_2.23 asks for the VirtualDub location, I give it the same path. I also create a shortcut to "C:\Program Files\VirtualDubMod\VirtualDubMod.exe" on my Desktop.

I also extract MKVExtractGUI and avc2avi into the same directory that the MKVtoolnix installer ("C:\Program Files\MKVtoolnix").

Many codecs either use an executable installer (especially if they are part of a codec pack) or can by installed by extracting the files into a temporary directory, right-clicking on the .inf file, and selecting Install.

FFDShow may need some configuring before it can decode H.264 streams for VirtualDubMod. Open up the FFDShow VFW Codec Configuration (On my system, Start -> All Programs -> Combined Community Codec Pack -> FFDShow VFW Codec Configuration), the click on the Decoder tab. Make sure that "Codecs" is selected in the left select box.

On the row with the H.264 format, change the Decoder to "libavcodec". If you wish to use FFDShow for your encoder, click on the Encoder tab and change the Encoder field to what ever format you wish (XviD is probably a good choice). When you get to the encoding step further down, choose the "ffdshow Video Codec" instead of the "XviD MPEG-4 Codec" that I use. Keep in mind that configuring it will look different.

Converting instructions

Demuxing

For my examples, I will be using a video at C:\temp\Global_Astroliner\Global_Astroliner.mkv, for simplicity's sake.

The first step is to run it through MKVextractGUI to separate the video, audio, and subtitle streams to manipulate in VirtualDubMod:

Once you have the Input file setup and all of the Tracks selected, press the Extract button.

When the process is finished, you should end up with at least three files with the following extensions: .h264 (video file), .ac3 (audio file), and .ass (subtitle track. Yes, I do think it's an amusing extension). Close MKVextractGUI

Video

Unfortunately, VirtualDubMod cannot read the .h264 file, so we will have to put it into an AVI container, which is where avc2avi comes in. It is a command-line program, so was have to open up a console window via Start->Run, type in "cmd" at the prompt and press the "OK" button. Navigate to the directory where the .h264 file is at, and run:

avc2avi -i <input file>.h264 -o <output file>.avi

For example:

This may take some time, but once it is finished you should have a .avi version of the video track that should be usable by Virtual Dub Mod! You may now close the command line window.

Now we get to the real work. Open up the above .avi file in VirtualDubMod.

Note: On my system, I couldn't move the position slider to the middle of the video and press play (I.E., to check for subtitle/audio syncronization with the video) without getting an error. I always had to start from the beginning of the video to do this. This seems to be an issue of the h.264 decoder I used. Fortunately, this does not affect the actual encoding of the AVI file.

Go into the Video menu and select Compression to choose the desired compression method. Select the codec, and press the Configure button to set it up.

As you may notice, I'm using a pretty high target bitrate for this run, as I wish to maintain as much of the original video quality as possible to be able to run on the big screen TV hooked into the player. I think most distributed video files go for around 800 kbps.

Audio

To add the audio stream, go to the Streams menu and select Stream List. When that window pops up, press the Add button and select the .ac3 file that was extracted by MKVextractGUI.

Optional: At this point, you may choose to process the audio into a 2-channel ADPCM or MP3 format. In my case, this was unnecessary as my player will pass through the AC-3 stream from the AVI file to my 6-channel sound system. If you decide to re-encode it, don't forget set the mode to Full Processing Mode and use the Conversion window to convert down to 2-channel Stereo before setting the desired Compression method. I'm not sure if all of the 6-channel AC-3 stream is down converted into 2-channel stereo this way, so you might have to use Filters (select Use advanced filtering to do this), but this is outside of my realm of knowledge.

After you get the the audio stream added and configured like you want, you will have to modify the framerate of the video stream, as that information is lost when you ran avc2avi earlier. Open up the menu option Video, and select Frame Rate....

Simply select Change so video and audio durations match and press the Ok button.

Subtitles

Now, we will add the subtitle track to the AVI file by adding it to the video stream. This step is actually optional, as my player will play the subtitle track if it's offered as a separate file on the disc, but the TextSub filter (which should be a part of the VobSub plugin) for VirtualDubMod does a much better job than my player does (I.E., text placement, colors, and proper line breaks. My DVD player will break to the next line in the middle of a word...).

Go into the Video menu, select Filters..., and press the Add... button. Select the TextSub filter and press the OK button.

Press the Open... button, choose the .ass file. I usually click on the Styles... button and setup the margins to account for overscan on my TV (You'll have to experiment for your own setup for the right values. For a 720x480 image, I'm trying out 30 for all the margins). Close the Subtitle Style Editer by pressing OK, close the TextSub settings by pressing OK, then OK again to close the Filter screen.

Other Options

At this point, I am ready to create the AVI file with the video at 720x480, as my player will simply stretch the image to full screen on the widescreen TV. For those who wish to set a proper aspect ratio in the video may do so using the resize filter (Video -> Filters... -> Add... -> resize). As a reference, many distributed videos files use a size of 704x396 for a widescreen video, and 640x480 is good for a full screen video. I believe it is okay to use Bilinear for the filter mode. Be aware that your encoding codec may not support any particular screensize (which would give you an error when you try to create the AVI file in the next section), so feel free to experiment.

Creating the AVI file

At this point, you can preview the video by clicking on the "Play" button with the "O" on it. If you get an error, rewind to the beginning of the video and try to play it again. Watch to make sure the video, audio, and subtitling sync up with each other.

This is the simplest step. Go into the File Menu, choose Save As..., Enter in the desired file name and press the Save button. Now you're in for a bit of a wait. Do something else, or simply sit back and watch the pretty graphs...

Please resist the urge to click around on things. On my system, clicking on the Log tab of the VirtualDubMod Status window caused it to crash, causing me to have to start over.

Once the video is finished, watch it. Skip forward in it and pay attention to the video/audio/subtitle synchronization. If something seems off, you may have skipped over a step.

Final Words

I hope this helps others, as I wasn't able to find any good instructions to convert these MKV files I had to play on my OPPO DVD player. This document is the result of a lot of Googling with quite a bit of time experimenting with programs.

1. avc2avi was at this location, but it is unavailable there now. Changed the link thanks to a tip in the comments. If you need, use 7-Zip to decompress the 7z file

Small discoveries

Nick — Thu, 01 Mar 2007 09:46:10 -0500

In the last few days, I had found that my favorite animation studio, Studio 4