How to extract Close Captions (EIA-608) from .ts ?

[Bondurant]

Hi guys, I've searched for a while and tried many softs but nothing has worked yet. To begin here's a part of the mediainfo:

Format : MPEG-TS
File size : 5.71 GiB
Duration : 56mn 16s
Overall bit rate mode : Variable
Overall bit rate : 14.5 Mbps

Video
ID : 33 (0x21)
Menu ID : 1 (0x1)
Format : MPEG Video
Format version : Version 2
Format profile : Main@High
Format settings, BVOP : Yes
Format settings, Matrix : Custom
Codec ID : 2
Duration : 56mn 15s
Bit rate mode : Variable
Bit rate : 13.4 Mbps
Maximum bit rate : 17.6 Mbps
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate : 29.970 fps
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Compression mode : Lossy
Bits/(Pixel*Frame) : 0.216
Stream size : 5.27 GiB (92%)


Text #1
ID : 33 (0x21)-608-1
Menu ID : 1 (0x1)
Format : EIA-608
Muxing mode : A/53 / DTVCC Transport
Muxing mode, more info : Muxed in Video #1
Duration : 56mn 15s
Bit rate mode : Constant
Stream size : 0.00 Byte (0%)

Text #2
ID : 33 (0x21)-1
Menu ID : 1 (0x1)
Format : EIA-708
Muxing mode : A/53 / DTVCC Transport
Muxing mode, more info : Muxed in Video #1
Duration : 56mn 15s
Bit rate mode : Constant
Stream size : 0.00 Byte (0%)

Tsmuxer doesn't indicate there are subtitles as there are muxed in the video track. CCextractor only gives me empty files. Would appreciate a little help.

[usually_quiet]

Does CCExtractorGUI produce any error messages? Has this file been edited?

[Bondurant]

It hasn't been edited and the CCexctractor activity gives me this:

CCExtractor 0.59, Carlos Fernandez Sanz, Volker Quetschke.
--------------------------------------------------------------------------
Input: C:\Documents and Settings\***************************.ts
[Raw Mode: Broadcast] [Extract: 1] [Stream mode: Transport]
[Program : Auto ] [Hauppage mode: No] [Use MythTV code: Auto]
[Timing mode: default] [Debug: No] [Buffer input: Yes]
[Use pic_order_cnt_lsb for H.264: No] [Print CC decoder traces: Yes]
[Target format: .srt] [Encoding: UTF-8] [Delay: 0] [Trim lines: No]
[Add font color data: No] [Add font typesetting: Yes]
[Convert case: No] [Video-edit join: No]
[Extraction start time: not set (from start)]
[Extraction end time: not set (to end)]
[Live stream: No] [Clock frequency: 90000]
Start credits text: [None]
Creating C:\Documents and Settings\*******************.srt


-----------------------------------------------------------------

Opening file: C:\Documents and Settings\********************************.ts

Analyzing data in general mode
Decode captions from MPEG-2 video stream [0x02]  -  PID: 33

New PID found: 33

New PID found: 36


New video information found
[1920 * 1080] [AR: 03 - 16:9] [FR: 04 - 29.97] [progressive: no]

Status: done code: 1073741819

[usually_quiet]

Is VLC able to display closed captioning?

[Bondurant]

Yep, I can see them using VLC.

[usually_quiet]

I think 0.59 is still beta software and may have some bugs. I would email the author and report the problem.The email address is on the GUI's "About & Save" tab.

[Bondurant]

I sent him an email and made a short sample using TSmuxer if someone wants to try it.

[pandy]

http://www.theneitherworld.com/mcpoodle/SCC_TOOLS/DOCS/SCC_TOOLS.HTML

[Bondurant]

I've seen this page but you have to admit it's quite hard to understand when you're not familiar with video editing. I don't know what to do.

[usually_quiet]

I think CCExtractorGUI is based on McPoodle's work, so it is doubtful McPoodle's tools will do better. I tried your sample with an CCExtractorGUI 0.59 and 0.56. Apparently neither can process the file, so this is a problem that has existed for some time.

If this .ts file is something you downloaded, it is quite possible somebody edited the file before making it available, and changed the headers or something else in a way that prevents CCExtractorGUI from processing the file. I found that some programs I tried for editing files recorded by my TV tuner cards made changes that prevented CCExtractorGUI from processing their output.

[Bondurant]

Thanks for you help usually_quiet, I appreciate it. As a complete noob on that matter, what I don't understand is: being able to show or hide these cc by using VLC but not having the possibilty to record them. If I can show or hide them, it means VLC is able to differentiate the video stream from the cc track. Why can't I separate them when I try to convert the file using VLC.

[usually_quiet]

Closed captions are encoded in the video's MPEG-2 user data, but video encoders are not designed to preserve existing MPEG-2 user data. ...so when a file containing closed captions is converted to a different codec, or re-encoded as MPEG-2, the closed captions are lost. While a few players can decode and display closed captions in an MPEG-2 file that includes them, they aren't designed to export them to a subtitle file.

[Edit]I took another look at the home page for McPoodle's tools, which says McPoodle can't process HDTV files and recommends CCExtractor for those, so it seems most unlikely that they will work for your problem file.

There is another method described on the home page for McPoodle's tools that uses Direct Show filters to extract closed captions in binary form, which can be converted to SCC form. I will give it a try

[Bondurant]

yeah, makes sense. Unfortunately.

[usually_quiet]

I found a CC extraction method for your sample, but it is not ideal. Because it requires drivers for specific ATI TV cards to be installed, it isn't good solution for most people. I have to hope I can find a MS or open source video decoder that works too, or it won't be of much use. Unfortunately, it may take a while for me to get back to this.

I built a filter graph using GraphStudio and used "ATI MPEG Video Decoder" to send the CCs to "Dump" filer (a specialized file writer) which produces a file in a format that CC extractor understands. It must be similar to McPoodle's .raw format, because that is what I used for "Input type" to produce the .srt text below.

00:02 00:05 LEWY BODY CAUSES
PROGRESSIVE DECLINE.
00:05 00:07 I HAVE IT.
THERE'S NO CURE.
00:07 00:08 I'M SORRY.
00:08 00:11 - IS THERE SOMETHING ELSE
I SHOULD KNOW?
- NO.
00:11 00:14 MY GUY SAID IT'S SOME
PRETTY POWERFUL SHIT.
00:14 00:16 - Darius: WHO'S IT FOR?
- Emma: A FRIEND.
00:16 00:18 Darius:
A FRIEND I NEED
TO KNOW ABOUT?
00:18 00:19 NO, RELAX.
THERE'S NOTHING
TO WORRY ABOUT.

[cfsmp3]

I think CCExtractorGUI is based on McPoodle's work, so it is doubtful McPoodle's tools will do better. I tried your sample with an CCExtractorGUI 0.59 and 0.56. Apparently neither can process the file, so this is a problem that has existed for some time.

0.58 should parse it OK. 0.59 a bit broken due to work in the XDS decoder. 0.60 (not yet official) also parses it fine.

[pandy]

I've seen this page but you have to admit it's quite hard to understand when you're not familiar with video editing. I don't know what to do.

http://www.theneitherworld.com/mcpoodle/SCC_TOOLS/DOCS/SCC_TOOLS.HTML#CCExtract or at least try SCC_RIP.EXE

[usually_quiet]

I think CCExtractorGUI is based on McPoodle's work, so it is doubtful McPoodle's tools will do better. I tried your sample with an CCExtractorGUI 0.59 and 0.56. Apparently neither can process the file, so this is a problem that has existed for some time.

0.58 should parse it OK. 0.59 a bit broken due to work in the XDS decoder. 0.60 (not yet official) also parses it fine.

I tried CCExtractorGUI 0.58 on the sample. It did not work. It produced an empty .srt file just like versions 0.56 and 0.59.

[usually_quiet]

I've seen this page but you have to admit it's quite hard to understand when you're not familiar with video editing. I don't know what to do.

http://www.theneitherworld.com/mcpoodle/SCC_TOOLS/DOCS/SCC_TOOLS.HTML#CCExtract or at least try SCC_RIP.EXE

Most people are not comfortable using command line tools, and don't know how to use them. That is why we have GUIs.

If you are sure they will work and know how to use them, then try the tools you think the OP should use on the test sample and post the command line when you get a working script.

[pandy]

[Edit]I took another look at the home page for McPoodle's tools, which says McPoodle can't process HDTV files and recommends CCExtractor for those, so it seems most unlikely that they will work for your problem file.

issue with CCExtractor can be related to conversion from one format to another, extract raw CC then convert - this can solve issue (or not).

Most people are not comfortable using command line tools, and don't know how to use them. That is why we have GUIs.

If you are sure they will work and know how to use them, then try the tools you think the OP should use on the test sample and post the command line when you get a working script.

then i think there is plenty of payware software with nice GUI - luckily CC structure is nicely defined by EIA/CEA/ATSC then CC can be extracted with help of some scripting tools.

[usually_quiet]

[Edit]I took another look at the home page for McPoodle's tools, which says McPoodle can't process HDTV files and recommends CCExtractor for those, so it seems most unlikely that they will work for your problem file.

issue with CCExtractor can be related to conversion from one format to another, extract raw CC then convert - this can solve issue (or not).

Already tried. That file is empty too. It looks like CCExtractor cannot parse the file at all.

Most people are not comfortable using command line tools, and don't know how to use them. That is why we have GUIs.

If you are sure they will work and know how to use them, then try the tools you think the OP should use on the test sample and post the command line when you get a working script.

then i think there is plenty of payware software with nice GUI - luckily CC structure is nicely defined by EIA/CEA/ATSC then CC can be extracted with help of some scripting tools.

Put your money where your mouth is. If you think one of McPoodle's tools will work better then prove it.

Paid software for working with CC's is extremely expensive.

[pandy]

Already tried. That file is empty too. It looks like CCExtractor cannot parse the file at all.

with this? SCC_RIP.EXE

Most people are not comfortable using command line tools, and don't know how to use them. That is why we have GUIs.

If you are sure they will work and know how to use them, then try the tools you think the OP should use on the test sample and post the command line when you get a working script.

then i think there is plenty of payware software with nice GUI - luckily CC structure is nicely defined by EIA/CEA/ATSC then CC can be extracted with help of some scripting tools.

Put your money where your mouth is. If you think one of McPoodle's tools will work better then prove it.

If You complain about free tools quality then pay for commercial one and use technical support because You pay for it or write own tool better one - that's all.

[usually_quiet]

Already tried. That file is empty too. It looks like CCExtractor cannot parse the file at all.

with this? SCC_RIP.EXE

Most people are not comfortable using command line tools, and don't know how to use them. That is why we have GUIs.

If you are sure they will work and know how to use them, then try the tools you think the OP should use on the test sample and post the command line when you get a working script.

then i think there is plenty of payware software with nice GUI - luckily CC structure is nicely defined by EIA/CEA/ATSC then CC can be extracted with help of some scripting tools yourself.

Put your money where your mouth is. If you think one of McPoodle's tools will work better then prove it.

If You complain about free tools quality then pay for commercial one and use technical support because You pay for it or write own tool better one - that's all.

Of course CCExtractorGUI will parse a .raw file, if one can be made. I already did that with the .raw file I created using another method.

My problem is not with free tools. It is with you. You recommended one that is difficult for most people to use. The OP needs your help and you refuse to provide any instructions. I can only assume it is because you don't actually know how to use these tools yourself.

[Edit]Furthermore, according to its author, SCC_RIP.EXE does not work for HDTV files, and the OP has an HDTV file. A quote from http://www.theneitherworld.com/mcpoodle/SCC_TOOLS/DOCS/SCC_TOOLS.HTML

NOTE: Carlos Fernandez has written a tool to extract raw captions from an MPEG file faster than SCC_RIP. In addition, it can also handle HDTV files, which my tool cannot. You can download this CCExtractor tool (with source code) here.

[poisondeathray]

you can extract them as srt subs with eac3to

yes it's a command line tool, but I can provide easier instructions or a batch file that you can double click if it's not clear. The GUI's are actually harder to use IMO and require setting up paths and .exes

the basic command line to demux all streams is

eac3to input.ts -demux

[pandy]

Of course CCExtractorGUI will parse a .raw file, if one can be made. I already did that with the .raw file I created using another method.

did You try SCC_RIP.EXE or not - im not asking about CCExtractor.

My problem is not with free tools. It is with you.

So You will not solve this problem - focus on something different - more productive.

You recommended one that is difficult for most people to use. The OP needs your help and you refuse to provide any instructions. I can only assume it is because you don't actually know how to use these tools yourself.

I can't provide better instruction how to use particular tool than instruction provided by author of this tool - and yes You can only assume what i know or not.

[usually_quiet]

you can extract them as srt subs with eac3to

yes it's a command line tool, but I can provide easier instructions or a batch file that you can double click if it's not clear. The GUI's are actually harder to use IMO and require setting up paths and .exes

the basic command line to demux all streams is

eac3to input.ts -demux

Thanks poisondeathray. As always, you know what you are doing well enough to provide real help. I will try eac3to in a few days when I have more time.

[usually_quiet]

Of course CCExtractorGUI will parse a .raw file, if one can be made. I already did that with the .raw file I created using another method.

did You try SCC_RIP.EXE or not - im not asking about CCExtractor.

No I did not. Since the author of SCC_RIP.EXE says it does not work on HDTV files which this is, doing so would be a waste of time. If you know how to make it work, post the command line, and prove it.

[poisondeathray]

Well I come from non programming background , so I know how difficult CLI programs can be for non computer guys like myself...

But many of the best tools and options can ONLY be accessed by CLI. A well designed GUI can only contain a few options and buttons before it gets too cluttered and unusable. CLI also enables easy automated batch processing.



It's easier to put all the files to be processed in the same directory as eac3to

If all the videos are organized the same way with track 3 as the subtitle then you can demux that specifically. If you don't know the track, safer option is to demux all

Open notepad txt file in same directory, copy & paste ONE of the following (either the demux all, or demux track 3 only) , save it, rename extension from .txt to .bat and double click. That's it.

### This is the code for demux all

for %%a in ("*.ts") do eac3to %%a -demux
pause

### This is the code for track 3 only

for %%a in ("*.ts") do eac3to %%a 3: %%~na.srt
pause

I've also attached the .bat files in a zip. So you would place the videos in the same directory as eac3to, place 1 of the versions the bat files in the same directory and double click

batchall.bat is for demux all tracks
batchtrack3.bat is for demux track 3 only as .srt . But if the video files have different track order or structure, this one won't work

But some people don't like running scripts or weird commands so I would just follow the instructions above (safer practices, internet can be dangerous )

[usually_quiet]

Well I come from non programming background , so I know how difficult CLI programs can be for non computer guys like myself...

But many of the best tools and options can ONLY be accessed by CLI. A well designed GUI can only contain a few options and buttons before it gets too cluttered and unusable. CLI also enables easy automated batch processing.



It's easier to put all the files to be processed in the same directory as eac3to

If all the videos are organized the same way with track 3 as the subtitle then you can demux that specifically. If you don't know the track, safer option is to demux all

Open notepad txt file in same directory, copy & paste ONE of the following (either the demux all, or demux track 3 only) , save it, rename extension from .txt to .bat and double click. That's it.

### This is the code for demux all

for %%a in ("*.ts") do eac3to %%a -demux
pause

### This is the code for track 3 only

for %%a in ("*.ts") do eac3to %%a 3: %%~na.srt
pause

I've also attached the .bat files in a zip. So you would place the videos in the same directory as eac3to, place 1 of the versions the bat files in the same directory and double click

batchall.bat is for demux all tracks
batchtrack3.bat is for demux track 3 only as .srt . But if the video files have different track order or structure, this one won't work

But some people don't like running scripts or weird commands so I would just follow the instructions above (safer practices, internet can be dangerous )

I had an unexpected delay in my interior painting project, so I copied the sample .ts file and the unzipped batch files into the folder containing eac3to and its dll files, and ran "batchall". It worked perfectly for the EIA-608 CCs in the sample .ts file. Thanks.

I would not have predicted that eac3to could work at all for this if I had just read the description in VideoHelp's tools section. It seems like a tool for demultiplexing and converting audio tracks. Since CCs are stored in the MPEG-2 user data, not a subtitle stream in the usual sense, I would not have expected any subtitle output from demultiplexing a file that only had CCs. Strange.