VideoHelp Forum




+ Reply to Thread
Results 1 to 7 of 7
  1. I have a video that has speech in a foreign language. I would like to ultimately convert the speech to English subtitle/caption for this video.

    Looking for local computer, offline software that does speech to text conversion, preferably, directly to English. That is, automatic language translation from foreign language to English text caption/subtitle, all done in one step.

    Least desirable option is for the software to convert the video foreign speech to foreign text first. This means that translating the foreign text would have to be done manually later as another step to translate to English text captions/subtitles.

    I don't want to use any online service as I don't know what else, if anything, these online services will do with the uploaded videos?

    Preferably the conversion/translating software should be free.

    And post translation, it should be possible to directly edit the converted/translated English text as translations are often not accurate.

    Thank you.
    Quote Quote  
  2. Member
    Join Date
    Mar 2021
    Location
    Israel
    Search Comp PM
    Subtitle Edit has several options for speech to Text. Look for Whisper AI (Open AI)
    What is the foreign language that the audio has? The success of the conversion might depend on the spoken language
    https://github.com/openai/whisper
    See "Whisper's performance varies widely depending on the language" graph
    Quote Quote  
  3. Thanks for all of the suggestions.

    Faster Whisper XXL appears to be CLI only which makes it a bit difficult to use. And at this time, I haven't tried it out. Unless I'm missing details about the capability of this software, it seems this software only converts foreign speech to foreign text/captions. Apparently there is no option to translate from foreign speech to English caption, and no option to edit the translated text either. Other software is required for translation and editing captions.

    So at this time it appears that Faster Whisper XXL is not really ideal.

    WizWhisp has been tried. But it seems to be limited to converting foreign speech to foreign text/captions only. There doesn't seem to be an option for translating to English text/captions. Although this software appears to allow editing of the generated foreign captions. So other software would have to be used to translate the foreign captions to English captions. Not really the ideal situation, but a bit better overall than Faster Whisper XXL.

    There is a Pro version of WizWhisp, apparently. I don't know if this Pro version allows translation of foreign captions to English captions and allows editing of the English captions? Anyone know?

    I've also tried Subtitle Edit. This software appears to be the best overall as it also translates foreign captions to English captions and allows editing of the captions. Still experimenting with this software, but it produces fairly good speech to caption results.

    Further comments?
    Quote Quote  
  4. Member
    Join Date
    Mar 2021
    Location
    Israel
    Search Comp PM
    I think it would be better to transcribe the foreign speech to the foreign language first, otherwise how else would you know the transcription was 100% successful?
    Then use Subtitle Edit to translate to English.
    Quote Quote  
  5. Video Damager VoodooFX's Avatar
    Join Date
    Oct 2021
    Location
    At Doom9
    Search PM
    Originally Posted by brispuss View Post
    Faster Whisper XXL appears to be CLI only which makes it a bit difficult to use.
    Actually, CLI makes it easier to use.

    Originally Posted by brispuss View Post
    Apparently there is no option to translate from foreign speech to English caption, and no option to edit the translated text either. Other software is required for translation and editing captions.
    There is translate option to English.
    Editing subtitles is different scope, for that use software like Subtitle Edit.
    Quote Quote  



Similar Threads

Visit our sponsor! Try DVDFab and backup Blu-rays!